Python Developer

Overview

Job Description:

We are seeking an experienced Python Developer with expertise in Big Data, Web Scraping, and Anti-Scraping Solutions. The ideal candidate will excel in large-scale data extraction, bypassing bot protections, and processing massive datasets using advanced scraping technologies and big data frameworks.

Key Responsibilities:

• Develop and optimize large-scale web scraping solutions using Python (Scrapy, Selenium, Puppeteer, Playwright).
• Bypass anti-scraping mechanisms (CAPTCHA, Cloudflare, IP rotation).
• Process data using Big Data tools (Apache Spark, Hadoop, Kafka).
• Build and maintain scalable data pipelines for SQL/NoSQL databases and cloud storage.
• Implement AI-driven data mining for efficient extraction and analysis.
• Work with RESTful APIs, WebSockets, and reverse engineering for large-scale data extraction.
• Ensure legal compliance with GDPR and ethical scraping practices.

Required Skills & Experience:

• 3+ years of experience in web scraping, big data, and data mining.
• Proficiency in Python and web scraping libraries (Scrapy, Selenium, Puppeteer).
• Expertise in bypassing bot protection systems.
• Experience with Big Data frameworks (Spark, Hadoop, Kafka).
• Knowledge of SQL/NoSQL databases (PostgreSQL, MongoDB, Elasticsearch).
• Familiarity with cloud platforms (AWS, GCP) and data pipeline tools.

Preferred Qualifications:

• Bachelor's/Master’s in Computer Science, Data Science, or related field.
• Experience with real-time data streaming (Kafka, Spark Streaming).
• Knowledge of machine learning for data extraction and classification

Job Types: Full-time, Permanent

Pay: ₹41,000.00 - ₹70,000.00 per month

Schedule:

• Day shift
• Monday to Friday
• Morning shift

Work Location: In person

Application Deadline: 21/03/2025