Python Developer

Overview

Job Title: Web Scraping Engineer (Python Developer

Experience Required - 1.5- 2 years.

Job Description:

We are looking for a skilled Web Scraping Engineer with expertise in Python to develop, maintain, and optimize web scraping solutions. The ideal candidate should have experience extracting, cleaning, and processing data from various websites while handling dynamic content, CAPTCHAs, and anti-scraping mechanisms.

Key Responsibilities:

• Develop and maintain web scraping scripts using Python (BeautifulSoup, Scrapy, Selenium, Playwright, etc.).
• Extract and process structured and unstructured data from websites.
• Handle dynamic content, AJAX calls, and JavaScript-rendered pages using headless browsers or APIs.
• Implement proxy rotation, CAPTCHA-solving, and anti-bot bypassing techniques.
• Store and manage scraped data in databases (SQL, MongoDB, Elasticsearch, etc.).
• Optimize scraping performance, ensuring scalability and efficiency.
• Work with data processing, cleaning, and transformation techniques.
• Collaborate with data engineers, analysts, and other stakeholders to define data requirements.
• Monitor and maintain scraping pipelines to ensure data accuracy and reliability.
• Stay updated on web scraping best practices and legal considerations (robots.txt, GDPR, etc.).

Required Skills & Qualifications:

• Proficiency in Python and experience with web scraping libraries like BeautifulSoup, Scrapy, Selenium, Playwright, or Puppeteer.
• Strong understanding of HTML, CSS, XPath, and Regular Expressions for data extraction.
• Experience working with APIs, including REST and GraphQL.
• Knowledge of headless browsers (Chrome, Puppeteer, Playwright) for JavaScript-heavy websites.
• Familiarity with proxy management and CAPTCHA-solving techniques.
• Hands-on experience with databases like MySQL, PostgreSQL, MongoDB, or Elasticsearch.
• Experience with cloud services (AWS, GCP, Azure) for deploying scraping solutions is a plus.
• Strong problem-solving skills and attention to detail.
• Ability to work independently and collaborate in a team environment.

Preferred Qualifications:

• Experience with automation frameworks for large-scale data collection.
• Knowledge of machine learning and NLP for data extraction and classification.
• Prior experience in data pipelines and ETL processing.
• Understanding of ethical and legal implications of web scraping.

Job Types: Full-time, Permanent, Fresher

Pay: From ₹15,000.00 per month

Benefits:

• Paid sick time

Schedule:

• Day shift
• Monday to Friday
• Morning shift

Ability to commute/relocate:

• Noida Sector 62, Noida, Uttar Pradesh: Reliably commute or planning to relocate before starting work (Required)

Experience:

• Python: 2 years (Required)

Location:

• Noida Sector 62, Noida, Uttar Pradesh (Required)

Work Location: In person