Tech Lead - Web Scraping Engineer
Gmware
posted 13d ago
Fixed timing
Key skills for the job
We are seeking an experienced Tech Lead - Web Scraping Engineer to lead data extraction efforts for our enterprise clients. In this role, you will be tasked with creating and maintaining robust, large-scale scraping systems for gathering structured data.
Responsibilities:
Develop and optimize custom web scraping tools and workflows.
Lead a team of junior developers to improve data extraction systems.
Integrate scraping systems with data storage solutions like SQL and NoSQL databases.
Troubleshoot and resolve scraping challenges, including CAPTCHAs, rate limiting, and IP blocking.
Provide technical guidance on scraping best practices and standards.
Skills Required:
Expert in Python and scraping libraries such as Scrapy and BeautifulSoup.
Deep understanding of web scraping techniques and challenges (CAPTCHAs, anti-bot measures).
Experience with cloud platforms (AWS, Google Cloud).
Strong background in databases and data storage systems (SQL, MongoDB).
Contact: 80555-03000
Job Type: Full-time Work from home available
Employment Type: Full Time, Permanent
Read full job description5-10 Yrs
10-15 Yrs
Bangalore / Bengaluru, Crescent 4, Karnataka 560048 +5 more