20 Scrapy Jobs

Hello,

Urgent job openings for Python Manager(Web Scraping & Data Quality).

Job Description given below please go through to understand requirement.

if requirement is matching to your profile share your updated resume @ mail id (m.salim@globaldata.com).

Mention Subject Line :-

Applying for Python Manager @ GlobalData(Hyd)

Share your details in the mail :-

Full Name :

Mobile # :

Qualification :

Company Name :

Designation :

Total Work Experience Years :

Current CTC :

Expected CTC :

Notice Period :

Current Location/willing to relocate to Hyd? :

Office Address : 3rd Floor, Jyoti Pinnacle Building, Opp to Prestige IVY League Appt, Kondapur Road, Hyderabad, Telangana-500081.

Python Manager (Web Scraping & Data Quality)

Location: Hyderabad

Experience: 10+ years

Job Description:

We are looking for a hands-on Python Engineering Manager to lead and mentor a team of developers and data quality engineers working on large-scale web scraping, data extraction, and validation for a job postings platform. The ideal candidate will have a strong technical background in Python, web scraping, and database technologies, along with proven leadership experience in managing high-performing teams.

Key Responsibilities:-

• Lead a cross-functional team comprising Python developers, data scraping leads, and data quality engineers.
• Architect and oversee the development of scalable web scraping pipelines and data validation frameworks.
• Ensure data accuracy, consistency, and quality across the jobs database.
• Drive the adoption of best practices in Python development, version control, code reviews, and testing.
• Work closely with product and business teams to align technical execution with business goals.
• Plan, prioritize, and manage sprint deliverables, ensuring timely and quality outcomes.
• Guide the team in solving complex scraping challenges like dynamic sites, anti-bot measures, and large-scale data processing.
• Monitor system performance, identify bottlenecks, and drive optimization initiatives.
• Foster a culture of innovation, continuous learning, and collaboration within the team.

Requirements:-

• 10+ years of total experience, with strong hands-on Python expertise.
• Proven track record in leading teams (3-10 members) focused on data scraping, data engineering, or backend development.
• Deep understanding of web scraping frameworks like Scrapy, Selenium, Playwright, or similar.
• Solid experience working with SQL and NoSQL databases (e.g., PostgreSQL, MySQL, MongoDB).
• Strong grasp of data validation techniques, data quality metrics, and automated checks.
• Experience in managing distributed scraping systems, handling CAPTCHAs, rotating proxies, and scaling crawlers.
• Excellent leadership, communication, and stakeholder management skills.
• Ability to make architectural decisions and mentor the team on design and implementation.

Preferred Qualifications:

• Prior experience in job aggregation, jobs data platforms, or related domains is a strong plus.
• Exposure to data governance, ETL pipelines, or large-scale batch processing.
• Experience with agile methodologies and sprint planning tools (e.g., Jira, Asana).

Thanks & Regards,

Salim

(Human Resources)