Gmware - Web Scraping Engineer - Python/Scrapy Framework (0-2 yrs)

Job Responsibilities :

- Develop and maintain web scraping scripts using Python and Selenium to extract data from websites and APIs

- Understanding the requirements of customer needs, identify source and scrape/collect data and integrating the data crawled and scraped into our databases.

- Writing efficient, reusable, testable, and testing scalable code.

- Build code that is easily readable, properly documented, and follows key coding standards.

- Use Beautiful Soup and other scraping tools to clean and process data for analysis

Key Requirements :

- Experienced in Python, with knowledge of Scrapy framework.

- Experience running large scale web scrapes.

- Design and build web crawlers to scrape data and URLs.

- Ability to clean the scraped data to make it ingestible in the database.

- Knowledge of Libraries like Selenium, Requests, Scrappy, BeautifulSoup etc.

- Good Understanding and Implementation of Scrapy, Selenium based crawlers which are highly scalable and reusable