Gmware - Python Developer - Web Scraping/Crawling (0-2 yrs)

Web Scraping engineer will be responsible for efficient web scraping/web crawling and parsing. The candidate should have demonstrated experience in web scraping and data extraction along with the ability to communicate effectively and adhere to set deadlines.

Responsibilities :

- Seeking a Python developer to develop and maintain web scraping solutions using BeautifulSoup, Scrapy, and Selenium.

- Responsibilities include handling dynamic content, proxies, CAPTCHAs, data extraction, optimization, and ensuring data accuracy.

- Develop, maintain, and optimize web scraping solutions to extract data from various websites.

- Implement and maintain robust, full-stack applications for web crawlers.

- Troubleshoot, debug, and improve existing web crawlers and data extraction systems.

- Utilize tools such as Scrapy and the Spider tool to enhance data crawling capabilities.

Requirements :

- Must have good working experience with WebScrape, Crawlers, and Data Extraction

- Sound understanding and knowledge of Python and good experience in any of the web

crawling tools like requests, scrapy, BeautifulSoup, Selenium etc.

- Strong knowledge of web scraping, having worked on scrapers and parsers

- Strong written and verbal English communication skills

- Knowledge of Libraries like Selenium, Requests, Scrappy, BeautifulSoup

- Familiar with vertical search crawlers and distributed web crawlers