Job Summary: We are seekinga skilled Web Scraper and Data Miner to join our team and contribute to theextraction, parsing, storage, and analysis of data from various web sources.This role is critical in providing actionable insights for business operations,particularly in sales, marketing, and strategy.
Key Roles and Responsibilities:
Data Extraction:
Identify relevant data from websites and automate its extraction using web scraping libraries (e.g., BeautifulSoup, Scrappy).
Become familiar with HTML and CSS to locate desired data elements.
Data Parsing and Transformation:
Clean, transform, and structure the extracted data for usability.
Apply data mining techniques to identify patterns and trends.
Data Storage and Management:
Organize and store data in databases or spreadsheets for easy access and analysis.
Utilize data visualization tools to present meaningful insights.
Web Scraping Tools Technologies:
Employ tools like Selenium, Puppeteer, Octoparse, and frameworks like Scrappy to automate tasks efficiently.
Leverage APIs, JSON, and AJAX for advanced data handling.
Data Analysis and Visualization:
Analyze data using Pandas, NumPy, and Matplotlib to identify actionable insights.
Present findings through clear and effective visualizations.
Problem Solving and Adaptation:
Troubleshoot scraping issues and adapt to changes in website structure or limitations.
Develop automated solutions to streamline data extraction processes.
Requirements
Key Skills Required:
Proficiency in programming languages: Python, JavaScript, HTML, and CSS.
Hands-on experience with web scraping libraries: Beautiful Soup, Selenium, Scrapy, Puppeteer, Octoparse.
Strong understanding of data pipelines, data cleaning, data transformation, and SQL.
Familiarity with cloud computing platforms (e.g., AWS, GCP) is a plus.
Excellent analytical skills to interpret data, identify trends, and present insights.
Robust problem-solving skills to manage complex data extraction challenges.
Preferred Qualifications:
Bachelors / Master degree in Computer Science, Data Science, or a related field.
Previous experience in web scraping, data mining, or related fields.
Familiarity with automation and scripting tools for efficient data extraction.
Benefits
Competitive market standard salaries.
Comprehensive Medical Insurance Benefits up to 4L for family
Commute Assistance / Company travel to factory
TA / DA Allowance
Paperless digital reimbursement of expenses
Variable Pay - Eligible for incentives/commissions