Use HTML, CSS, Python, and Beautiful Soup to develop and manage complex online scraping scripts and tools that harvest, organize, and interpret data from a variety of websites and the SECs EDGAR platform
Make optimal use of REST APIs for data access and manipulation to guarantee smooth data
integration
and retrieval procedures
Work together with stakeholders to understand the particular requirements for data extraction, ensuring that the data is captured accurately and pertinent to the projects goals
Oversee the handling and archiving of data that has been scraped, utilizing tools like
Django
and
PostgreSQL
to arrange and safeguard information while maximizing system efficiency
Examine and settle complicated data extraction problems, anticipating obstacles and putting forward solutions that improve data efficiency and accuracy
Directly scrape content from websites and from API responses
Assist stakeholders in obtaining accurate data by working together with the team
Job Requirements:
Bachelor s/Master s degree in Engineering, Computer Science (or equivalent experience)
At least 5+ years of relevant experience as a full-stack engineer
Prolific experience working with HTML, CSS, Beautiful Soup, and
Python
Extensive experience with React, WebScrape, and Selenium
Proven expertise using REST APIs in a production setting for data extraction and manipulation activities
Proficient in data parsing and possessing a strong grasp of web technologies, allowing for the effective extraction of information from large and intricate datasets
Expertise in
Django
and
PostgreSQL
is extremely advantageous as it offers extra tools for organizing and storing extracted data
Outstanding teamwork abilities are necessary to closely collaborate with stakeholders to determine data requirements and guarantee accurate data capture
Prior practical knowledge of the SECs EDGAR system is very beneficial as it allows for an instantaneous contribution to the teams goals
Dedication to upholding strict data security guidelines, confidentiality, and ethical scraping techniques
Excellent English communication skills, both spoken and written