Skills required : Past experience in building large-scale and complex web scrapers. Good understanding of web crawling strategies & experience with reverse engineering web applications will be advantageous Expertise in Rest API design and development. Strong understanding of web technologies and protocols such as HTML, CSS, and HTTP. Strong proficiency with JavaScript. Strong Knowledge of Node.js and frameworks available for it (like Express) Experience working with databases and data management tools such as MySQL, MongoDB, and Redis. Excellent problem-solving and analytical skills. Familiarity with cloud-based services such as AWS or Azure. Strong communication and leadership skills.
Nice to have Experience with Puppeteer/Playwright or any other headless-browser library Experience/Knowledge of Node.js child processes & multi-threading
Experience with Kafka or similar Message Queue system