Tracxn - Senior Engineer - Web Crawling (1-7 yrs)

Total Experience : 1+ years

Mode of Hire : Permanent

Required Skills Set (Mandatory) : JavaScript/Node.js/Python, Web Crawling (Puppeteer/Playwright), Strong knowledge of web technologies

Desired Skills (Good if you have) : HTML, Distributed Systems, Data pipelines, Proxy Management, Anti-bot Techniques

Job Responsibilities :

- Design scalable web crawling solutions using modern technologies like Puppeteer and Playwright.

- Develop optimal and cost-effective methods for efficiently crawling diverse websites at scale.

- Implement robust proxy management and sophisticated anti-bot techniques.

- Create comprehensive debugging and monitoring systems for crawler performance.

- Actively contribute to technical discussions and architectural decision-making processes.

Job Requirements :

- Experience in end-to-end management of large-scale distributed web crawling.

- Deep understanding of website internal mechanics, enabling innovative data extraction strategies.

- Expert-level proficiency in JavaScript/Node.js, web technologies, and anti-bot measures.

- Demonstrated ability to understand, adapt, and extend current system architectures.

- Strong collaborative skills with the ability to work effectively within existing technical frameworks.

Preferred Qualifications :

- Advanced system optimization skills.

- Proven experience with cloud platforms, databases, and distributed systems.

- Comprehensive knowledge of data pipelines and data warehousing concepts.

Culture :

- Work with performance-oriented teams driven by ownership and passion.

- Learn to design systems for high accuracy, efficiency, and scalability.

- No strict deadlines, focus on delivering quality work.

- Meritocracy-driven, candid culture. No politics.

- Very high visibility regarding which startups and markets are exciting globally.

About Tracxn :

Tracxn (Tracxn.com) is a Bangalore-based product company providing a research and deal sourcing platform for Venture Capital, Private Equity, Corp Dev, and professionals working around the startup ecosystem.

We are a team of 800+ working professionals serving customers across the globe. Our clients include Funds like Andreessen Horowitz, Matrix Partners, GGV Capital, and Large Corporations such as Citi, Embraer & Ferrero.

Founders :

Neha Singh (ex-Sequoia, BCG | MBA - Stanford GSB)

Abhishek Goyal (ex-Accel Partners, Amazon | BTech - IIT Kanpur)

News about Tracxn :

Tracxn Technologies' Singh On Expansion Strategy (Neha's interview with Bloomberg)

The goal is to build an iconic data-providing company from India, like how Infosys is an iconic software company from India: Founders Abhishek Goyal and Neha Singh (Interview with Moneycontrol)

All You Need To Know About Tracxn Technologies: IPO Adda (Interview with BQPrime)