Senior Software Engineer

• We re looking for a Senior Software Engineer to join our team and help build the next generation of big data solutions at Index Exchange with real-time streaming and batch analytical capabilities
• Data is a big deal at Index Exchange (Index)
• Index s advertising exchange handles billions of auctions and generates terabytes of auction-related information every day
• Our team builds tools and infrastructure to manage this vast amount of data and make it available to both internal and external customers and partners for their reporting and analytics as well as machine model training needs
• Working with exciting technologies, your team will experiment with new tools and engineer innovative approaches to solve interesting challenges
• Things shift very quickly in our industry, and we rely on our Engineering teams to keep Index and our clients ahead of the curve and moving in the right direction
• We re looking for Engineers who have experience in an Agile environment, who can drive innovation, and be a technical leader on our team

What We re Looking For:

• Experience and Leadership: A senior engineer with exposure leading projects and mentoring junior developers. A leader who continuously challenges the status quo and brings forth innovative ideas and improvements for the team.
• Problem Solvers: You don t stop until the problem gets solved and you find more than one way to solve it. You love working with other people, presenting your viewpoint but ultimately working towards the best solution, regardless of where it comes from
• Knowledge Hungry: Learning new frameworks and languages is exciting to you - you re not satisfied with the status quo. We use a variety of languages and tools to solve problems and were interested in what youre looking to learn.
• Passionate: You have a passion for Big Data and an interest in the latest trends and developments constantly researching new tools and data technologies

Here s What You ll be Doing:

• Evaluate new technologies, design, implement, and maintain data pipelines for extraction, transformation, and loading of data from a wide variety of data sources to various data services
• Identify, design, and implement system performance improvements
• Identify, design, and implement internal process improvements
• Automate manual processes and optimize data delivery
• Lead and mentor team members
• Identify and assess potential solutions for technical and business suitability

Heres What You Need:

• Bachelor/ Master s Degree in Computer Science or Engineering related fields
• 8+ years of experience as a Software Engineer in enterprise grade, large scale distributed software product development
• 5+ years of work experience designing and building high performance data pipelines and applications using Hadoop, Spark, Hive, Presto, Kafka and Flink streaming, Druid, or other similar technologies
• Proficiency in some of the following languages: SQL, Scala, Java, Python, Bash
• Deep understanding of design principles of distributed systems and familiar with mainstream big data related technologies and distributed frameworks
• Leadership, mentorship, collaboration, and communication skills
• Exposure to working and leading in a globally distributed, culturally diverse team
• Knowledge of data modeling, data warehousing, ETL processes, and business intelligence reporting tools
• Experience with SQL and NoSQL systems
• Experience with automated testing systems
• Experience working in Agile methodologies with continuous integration and delivery as CI/CD
• Experience working on and building distributed data pipelines that ingest and process large scale data and optimizations.
• Experience working with containerization, and virtualization tools such as Kubernetes, Docker
• Experience with integration of data from multiple data sources
• Experience with scheduling tools such as airflow, oozie

Why You ll Love Working Here:

• Company paid comprehensive health and life insurance plans
• Paid Time off and flexible work schedules
• Company contribution to Provident Fund
• Participation in our company Stock options plan
• Company paid Parental Leave
• Monthly internet stipend
• Quarterly Wellness allowance
• Community engagement opportunities and donation-matching program
• Volunteer paid day off
• Annual virtual company retreats and regular community-led team events
• A workplace that supports a diverse, equitable, and inclusive environment.