Senior Data Engineer

Description

You will be joining Azira, a global Consumer Insights platform, helping marketing and operational leaders improve their effectiveness with actionable intelligence to drive business results. Its mission is to create a more relevant world where brands are empowered to reach and build relationships with their consumers.

Azira is in search of a Senior Data Engineer to oversee all Data Engineering activities. In this role, you will utilize your extensive knowledge to design, define, develop, deploy, and manage secure, scalable data pipelines. Responsibilities include planning and executing the data engineering roadmap and implementing improvements. You will work independently to tackle challenging problems and set the pace.

This position offers the opportunity to join Azira s Engineering team, providing exposure to large-scale data and cutting-edge technology stacks. Your role involves enhancing data techniques, and collaborating with Data Scientists, Software Engineers, and UI Engineers to solve complex problems as part of a high-performance team.

A Day in the Life

• Develop and optimize scalable data processing pipelines for diverse data sources, formats, and content at a petabyte scale on the Azira Platform.
• Hands-on role involving coding, system architecture, and tackling complex technical challenges.
• Enhance product development, contributing to Azira s Operational Intelligence & Marketing Intelligence solutions.
• Ensure high-quality product delivery by designing and executing comprehensive integration tests.
• Conduct code and design reviews to drive efficiency and innovation within Data Engineering modules.
• Plan and optimize system capacity, defining resource requirements for various deployment scenarios.
• Create clear and concise documentation, including deployment guides and technical references.
• Work in an agile environment, actively tracking and updating tasks/stories.
• Understand business needs, ensuring applications align with operational goals.
• Collaborate cross-functionally to develop creative solutions.
• Strong interpersonal and communication skills, effectively translating business requirements into data-driven solutions while working with diverse stakeholders.

What You Bring to the Role

• Experience: 5-8 years of overall experience, with at least 3 years in a data-driven company/platform.
• Big Data Expertise: Hands-on experience with at least one distributed big data processing framework such as Apache Spark, Apache NiFi, Hadoop, Airflow, Apache Kafka, Apache HBase, or Redshift.
• Programming Skills: Proficiency in Java is essential; Scala experience is a plus.
• Cloud & System Design: Experience with AWS cloud, along with a strong grasp of algorithms, data structures, and design patterns.
• Technical Proficiency: Expertise in frameworks, distributed systems, and NoSQL databases (Kafka, HBase, Spark, Cassandra, MongoDB).
• Bonus Skills: Experience with Spring Boot and API development is a plus.
• Soft Skills: A team player who thrives in collaborative and start-up environments, with strong interpersonal, verbal, and written communication skills.