Data Engineer

JOB DESCRIPTION:

The Data Engineer is responsible for Individual contribution and leading a team of 3-4 team members, guiding the team technically, reviewing the work done and emphasizing on the right design considerations and implementations wherever needed. Ensuring and validating data quality developing and maintaining end to end data pipelines and insight products. We are looking for someone with strong data lake fundamentals, AWS, spark, python, airflow etc. hands-on experience in all layers of data Integration and analytics.

RESPONSIBILITIES:

• Sr Data Engineer will understand the business need and design the data pipelines, translate data into business insights, data cleansing and ETL.
• Gather requirements from vested teams to build features.
• Self-motivated individual will use their love of user interfaces to balance design and function, and thrive in a fast-paced environment, knowledge in Angular / Play Framework is a plus.
• Understand the priorities and ensures the deliverables stick to the timeline and complete projects on time
• Be a team player who works effortlessly with people

Requirements:

• 2 5 years of development experience at an Enterprise level in the following tools and languages:
• Spark Scala
• python
• Mysql
• Apache Parquet / any columnar formats
• Desired Pluses
• Java
• Play framework / Angular
• Tableau
• Advertising Tech Industry experience
• AWS Services, Hadoop architecture and EMR management
• Linux
• Strong experience with digital media.
• Strong experience with relational databases like MySQL. NoSQL databases experience is a plus.
• Strong background with data modeling, data access, and data storage techniques
• Experience with design, development, and implementation of highly scalable, high-volume software systems and components, source of truth systems for different business areas.
• Bachelors degree in Computer Science or related field or equivalent combination of industry related professional experience and education