Data Engineer (Data Pipeline, Python, AWS)

Nielsen is seeking an organized, detail oriented, team player, to join the OpIntel team in the role of Data Engineer. Nielsen's Audience Measurement Engineering platforms support the measurement of television viewing in more than 30 countries around the world. Ideal candidates will have exceptional skills in programming, testing, debugging and problem solving as well as effective communication and writing skills.

Qualifications:

• Bachelors degree in computer science, information systems, software engineering or a related field (foreign equivalent degree acceptable) plus
• 3+ years of experience in: software development technology using Python and SQL to write data pipelines/ETL/ELT, designing OLAP and S3 object store data architecture
• 2+ years of experience with/in: AWS DevOps, Python,Spark
• Some experience with/in: Test Automation, CICD Pipeline Development

Roles and Responsibilities:

• Design, develop, test and support highly complex data engineering software solutions for analytical data storage (AWS Data Lake, Data Warehouse) by providing necessary design and technical expertise.
• Understand the big picture in an End-to-End data environment and understand upstream system data and downstream consumption requirements.
• Adopt standard platform tools for source code management, CICD, Orchestration, monitoring and alerting (gitlab, airflow, jenkins etc).
• Work on AWS cloud infrastructure in a DevOps capacity, including automating the deployment and scaling of EMR, EC2, S3.
• Participate in technical planning & requirements gathering phases including discovery, design, code, test and documentation.
• Demonstrate development best practices to guarantee the quality and sustainability of software deliverables.
• Support Testing and UAT phases and participate in Deployment.
• As a Software Engineer on Nielsen Engineerings OpIntel Team, you will be part of a collaborative group of skilled Software Engineers who deal with a wide variety of Nielsen data from our TV, Digital/Internet, and Radio monitoring business. You will be working closely with offshore team members in the software development lifecycle process.
• You will be designing and building complex data-driven applications and processes that help
• to ensure that Nielsen TV, Digital/Internet, and Radio measuring systems are generating accurate data.