Data Engineer III - Advertising Technology

As a Data Engineer III, you will propose, design and implement various initiatives. As a member of the team, you will work in alliance with global teams providing the technical expertise needed to overcome hard problems. We value rigor and innovative thinking in our development process and believe in the power of a motivated & agile development team.

In this role, you will:

• Partners with the business to have a clear understanding of how own technology stack is tied to business outcomes and our bottom line.

• Successfully conducts day-to-day work and solves complex issues in own specific technical engineering area.

• Shares domain and Industry knowledge between cross-functional teams.

• Serves as a guide to others by sharing and helping junior associates in their duties.

• Is recognized ability to fill in for peer engineering management as need arises.

• Advocates efforts to remove tech roadblocks for their team for long term success.

• Demonstrates positive impact and leadership outside immediate team scope.

• Possesses knowledge of features and facilities for integration, and communication among applications, databases and technology platforms to bring together different components and form a fully functional solution to a business problem.

• Has proven ability, experience and advanced knowledge of building and operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets.

• Creatively tests and maintains software applications and related programs and procedures by using a variety of software development tools following design requirements of customer.

• Acts as a spokesperson for software design best practices.

• Researches and recommends frameworks and architectural/code design patterns [NG] for large scale data processing in a scalable distributed environment.

• Advises on designing, performance/scalability tuning of batch and real time stream analytics and large data processing systems.

• Identifies areas of improvements within the code and suggests solutions.

• Advocates for operational excellence (such as unit testing, establishing SLAs, programming for resiliency and scalability).

• Advises on technical limitations of software design for products and provides alternative solutions.

• Facilitates collaboration with different stakeholders with varied perspectives to develop effective solutions to issues.

• Strives for optimum organizational efficiency by applying systems thinking across boundaries and making recommendations about policies/ processes.

• Takes a whole systems approach to analyze issues and implements holistic solutions by ensuring that linkages between structure, people, process and technology are made.

• Recognizes outmoded methods of operation with current systems and design plans for disrupting them in a non-disruptive manner.

• Designs and leads advancements, innovations and changes in current solution designs relating to latest advancements in software engineering (specifically related to data engineering, cloud data platforms, data models, enterprise information management, business intelligence and data science).

• Reports on status of difficult or high-level projects to local tech leadership via written or oral means. Ensures documentation is complete.

• Justifies technology choices to both technical and non-technical observers.

• Shares technology learnings and best practices across engineering community in organization

Experience and qualifications:

• 4+ years of experience developing data and software solutions, including ETLs, with a minimum of 2 years in a senior or lead role.

• 3+ years of experience in building data pipelines in the cloud

• Experience in Cloud computing platforms including AWS, EMR, or Kubernetes/Docker

• Experience in Apache Spark, Apache Kafka, Splunk, Datadog.

• Experience in NoSQL and SQL Databases including MongoDB or Elastic Search.

• Experience with ML, deep learning, TensorFlow, Python, NLP

• Experience with aggregation strategy and performance optimization

• Experience building data pipelines incrementally and ensure test cases and logging are built for all scenario

• Agile methodologies and tools including Jira or Scrum practices.

• Experience in language like Java, Scala or python.

• Strong communication skills, experience communicating across various groups, and levels of leadership within a global organization

• Enthusiastically seek out solutions for data engineering problems

• Focused developer with a strong sense of ownership

• Ability to drive individual tasks to completion and production deployment