Data Engineering - Senior Developer

Position Overview

Annalect is currently seeking a data engineer to join our technology team. In this role you will build Annalect products which sit atop cloud-based data infrastructure. We are looking for people who have a shared passion for technology, design & development, data, and fusing these disciplines together to build cool things. In this role, you will work on one or more software and data products in the Annalect Engineering Team. You will participate in technical architecture, design and development of software products as well as research and evaluation of new technical solutions.

Key Responsibilities:

• Steward data and compute environments to facilitate usage of data assets
• Design, build, test and deploy scalable and reusable systems that handle large amounts of data
• Manage small team of developers
• Perform code reviews and provide leadership and guidance to junior developers
• Learn and teach new technologies

Required Skills

• Experience designing and managing data flows
• Experience designing systems and APIs to integrate data into applications
• 8+ years of Linux, Bash, Python, and SQL experience
• 4+ years using Spark and other Hadoop ecosystem software
• 4+ years using AWS cloud services, esp. EMR, Glue, Athena, and Redshift
• 4+ years managing team of developers
• Passion for Technology: Excitement for new technology, bleeding edge applications, and a positive attitude towards solving real world challenges

Additional Skills

• BS, MS or PhD in Computer Science, Engineering, or equivalent real-world experience (You've learned something to be able to claim you are an engineer)
• Significant experience with Python, C++, or other popular language
• Experience with big data and/or infrastructure. Bonus for having experience in setting up Petabytes of data so they can be easily accessed. Understanding of data organization, i.e., partitioning, clustering, file sizes, file formats. Data cataloging with Hive/Hive meta store or Glue or something similar.
• Experience working with relational databases.
• Experience with Hadoop, Hive, Spark, or other data processing tools
• Experience in any of the modern data stack technologies like dbt, airbyte is desired.
• Experience building scalable data pipelines (Airflow experience a plus)
• Significant experience working with AWS and/or GCP
• Proven ability to independently execute projects from concept to implementation to launch and to maintain a live product

Perks of working at Annalect

• Culture. We have an incredibly fun, collaborative and friendly environment, and often host social and learning activities such as game night, speaker series, and so much more!
• Generous vacation policy. Paid time off (PTO) includes vacation days, personal days, and a Summer Friday program.
• Extended time off around the holiday season. Our office is closed between Xmas and New Year to encourage our hardworking employees time to rest, recharge and celebrate the season with family and friends.
• As part of Omnicom, we have the backing and resources of a global billion-dollar company, but also have the flexibility and pace of a “startup” - we move fast, break things, and innovate.

We are an equal opportunity employer.

Annalect, a division of Omnicom Media Group, reaffirms its commitment to the policy of Equal Employment Opportunity and to carrying out this policy at all of its offices. It shall be the policy of Omnicom Media Group to (1) recruit, select, hire, train, promote, pay, discipline and terminate employees in all job classifications without regard to age, race, color, creed, national origin, citizenship status, alienage, religion, sex, sexual orientation, marital status, veteran status, disability or any other basis upon which discrimination against or harassment of employees or applicants for employment is prohibited under any applicable federal, state or local equal opportunity employment laws and (2) ensure that all personnel actions are administered without discrimination in violation of applicable law.