Data Engineer , Amazon Music DISCO

Amazon Music is an immersive audio entertainment service that deepens connections between fans, artists, and creators. From personalized music playlists to exclusive podcasts, concert livestreams to artist merch, Amazon Music is innovating at some of the most exciting intersections of music and culture. We offer experiences that serve all listeners with our different tiers of service: Prime members get access to all the music in shuffle mode, and top ad-free podcasts, included with their membership; customers can upgrade to Amazon Music Unlimited for unlimited, on-demand access to 100 million songs, including millions in HD, Ultra HD, and spatial audio; and anyone can listen for free by downloading the Amazon Music app or via Alexa-enabled devices. Join us for the opportunity to influence how Amazon Music engages fans, artists, and creators on a global scale.

Key job responsibilities
- Engage in collaborative efforts with cross-functional teams, including data scientists and business intelligence engineers, to architect a state-of-the-art data analytics platform on AWS, employing the AWS Cloud Development Kit (CDK).
- Construct resilient and scalable data pipelines using SQL/PySpark/Airflow to effectively ingest, process, and transform substantial data volumes from diverse sources into a structured format, ensuring data quality and integrity.
- Devise and implement an efficient, scalable data warehousing solution on AWS, utilizing appropriate NoSQL/SQL storage and database technologies for both structured and unstructured data.
- Automate ETL/ELT processes to streamline data integration from diverse sources, enhancing the platforms reliability and efficiency.
- Develop data models to support business intelligence, delivering actionable insights and interactive reports to end-users.
- Enable advanced analytics and machine learning capabilities within the platform, extracting predictive and prescriptive insights through tools like EMR/SageMaker Notebooks.
- Continuously monitor and optimize the performance of data pipelines, databases, and applications, ensuring low-latency data access for analytics and machine learning tasks.
- Implement robust security measures and ensure data compliance with internal requirements, industry standards, and regulations to safeguard sensitive information.
- Collaborate closely with data scientists and business intelligence engineers to comprehend their requirements and work together on data-related projects.
- Generate comprehensive technical documentation covering the platforms architecture, data models, and APIs, promoting knowledge sharing and ease of maintainability.

About the team
Embark on an exhilarating journey with the DISCO team at Amazon Music! Were seeking a dynamic Data Engineer to be a vital part of propelling our success story. In this role, youll be instrumental in crafting extraordinary Analytics & Science infrastructure for DISCO teams. Join us in championing a culture of inclusivity and a data-driven mindset, where every team member at Amazon Music is empowered to make informed decisions and measure their impact. Be the driving force behind delivering top-notch, accessible data and democratizing data access through user-friendly self-service tools. Join us on this exciting quest to redefine how we approach insights and decision-making for all! - 3+ years of data engineering experience