Sr Data Engineer

Role & responsibilities

Data engineering experience in an agile production environment. Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or implementing machine learning systems at scale. Experience leading the design and implementation of complex features. Experience with end-to[1]end lifecycle of data management including data ingestion, modeling, unification, production, and customer adoption. Experience leading a large project and working with other data and software engineers. Experience working in enterprise databases and ensure follow industry best practices around data privacy. Expertise in using Python or Scala, Spark, Data Modeling, Hadoop platforms & tools (Hive, Impala, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms. Experience in anonymizing data, data product development, analytical models, and AI governance. Experience with SQL, Paral lel Data Processing, Message Queuing & Distributed Systems. Effective communication and collaboration skills to work with both technical and non-technical stakeholders. Flexible to work with global offices across several time zones. Outstanding problem[1]solving skills and the ability to navigate complex data challenges. Experience with agile methodologies, DevOps practices, and CI/CD.