Decision Point - Data Engineering Manager - SQL/Spark (8-15 yrs)

Job Description :

What would a typical day at your work be like?

- You will lead and manage the delivery of projects and be responsible for the delivery of project and team goals.

- Build & support data ingestion and processing pipelines.

- This will entail extract, load and transform of data from a wide variety of sources using latest data frameworks and technologies.

- Design, build, test, and maintain machine learning infrastructure and frameworks to empower data scientists to rapidly iterate on model development.

- Own and lead client engagement and communication on technical projects.

- Define project scopes and track project progress and delivery.

- Plan and execute project architecture and allocate work to team.

- Keep up to date with advances in big data technologies and run pilots to design the data architecture to scale with the increased data volume.

- Partner with software engineering teams to drive completion of multi-functional projects.

What Do We Expect?

- Minimum 8 years of overall experience in data engineering and 3+ years leading a team as team lead and doing project management.

- Experience working with a global team and remote clients.

- Hands on experience in building data pipelines on various infrastructures.

- Knowledge of statistical and machine learning techniques.

- Hands on experience in integrating machine learning in data pipelines.

- Ability to work hands-on with the data engineers in the team in design and development of the solution using the relevant big data technologies and data warehouse concepts

- Strong knowledge of advanced SQL, data warehousing concepts, DataMart designing.

- Have strong experience in modern data platform components such as Spark, Python, etc.

- Experience with setting up and maintaining Data warehouse (Google BigQuery, Redshift, Snowflake) and Data Lakes (GCS, AWS S3 etc.) for an organization.

- Experience in building data pipeline with AWS Glue, Azure Data Factory and Google Dataflow.

- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra / MongoDB.

- Strong problem solving and communication skills