Lead Data Engineer

Job Description :

- Assist in the design and implementation of Snowflake-based analytics solution (data lake and data warehouse) on AWS

- Requirements definition, source data analysis and profiling, the logical and physical design of the data lake and data warehouse as well as the design of data integration and publication pipelines

- Develop Snowflake deployment and usage best practices

- Help educate the rest of the team members on the capabilities and limitations of Snowflake

- Build and maintain data pipelines adhering to suggested enterprise architecture principles and guidelines

- Design, build, test, and maintain data management systems

- Work in sync with internal and external team members like data architects, data scientists, data analysts to handle all sorts of technical issue

- Act as technical leader within the team

- Working in Agile/Lean model

- Deliver quality deliverables on time

- Translating complex functional requirements into technical solutions.

- Creation and maintenance of optimum data pipeline architecture for ingestion, processing of data

- Creation of necessary infrastructure for ETL jobs from a wide range of data sources using Talend, DBT, S3, Snowflake.

- Experience in Data storage technologies like Amazon S3, SQL, NoSQL

- Data modeling technical awareness

- Experience in working with stakeholders working in different time zones

Good to have :

- AWS data services development experience.

- Working knowledge on using Bigdata technologies.

- Experience in collaborating data quality and data governance team.

- Exposure to reporting tools like Tableau

- Apache Airflow, Apache Kafka (nice to have)

- Payments domain knowledge

- CRM, Accounting, etc. in depth understanding

- Regulatory reporting exposure