Senior Data Engineer - Snowflake DB (5-7 yrs)

Job Description :

We are seeking skilled Data Engineers with expertise in Snowflake to join our team.

As a Data Engineer, you will play a critical role in our client's migration from on-premises systems to Snowflake, a cloud-based data platform.

You will be responsible for building robust and efficient data pipelines, transforming raw data, and ensuring smooth data consumption.

Responsibilities :

- Collaborate with cross-functional teams to understand data requirements and design performant, efficient, and secure data pipelines from the landing zone to the consumption level in Snowflake.

- Utilize native Snowflake capabilities to implement data transformations, aggregations, and enrichments to meet business needs.

- Develop and maintain data ingestion processes from on-premises sources to the landing zone, ensuring data integrity and accuracy throughout the pipeline.

- Work closely with the architecture team to ensure seamless integration of data sources, leveraging Snowflake's features and functionalities.

- Optimize data pipelines for performance, scalability, and reliability, implementing best practices and monitoring mechanisms.

- Collaborate with data analysts and other stakeholders to understand data consumption requirements and provide solutions for efficient data retrieval.

- Ensure compliance with data governance policies and industry standards throughout the data engineering process.

- Continuously stay updated with the latest advancements in Snowflake and data engineering techniques, sharing knowledge and insights with the team.

Qualifications :

- Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent practical experience).

- Proven experience as a Data Engineer with a focus on Snowflake, including hands-on experience in building end-to-end data pipelines.

- Strong understanding of Snowflake architecture, data warehousing concepts, and ETL/ELT methodologies.

- Proficiency in SQL for data manipulation and transformation within Snowflake.

- Expertise and experience using Snowflake procedures, functions, streams, tasks, external stages, and external tables.

- Expertise and experience using blob and data lake storage (AWS/Azure).

- Expertise and experience using Snowpipe.

- Experience with data integration and ingestion tools, such as Fivetran, AWS Glue, Azure Data Factory, or dbt.

- Familiarity with cloud platforms (e.

, AWS, Azure) and their data services.

- Solid understanding of data modeling principles and ability to design efficient data structures within Snowflake.

- Strong problem-solving skills and ability to analyze complex data requirements to develop effective solutions.

- Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams.

- Proactive and self-motivated with a passion for data engineering and delivering high-quality solutions.

- Experience working with on-premises ETL tools such as SSIS and SSMS.

- Experience with data migration projects from on-premises environments to Snowflake cloud technologies is highly desirable.

- Strong analytical and problem-solving skills with a keen attention to detail.

Preferred Qualifications :

- Snowflake certification(s) in Data Engineering or related areas.

- Experience integrating external systems and services with Snowflake.

- Experience with Snowpark, especially with Python.

- Experience with version control systems (e.g, Git) and CI/CD pipelines.

- Knowledge of Python or other scripting languages for data processing and automation.

- Expertise in Banking Data/Domain.

- Familiarity with data governance frameworks and practices.

- Experience with data visualization tools (e.g, Tableau, Power BI) for reporting and analytics.

- Experience with other ETL tools and technologies (e.g, Informatica, Talend).

- Knowledge of data modeling principles and techniques.