Data Engineer - Snowflake DB (2-10 yrs)

Job Description :

We are seeking a skilled Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support our data warehousing and analytics initiatives. You will work closely with cross-functional teams to understand business requirements, design efficient data solutions, and ensure data integrity and quality. The ideal candidate should have expertise in using databricks and Snowflake for ETL processes, proficiency in Python programming for scripting and automation, and a solid understanding of data warehousing concepts and SQL.

Responsibilities :

- Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and Apache Spark to process large volumes of data efficiently.

- Architect and implement data storage solutions on Snowflake, ensuring optimal performance, reliability, and scalability.

- Develop and optimize SQL queries for data extraction, transformation, and analysis, ensuring adherence to best practices and performance optimization techniques.

- Collaborate with cross-functional teams to gather data requirements and translate business needs into technical solutions.

- Design and implement data models and schemas to support reporting, visualization, and business intelligence initiatives.

- Monitor and troubleshoot data pipelines and processes, identifying and resolving issues to ensure uninterrupted data flow and availability.

- Stay up-to-date with emerging technologies and industry trends in data engineering and analytics, contributing to continuous improvement and innovation within the team.

Requirements :

- Bachelor's degree in Computer Science, Engineering, or related field; advanced degree preferred.

- Proven experience in data engineering, with expertise in Databricks and Apache Spark for large-scale data processing and analytics.

- Strong proficiency in SQL, with the ability to write complex queries and optimize performance for various database platforms, including Snowflake.

- Hands-on experience with Snowflake for cloud-based data warehousing, including data modeling, storage, and querying.

- Solid understanding of data warehousing concepts, dimensional modeling, and data governance principles.

- Experience with version control systems (e.g., Git) and CI/CD pipelines for code deployment and automation.

- Excellent problem-solving skills and attention to detail, with the ability to troubleshoot and debug complex data issues.

- Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.