Data Engineer - Snowflake DB (10-20 yrs)

Job Description :

We are looking for Engineers who can :

- Design, develop, and maintain data pipelines to ingest, transform, and load data from various sources into Snowflake.

- Implement ETL (Extract, Transform, Load) processes using Snowflake's features such as Snowpipe, Streams, and Tasks.

- Design and implement efficient data models and schemas within Snowflake to support reporting, analytics, and business intelligence needs.

- Optimize data warehouse performance and scalability using Snowflake features like clustering, partitioning, and materialized views.

- Integrate Snowflake with external systems and data sources, including on-premises databases, cloud storage, and third-party APIs.

- Implement data synchronization processes to ensure consistency and accuracy of data across different systems.

- Monitor and optimize query performance and resource utilization within Snowflake using query profiling, query optimization techniques, and workload management features.

- Identify and resolve performance bottlenecks and optimize data warehouse configurations for maximum efficiency.

- Work on Snowflake modeling - roles, databases, schemas, ETL tools with cloud-driven skills

- Work on SQL performance measuring, query tuning, and database tuning

- Handle SQL language and cloud-based technologies

Key Skills & Qualifications :

- Experience with ETL processes for data integration.

- Strong SQL skills for querying and data manipulation

- Strong command of Python, especially in AWS Boto3, JSON handling, and dictionary operations

- Competent in Unix for file operations, searches, and regular expressions

- Proficient with AWS services including EC2, Glue, S3, Step Functions, and Lambda for scalable cloud solutions

- Database Modeling - Solid grasp of database design principles, including logical and physical data models, and change data capture (CDC) mechanisms.

- Experienced in Snowflake for efficient data integration, utilizing features like Snowpipe, Streams, Tasks, and Stored Procedures.

- Bachelor's degree in Computer Science, or a related field is preferred. Relevant work experience may be considered in lieu of a degree.

- Excellent communication and interpersonal skills, with the ability to effectively collaborate with cross-functional teams and stakeholders.

- Proven leadership abilities, with experience mentoring junior developers and driving technical excellence within the team.

We work closely with :

- Data Wrangling

- ETL

- Talend

- Jasper

- Java

- Python

- Unix

- AWS

- Data Warehousing

- Data Modeling

- Database Migration

- RBAC model

- Data migration

Experience Needed :

- At least 7 years of Data Wrangling Experience

- At least 7 years of Snowflake Experience

- At least 7 years of ETL Experience