Data Engineer (5-10 yrs)

Job Title : Data Engineer - Management Consulting

Job Description :

Designing, building, and maintaining data pipelines using cloud technologies to ensure efficient data flow and quality for analysis by data scientists and business users. Key responsibilities will include :

Job Responsibility :

1. Data ingestion and extraction :

- Utilize Airbyte to establish connections to various data sources, configure data extraction pipelines, and manage data replication schedules.

2. Data transformation with dbt :

- Write dbt models to clean, transform, and aggregate data according to business requirements, leveraging dbt's declarative syntax for maintainable data pipelines.

3. Snowflake data modeling :

- Design and implement data models in Snowflake, optimizing for performance and query efficiency, including dimensional modeling techniques.

4. Pipeline monitoring and maintenance :

- Monitor data pipelines for errors, troubleshoot issues, and implement alerts to ensure data quality and reliability.

5. Data quality checks :

- Implement data validation processes to identify and address data inconsistencies or errors before loading into Snowflake.

6. Collaboration with stakeholders :

- Work closely with data analysts, data scientists, and business teams to understand data needs, define data requirements, and deliver actionable insights.

Key Skills :

Mandatory :

- Knowledge of ETL/ELT processes, data modelling, data quality best practices, and change data capture

- Strong SQL skills to query, manipulate, and transform data

- Understanding of Airbyte connectors, configuration, and data synchronization capabilities

- Familiarity with dbt syntax, development workflow, and best practices for data transformation- mandatory experience.

- Understanding of Snowflake architecture, data warehousing concepts, and performance optimization techniques

- Familiarity with cloud platforms like AWS, Azure.

Experience : 5 + years

Job Location : Goregaon, Mumbai ((Hybrid) but should be willing to come to the office regularly till confirmation i.e for 6 months

Working Days : 5 days

Qualification : Bachelor's degree in computer science, Engineering, or a related field

Notice Period : Immediate to 30 days

Relocation candidates : No