Data Engineer - ETL/SQL (3-4 yrs)

Job Description :

Key Responsibilities :

- Cloud Data Engineering : Develop, deploy, and manage cloud-based data solutions on the Azure platform, focusing on data warehousing and ETL pipelines.

- ETL Migration : Lead the migration of traditional ETL processes (using SSIS) from on-premise systems to the Azure cloud landscape, ensuring seamless data flow and integrity.

- Database Development : Work with Azure SQL, Synapse, and Snowflake databases to design and optimize data models, queries, and storage solutions.

- SQL Development : Utilize SQL Server and other SQL-based technologies to write efficient queries and optimize database performance.

- Data Pipeline Design : Build and maintain scalable, high-performance data pipelines to process large datasets, ensuring accuracy and completeness of data for reporting and analytics.

- Collaboration : Work closely with data scientists, analysts, and other stakeholders to understand data requirements and ensure data solutions align with business goals.

- Performance Tuning : Optimize data queries and pipelines for improved performance and reduced latency in cloud environments.

- Cloud Best Practices : Stay up-to-date with the latest Azure cloud technologies and best practices for cloud-based data engineering and warehousing.

Mandatory/Must-Have Skills :

- 3+ years of experience in Data Engineering or Data Warehousing development and operations.

- At least 2 years of experience working with cloud computing platforms, especially Azure.

- Hands-on experience with Azure SQL, Azure Synapse, and Snowflake databases.

- Strong experience with ETL processes, including migrating conventional SSIS ETL pipelines to the Azure cloud.

- Proven proficiency in SQL development, with a strong preference for SQL Server.

- Experience in designing and optimizing cloud-based data solutions for large-scale data processing and analytics.

- Familiarity with cloud storage solutions, data lake architectures, and cloud-based data integration tools.

Desired Skills :

- Familiarity with Azure Data Factory, Azure Databricks, and other Azure-based data processing services.

- Knowledge of NoSQL databases and experience with cloud-native data storage solutions.

- Experience with DevOps or CI/CD pipelines for automating data operations and deployments.

- Familiarity with data modeling and building data lakes in cloud environments.

- Experience working in Agile development environments.

Qualifications :

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- Azure certifications (e. , Azure Data Engineer) are a plus