Data Engineer - SQL Server (8-10 yrs)

Job Title : Data Engineer

Location : Pune

Experience : 8-10 Years

Job Summary :

We are seeking a highly skilled Data Engineer with expertise in SQL Server and cloudbased data solutions, specifically on the AWS platform. This role involves addressing existing database challenges, including design, performance, and governance. You will play a key role in setting up a high-performance reporting database in the short term and leading the transformation of the organization's data infrastructure to a modern, cloudbased system in the long term.

The ideal candidate will have extensive experience in data architecture, ETL development, query optimization, and cloud data engineering. They must be a self-starter capable of delivering solutions with minimal supervision while working collaboratively with stakeholders to meet business objectives.

Key Responsibilities :

Short-Term Objectives :

1. Optimize Existing SQL Server Environment :

- Analyse and resolve performance issues in the current SQL Server databases.

- Implement governance and data quality checks.

2. Setup Reporting Database :

- Create a reporting database ensuring the new database supports all reporting and analytics requirements.

3. Support Existing Systems :

- Utilize SSIS, SSRS, and related tools for data integration and reporting tasks.

- Manage and monitor MS-SQL Server jobs and scheduling tools.

4. Cloud Data Warehousing on AWS :

- Implement a scalable, cloud-native data warehousing solution using AWS services like AWS Glue, Redshift, Lake Formation, and S3.

- Develop ETL/ELT pipelines and integrate data sources for analytics and reporting.

5. Data Governance and Security :

- Establish and enforce robust data governance policies.

- Ensure data security and compliance with relevant regulations.

6. Performance Optimization :

- Monitor and optimize the performance of both on-premises and cloudbased data systems.

7. Collaboration & Leadership :

- Collaborate with stakeholders to gather requirements and deliver effective solutions.

- Act as a technical expert and mentor for junior team members.

Required Skills & Qualifications :

Technical Expertise :

- Advanced knowledge of SQL Server, including replication technologies (e.g., merge replication).

- Proficiency in SSIS, SSRS, and other SQL Server tools.

- Strong understanding of AWS cloud services for data engineering (e.g., AWS Glue, Redshift, Athena, S3, and Lake Formation).

- Expertise in ETL/ELT processes and automation.

- Proficient in data modelling, query optimization, and database performance tuning.

Data Governance & Security :

- Strong understanding of data governance frameworks and compliance standards.

- Experience with securing data on cloud platforms.

Soft Skills :

- Excellent problem-solving and analytical skills.

- Strong communication skills for working with technical and non-technical stakeholders.

- Ability to work independently and deliver solutions with minimal supervision.

Preferred Qualifications :

- Experience in database migration to cloud native platforms.

- Familiarity with reporting tools like Power BI or third-party visualization tools.

- Knowledge of big data technologies and real-time data processing.

- AWS Data Engineering certification or equivalent is a plus.