Data Engineer - Amazon RDS (7-14 yrs)

Job Description :

Job Title : Data Engineer.

Shift Timings : 1 PM 10 PM.

Experience required : 7 to 14 years.

Job Description :

- We are looking for an Data Engineer with a focus on PostgreSQL optimization and extensive experience in database migrations from MS SQL Server to PostgreSQL leveraging AWS Database Migration Service (DMS).

- In this role, you will play a key part in transitioning our data infrastructure to a more optimized and scalable system, ensuring performance and data integrity throughout the process.

Key Responsibilities :

- Lead and facilitate database migration from MS SQL Server to PostgreSQL, using AWS DMS to minimize downtime and ensure data accuracy.

- Optimize PostgreSQL databases for performance, focusing on query optimization, indexing strategies, partitioning, and schema design improvements.

- Collaborate with cross-functional teams (product, software engineers, data science) to understand data requirements and develop robust data solutions.

- Monitor and troubleshoot PostgreSQL database performance issues, ensuring high availability and reliability.

- Design, build, and maintain efficient ETL pipelines to transfer data between various systems.

- Establish and document best practices for database management, security, and disaster recovery in a cloud environment, with an emphasis on AWS.

- Develop migration plans and roadmaps, including testing, validation, and post-migration optimization.

Qualifications :

- Strong expertise with PostgreSQL, especially in performance tuning, indexing, query planning, and schema optimization.

- Proven experience with database migrations from MS SQL Server to PostgreSQL, with hands-on experience using AWS Database Migration Service (DMS) for large-scale migrations.

- Proficiency in SQL and relational database design principles.

- Experience with ETL processes, data pipelines, and integrating data from multiple sources.

- Familiarity with cloud platforms, particularly AWS (e.g, RDS, Aurora) and their database services.

- Strong understanding of database security best practices, including encryption, access management, and auditing.

- Strong problem-solving skills, with the ability to identify and resolve complex data-related issues.

- Excellent communication and collaboration skills in a cross-functional and remote team environment.