Senior Data Engineer

Minimum of 7 years of experience in ETL development and data integration.
At least 3 years of hands-on experience with Spark DPL framework and AWS managed Snowflake.
Proven experience in successfully migrating legacy ETL jobs to cloud environments
Convert and rewrite legacy Informatica ETL jobs into a Spark DPL framework
Migrate data pipelines to AWS-managed Snowflake environment.
Collaborate with data engineers, architects, and other stakeholders to ensure seamless migration and integration.
Ensure high-quality, scalable, and efficient ETL processes in the new environment.
Write and optimize Spark jobs to process large volumes of data.
Create and maintain the deployment pipelines and automation scripts.
Troubleshoot and resolve issues during migration and deployment.
Work with Snowflake to define and optimize data models and transformations.
Perform thorough testing and validation of the new ETL processes to ensure data integrity and accuracy.
Optimize performance, ensuring minimal latency and efficient resource utilization in AWS and Snowflake environments.
Document code, processes, and architecture for future reference and knowledge transfer.