Aws Devops Engineer

Job Description

Responsibilities:
- Maintain ETL pipelines using SQL, Spark, AWS Glue, and Redshift.
- Optimize existing pipelines for performance and reliability.
- Troubleshoot and resolve UAT / PROD pipeline issues, ensuring minimal downtime.
- Implement data quality checks and monitoring to ensure data accuracy.
- Collaborate with other teams, and other stakeholders to understand data requirements.

Roles & Responsibilities

Required Skills and Experience:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Extensive experience (e.g., 6+ years) in designing, developing, and maintaining ETL pipelines.
- Strong proficiency in SQL and experience with relational databases (e.g., Redshift, PostgreSQL).
- Hands-on experience with Apache Spark and distributed computing frameworks.
- Solid understanding of AWS Glue and other AWS data services.
- Experience with data warehousing concepts and best practices.
- Excellent problem-solving and troubleshooting skills.
- Strong communication and collaboration1 skills.   
- Experience with version control systems (e.g., Git). 

- Experience with workflow orchestration tools (e.g., Airflow).

Preferred Skills and Experience:
- Experience with other cloud platforms (e.g., Azure, GCP).
- Knowledge of data modeling and data architecture principles.
- Experience with data visualization tools (e.g., Tableau, Power BI).
- Familiarity with Agile development methodologies