Senior Data Engineer - AWS Platform (8-12 yrs)

Job Title : Senior AWS Data Engineer

Company : AstroSoft Technologies

About the Job :

Astrosoft Technologies, a leading provider of innovative Data, Analytics, Cloud, AI/ML, and Digital solutions, is seeking a highly experienced and driven Senior AWS Data Engineer to join our expanding team in Hyderabad.

We are looking for a seasoned professional with 8-12 years of experience in building and managing complex data engineering solutions on the AWS platform.

This role offers a unique opportunity to work on cutting-edge projects and contribute to the success of our clients.

Location : Hyderabad, India (Hybrid)

Job Type : Full-Time

Experience : 8-12 Years

Key Responsibilities :

- Advanced Data Pipeline Development : Design, develop, and implement highly scalable and performant data pipelines using advanced AWS services like AWS Glue, Lambda, EMR, and MWAA (Airflow).

- Real-Time Data Streaming : Architect and implement complex real-time data streaming solutions using Kafka, Spark Streaming, and Flink.

- Data Warehousing & Optimization : Design and optimize data warehouses using Amazon Redshift, focusing on performance tuning, scalability, and cost-effectiveness.

- Infrastructure as Code (IaC) : Develop and maintain robust and reusable infrastructure as code using Terraform, ensuring consistent and automated deployments.

- ETL/ELT Architecture : Design and implement sophisticated ETL/ELT architectures, including data quality checks and data governance processes.

- Database Management & Optimization : Manage and optimize database platforms like Oracle and AWS Redshift, including advanced SQL tuning, physical optimization, and performance monitoring.

- SRE & Observability : Implement and maintain robust SRE practices, including monitoring, alerting, and logging using tools like CloudWatch, Splunk, and DataDog.

- Cloud Architecture & Design : Design and implement scalable and secure cloud architectures, adhering to AWS best practices.

- Collaboration & Communication : Collaborate with business partners, data scientists, and other engineers to understand complex requirements and deliver effective solutions.

- Mentorship & Leadership : Mentor junior engineers and contribute to the development of best practices and standards.

- Problem Solving & Innovation : Identify and solve complex technical challenges, driving innovation and continuous improvement.

Required Skills and Qualifications :

- Experience : 8-12 years of experience in data engineering and analytics on the AWS platform.

- AWS Expertise : Deep understanding and extensive experience with AWS services, including S3, SNS, SQS, MWAA (Airflow), Glue, DMS, EMR, and Redshift.

- Stream Processing : Expert-level knowledge of streaming architectures and technologies like Kafka, Spark Streaming, and Flink.

- Programming Skills : Strong proficiency in Python (preferred), Java, or Scala.

- Infrastructure as Code : Extensive experience with Terraform for building and managing AWS infrastructure.

- ETL/ELT Expertise : Advanced experience with ETL/ELT tools and techniques on AWS.

- Database Proficiency : Strong expertise in database platforms like Oracle and AWS Redshift, including advanced SQL tuning and optimization.

- SRE & Observability : Deep understanding and experience with SRE principles and tools like CloudWatch, Splunk, and DataDog.

- Communication & Collaboration : Excellent communication, collaboration, and interpersonal skills.

- Problem Solving & Critical Thinking : Strong analytical and problem-solving skills, with the ability to think critically and creatively.

- Self-Motivation & Leadership : Self-motivated, able to work independently, and demonstrate strong leadership skills.

Desired Skills and Experience :

- AWS Certified Data Analytics - Specialty or other relevant AWS certifications.

- Experience with advanced data governance and data quality tools.

- Experience with machine learning and AI on AWS.

- Experience with containerization and orchestration technologies like Docker and Kubernetes.

- Experience with complex data modeling and data architecture design.

Benefits Program :

H1B Sponsorship (Depends on Project & Performance)

Lunch & Dinner (Every day)

Health Insurance Coverage- Group

Industry Standards Leave Policy

Skill Enhancement Certification

Hybrid Mode

Interview Process :

2 Technical Rounds

Early Joiners Preferred

- -