Data Engineer - Spark/Python (7-10 yrs)

Job Title : Data Engineer

Location : Hyderabad

Experience Level : 7+ Years

Mode : Hybrid (3days WFO & 2days WFH.)

Job Description :

Key Responsibilities :

- Design & implement enterprise-grade Data Lake solutions using AWS (S3, Glue, Lake Formation).

- Define best practices for data ingestion, storage, and processing at scale.

- Optimize cloud infrastructure for performance and cost-effectiveness.

- Develop & maintain ETL pipelines using AWS Glue and CI/CD DevOps practices.

- Build and manage Data Warehousing solutions with Redshift.

- Ensure high data quality, security, and governance standards.

- Design insightful dashboards & visualizations with Tableau, Power BI, or Qlik.

- Collaborate with stakeholders to define data-driven business strategies.

- Lead audits, compliance, and security implementations (IAM, Encryption, KMS).

- Mentor junior team members and drive technical excellence.

Qualifications & Skills :

- Expertise in AWS Data Lake architecture & technologies (S3, Glue, Redshift, Athena).

- Strong ETL, SQL, NoSQL, Python, Spark, Kafka experience.

- Hands-on with data security & governance (IAM, KMS, Secrets Manager).

- Familiarity with modern Data Warehousing & Lakehouse architectures.

- Experience with CI/CD pipelines, version control (Git), and Agile methodologies.

- AWS Certified Solutions Architect - Associate (Required).