AWS Data Engineer - SQL/Python (6-12 yrs)

Job Description :

Must-Have :

- 6+ years of experience with AWS tech stack (S3, Glue, Redshift, Athena, Lambda, CloudWatch, SQS, IAM roles, CloudTrail).

- 3-5 years of SQL, Python & Pyspark programming experience.

- Experience working with ETL Tools.

- Experience with CDC mechanisms for database sources.

- Experience building distributed architecture-based systems, especially handling large data volumes and real-time distribution.

- Initiative and problem-solving skills when working independently.

- Expertise in building high-performance, highly scalable, cloud-based applications.

- Experience with SQL and No-SQL databases.

- Good collaboration and communication skills, highly self-driven, and take ownership.

- Experience in Writing well-documented, Clean, and Effective codes is a must.

Good to have :

- AWS Cloud Certifications.

- Knowledge and experience in designing and developing RESTful services.

- 1-3 years of experience in DBT with Data Modeling, Airflow, MWAA, SQL, Jinja templating, and packages/macros to build robust, performant, and reliable data transformation and feature extraction pipelines.

- 1-2 years of experience in Airbyte building ingestion modules for streaming, batch.

- Good experience building Real-Time streaming data pipelines with Kafka, Kinesis etc.

- Familiarity with Big Data Design Patterns, modeling, and architecture.

- Working knowledge of DevOps methodologies, including designing CI/CD pipelines.

- Good understanding of Data warehousing & Data Lake solutions concepts.