Aws Data Engineer

Job Title AWS+GCP Data Engineer

Min Exp 5-10 years

Key Responsibilities:

Work with cross-functional teams to build and maintain data pipelines and project infrastructure

Manage end-to-end data engineering tasks, including data ingestion, transformation, and integration with the data lake

Ensure data quality and perform data transformations within the AWS ecosystem

Support CDP-related initiatives, particularly involving AWS cloud services and popular marketing and analytics platforms

Required Skills and Experience:

AWS Data Engineering: Hands-on experience with AWS S3, Glue, Lambda, Redshift and other AWS services for IAM, Networking and cloud Security

SQL: Ability to write and optimize complex SQL queries

Python: Experience in Python for data processing and automation tasks

CDP: Familiarity with Customer Data Platforms, preferably Treasure Data

Version Control: Knowledge of tools like Jenkins and Bitbucket for CI/CD

Additional Skills:

Data Modelling: Experience in creating and maintaining data models for large-scale environments

Big Data Technologies: Familiarity with Databricks and other big data processing frameworks

Cloud Security & Compliance: Knowledge of cloud security best practices, data encryption, IAM (Identity and Access Management), and compliance (e.g., GDPR, CCPA)

Workflow Orchestration: Familiarity with Apache Airflow or AWS Step Functions for managing complex data workflows

Qualifications:

Proven experience in delivering data engineering projects, ideally within large organizations

Ability to take ownership of tasks and work independently in an individual contributor role

No strict educational background requirements, but strong hands-on experience in delivering projects with diverse teams is essential

AWS Glue Lambda redshift SQL Python Data Modelling Databricks