AWS Data Engineer - ETL/Data Pipeline (5-10 yrs)

Core Responsibilities :

Data Engineering Solutions :

- Design, implement, and optimize ETL/ELT processes for data pipelines.

- Manage data flow using AWS services, Kafka, and Delta Lake.

Data Processing and Integration :

- Work with Databricks for advanced analytics and data transformation.

- Integrate and manage structured and unstructured data sources using SQL.

Data Quality and Performance :

- Ensure high data quality and reliability through effective testing and validation processes.

- Optimize performance of data pipelines and workflows for scalability.

Collaboration :

- Collaborate with cross-functional teams for requirements gathering and solution delivery.

- Contribute to architectural decisions and best practices for cloud data solutions.

Mandatory Skills :

- Big Data and Cloud Platforms : Kafka, AWS (various services), Databricks

- Database Proficiency : SQL

- Data Engineering Processes : ETL/ELT processes, Delta Lake

Desired Attributes :

- Excellent problem-solving and debugging skills.

- Ability to work independently in a remote setup while adhering to tight deadlines.

- Strong communication skills to effectively collaborate with team members and stakeholders.