CodeKart - Data Engineer - ETL/Data Warehousing (3-5 yrs)

Role : Data Engineer.

Experience :3 yr.

Location : Remote.

Responsibilities :

- Provide ongoing support and monitoring for AWS-based data engineering infrastructure.

- Ensure the smooth operation of data pipelines and applications in a production environment.

- Develop and maintain data pipelines, ETL processes, and data warehouses using AWS services.

- Design and implement data models that effectively capture and organize data.

- Implement data quality checks and validation processes to ensure data accuracy and integrity.

- Use SQL, Python, and PySpark to analyze and extract insights from large datasets.

- Collaborate with DevOps teams to automate deployment and management of data engineering infrastructure.

Qualifications :

- 3 to 5 years of experience in data engineering or a related field. Strong proficiency in AWS services such as EMR, Glue, Lambda, SNS, EventBridge, Redshift, and Jupyter.

- Expertise in Python, PySpark, and SQL for data processing and analysis.

- Understanding of Unix/Linux operating systems. Experience with data warehousing and data modeling concepts.

- Knowledge of DevOps practices and tools CI/CD, Git, Docker.

- Strong problem-solving and troubleshooting skills.

- Ability to work independently and as part of a team.

Key Skills : AWS, Python, PySpark, SQL, Unix, EMR, Glue, Lambda, SNS, EventBridge, Redshift, Jupyter, data engineering, data warehousing, data modeling, DevOps.

- Problem-solving, troubleshooting, communication, collaboration, teamwork, adaptability, time management.

Additional Considerations :

- Experience with banking domain processes and environments would be a plus.

- Familiarity with data governance and compliance requirements is beneficial.

- Knowledge of data visualization tools (e.g., Tableau, Power BI) is helpful.