Openings For Data Engineer with Relevantz

We are looking for a skilled DE to help build out our data analytics platform. This role will focus on designing and maintaining scalable ETL pipelines using Python, Kafka, and dbt, orchestrated with Apache Airflow. Data will be stored in Snowflake and leveraged for advanced analytics and reporting using ThoughtSpot or PowerBI.

Responsibilities:

• Design, build and maintain robust ETL/ELT pipelines using Python, Kafka and dbt to process data from various internal data sources
• Manage workflow orchestration with Apache Airflow to ensure timely and accurate data transformations
• Design data models for fast query times
• Optimize data models using Snowflake for high query performance and cost efficiency
• Implement real-time data streaming using Kafka
• Work closely with various application teams to identify, map and load data required for analysis and reporting
• Develop BI dashboards and self-service analytics using ThoughtSpot and/or PowerBI
• Adherence to data governance, enterprise security and compliance standards
• Monitor and optimize data pipelines for scalability and reliability

Preferred Skills:

• 5+ years of experience in data engineering preferably in a financial services or banking industry
• Proficient in python data processing and automation
• Hands-on experience with Kafka for real-time data streaming
• Strong SQL knowledge and prior experience with data lakes or warehouses
• Good knowledge of dbt for data transformations
• Experience with Airflow for orchestrating complex workflows
• Good understanding of Snowflake architecture with experience with using Snowflake tools for querying and loading data and optimizing query performance
• Exposure to cloud environments especially Azure and CI/CD best practices

Preferred candidate profile

• Candidates should be good in Data Engineering
• Candidates who have Strong experience in ETL Pipelines using Python, Airflow ,Kafka & dbt
• Work Experience:  5+ Yrs.
•  Azure Cloud Preferable

Perks and benefits

- Best Salary in the Industry & Medical Insurance

Interested Candidate can share your profile to sridhar.soundaraj@relevantz.com

Contact HR : Sridhar S