Intellicus Technologies - Data Engineer - Apache Airflow/Kafka (3-7 yrs)

Data Engineer

Experience : 3-7 years

Location : Noida/Indore/Bangalore

Key Responsibilities :

- Design and develop robust data pipelines using tools like Apache Airflow, Kafka, or similar technologies.

- Extract, transform, and load data from various sources (e.g, databases, APIs, cloud storage) into data warehouses.

- Implement data quality checks and monitoring to ensure data accuracy and consistency.

- Optimize data pipelines for performance and scalability.

- Design and implement data models (dimensional and relational) to support business analytics.

- Create and maintain data warehouses and data marts.

- Optimize query performance and troubleshoot data issues.

- Analyze data to identify trends and patterns.

- Collaborate with data analysts and business users to understand their data needs.

- Use data visualization tools (Tableau, Power BI) to create insightful dashboards and reports.

- Utilize cloud platforms (AWS, GCP, Azure) to build scalable and cost-effective data solutions.

- Implement cloud-native technologies and best practices.

- Work closely with cross-functional teams (data analysts, data scientists, engineers) to deliver data solutions.

- Communicate effectively with technical and non-technical stakeholders.

- Document data pipelines, processes, and best practices.

Required Skills and Experience :

- Strong proficiency in SQL and data modeling techniques.

- Experience with data warehousing and data lake concepts.

- Proficiency in scripting languages (Python, Scala, or R).

- Experience with big data technologies (Hadoop, Spark, Kafka).

- Knowledge of cloud platforms (AWS, GCP, Azure).

- Experience with data visualization tools (Tableau, Power BI).

- Strong problem-solving and analytical skills.

- Excellent communication and collaboration skills