Data Engineer - Reports & Dashboarding

Job Description :

Position : Data Engineer - Dashboarding & Reports

About Us :At Learning mate, we are passionate about shaping the future of digital education. As a leading IT service provider for edtech domain, we work with a diverse clientele to create innovative and transformative learning experiences. We are seeking a talented and experienced lead UX designer to drive our mission forward for one of our esteemed clients.

Role Description :As a Data Engineer, you will play a crucial role in designing and implementing data pipelines to support business intelligence and analytics initiatives. You will work closely with data analysts, data scientists, and business stakeholders to understand data requirements and create efficient data models.

Key Responsibilities :

- Design and implement data pipelines to extract, transform, and load data from various sources into a centralized data warehouse or data lake

- Collaborate with data analysts and business stakeholders to understand data requirements and create efficient data models

- Optimize data pipelines for performance, scalability, and reliability using tools like Apache Airflow, Kafka, or AWS Glue

- Ensure data quality, consistency, and security throughout the data lifecycle

- Develop and maintain data documentation, including data dictionaries, metadata, and data lineage

- Provide technical support and troubleshooting for data-related issues in Looker Studio and Power BI reports

- Stay up-to-date with the latest data engineering technologies and best practices

Qualifications :

- 5+ years of experience in data engineering or a related field

- Strong proficiency in SQL and at least one programming language (Python, Scala, Java, etc.)

- Hands-on experience with data warehousing technologies like Snowflake, BigQuery, or Redshift- Familiarity with data streaming and batch processing frameworks like Apache Kafka, Spark, or Flink

- Knowledge of cloud computing platforms (AWS, Azure, or GCP) and their data engineering services

- Experience with data orchestration tools like Apache Airflow, Luigi, or Prefect

- Understanding of data modeling techniques and best practices for dimensional modeling or data vault

- Familiarity with Looker Studio and Power BI is a plus

- Strong problem-solving skills and the ability to work collaboratively in a team environment

Skills Applicable : SQL, Python, Java, Data Modelling, Data Visualization, data API