Infiniti Research - Data Engineer (3-4 yrs)

Job Description :

Key Responsibilities :

- Design, build, and maintain robust and scalable data pipelines using Azure Data Factory, Azure Synapse Analytics, and Microsoft Fabric.

- Implement data ingestion, transformation, and loading (ETL/ELT) processes to support analytical and reporting needs.

- Develop and optimize SQL queries, stored procedures, and data models to ensure efficient data retrieval and processing.

- Design and implement data warehousing solutions that support complex analytical requirements.

- Create interactive and visually compelling Power BI dashboards and reports that provide actionable insights to business stakeholders.

- Utilize DAX to develop complex calculations and measures, and apply best practices for data visualization.

- Implement row level security, and other security measures within power BI.

- Utilize Microsoft Fabric for unified analytics, data lake creation, and real-time data processing.

- Integrate Fabric components with existing Azure services to create a seamless data ecosystem.

- Monitor data pipeline performance, identify bottlenecks, and implement optimization strategies.

- Ensure data quality, security, and compliance through rigorous testing and validation.

- Apply domain knowledge to understand business requirements and translate them into effective data solutions.

- Develop dashboards and reports that provide insights into key performance indicators (KPIs) specific to the Retail/CPG/E-commerce industry.

Qualifications :

Experience :

- 3+ years of experience in a hybrid BI and Data Engineering role, or a combination of BI and Data Engineering roles.

- Proficiency in Azure cloud services, including Azure Data Factory, Azure Synapse Analytics, and Azure SQL Database.

- Strong SQL skills, including query optimization, stored procedure development, and data modeling.

- Expertise in Power BI development, including DAX, data modeling, and report design.

- Familiarity with Microsoft Fabric and its components.

- Understanding of data warehousing concepts (Kimball, Inmon).

- Experience in the Retail, CPG, or E-commerce industry is highly desirable.

- Understanding of common business metrics and KPIs in these sectors.

Preferred Qualifications :

- Experience with data governance and data quality tools.

- Knowledge of Python or other scripting languages.

- Experience with real time data processing.