Insight - Data Engineer III - ETL (5-8 yrs)

Role : Data Engineer III

Shift: Rotational, 2:00 pm- 11:00 PM IST

Location: Delhi NCR, Hyderabad, Bangalore, Pune, Chennai, this is a hybrid work opportunity.

Insight at a Glance :

- 14,000+ engaged teammates globally with operations in 25 countries across the globe.

- Received 35+ industry and partner awards in the past year

- $9.2 billion in revenue

- #20on Fortunes World'sBest Workplaces list

- #14 on Forbes World's Best Employers in IT 2023

- #23 on Forbes Best Employers for Women in IT- 2023

- $1.4M+ total charitable contributions in 2023 by Insight globally

Now is the time to bring your expertise to Insight. We are not just a tech company; we are a people-first company. We believe that by unlocking the power of people and technology, we can accelerate transformation and achieve extraordinary results. As a Fortune 500 Solutions Integrator with deep expertise in cloud, data, AI, cybersecurity, and intelligent edge, we guide organizations through complex digital decisions.

About the role :

As a Data Engineer III, you will focus on delivering the vision of the customer through process, development, and lifecycle. We will count on you to work directly with stakeholders and team members to define, design, and deliver actionable insights while working with ETL developers and BI developers in an agile environment.

As a Data Engineer III, you will get to :

- Implement ETL pipelines using Azure Databricks and event-driven streaming data engineering

- Develop and optimize data pipelines using Microsoft Fabric's data integration tools

- Design and implement data lakes and data warehouses using Fabric's storage solutions

- Fixing and improving existing data Ingestion Pipelines for customers

- Implement data governance and security measures across the Fabric ecosystem

- Optimize data workflows for performance, scalability, quality and cost-efficiency

- Formulates and recommends standards for achieving maximum performance and efficiency of the DW ecosystem.

- Participates in the DataOps activities for supporting various customer problem-statement/situations.

Be Ambitious :

This opportunity is not just about what you do today but also about where you can go tomorrow. As a Data Engineer III, you are positioned for swift advancement within our organization through a structured career path. When you bring your hunger, heart, and harmony to Insight, your potential will be met with continuous opportunities to upskill, earn promotions, and elevate your career.

What were looking for Data Engineer III with :

- 6+ years of experience with ETL Process, business intelligence & data warehouse architecture

- 6+ years of experience with Azure Data services i.e. Azure Databricks, ADF, ADLS Gen 2, Azure SQL dB, Synapse, Microsoft Fabric and Power BI

- 2+ years of hands-on experience with event-driven streaming data engineering, preferably with Apache Flink and/or Confluent.

- Strong proficiency in SQL and Python/pyspark (Databricks)

- Implementation experience of Medallion architecture and delta lake (or lakehouse)- DataBricks

- Working knowledge of Azure DevOps and CICD (build and release)- Basic exp is required.

- Good analytical and problem-solving skills

- Fluent in relational database concepts and flat file processing concepts

- Has strong presentation and collaboration skills and can communicate all aspects of the job requirements, including creating formal documentation.

Good to Have :

- Experience with Change Data Capture (CDC) frameworks, with Debezium experience being a bonus.

- Familiarity with containerized environments for event-driven streaming- Apache Flink/Confluent

- Experience in Unity catalog & DBT knowledge- Not mandatory

- Experience in Snowflake- Not mandatory

What you can expect :

Were legendary for taking care of you, your family and to help you engage with your local community. We want you to enjoy a full, meaningful life and own your career at Insight. Some of our benefits include:

Freedom to work from another locationeven an international destinationfor up to 30 consecutive calendar days per year.

- Medical Insurance

- Health Benefits

- Professional Development: Learning Platform and Certificate Reimbursement

- Shift Allowance

But what really sets us apart are our core values of Hunger, Heart, and Harmony, which guide everything we do, from building relationships with teammates, partners, and clients to making a positive impact in our communities.