Lead I - Data Engineering

JOB DESCRIPTION Lead Data Engineer

RESPONSIBILITIES/TASKS:

Work with Technical Leads and Architects to analyse solutions.

Translate complex business requirements into tangible data requirements through collaborative work with both business and technical subject matter experts.

Develop / modify data models with an eye towards high performance, scalability, flexibility, and usability.

Ensure data models are in alignment with the overall architecture standards.

Create source to target mapping documentation.

Subject matter knowledge guidance in source system analysis and ETL build.

Responsible for overseeing data integrity in the Smart Conductor system.

Serves as data flow and enrichment owner with deep expertise in data dynamics, capable of recognizing and elevating improvement opportunities early in the process.

Work with product owners to understand business reporting requirements and deliver appropriate insights on regular basis.

Responsible for system configuration to deliver reports, data visualizations, and other solution components.

SKILLS REQUIRED:

More than 8 years of data engineering experience with minimum 4 years experience working on Azure Data Factory or SSIS

Proficient and minimum 4 years working experience on Databricks and Delta Lake

Proficient and minimum 2 years working experience with Azure cloud services and Azure blob storage & data lake.

Very strong knowledge & working experience of SQL/TSQL

Proficient in Python scripting

Experience with RDBMS (MS SQL or Oracle 10g/11g), including database design, developing stored procedures and functions, and performance tuning.

Strong working experiences with No-SQL databases like Azure Cosmos DB

Experience in Azure SQL Server, Azure Synapse and Azure Synapse Analytics

Understanding of Reporting and Data Visualization tools (PowerBI or SSRS)

Experience in migrating systems from SSIS to Azure based systems.

Experience within the healthcare insurance industry with payer data strongly preferred.

Experience in data cleansing, data engineering, data enrichment, data warehousing/ Business Intelligence preferred.

Strong analytical, problem solving and planning skills.

Strong organizational and presentation skills.

Excellent interpersonal and communication skills.

Ability to multi-task in a fast-paced environment.

Flexibility to adapt readily to changing business needs in a fast-paced environment.

Team player who is delivery-oriented and takes responsibility for the team s success.

Enthusiastic, can-do attitude with the drive to continually learn and improve.

Knowledge of Agile, SCRUM and/or Agile methodologies.