Data Engineer

Position Title: Data Engineer
Required Experience: 3 to 6 years
Job Location: Pune/Mumbai

Job Description (Job Summary/Roles & Responsibilities)

• 'This role will collaborate with our Analytics Portal team to design and implement data strategy, ensuring reliable data infrastructure and creating data solutions for variety of business use cases.
• Creates and maintains highly scalable data pipelines across Azure Data Lake Storage, and Azure Synapse using Data Factory, Databricks and Apache Spark/Scala
• Responsible for managing a growing cloud-based data ecosystem and reliability of our Corporate datalake and analytics data mart
• Contributes to the continued evolution of Corporate Analytics Platform and Integrated data model.
• Be part of Data Engineering team in all phases of work including analysis, design and architecture to develop and implement cutting-edge solutions.
• Influences changes outside of the team that continuously shape and improve the Data strategy

Mandatory Skills

• Understands business and technology environments, application, and process capabilities.
• Knowledge of Azure services and technologies like Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, Azure Data Lake, and Azure Event Hubs
• Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure.
• Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations.
• Experience with data engineering processes and best practices
• Knowledge of industry trends and emerging technologies in data engineering
• Ability to collaborate with data scientists, analysts, and other teams
• Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
• Monitoring and resolving data pipeline problems will guarantee consistency and availability of the data.

Desired Skills

• Degree plus related IT field work experience.
• Proven communication skills (written and verbal) in working with management, clients, and technological experts.
• Microsoft Office applications, specifically Word, Excel, Visio, Outlook, JIRA and Confluence
• Experience with Insurance Industry is a huge plus.

Education & Certifications:

• BE/ BTech / BSC