As a Sr Data Engineer in AI COE team, youll design, architect and implement data solutions, build data pipelines, and perform complex data analysis. Your expertise in Azure tools will ensure efficient data processing and compliance with security and privacy regulations.
Key Position Responsibilities include:
Design data solutions to meet business, technical and user requirements. This includes building modern data pipelines that meet that meet functional/non-functional business requirements and provide end to end data solutions.
Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
REST API integrations with other production systems.
REST APIs wherever necessary and writing effective and scalable codes.
Participate in code reviews, ensure code quality and identify areas for improvement to implement practical solutions.
Analyzing Raw data and combining raw data from multiple sources, Developing and maintaining data sets and improving data quality and efficiency.
Analyzing raw data and combining raw data from multiple sources, Developing and maintaining data sets and improving data quality and efficiency.
Improving the use of Azure resources and processes to achieve better performance and reduce the cost values.
Master data lifecycle, standards and technologies used by the team and the company.
Perform technical documentation of the resources, pipelines, data sources, and datasets.
Optimize database performance and reliability through efficient data modeling, indexing strategies, and query optimization techniques.
Required Experience and Qualifications:
Bachelor s degree in computer science or IT-related courses.
5+ years of experience in Data area.
Strong hands-on experience in building pipelines and ETL with Azure Synapse, DBT, Stitch, or similar tools.
Proficiency in Python Programming.
Sound understanding of Azure resources and Azure services.
Experience working with relational and NoSQL databases (SQL Server, Snowflake, CosmosDB)
Experience in developing C# based REST API and deployment using azure application services will be a big advantage.
Exposure in Azure Service Bus, Azure Storage Account Gen2 and Azure Functions.
Should be able to work independently and multi-task effectively
Analytical, problem-solving, and decision-making skills.
Experience working in an agile environment as an important part of the team.