Senior Data Engineer

About Us:
AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology consulting, product development, start-up advisory and fund-raising services to our global clients across banking financial services, healthcare, supply chain logistics, consumer retail, manufacturing, eGovernance and other industry sectors.
We are looking for hungry, highly skilled and motivated individuals to join our dynamic team. If you re passionate about technology and thrive in a fast-paced environment, we want to hear from you.

Job Summary :
We are seeking a skilled Senior Data Engineer to support and enhance the Business Analytics Platform for ecommerce business. This platform, hosted on Microsoft Azure, is crucial for Business Intelligence (BI) and Machine Learning (ML) initiatives, serving various departments and use cases. The existing technology stack includes Azure Databricks, Azure Data Factory, Azure Data Lake Storage, and Azure Synapse Serverless.

Key Responsibilities:
*Design and develop data pipelines on Azure for ingesting, processing, and storing data from various sources.
*Develop and maintain Azure-based data framework solution, including data lake and data warehouse approaches.
*Collect requirements from data analysts, data scientists, and other stakeholders to build solutions that meet their requirements.
*Implement security measures to ensure that our data is protected at all times.
*Optimize data pipelines and queries for performance, scalability, and cost efficiency.
*Troubleshoot data-related issues and provide solutions in a timely manner.
*Recommend new technologies and best practices that can improve our data platform and solutions.
*Develop and maintain documentation for the data engineering team, including data models, data flow diagrams, and technical specifications.
*Provide feedback in code reviews to ensure that coding standards and best practices are followed.

Role Requirements and Qualifications:
*5+ Years of experience as Senior Data Engineer.
*Experience with developing new use cases.
*Optimize existing data processing pipelines for better efficiency.
*Provide ongoing support to ensure smooth platform operation.
*Enhance our analytics capabilities, driving improved decision-making and business outcomes.
*Hands on experience with following skills :
*Azure Data Technologies: Azure Data Factory (ADF) ,Azure Databricks,Azure Synapse Serverless,Azure Data Lake Storage (ADLS),Azure Blob Storage ,Azure SQL Database
*Big Data Technologies: Apache Spark ,Delta Lake ,Kafka (optional but beneficial) ,Spark Streaming (optional but beneficial)
*Programming and Scripting Languages: Python ,SQL
*Data Modeling and ETL: ETL/ELT processes ,Data transformation and cleansing ,Data warehousing concepts (optional but beneficial)
*Data Integration: Integration with various data sources (on-premises and cloud-based) ,Real-time data processing and streaming (optional but beneficial)
*DevOps and CI/CD: Azure DevOps for CI/CD pipelines

Why Join Us:
*Opportunities to work on transformative projects, cutting-edge technology and innovative solutions with leading global firms across industry sectors.
*Continuous investment in employee growth and professional development with a strong focus on up re-skilling.
*Competitive compensation benefits, ESOPs and international assignments.
*Supportive environment with healthy work-life balance and a focus on employee well-being.
*Open culture that values diverse perspectives, encourages transparent communication and rewards contributions.

How to Apply:
If you are interested in joining our team and meet the qualifications listed above, please apply and submit your resume highlighting why you are the ideal candidate for this position.