Senior Data Engineer

Responsibilities

• A problem-solving mindset with the ability to understand business challenges and how to apply analytics expertise to solve them.
• Build compelling, clear, and powerful visualizations of data.
• Design, architect and implement Azure Data Factory V2 Pipelines.
• Should have worked on Team Foundation Server / GIT as part of ADF Implementation.
• Experience in migration projects like moving/implementing code from other ETL tool to ADF.
• Develop solution to implement error logging, alerting mechanism using various available azure services.
• A team mentality empowered by the ability to work with a diverse set of individuals.
• Tell a clear story, highlight insights we had not previously seen and do it all faster than weve been able to previously.
• Create, maintain, and document a robust set of metrics to monitor day-to-day bug detection and long-term performance tracking/tuning.
• Have strong understanding of best practices, standards and guidelines in each technology/product and apply same to produce high quality deliverables
• Should be able to take responsibility for the software life cycle - set up all environment, design, code, test, repository mgmt. and deployments as applicable and as required

Required Qualifications

• Minimum 5-7 years of Development experience in ADF.
• At least 3-5 years of experience in T-SQL, creating complex store procedures, triggers etc.
• Should have used Azure DevOps extensively as part of projects
• Should have worked on SQL Database, Azure SQL Database, Azure Datawarehouse, salesforce connectors, snowflake connectors and should be comfortable with data warehousing concepts.
• Should have worked on Azure Logic Apps, Azure Functions for not less than 3 years.
• 4+ Years professional experience in a data Engineer/analyst role or similar.
• Knowledge in creating Power BI Reports & Dashboards [Optional]
• Should have worked on Service Bus, Event Hub.

Preferred Qualifications

• Experience working on Data Migration / Code implementation from other ETL tools using ADF will be an advantage.
• Experience with Azure Data Factory, SSIS package, managed identity, service principles and other deployment activities
• Experience with building CI/CD pipelines in Data environments and different patterns of deployment activities
• Experience working on Azure Analysis Service with intermediate expertise in writing DAX.
• Exposer to NOSQL databases Cosmos DB, Kusto DB.
• Preferred Azure Cloud Shell, PowerShell, Azure CLI and Work with other Azure stack modules like Azure Data Lakes, SQL, Data warehouse, SF connectors, etc.
• Excellent communication, organizational transformation, and leadership skills
• Eager to continuously learn and grow.