Azure Data Engineer

Job Description

SQL Server, Azure SQL PaaS, CosmosDB

Job Overview:

We are seeking a skilled Data Engineer with expertise in Azure Cosmos DB and SQL to join our team. The ideal candidate will be responsible for designing, developing, and managing data solutions that leverage Cosmos DB to ensure high availability, scalability, and performance. You will work closely with cross-functional teams to integrate and optimize data workflows and support data-driven decision-making.

Key Responsibilities:

• Data Management: Design and implement data solutions using Azure Cosmos DB, SQL, including schema design, indexing strategies, and data partitioning.
  
• ETL Processes: Develop and maintain ETL pipelines to move and transform data into Cosmos DB from various sources.
  
• Performance Optimization: Monitor and optimize the performance of Cosmos DB databases to ensure efficient query execution and minimal latency.
  
• Integration: Collaborate with application developers and data scientists to integrate Cosmos DB with other data systems and applications.
  
• Data Security: Implement security best practices to ensure data integrity and compliance with regulatory requirements.
  
• Troubleshooting: Identify and resolve data issues, such as inconsistencies and performance bottlenecks.
  
• Documentation: Create and maintain technical documentation for data processes, system configurations, and best practices.
  
• Collaboration: Work with cross-functional teams to understand data requirements and provide data solutions that meet business needs.
  

Qualifications:

• Education: Bachelors degree in Computer Science, Engineering, or a related field. Advanced degree preferred.
  
• Experience: 3+ years of experience as a Data Engineer, with significant experience in Azure Cosmos DB.
  
• Technical Skills:
  

○ Proficiency in Azure Cosmos DB, including data modeling, query optimization, and API usage.

○ Experience with Azure Data Factory, Azure Synapse Analytics, or other Azure data services.

○ Strong SQL skills and knowledge of NoSQL databases.

○ Familiarity with programming languages such as Python, C#, or Java.

○ Good to have Snowflake experience.

• Problem-Solving: Excellent analytical and problem-solving skills with the ability to troubleshoot complex data issues.
  
• Communication: Strong verbal and written communication skills, with the ability to convey technical concepts to non-technical stakeholders.
  

Teamwork: Ability to work effectively in a collaborative environment and manage multiple priorities.

Preferred Qualifications:

• Certifications in Azure or related data technologies.
  
• Experience with other cloud-based data platforms or big data technologies.
  
• Knowledge of data governance and data warehousing concepts.