Cygnus Technologies - Azure Data Engineer - PySpark/SQL (6-8 yrs)

Job Title : Azure Data Engineer

Location : Pan India (Hybrid Work Mode)

Employment Type : Full-Time

Experience : 6-8 years

- Data Engineer to join our dynamic team and contribute to our data-driven initiatives.

Job Summary :

As an Azure Data Engineer, you will play a key role in designing, building, and maintaining robust data pipelines and solutions. You will leverage Azure Data Services to enable powerful analytics and data-driven decision making across the organization.

Key Responsibilities :

- Design, develop, and deploy data pipelines using Azure Data Factory and Azure Databricks.

- Implement data transformation and processing using PySpark, ensuring efficient handling of large datasets.

- Collaborate with data architects and data scientists to collect and process data from multiple sources.

- Develop and optimize SQL queries for data extraction, transformation, and analysis.

- Manage and monitor Azure infrastructure and services to ensure optimal performance of data pipelines.

- Troubleshoot and resolve data-related issues in a timely manner.

- Document data workflows, processes, and best practices to maintain data governance and quality standards.

- Participate in code reviews and contribute to the continuous improvement of development processes.

- Stay updated with industry trends and best practices in data engineering and Azure technologies.

Technical Skills Required :

- Azure Data Services : Proficiency in Azure Data Factory and Azure Databricks for data integration and transformation.

- Programming : Strong experience with PySpark for large-scale data processing.

- SQL Proficiency : Solid understanding of SQL and experience with building complex queries for data manipulation and reporting.

- Data Modeling : Understanding of data modeling concepts and best practices.

- Cloud Knowledge : Familiarity with Azure cloud concepts, services, and architecture.

Required Qualifications :

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- 6-8 years of professional experience in data engineering or related roles.

- Proven experience working with Azure data technologies and services.

- Strong analytical and problem-solving skills.

- Excellent communication and teamwork abilities.

Preferred Qualifications :

- Experience with additional Azure services like Azure Synapse Analytics, Azure SQL Database, or Azure Blob Storage.

- Knowledge of data warehousing and ETL processes.

- Certification in Azure Data Engineering or related fields is a plus.

Why Join Us :

- Opportunity to work with cutting-edge technologies in a collaborative and innovative environment.

- Competitive salary and benefits package.

- Flexible hybrid work model providing a balance between remote work and in-office collaboration.

- Continuous learning and career development opportunities.