Azure Data bricks Engineer

Position Overview:

We are seeking a skilled Azure Data bricks Engineer to join our dynamic team. The ideal candidate will have a strong background in big data processing, data engineering, and cloud technologies, with specific experience in Azure Data bricks.

Responsibilities:

Design and Develop Data Solutions:

•         Architect, develop, and optimize scalable data pipelines and ETL processes using Azure Data bricks.
•         Implement data integration, data transformation, and data storage solutions.

Data Modeling and Management:

•         Design and implement data models and structures that support business intelligence and analytics requirements.
•         Manage and maintain the Data bricks environment, ensuring optimal performance and reliability.

Collaboration:

•         Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
•         Collaborate with other engineering teams to integrate Data bricks solutions with existing systems.

Optimization and Performance Tuning:

•         Perform data quality checks and ensure data accuracy and consistency.
•         Optimize performance of Data bricks jobs and troubleshoot any issues.

Security and Compliance:

•         Implement data security and compliance best practices.
•         Ensure all solutions adhere to company policies and regulatory requirements.

Documentation and Training:

•         Document data processes, solutions, and configurations.
•         Provide training and support to end-users and team members as needed.

Qualifications:

Education: Bachelors degree in computer science, Information Technology, or related field.

Experience:

•  6+ years of experience in data engineering or a related field.
•  6+ years of experience with Azure Data bricks.
•  Strong experience with big data technologies such as Apache Spark.

Technical Skills:

• Proficiency in programming languages such as Python, Scala, or SQL.
• Experience with Azure cloud services (e.g., Azure Data Lake, Azure Data Factory).
• Knowledge of data warehousing concepts and tools.
• Familiarity with CI/CD pipelines and version control systems (e.g., Git) Soft Skills:
•  Strong problem-solving and analytical skills.
• Excellent communication and collaboration abilities.
• Ability to work in a fast-paced, dynamic environment.

 Preferred Qualifications:

• Experience with other cloud platforms (e.g., AWS, Google Cloud).
• Certifications in Azure or Data bricks.
• Experience with machine learning and data science projects.: