Senior Data Engineer

Looking for experienced Data Engineer to join our team.

Key Responsibilities:

Collaborate with the Product Owner, Business analyst and other team members to understand requirements and design scalable data pipelines and architectures.

Build and maintain data ingestion, transformation and storage processes using Databricks and Azure services.

Develop efficient ETL/ELT workflows to extract, transform and load data from various sources into data lakes.

Design solutions and drive implementation for enhancing, improving and securing Data Lakehouse.

Optimize and fine-tune data pipelines for performance, reliability and scalability.

Implement data quality checks and monitoring to ensure data accuracy and integrity.

Work with data developers, engineers and data analysts to provide them with the necessary data infrastructure and tools for analysis and reporting.

Troubleshoot and resolve data-related issues, including performance bottlenecks and data inconsistencies.

Stay up to date with the latest trends and technologies in data engineering and recommend improvements to existing systems and processes

Preferred candidate profile

• 4+ years of proven experience as a Data Engineer, with a focus on designing and building data pipelines.
• Experience in working with big and complex data environments.
• Certifications in Databricks or Azure services is a plus.
• Experience with data streaming technologies such as Apache Kafka or Azure Event Hubs is a plus.
• Strong programming skills in languages such as SQL, Python, Scala or Spark.
• Experience working with Databricks and Azure services, such as Azure Data Lake Storage, Azure Data Factory, Azure Databricks, Azure SQL Database and Azure Synapse Analytics.
• Proficiency in data modeling, database design and Spark SQL query optimization.
• Familiarity with big data technologies and frameworks like Hadoop, Spark and Hive.

If interested please apply via below link.

https://careers.softwareone.com/en/jobs/25879?lang=en-us

Applications will not be accepted on Emails.