Data Engineer - Contract

Job Title: Data Engineer
Job Description: We are seeking a skilled and motivated Data Engineer to join our team. The ideal candidate will have >5 years experience with >2 years experience working specifically with Databricks. Databricks Certification is preferred. DBT Cloud development experience and exposure to data vault modeling techniques is good to have.
The client is migrating from Teradata / Informatica to Databricks / dbt. Any experience working on migrations to Databricks is preferred.
Key Responsibilities:

• Design, develop, and maintain scalable data pipelines and ETL processes using Databricks.
• Learn dbt cloud quickly, onboard oneself with training courses and help from team members.
• Utilize Data Vault methodology to design and build data warehouses.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
• Optimize and tune data processing workflows for performance and scalability.
• Ensure data quality, integrity, and security across all data platforms.
• Own and document data pipelines and data lineage.
• Monitor and troubleshoot data pipeline issues to ensure timely and accurate data delivery.

Qualifications:

• Bachelor's degree in computer science, Information Technology, or a related field.
• Proven experience as a Data Engineer, with a strong focus on Databricks.
• Strong programming skills in SQL, Python, or other relevant languages.
• Experience with cloud platforms such as AWS, Azure, or GCP.
• Ability to work on multiple areas like Data pipeline ETL, Data modeling & design, writing complex SQL queries etc.
• Excellent problem-solving skills and attention to detail.
• Effective communication and collaboration skills.

Preferred Qualifications:

• Hands-on experience with dbt Cloud for data modeling and transformations is preferred.
• Exposure to Data Vault methodology and data warehousing concepts is preferred
• Experience with other data engineering tools and technologies (e.g., Apache Spark, Airflow).
• Knowledge of data governance and data security best practices.
• Familiarity with CI/CD pipelines and DevOps practices.