7 Texplorers Jobs

Data Engineer

Your Mission :

We are implementing Microsoft's best practices ("Enterprise-Scale for Analytics and AI" in a "Data Landing Zone"). As a Data Engineer (Spark), you will focus on :

Designing & Implementing Spark Solutions :

- End-to-end design and implementation of Spark solutions (Data Ingestion, Data Lake Design, ELT Design).

- Building prototypes for solution architects in Apache Spark, Synapse Pipelines, Python, and GitHub DevOps.

- Deep technical expertise in Azure Synapse/Spark landscape.

Guiding & Reviewing Code :

- Acting as the go-to person for junior developers and external consultants.

- Ensuring high-quality implementation and technical solution design.

- Teaching PySpark, Python, and organizing proper testing & GitHub workflows for automated deployments.

Your Talent :

- Educational Background : Bachelor's/Master's degree in Computer Science or a related field.

- Experience : 5+ years in an Azure environment (Ideally completed MS courses : DP-203, AZ-104, AZ-304).

Technical Expertise :

- Strong knowledge of Azure Synapse Analytics (Synapse Pipelines, Apache Spark for Synapse, Synapse Studio).

- 1-3 years of experience in GitHub DevOps workflows.

- 3+ years of hands-on coding in Python, PySpark, Spark SQL, and T-SQL.

- Passion for mentoring and guiding teammates.

- Fluent in English.

- Databricks Certified Associate Developer for Apache Spark 3.0 is a plus!