Data Engineer - SQL/PySpark (4-8 yrs)

Job Description :

- 4+ years of Big data processing experience using Spark Spark-SQL/ PYSpark

- 4+ years of Experience in developing and running data engineering pipelines, link raw client data with data model, conduct data assessment, perform data quality checks, and transform data using ETL tools.

- Excellent in data transformations, data modelling, and data validation activities, as well as configure applications to the client context.

- Experience in developing scripts to validate, transform, and load raw data using programming languages such as Python

- Self-driven with strong sense of ownership and eager to learn new tools and technologies like modern data warehouse technology (Snowflake / AWS Redshift / Azure Synapse)

- Working Experience on multiple domain (Pricing, Marketing , Retail, Healthcare etc.)

- Can manage stakeholder expectation

- Good Experience on designing artifacts related to data solutions

- Experience on Implementing Data Jobs (Batch / Real time Streaming)

- Excellent skills on SQL and Advanced Level SQL.

Excellent analytical skills :

- Knows data and DWH modelling-

- Optimization of pipelines