Senior Associate _Azure Data Engineer_Data and Analytics

Responsibilities

Data Engineer Profile

PWC is looking for handson data engineers who can produce beautiful & functional code to solve complex analytics problems. If you are an exceptional developer with an aptitude to learn and implement using new technologies,
and who loves to push the boundaries to solve complex business problems innovatively, then we would like to talk with you.

Strong interpersonal skills and ability to manage and work with crossfunctional teams.
Being able to perform on multiple levels both as an individual contributor as well as driving initiatives.
Gogetter attitude with a mindset of thinking innovative
Experience building and optimizing big data data pipelines, architectures and data sets involving petabyte and terabyte of data.
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Expand and grow data platform capabilities to solve new data problems and challenges
Apply complex big data concepts with a focus on collecting, parsing, managing, and analyzing large sets of data to turn information into insights

Technical Skill set

Must Have
Extensive experience on big data platforms including Hadoop, Spark, Hive, Presto, Kudu.
Handson experience in design and development of hybrid cloud architecture
Extensive experience in at least one of the cloud platforms among Azure (Azure Data Factory, Databricks, Sybase Analytics, Azure functions, Azure stream analytics) OR AWS (S3, lambda, glue, Quick sight, EMR,EC2,Redshift ,Athena and Presto)
Handson experience in developing large scale distributed applications in either java or python programming language
Handson experience in either one of the real time streaming applications KAFKA OR Azure event hub OR AWS Kinesis
Advanced SQL programming skills
Design DWH model, ensuring data design follows the prescribed reference architecture framework while reflecting appropriate business rules built for logical, physical and conceptual model.
Experience in performance tuning of complex ETL mappings for relational and nonrelational workloads
Well versed with relational and noSql databases like MySQL, PostgreSQL, Mongo DB and Cassandra
Handson experience in migration from onpremise systems to cloud.

Good to have
Handson experience on microservice architecture
Knowledge on spring boot framework
Knowledge on developing scalable web applications
Developing distributed applications using cloud platforms.

Mandatory skill sets

Pyspark, SQL, Databricks

Preferred skill sets

Pyspark, SQL, Databricks

Years of experience required

5 8