IN-Senior Associate_Azure Data Engineer

Data Engineer Profile

PWC is looking for hands-on data engineers who can produce beautiful & functional code to solve complex analytics
problems. If you are an exceptional developer with an aptitude to learn and implement using new technologies,
and who loves to push the boundaries to solve complex business problems innovatively, then we would like to
talk with you.
Roles and Responsibilities -
Strong interpersonal skills and ability to manage and work with cross-functional teams.
Being able to perform on multiple levels both as an individual contributor as well as driving initiatives.
Go-getter attitude with a mindset of thinking innovative
Experience building and optimizing big data data pipelines, architectures and data sets involving petabyte
and terabyte of data.
Experience performing root cause analysis on internal and external data and processes to answer specific
business questions and identify opportunities for improvement.
Expand and grow data platform capabilities to solve new data problems and challenges
Apply complex big data concepts with a focus on collecting, parsing, managing, and analyzing large sets
of data to turn information into insights

Technical Skill set-

Must Have
Extensive experience on big data platforms including Hadoop, Spark, Hive, Presto, Kudu.
Hands-on experience in design and development of hybrid cloud architecture
Extensive experience in at least one of the cloud platforms among Azure (Azure Data Factory, Databricks,
Sybase Analytics, Azure functions, Azure stream analytics) OR AWS (S3, lambda, glue, Quick sight,
EMR,EC2,Redshift ,Athena and Presto)
Hands-on experience in developing large scale distributed applications in either java or python programming
language
Hands-on experience in either one of the real time streaming applications- KAFKA OR Azure event hub OR
AWS Kinesis
Advanced SQL programming skills
Design DWH model, ensuring data design follows the prescribed reference architecture framework while reflecting appropriate business rules built for logical, physical and conceptual model.
Experience in performance tuning of complex ETL mappings for relational and non-relational workloads
Well versed with relational and no-Sql databases like MySQL, PostgreSQL, Mongo DB and Cassandra
Hands-on experience in migration from on-premise systems to cloud.

Good to have
Hands-on experience on microservice architecture
Knowledge on spring boot framework
Knowledge on developing scalable web applications
Developing distributed applications using cloud platforms.

Mandatory skill sets

Pyspark, SQL, Databricks

Preferred skill sets

Pyspark, SQL, Databricks

Years of experience required

5 - 8