Data Engineer

PySpark, ANSI SQL, HDFS, Hive, Python, Scala, Java, Airflow, Any ETL tool, Shell Scripts, Control-M, Git, CI & CD, Unix File System, RDBMS
Empirical understanding of data systems (BI analytics, data blending, data warehousing, data ETL, etc.) on process automation and standardization

Good experience in requirement gathering/ analysis, coding, Unit testing, SIT Support
Knowledge working on both Agile and waterfall models
Develop end to end framework
4+ Years of relevant Experience in ETL and Data Engineering
Strong Knowledge in Spark, Python
Strong experience in Hive/SQL, PL/SQL
Good Understanding of ETL & DW Concepts, Unix Scripting
Design, implement and maintain Data Pipeline to meet the business requirements.
Convert the Business need into Technical complex PySpark Code.
Ability to write complex SQL queries for reporting purpose.
Strong written and verbal communication, and proficiency in reporting analysis tools.

Understanding of any ETL tool
Understanding of any BI tool
Cloud Computing AWS/AzureGood understanding of SDLC
Core Compliance Domain knowledge
Experience in the Agile Scrum Methodology