Pyspark Developer

Budget Range : 4 to 6 yrs 21 LPA/ 6 to 8 Yrs- 23 LPA/ 8 to 9 Yrs-25 LPA

Responsibilities:

• PySpark, ANSI SQL, HDFS, Hive, Python, Scala, Java, Airflow, Any ETL tool, Shell Scripts, Control-M, Git, CI & CD, Unix File System, RDBMS
• Empirical understanding of data systems (BI analytics, data blending, data warehousing, data ETL, etc.) on process automation and standardization
• Good experience in requirement gathering/ analysis, coding, Unit testing, SIT Support
• Knowledge working on both Agile and waterfall models
• Develop end to end framework
• 4+ years of relevant Experience in ETL and Data Engineering
• Strong Knowledge in Spark, Python
• Strong experience in Hive/SQL, PL/SQL
• Good Understanding of ETL & DW Concepts, Unix Scripting
• Design, implement and maintain Data Pipeline to meet the business requirements.
• Convert the Business need into Technical complex PySpark Code.
• Ability to write complex SQL queries for reporting purpose.
• Strong written and verbal communication, and proficiency in reporting analysis tools.