Senior Data Engineer - Python (4-8 yrs)

Role And Responsibilities :

- Strong technical, analytical, and problem-solving skills

- Strong organizational skills, with the ability to work autonomously as well as in a team-based environment

- Data pipeline framework development

Technical Skills Requirements :

- The candidate must demonstrate proficiency in data processing and extraction

- Ability to own and deliver on large, multi-faceted projects

- Fluency in complex SQL and experience with RDBMSs

- Project Experience in Spark, PySpark, Scala, Python, NiFi, Hive, NoSql DBs)

- Experience designing and building big data pipelines

- Experience working on large scale, distributed systems

- Experience working on any Bigquery would be added advantage

- Strong hands-on experience of programming language like PySpark, Scala with Spark, Python.

- Exposure to various ETL and Business Intelligence tools

- Experience in shell scripting to automate pipeline execution.

- Solid grounding in Agile methodologies

- Experience with git and other source control systems

- Strong communication and presentation skills