No of years experience 8 + years Jid Desciption Need to have total 5 + years of work experience Pyspark Knowledge Hands-on experience in SQL, HDFS, Hive, Spark, Pyspark and Python
good understanding of Hadoop and Spark architectures
good understanding of Partitions and Bucketing concepts in Hive
Good understanding data and data processing by using SQL or Pyspark
good experience of writing code on Python and Pyspark
Knowledge on data science concepts like python programming, Data preparation
good experience on Databricks with Azure and Pyspark notebook development