Azure Databricks

Must have skills - Azure DataBricks, Python And Pyspark, Spark.

Please find the JD In the mail chain

Expert level understanding of distributed computing principles

Expert level knowledge and experience in Apache Spark

Hands on experience in Azure - Databricks , Data Factory, Data Lake store/Blob storage, SQL DB

Experience in creating Big data Pipelines with Azure components

Hands on programing with Python

Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop

Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming

Experience with messaging systems, such as Kafka or RabbitMQ

Good understanding of Big Data querying tools, such as Hive, and Impala

Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files

Good understanding of SQL queries, joins, stored procedures, relational schemas

Experience with NoSQL databases, such as HBase, Cassandra, MongoDB

Knowledge of ETL techniques and frameworks

Performance tuning of Spark Jobs

Experience with designing and implementing Big data solutions.