Lead DataOps Engineer

Role & responsibilities -

• Minimum 10 years of experience in data analytics field
• Minimum 6 years of experience in running operation and support in Cloud Data Lakehouse environment
• Experience with Azure Databricks
• Experience in building and optimizing data pipelines, architectures and data sets
• Excellent experience in Scala or Python
• Ability to troubleshoot and optimize complex queries on the Spark platform
• Knowledgeable on structured and unstructured data design / modeling, data access and data storage techniques

Experience with DevOps tools and environment

Technical / Professional Skills -

• Azure Databricks
• Python / Scala / Java
• HIVE / HBase / Impala / Parquet
• Sqoop, Kafka, Flume
• SQL and RDBMS
• Airflow
• Jenkins / Bamboo
• Github / Bitbucket

Nexus

Perks and benefits