Azure Bigdata Specialist

Company Description Bosch Global Software Technologies Private Limited is a 100% owned subsidiary of Robert Bosch GmbH, one of the worlds leading global supplier of technology and services, offering end-to-end Engineering, IT and Business Solutions. With over 22, 700 associates, it s the largest software development center of Bosch, outside Germany, indicating that it is the Technology Powerhouse of Bosch in India with a global footprint and presence in the US, Europe and the Asia Pacific region. Job Description Overall, 4 to 8 years of experience in IT Industry. Min 4 years of experience working on Data Engineering using Azure Databricks, Synapse, ADF/Airflow. At least 3 Project experience in Building and maintaining ETL / ELT pipelines for large data sets, complex data processing, transformations, business logics, cost monitoring & performance optimization, and feature engineering processes. Must Have skills: Extensive experience with Azure Databricks (ADB), Delta Lake, Azure Data Lake Storage (ADLS), Azure Data factory (ADF), Azure SQL Database (SQL DB), SQL, ELT / ETL Pipeline Development in Spark based environment. Extensive Experience with SparkCore, PySpark, Python, SparkSQL, Scala, Azure Blob Storage. Experience in Real-Time Data Processing using Apache Kafka/EventHub/IoT, Structured Streaming and Stream analytics. Experience with Apache Airflow for ELT Orchestration. Experience with infrastructure management, Infrastructure as code (e. g. Terraform)Experience with CI/CD, Version control tools like GitHub, Azure DevOps. Experience with Version control tools, building CI/CD pipelines. Experience with Azure cloud platform. Good to have: Experience / Knowledge on Containerizations - Docker, Kubernetes Experience working in Agile Methodology Qualifications Qualifications - BE, MS, M. Tech or MCAAdditional Information Certifications: Azure Big Data, Databricks Certified Associate