Home
Communities
Companies
- Companies
  
  Discover best places to work
- Compare Companies
  
  Compare & find best workplace
- Add Office Photos
  
  Bring your workplace to life
- Add Company Benefits
  
  Highlight your company's perks
Reviews
- Company reviews
  
  Read reviews for 6L+ companies
- Write a review
  
  Rate your former or current company
Salaries
- Browse salaries
  
  Discover salaries for 6L+ companies
- Salary calculator
  
  Calculate your take home salary
- Are you paid fairly?
  
  Check your market value
- Share your salary
  
  Help other jobseekers
- Gratuity calculator
  
  Check your gratuity amount
- HRA calculator
  
  Check how much of your HRA is tax-free
- Salary hike calculator
  
  Check your salary hike
Interviews
- Company interviews
  
  Read interviews for 40K+ companies
- Campus placements
  
  Interviews questions for 2K+ colleges
- Share interview questions
  
  Contribute your interview questions
Jobs
Awards

WINNERS AWAITED!
- ABECA 2025
  
  WINNERS AWAITED!
  
  AmbitionBox Employee Choice Awards - 4th Edition
- ABECA 2024
  
  AmbitionBox Employee Choice Awards - 3rd Edition
- AmbitionBox Best Places to Work 2022
  
  2nd Edition
- AmbitionBox Best Places to Work 2021
  
  1st Edition

For Employers

Add office photos

Engaged Employer

RARR Technologies

Compare

4.5

based on 31 Reviews

1004 RARR Technologies Jobs

Data Engineer/ Databricks

RARR Technologies

4.5

based on 31 Reviews

7-12 years

Remote

1 vacancy

Data Engineer/ Databricks

RARR Technologies

posted 20d ago

Job Role Insights

Flexible timing

Key skills for the job

Computer Science Data Analytics Python Computer Networking SQL Automation Testing

+ 4 more

Job Description

Hands-on experience in Azure Cloud services, Networking Concepts, Security - Cloud and on-premises system, Deployment using Azure DevOps, Azure Cloud Monitoring and Cost controls and Terraform - hands-on experience
CI/CD Pipeline Management: Design, implement, and manage Continuous Integration/Continuous Deployment (CI/CD) pipelines using Azure DevOps and GitHub. Ensure the pipelines are efficient, reliable, and scalable.
Infrastructure as Code (IaC): Automate the provisioning and management of infrastructure, with a focus on Azure Databricks and Azure Data Factory in a private network environment, using tools like Terraform and ARM templates.
Environment Management: Create and manage development, testing, and production environments, ensuring consistency, security, and alignment with organizational requirements.
Security: Implement security best practices throughout the CI/CD pipeline, including secrets management, secure code scanning, and compliance with security standards.
Monitoring & Logging: Set up and maintain monitoring and logging for applications and infrastructure using Azure Monitor, Log Analytics, and related tools to ensure system reliability and performance.
Automation: Identify opportunities for automation to streamline processes, reduce manual errors, and improve operational efficiency.
Policy Enforcement: Establish and enforce policies such as branch policies, pull request reviews, and pipeline approvals to maintain code quality and compliance with organizational standards.
Manage and maintain Azure Databricks Platform, workspaces, clusters, and jobs
Oversee user administration including access controls and permissions
Handle library installations, runtime management, and policy enforcement
Implement/analyze cost control measures
Administer Unity Catalog for data governance and security
Collaborate with data engineers, data scientists, and analysts to optimize and streamline data workflows, and analytical pipelines on the Databricks platform
Manage Azure storage solutions, including Blob Storage and Data Lake Storage
Administer Azure Key Vault for secure storage of secrets and keys
Configure and manage Azure Data Factory for data integration and ETL processes
Implement and manage VNETs, firewalls, Azure policies and security best practices
Set up budgets and alerts to monitor and control Azure costs and spend
Configure alerts for proactive issue detection and resolution
Databricks Lakehouse Monitoring

Minimum Qualifications

Minimum of Bachelors degree in Computer science, Information systems, or Engineering
Experience: 7+ years of professional experience in DevOps, with a strong focus on Azure. Knowledge of Data Platforms like Databricks, Data Factory (preferred)
Proficiency in scripting languages such as Python/PySpark, PowerShell, or Bash
Experience in automating administrative tasks and workflows
Knowledge of security best practices and compliance requirements
Experience with ETL processes, data pipelines, and big data technologies
Experience with backup and restore procedures for Databricks and Azure services
Ability to troubleshoot and resolve issues in a timely and efficient manner
Strong verbal and written communication skills
Ability to document processes, procedures, and configurations clearly
Commitment to providing high-quality support to internal/external users and stakeholders
Ability to understand and address the needs of internal and external customers
Team player with the ability to work collaboratively with cross-functional teams
Flexibility to adapt to changing requirements and priorities
Offshore data engineer with Databricks ML (leverage Python skill to train as needed).
Continuous Learning: Eagerness to learn new technologies and continuously improve skills to stay current in a rapidly evolving field.

Preferred Qualifications

Offshore data engineer with Databricks ML (leverage Python skill to train as needed).
Deep understanding of Databricks architecture, features, and best practices
Experience with Delta Lake and Databricks SQL for advanced data management
Experience in performance tuning and optimization for both Databricks and Azure environments
Experience supporting/administering data science and ML workloads in Databricks
Knowledge of disaster recovery planning and implementation
Experience integrating Databricks with other data platforms and tools
Understanding of hybrid and multi-cloud environments
Experience implementing data protection measures and ensuring regulatory compliance

Data Bricks, Machine Learning, Cicd, Adf, Adb

Employment Type: Full Time, Permanent

Read full job description

Prepare for Data Engineer roles with real interview advice