Databricks Engineer - SQL/Python/ETL (4-7 yrs)

Job Summary :

We are seeking an experienced Databricks Engineer to join our team. The ideal candidate will have a deep understanding of data engineering with minimum of 3+ years of experience. The role will require deep knowledge of data engineering techniques to create data pipelines and build data assets.

Key Responsibilities:

-At least 4+ years of Strong hands on programming experience with Pyspark / Python / Boto3 including Python Frameworks, libraries according to python best practices.

-Strong experience in code optimisation using spark SQL and pyspark.

-Understanding of Code versioning ,Git repository , JFrog Artifactory.

-AWS Architecture knowledge specially on S3, EC2, Lambda, Redshift, CloudFormation etc and able to explain benefits of each.

-Code Refactorization of Legacy Codebase: Clean, modernize, improve readability and maintainability.

-Unit Tests/TDD: Write tests before code, ensure functionality, catch bugs early.

-Fixing Difficult Bugs: Debug complex code, isolate issues, resolve performance, concurrency, or logic flaws.

Role Requirements & Qualifications:

-Design and implement scalable data pipelines and ETL processes on Databricks.

-Optimize existing code using Spark SQL and PySpark to improve performance and resource utilization.

-Ability to work in a fast-paced environment and deliver robust, scalable solutions.

-Strong problem-solving skills and analytical mindset.