Softpath Technologies - Software Engineer - Azure Databricks (4-6 yrs)

Job Title: Software Engineer - Data Bricks

Location: Pune (Work from Office)

Total Experience: 4 to 6 Years

Notice Period: Immediate to 15 Days (Serving notice period candidates will be considered)

Project Type: Contract

Contract Duration: Minimum 6 Months to 1 Year

Job Description:

We are seeking a highly skilled Software Engineer with a strong background in Data Engineering and Databricks to join our dynamic team in Pune. This role involves building robust and scalable data solutions and applications, developing APIs, and working extensively with data pipelines and flows. As part of an agile development environment, you will be responsible for delivering high-quality code and collaborating with cross-functional teams. If you are passionate about data engineering, cloud technologies, and developing efficient solutions, this could be a great opportunity for you!

Key Responsibilities:

Data Solutions Development: Design, develop, and implement data applications and solutions using Databricks, including working with SQL/NoSQL databases and integrating Python, Java, Scala, and Spark.

Building Data Pipelines: Build and maintain complex Data Engineering pipelines and workflows using modern data engineering best practices and Infrastructure as Code (IaC).

API Development: Create APIs for seamless data exchange between systems and applications.

BI Tools Integration: Work with Business Intelligence tools like Power BI or Tableau for data visualization and reporting.

Cloud Technologies: Work with cloud platforms, ensuring effective management and processing of large-scale data in the cloud (preferably AWS, Azure, or GCP).

Agile Methodology: Work within an agile development environment, adhering to agile principles such as Test Driven Development (TDD), continuous integration, and iterative development cycles.

Collaboration: Work closely with cross-functional teams including data scientists, analysts, and business stakeholders to deliver data solutions that meet business requirements.

Customer Focus: Provide excellent customer service by understanding the customer's needs and ensuring the data solutions align with business goals.

Problem-Solving & Adaptability: Quickly adapt to new challenges and adjust work priorities to meet changing requirements and timelines in a dynamic environment.

Required Skills & Experience:

Databricks Expertise: Proven experience with Databricks for data engineering, processing, and analysis.

Programming Skills: Solid proficiency in Python, Java, Scala, and Spark for building data solutions and APIs.

Database Experience: Experience working with SQL/NoSQL databases for data storage and retrieval.

BI Tools: Hands-on experience with Power BI, Tableau, or similar tools for data visualization and reporting.

Cloud Infrastructure: Familiarity with cloud-based data processing (AWS, Azure, or GCP).

Data Pipelines: Experience in building, maintaining, and optimizing data pipelines using modern technologies like Spark, Databricks, or similar tools.

Agile Development: Strong experience working in Agile environments, using principles like Test Driven Development (TDD) and Continuous Integration (CI).

Excellent Communication Skills: Strong verbal and written communication skills, with the ability to present technical details to non-technical stakeholders.

Problem-Solving: Strong analytical and problem-solving skills, with the ability to troubleshoot complex issues and offer effective solutions.

Customer Service: Excellent interpersonal skills with a focus on providing high-quality customer service and client satisfaction.

Preferred Qualifications:

Certifications: Databricks certifications or other relevant cloud certifications (AWS, Azure, or GCP).

Big Data Experience: Familiarity with big data technologies and ecosystems such as Hadoop, Spark, Kafka, etc.

Test Driven Development (TDD): Strong understanding and experience with TDD practices and tools.

Agile Tools: Experience using Agile project management tools (e.g., Jira, Confluence, or similar).

Key Competencies :

- Adaptability to new technologies and tools

- Strong collaboration and teamwork capabilities

- Ability to work independently and take ownership of projects

- Strong attention to detail and commitment to quality

- Effective time management and ability to meet deadlines in a fast-paced environment