Sr. data engineering analyst

The position is for data Engineering role responsible for the design, development and maintenance of data pipelines. The position creates technical design, develop, test and implement data solutions for the batch and streaming solutions.

Candidates with a strong desire to learn a multitude of technologies and programming languages with a can-do attitude will thrive in this role. The position requires problem-solvers able to work in a fast-paced, collaborative office environment alongside other engineers and developers.

What You'll Be Doing:

• Designing, Developing, optimizing, and maintaining data pipelines for both batch and streaming data solutions.
• Develop and testing of backend services using SQL, Python/Java, Databricks, ADF
• Work with SQL and NoSQL databases to manage data effectively.
• Work with Kafka or similar technologies to create streaming solutions.
• Deploy containerized applications using Docker and Kubernetes on cloud platforms.
• Maintain secure, high-quality code and follow best practices in an Agile environment.
• Condensing complex requirements into specific and measurable test objectives

• Minimum of 4+ years of development experience
• Significant experience of building data solutions using SQL, Azure, Databricks, Python/Java.
• Experience working on at least one RDBM ( e.g. PostgreSQL, Tera Data, SQL Server, Oracle and NoSQL databases
• Knowledge and Exposure of streaming solution like Kafka
• Experience with DevOps (Jenkins/Kubernetes/Github actions)
• Experience on Agile / Scrum Teams

• Familiarity with AI Coding tools like GitHub CoPilot