Data Engineer

Team Overview

We are a cross-functional team of 6 whos responsibility is to work on new and existing products across the business which may be used by internal or external stakeholders. We have built some of our companys newest suite of products such as the EquiLend Competitive Bid which has features such as real-time data and depth of market. S ome of the products are used in BI reporting which facilitates decision making. Others are more real-time that helps traders to v iew KPI s to trade across multiple counterparties.

If you are a passionate Data Engineer based in Pune/Chandigarh, then we would love to hear from you!

Role Responsibilities

• Design and develop ETL data pipelines using Python on Spark.
• You will combine the discipline of software engineering with the knowledge and experience of building data solutions to deliver business value.
• As a data engineer, you ll help deploy data pipelines and processes in a production-safe manner
• Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility.
• Implement processes and systems to monitor data quality, ensuring production data is accurate and available.
• Work closely with all business units and engineering teams to develop a strategy for long-term data platform architecture.

Required Skills :

• 3+ years of relevant commercial experience.
• Have excellent knowledge of Python/PySpark or other Object-Oriented languages such as Scala or Java Experience
• Experience with scheduling and monitoring tools such as Airflow or similar.
• Advanced SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• A background in software development in high-volume environments.
• Worked with stream processing technologies (such as Kafka, Spark and AWS Kinesis)
• Working knowledge of AWS is highly desired, but not required,
• Thrive in a diverse, open and collaborative agile environment.

Role Location Benefits

• Hybrid Working: You can work remotely for up to 50 days each year.
• Discretionary Annual Cash Bonus: A discretionary cash bonus is available to reward your performance and contributions to the company s success.
• Generous Vacation Days Per Year: Take advantage of 30 vacation days annually, plus public bank holidays.
• Family Health Insurance Coverage: Comprehensive health insurance coverage for you and your dependents available from your first day.
• Personal Accidental Injury Insurance: Feel secure with personal accidental injury insurance provided from the start of your employment.
• Annual Team Building Retreat: Participate in an annual team-building retreat at a new and exciting location each year with a hackathon and the chance to bring ideas to reality!
• Relocation Assistance: If you re relocating from more than 40 miles away, we provide hotel accommodation and travel ticket reimbursement to help ensure a smooth transition.