Lead ETL Specialist - Data Ingestion Pipelines (8-10 yrs)

Position summary :

This is an exciting opportunity for an experienced developer of large-scale data plumbing solutions. We are seeking someone with good experience in building solutions using data plumbing (ETL) tools and a proven track record in delivering high quality work to tight deadlines.

You will be responsible for :

- Designing and implementing highly performant data ingestion pipelines from multiple sources using latest tools (Apache Airflow , Apache NiFi, mage.ai , Apache Spark etc.

- Delivering and presenting proofs of concept to of key technology components to project stakeholders.

- Developing scalable and re-usable frameworks for ingesting of data sets.

- Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained.

- Working with event based / streaming technologies to ingest and process data.

- Working with SQL Query Engines like Dremio, Trino. Presto etc.

- Expertise in SQL, Python, scala languages to be used in notebooks.

- Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.

Competencies :

The position must have the following competencies:.

- Strong Communication.

- Building trust.

- Decision making / problem solving.

- Delegating Responsibility.

- Customer / client focus.

- Initiatives.

- Planning & Organizing.

- Managing Stress levels at critical times.

- Technical / professional knowledge.

- Team Player.

- Troubleshooting skills in Azure Databricks.

What you'd have :

- B.E/B.Tech

- Strong knowledge of Data Management principles.

- Experience in building ETL / data warehouse transformation processes.

- Direct experience of building data pipelines using latest tools ( Apache Airflow, Apache NiFi, Apache Spark etc).

- Experience using associated design and development patterns.

- Hands on experience designing and delivering solutions using the data plumbing tools.

- Experience with Apache Kafka / Nifi for use with streaming data / event-based data.

- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J).

Why join us :

- Impactful Work : Play a pivotal role in safeguarding Tanla's assets, data, and reputation in the industry.

- Tremendous Growth Opportunities: Be part of a rapidly growing company in the telecom and CPaaS space, with opportunities for professional development.

- Innovative Environment: Work alongside a world-class team in a challenging and fun environment, where innovation is celebrated.

Tanla is an equal opportunity employer :

We champion diversity and are committed to creating an inclusive environment for all employees.