Lead ETL Specialist

JD: Lead - ETL Specialist 

Location Hyderabad

Position summary: 

This is an exciting opportunity for an experienced developer of large-scale data plumbing solutions. We are seeking someone with good experience in building solutions using data plumbing (ETL) tools and a proven track record in delivering high quality work to tight deadlines.

You will be responsible for?

• Designing and implementing highly performant data ingestion pipelines from multiple sources using latest tools (Apache Airflow , Apache NiFi, mage.ai , Apache Spark etc.)
• Delivering and presenting proofs of concept to of key technology components to project stakeholders.
• Developing scalable and re-usable frameworks for ingesting of data sets
• Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained
• Working with event based / streaming technologies to ingest and process data
• Working with SQL Query Engines like Dremio, Trino. Presto etc.
• Expertise in SQL, Python, scala languages to be used in notebooks.
• Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.

Competencies: The position must have the following competencies:

• Strong Communication
• Building trust
• Decision making / problem solving
• Delegating Responsibility
• Customer / client focus
• Initiatives
• Planning & Organizing
• Managing Stress levels at critical times
• Technical / professional knowledge
• Team Player
• Troubleshooting skills in Azure Databricks.

Knowledge and Skill set:

• B.E/B. Tech/MCA with 8-10 years of experience in Data pipelines Development.
• Strong knowledge of Data Management principles
• Experience in building ETL / data warehouse transformation processes
• Direct experience of building data pipelines using latest tools ( Apache Airflow, Apache NiFi, Apache Spark etc)
• Experience using associated design and development patterns.
• Hands on experience designing and delivering solutions using the data plumbing tools
• Experience with Apache Kafka / Nifi for use with streaming data / event-based data
• Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

Why join us?

• Impactful Work: Play a pivotal role in safeguarding Tanla's assets, data, and reputation in the industry. 
• Tremendous Growth Opportunities: Be part of a rapidly growing company in the telecom and CPaaS space, with opportunities for professional development. 
• Innovative Environment: Work alongside a world-class team in a challenging and fun environment, where innovation is celebrated. 

Tanla is an equal opportunity employer. We champion diversity and are committed to creating an inclusive environment for all employees.

www.tanla.com