Lead ETL Specialist - Data Ingestion Pipelines (8-10 yrs)
Karix Mobile
posted 10d ago
Flexible timing
Key skills for the job
Position summary :
This is an exciting opportunity for an experienced developer of large-scale data plumbing solutions. We are seeking someone with good experience in building solutions using data plumbing (ETL) tools and a proven track record in delivering high quality work to tight deadlines.
You will be responsible for :
- Designing and implementing highly performant data ingestion pipelines from multiple sources using latest tools (Apache Airflow , Apache NiFi, mage.ai , Apache Spark etc.
- Delivering and presenting proofs of concept to of key technology components to project stakeholders.
- Developing scalable and re-usable frameworks for ingesting of data sets.
- Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained.
- Working with event based / streaming technologies to ingest and process data.
- Working with SQL Query Engines like Dremio, Trino. Presto etc.
- Expertise in SQL, Python, scala languages to be used in notebooks.
- Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.
Competencies :
The position must have the following competencies:.
- Strong Communication.
- Building trust.
- Decision making / problem solving.
- Delegating Responsibility.
- Customer / client focus.
- Initiatives.
- Planning & Organizing.
- Managing Stress levels at critical times.
- Technical / professional knowledge.
- Team Player.
- Troubleshooting skills in Azure Databricks.
What you'd have :
- B.E/B.Tech
- Strong knowledge of Data Management principles.
- Experience in building ETL / data warehouse transformation processes.
- Direct experience of building data pipelines using latest tools ( Apache Airflow, Apache NiFi, Apache Spark etc).
- Experience using associated design and development patterns.
- Hands on experience designing and delivering solutions using the data plumbing tools.
- Experience with Apache Kafka / Nifi for use with streaming data / event-based data.
- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J).
Why join us :
- Impactful Work : Play a pivotal role in safeguarding Tanla's assets, data, and reputation in the industry.
- Tremendous Growth Opportunities: Be part of a rapidly growing company in the telecom and CPaaS space, with opportunities for professional development.
- Innovative Environment: Work alongside a world-class team in a challenging and fun environment, where innovation is celebrated.
Tanla is an equal opportunity employer :
We champion diversity and are committed to creating an inclusive environment for all employees.
Functional Areas: Other
Read full job descriptionPrepare for Karix Mobile roles with real interview advice
Nothing as such now
New VP of engineering in Bangalore has created environment of job security fear among engineers with his impulsive and sarcastic discussions.
Karix Mobile Pvt. Ltd.
8-10 Yrs
5-10 Yrs
NEXTLINK TECHNOLOGIES INDIA PRIVATE LIMITED
3-5 Yrs
Hyderabad / Secunderabad