Lead Data Engineer - Scala/Python (3-8 yrs)

Role : Lead Data Engineer

Kadel Labs is a first-of-its-kind Venture Studio in India. It is a global software technology system incubator with synergistic blend of IT Services and SaaS products under its portfolio. Since 2017, KL has grown organically (180+ employees and expanding) and served 200+ Customers. At the core, KL is a people's company. We serve clients by practicing an employee-centric culture and creating an environment where ideas, creativity, free-flowing communication and innovation is encouraged to create better products and services.

Experience : 5+years

Location : Udaipur/Jaipur

Job Description :

We are seeking a highly skilled Lead Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and optimizing data pipelines and architectures to support our growing data and analytics needs. You will work closely with data scientists, analysts, and software engineers to ensure efficient data flow, storage, and processing.

Responsibilities :

- Design, build, and maintain scalable, efficient, and reliable data pipelines.

- Develop and optimize ETL/ELT processes to transform raw data into usable formats.

- Implement data warehousing solutions and manage data lakes.

- Ensure data quality, consistency, and security across various platforms.

- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.

- Monitor and troubleshoot data pipeline performance issues.

- Optimize database queries and improve data retrieval times.

- Implement best practices for data governance, compliance, and security.

- Stay up-to-date with emerging trends and technologies in data engineering.

Requirements :

- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.

- 5+ years of experience in data engineering or a related role.

- Proficiency in programming languages such as Python, Java, or Scala.

- Strong experience with SQL and relational databases (e.g., PostgreSQL, MySQL, SQL Server).

- Hands-on experience with big data technologies (e.g., Hadoop, Spark, Kafka).

- Experience with cloud platforms such as AWS, Azure, or GCP (e.g., Redshift, BigQuery, Snowflake).

- Knowledge of data modeling, ETL frameworks, and data warehouse design.

- Familiarity with CI/CD pipelines and DevOps practices for data engineering.

- Strong problem-solving skills and ability to work in an agile environment.

Preferred :

- Experience with real-time data processing and streaming technologies.

- Knowledge of machine learning pipelines and AI-driven analytics.

- Understanding of data governance, privacy regulations (GDPR, CCPA), and security best practices.

- Experience with containerization and orchestration tools (Docker, Kubernetes, Airflow).

Life @KL :

- Work on pioneering technology that has real-world impact, from urban planning to disaster response.

- Be part of a creative, innovative team that values diversity of thought and expertise.

- Enjoy a flexible working environment that encourages in-person collaboration while supporting remote work when necessary.

- Benefit from a culture that supports growth, learning, and personal development

- Lead from the front : We're constantly pushing the envelope to redefine what's possible. We make huge breakthroughs, rapidly advancing our technology and the industry as a whole. It's what we do.

- Make an impact : We hire rockstars who are passionate about creating the future of "spatial computing" and want nothing more than to have a meaningful impact on turning our vision into reality.

- Break down barriers : Our products are designed to dissolve barriers between humans and creating technology that serves all of humanity.

- No matter where you're based, or which team you work on, you'll be part of a group of people working together to build solutions to mission-critical problems and a company that values the very best ideas.

Ready to make a difference? Apply now and help us build the future of planetary-scale digital twin technology.