AppSierra Solutions - Apache Druid Developer - Data Ingestion (4-12 yrs)

Description :

We are seeking a highly skilled Apache Druid Developer with extensive experience in data ingestion processes, particularly leveraging technologies such as Kafka, HDFS, and S3. In this role, you will be responsible for designing, developing, and maintaining robust Druid clusters to support our analytics and data visualization initiatives.

Our ideal candidate will have a strong background in big data technologies and a passion for improving data pipelines and architectures to ensure high performance and reliability. As a key member of our data engineering team, you will contribute to data model design, implement ingestion workflows, and optimize query performance.

You will collaborate with cross-functional teams to ensure that our data architecture is aligned with business needs and that our Druid setup is tuned for optimal performance. If you thrive in a fast-paced environment and have a knack for problem-solving, we invite you to apply for this exciting opportunity to be at the forefront of our data analytics transformation.

Responsibilities :

- Design and develop data ingestion processes using Kafka to funnel real-time data into Apache Druid.

- Manage and optimize Druid cluster configurations for performance and availability.

- Implement data ingestion tasks using HDFS and S3 for batch data processing.

- Collaborate with data engineering teams to establish data integration and transformation workflows.

- Monitor Druid cluster performance and troubleshoot technical issues as they arise.

- Develop and maintain documentation for ingestion processes and cluster configurations.

- Assess and recommend improvements for existing data infrastructure to enhance scalability and reliability.

Requirements :

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- Proven experience working with Apache Druid and its ecosystem for at least 2 years.

- Strong expertise in data ingestion tools and frameworks, especially Kafka.

- Experience with distributed storage systems such as HDFS and Amazon S3.

- Solid understanding of SQL and data modeling concepts.

- Familiarity with monitoring and troubleshooting Druid cluster performance issues.

- Ability to work collaboratively in a team environment and communicate effectively.