Kellton - Big Data Developer - Distributed Data Processing Framework (8-10 yrs)

About Kellton :

Kellton Tech is a publicly listed, CMMI Level 5, and ISO 9001:2015 certified global company, providing cutting-edge digital transformation solutions and services in strategy, consulting, digital, and technology.

With our service vision "Infinite Possibilities with Technology" and specialized digital transformation skills across all business functions, we work at the intersection of business and technology to deliver sustainable business value to our clients.

We have a global workforce of 1400 employees who work with clients-startups, SMBs, and Fortune 500 businesses-to drive innovation and deliver on our promises to stakeholders.

Key Responsibilities :

- Design, develop, and deploy data pipelines and data processing applications using big data technologies.

- Develop and maintain data ingestion and transformation processes, including data cleaning, validation, and enrichment.

- Build and optimize data models and schemas for high-performance data warehousing and analytics.

- Develop and maintain real-time data streaming applications using technologies like Kafka, Spark Streaming, or Flink.

- Work with cloud-based data services, such as AWS S3, EMR, Redshift, Glue, and Kinesis.

- Develop and maintain data quality checks and monitoring systems.

- Collaborate with data scientists to support data exploration, analysis, and model development. Troubleshoot and resolve data-related issues.

- Stay abreast of the latest advancements in big data technologies and best practices. Mentor junior team members and provide technical guidance.

Requirements :

- Overall 8+ years of IT experience with 5+ years in Data related technologies, and expertise of 3+ years in data-related AWS Cloud services.

- Have 3+ years of experience in ClickHouse or any other OLAP system.

- Expert in programming languages like Java/ Scala and good at Python.

- Worked on at least one distributed data processing framework: Spark (Core, Streaming, SQL), Storm or Flink, etc.

- Strong understanding of data warehousing principles, data modeling techniques, and data quality best practices.

- Experience with SQL and NoSQL databases.

- Experience with data visualization and reporting tools (e.g., Tableau, Power BI).

- Excellent problem-solving, analytical, and communication skills.

- Ability to work independently and as part of a team.

Bonus Points :

- Experience with containerization technologies like Docker and Kubernetes.

- Experience with machine learning and deep learning frameworks.

- Experience with Agile development methodologies.

- Relevant certifications (e.g., AWS Certified Big Data - Specialty)