Expert Data Engineer

Description

Ciklum is looking for an Expert Data Engineer to join our team full-time in India.

We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4, 000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.

About the role:

As an Expert Data Engineer, become a part of a cross-functional development team engineering experiences of tomorrow.

Responsibilities

• Responsible for the building, deployment, and maintenance of mission critical analytics solutions that process data quickly at big data scales
• Contributes design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction, transformation, and loading across multiple data storages
• Owns components of the engineering infrastructure and works to continually improve it, identifying gaps and improving the platform s quality, robustness, maintainability, and speed
• Cross-trains other team members on technologies being developed, while also continuously learning new technologies from other team members
• Interacts with engineering teams and ensures that solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliability
• Performs development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions
• Works directly with business analysts and data scientists to understand and support their use-cases
• Contribute in the Unit s activities and community building, participate in conferences, provide excellence in exercise and best practices
• Help in sales activities, customer meetings and digital services

Requirements

We know that sometimes, you can t tick every box. We would still love to hear from you if you think you re a good fit!

• 5+ years of experience coding in SQL, Java, Python, Scala, with solid CS fundamentals including data structure and algorithm design
• 3+ years contributing to production deployments of large backend data processing and analysis systems as a team lead
• 2+ years of hands-on implementation experience working with a combination of the following technologies: Hadoop, Map Reduce, Pig, Hive, Impala, Spark, Kafka, Storm, SQL and NoSQL data warehouses such as Hbase and Cassandra
• 3+ years of experience in cloud data platforms (AWS, Azure, GCP)
• Detailed knowledge and understanding of Data Governance process definition, development and deployment. This should include data quality, security and other data management standards & practices
• Demonstrable experience in leading development teams including managing the teams backlog and assigning tasks to team members, leading on maintaining development standards & the peer review process
• Ability to work on and manage multiple projects simultaneously while adapting to changing priorities in a fast-paced environment
• Knowledge of SQL and MPP databases (e. g. Vertica, Netezza, Greenplum, Aster Data)
• Knowledge of professional software engineering best practices for the full software
• Knowledge of Data Warehousing, design, implementation and optimization
• Knowledge of Data Quality testing, automation and results visualization
• Knowledge of BI reports and dashboards design and implementation (PowerBI, Tableau)
• Knowledge of development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
• Experience participating in an Agile software development team, e. g. SCRUM
• Experience designing, documenting, and defending designs for key components in large distributed computing systems
• A consistent track record of delivering exceptionally high-quality software on large, complex, cross-functional projects
• Demonstrated ability to learn new technologies quickly and independently
• Understanding of cloud infrastructure design and implementation
• Undergraduate degree in Computer Science or Engineering from a top CS program required. Masters preferred
• Experience with supporting data scientists and complex statistical usecases highly desirable

Desirable

• Experience in data science and machine learning
• Experience in backend development and deployment
• Experience in CI/CD configuration
• Good knowledge of data analysis in enterprises
• Experience with Databricks, Snowflake
• Experience with Kubernetes

What's in it for you

• Care: your mental and physical health is our priority. We ensure comprehensive company-paid medical insurance, as well as financial and legal consultation
• Tailored education path: boost your skills and knowledge with our regular internal events (meetups, conferences, workshops), Udemy licence, language courses and company-paid certifications
• Growth environment: share your experience and level up your expertise with a community of skilled professionals, locally and globally
• Flexibility: hybrid work mode at Chennai or Pune
• Opportunities: we value our specialists and always find the best options for them. Our Resourcing Team helps change a project if needed to help you grow, excel professionally and fulfil your potential
• Global impact: work on large-scale projects that redefine industries with international and fast-growing clients
• Welcoming environment: feel empowered with a friendly team, open-door policy, informal atmosphere within the company and regular team-building events