Big Data Engineer Consultant I

As a Big Data Engineer, you will be responsible for the design, implementation, Security and on- going support of Scality data storage. You will partner with Data Scientists as well as product stakeholders to create an advanced analytics eco-system.

Obtain an overall understanding of data and processes
Partner with the Product Owner on requirements and brainstorm implementation options
Participate in planning session to determine technical designs and estimates
Develop and deliver solutions using Big Data/Spark tools and technologies
Collaborate effectively with other teams (internal and external) in a very dynamic agile environment
Learn new tools and implement continuous improvements in support of the Products strategic visionKey Responsibilities

Partners closely with team members on Big Data solutions for our data science community and analytic users

Partners with 360F teams on Big Data efforts

Executes moderately complex functional work tracks for the team

Contributes to the development of moderately complex prototypes and department applications that integrate big data and advanced analytics to make business decisions

Develops innovative solutions to Big Data issues and challenges within the team

Contributes to the development of moderately complex technical solutions using Big Data techniques in data & analytics processes

Leverages and uses Big Data best practices / lessons learned to develop technical solutions

Understands the Big Data related problems and requirements to identify the correct technical approach

Uses new areas of Big Data technologies, (ingestion, processing, distribution) and research delivery methods that can solve business problems

Key Skills

Experience in Spark, Scala, Python, SQL, Unix, Kubernetes, Airflow. Preferable if experience in PowerBI and MS Fabric. Additionally, need to support oncall jobs during India day time on rotation basis.

4 year Bachelors Degree (Preferred)

2 or more years of experience (Preferred)