Full Stack Engineer

Project Role :Full Stack Engineer


Project Role Description :Responsible for developing and/or engineering the end-to-end features of a system, from user experience to backend code. Use development skills to deliver innovative solutions that help our clients improve the services they provide. Leverage new technologies that can be applied to solve challenging business problems with a cloud first and agile mindset.

Must have skills :Scala


Good to have skills :NA
Minimum
5 year(s) of experience is required


Educational Qualification :15 years full time education

Summary:We are seeking a Data Engineer with expertise in Scala to develop and manage data workflows, artifacts, and job runs. This role will focus on integration testing builds and optimizing data processing within our Dataproc service.Key Responsibilities:A.Data Management:1.Develop and manage data pipelines using Scala for processing and transforming data efficiently.2.Ensure high data quality and reliability.B.Artifact Management:1.Oversee the creation and maintenance of Scala-based scripts and artifacts.2.Handle version control and deployment of Scala artifacts.C.Setup and Configuration:1.Set up and configure Dataproc clusters for Scala-based processing tasks.2.Manage Scala job configurations, including tuning for optimal performance.D.Job Runs and Monitoring:1.Schedule and monitor Scala jobs, ensuring they run effectively and efficiently.2.Address performance issues and optimize job execution.E.Integration Testing:1.Develop and perform integration tests for Scala pipelines to ensure they meet project requirements.2.Work with development and QA teams to align testing with project goals.Required Skills and
Qualifications:1.Proficiency in Scala and Spark with hands-on experience.2.Experience with Dataproc or similar cloud data services.3.Strong SQL skills and understanding of data structures.4.Problem-solving abilities and excellent communication skills.5.Bachelor's degree in Computer Science, Data Science, Engineering, or a related field.Preferred
Qualifications:1.Experience with additional data processing tools.2.Certification in cloud-based data engineering or related fields.


Qualifications
15 years full time education