Leuwint Technologies - Senior Big Data Engineer - ETL/Spark (5-10 yrs)

We are looking for Senior Big Data Engineers to join our team immediately, responsible for designing, developing, maintaining, and implementing large-scale data processing systems for the Sherlock platform. In this role, you will collaborate closely with cross-functional teams, including data scientists, software engineers, business analysts, and product managers, to ensure the successful deployment and scaling of our data infrastructure.

Requirements :

• A Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related field.
• Over 5 years of experience in Big Data engineering or a related discipline.
• Proficiency in programming languages such as Python, Java, or Scala.
• Extensive experience with Big Data technologies like Spark, Cassandra, and Kafka.
• Strong background in data modeling and database design for both structured and unstructured data.
• In-depth experience with data processing and ETL frameworks such as Apache NiFi, Airbyte, or Apache Beam.
• Solid experience in implementing data security and access control measures.
• Expertise in data quality and validation frameworks.
• Familiarity with monitoring and alerting systems for Big Data technologies.
• Experience with cloud-based Big Data platforms such as Databricks, AWS EMR, or Google Cloud Dataproc.
• Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams.