Big Data Developer

• Your key responsibilities

Key Responsibilities / Tasks:

• Strong Solution Design Capability
• Develop and unit-test,
• Integrate, deploy, maintain and improve software
• Perform peer code review
• Actively participate into the squad activities and ceremonies e.g. daily stand-up/scrum meeting
• Actively participate and Dev chapter lead activities
• Apply continuous integration best practices in general (SCM, build automation, unit testing, dependency management)
• Collaborate with other squad members to achieve the Squad/Sprint objectives
• Report progress/update Agile team management tools (JIRA/Confluence)
• Manage individual task priorities and deliverables
• Responsible for quality of solutions the candidate provides
• Contribute to planning and continuous improvement activities,
• Support the PO, Analyst and Scrum Master

Your skills and experience

Experience 5+ Years

• Big data developer with strong programming skills in both functional and OOP: Scala / Java. Desired experience in distributed architectures or cloud.
• Passionate about big data technologies and the delivery of effective solutions through creative problem solving and willing to develop and expand skills and experience in DB.

Must have Skills

• Programming Languages: Strong programming skills in both functional and OOP: Scala / Java.
• Big Data Technologies: Extensive experience with Apache Spark, HDFS, Hive, Impala.
• Data Formats: Proficiency in working with file formats such as Avro and Parquet.
• Programming Principles: Expertise in functional programming and OOP design patterns.
• Distributed Architectures or Cloud: Experience in designing and managing distributed architectures or cloud-based solutions.

Nice to Have Skills

• Cloud Platforms: Familiarity with Google Cloud, BigQuery, DataProc, etc.
• Database Management: Knowledge of SQL and data warehousing.
• Spark Tuning: Experience with performance tuning in Spark.
• Workflow Management: Experience with Oozie and the Cloudera stack.
• Scripting: Proficiency in Shell/Bash scripting.
• Streaming Technologies: Experience with streaming technologies like Apache Beam, Spark Streaming, KStreams, and Flink.
• Monitoring and Logging: Knowledge of monitoring/logging/operations tools such as Splunk, Prometheus, Grafana, ELK, or the GCP stack for SRE.