Big data technologies (Hadoop data lakes ),SQL, scripting languages (Python, Shell scripting), CI/CD, working Knowledge on Spark/Java/Python Description We are looking for a technically skilled Senior Developer for Big Data development to help prevent financial crime to the benefit of our customers, societies and Danske Bank. You have hands on experience in PySpark, Hadoop, Tableau and SQL Server development covering all phases from design and build to deploy and run You have great technical skills within the ETL development area You have a good knowledge of creating solutions that follow industry-standard regarding usability, performance, reliability, and scalability You are experienced in and understanding of DevOps principles and practices (e.g., CI/CD pipelines)
Primary Skills:
Python,PySpark, ETL, HDFS, SQL, SQL , CICD on AWS, Airflow on Prem
Secondary Skills:
Good Python Coding Skill, SQL, Data Modeling, Advance level of Spark
Requirements Required Proficiency: Advanced
SQL , Pyspark, CICD on AWS, Data engineering, Airflow on Prem Good to have skill: API development(data ingestion using APIs (REST/gRPC)) , Airflow on AWS Kafka, Scala