Python Programmer + Data Engineer

Job Description:

Python

• Good understanding of Python and its ecosystem, including advanced programming techniques, libraries, frameworks, and best practices
• Areas include
• Connecting and sourcing data from multiple kind of data sources
• Python + Databricks integration
• Coding skills (well aware of classes, objects, loops, dictionary ,etc)
• Experienced with working with python modules like numpy, pandas, re, scipy, etc.
• Experience in build and package a Python application using the Wheel format
• Python data transformations

PySpark/Databricks

• Pyspark functions and control operations
• Transformations (aggregation, functions, joints)
• Aware of managing Databricks job clusters, performance optimizations
• Secrets Management

Azure

• Familiarity with Azure services
• Azure Key Vaults
• Azure Data Lake
• Azure DevOps

Github

• Github source management

Database

• SQL/ oracle/ PostgreSQLRole & responsibilities