Senior Data Engineer

• Learn how to use Synapse, Databricks, Azure Events Hub, and Azure Data Lake, and contribute to the development of a data analytics platform and support that makes data sharing and access simple and standardized
• Demonstrate your ability to ingest and transform real-time data to serve our use cases
• Integrate governance, quality data capabilities, and technologies to ensure data consistency
• Ensure the transformation backlog is delivered for source systems, derived tables, and data products
• Work together with other senior and lead engineers to produce new products and support BAU activities
• Perform detailed data analysis and report results
• Debug BAU-related issues, create JIRA issues, and work on process improvement
• Support your ideas and share your knowledge with your teammates
• Participate in on-call situations to assist with any catastrophic failures
• Take part in the on-call schedule for production support
• Ensure that Ad hoc data requests and production difficulties are supported

Job Requirements:

• Bachelor s/Master s degree in Engineering, Computer Science (or equivalent experience)
• At least 8+ years of relevant experience as a data engineer
• 8+ years of experience working with Azure Databricks
• 5+ years of experience with SQL and Spark
• 9+ years of relevant experience working in the trading/financial services industry
• Familiarity working with ETL, Python, and Azure Data Lake is desirable
• Nice to have some experience working with PySpark and Azure Eventhub
• Some Data Engineering certification like Azure Data Engineer or Google Certified Professional, is preferred
• Excellent design skills for data pipelines, ETL processes, data warehousing, and big data processing
• Possess practical knowledge of Azure Synapse and Azure SQL
• Extensive Python framework programming experience
• Prior experience with business data processing and analytics systems.
• some familiarity with the fundamentals of enterprise data modeling
• In-depth knowledge of real-time development
• Excellent political knowledge, and communication abilities
• Outstanding ability to determine priorities
• Excellent debugging and problem-solving abilities
• Fluent in spoken and written English