Data Engineer

Please be advised that this will be a Support Data Engineer.

DUTIES/RESPONSIBILITIES

• Be a key part of Momentums Data strategy by developing the next-gen Dynamic Data Engineering framework
• Lead and enhance data lake platform acquiring additional data sources - structured and unstructured
• Lead the reporting data structure design and oversee the design phases of the projects assuring that design conforms to established architecture design guidelines and standards
• Develop and deliver long-term goals for data architecture standards
• Create short-term tactical solutions to achieve long-term objectives and data management roadmap
• Ensure the success of enterprise-level application roll-outs; connect vendors and providers to select products and services that meet the company's goal
• Develop highly scalable and extensible Big Data platform which enables collection, storage, modeling, and analysis of massive data sets from numerous channels
• Be an active part in analyzing and constantly learning the latest Big Data Analytic technologies and their innovative applications in both business intelligence analysis and new service offerings, adopt and implement these insights and best practices

EXPERIENCE & SKILLS

• 2-3 years of relevant experience in Data Engineering / Analytics domain with at least 1 year in Digital Analytics.
• 1-2 years of data analysis, data modeling and data management experience.
• Experience with building a data lake over Cloud / Azure, ADF, Synapse
• Strong experience with SQL and one other programming language ( Python/ .NET/ Java)
• Hands on Experience parsing NOSQL file systems such as JSON, XML, AVRO, Parquet.
• Proven track record of experience with Apache Spark Data Bricks or Synapse Analytics using Spark Clusters
• Exposure to traditional BI Tools (Tableau, Power BI, Qlik, SSRS, etc.)
• Drive projects that merge digital and transactional data for advanced analytics.
• Experience implementing Data Lake projects.
• Experience building web-services is a plus.
• Functional knowledge of financial instruments such as Installment Loans, Payday Loans and data domains such as loans, underwriting, collection, promotions, call center data, Fraud, etc.
• Good to have: Strong knowledge on Big Data technologies such as Data Bricks, Event driven data processing using Function Apps/Lambda.
• Must have Azure / Synapse, / ETL & ADF skills
• Understanding of Web services (SOAP, XML, UDDI, WSDL)
• Establish data quality control framework while sourcing data
• Data analysis using SQL is mandatory.
• Databricks Delta Lake, Well versed with Python scripting and use of libraries ( Numpy, Pandas )
• Tableau (preferred), Power BI, Qlik
• Analyze digital data generated and build visualizations.
• Experience in AI, BI and Data Lake projects.
• SQL Server / SSIS experience. Exposure to No SQL databases

QUALIFICATIONS

• BS in computer science, or related scientific field