Understanding of Big Data Engineering/processing, Business Intelligence and Advanced analytics
Developing ETL/ELT processes
Knowledge in databases and Data warehouse modeling
Knowledge in Cloud based data engineering and Machine Learning Models
Knowledge in building APIs for application integration
Experience with various frameworks and processes, such as Agile
Determine transformation requirements and develop processes to bring structured and unstructured data from the source to a new physical Data Model
Work with Data Scientists to implement strategies for cleaning and preparing data for analysis, to develop data imputation algorithms, and optimize performance of big data and machine learning systems
Above average skills in:
Big Data Engineering and Processing using Hadoop stack (Hadoop, Hive, HDFS, Spark and HBase etc)
Develop ETL/ELT processing using Apache Ni-Fi
Strong background on SQL and databases
Programming Skills in Python or Scala
Data Analysis and Validation skills
Demonstrated ability to:
Work in a dynamic, fast-paced, work environment
Self-motivated with the ability to work under minimal direction
To adapt to new technologies and learn quickly
A passion for data and information with strong analytical, problem solving, and organizational skills
Work in multi-functional groups, with diverse interests and requirements, to a common objective
Communicate very well with distributed teams (written, verbal and presentation)
Education and Experience:
bachelors degree in computer science, Engineering, or a related field.
2+ years of experience in data engineering, with a strong background in data architecture and ETL processes.