Data Engineer - Python/Apache NiFi (3-5 yrs)

Responsibilities :

- Analyze and organize raw data

- Build data systems and pipelines (Apache Nifi)

- Evaluate business needs and objectives

- Interpret trends and patterns

- Conduct complex data analysis and report on results

- Prepare data for prescriptive and predictive modeling

- Build algorithms and prototypes

- Combine raw information from different sources

- Explore ways to enhance data quality and reliability (Spark)

- Airflow to schedule and execute py-spark job.

- Identify opportunities for data acquisition

- Develop analytical tools and programs

- Collaborate with data scientists and architects on several projects

Requirements and skills :

- 2-3 year of experience as a data engineer

- Technical expertise with data models, data mining, and segmentation techniques

- Knowledge of programming languages (e.g. Java and Python)

- Hands-on experience with SQL database design

- Great numerical and analytical skills

- Bachelor Degree in Computer Science, IT, or similar field; a Master's is a plus

- Data engineering certification (e.g IBM Certified Data Engineer) is a plus