Data Engineer

Responsibilities :-

Analyze and organize raw data
Build data systems and pipelines (Apache Nifi)
Evaluate business needs and objectives
Interpret trends and patterns
Conduct complex data analysis and report on results
Prepare data for prescriptive and predictive modeling
Build algorithms and prototypes
Combine raw information from different sources
Explore ways to enhance data quality and reliability (Spark)

Airflow to schedule and execute py-spark job.
Identify opportunities for data acquisition
Develop analytical tools and programs
Collaborate with data scientists and architects on several projects

Requirements and skills:-

2-3 year of experience as a data engineer
Technical expertise with data models, data mining, and segmentation techniques
Knowledge of programming languages (e.g. Java and Python)
Hands-on experience with SQL database design
Great numerical and analytical skills
Bachelor Degree in Computer Science, IT, or similar field; a Master s is a plus
Data engineering certification (e.g IBM Certified Data Engineer) is a plus