Add office photos

InvitusData

Compare

No reviews yet

1 InvitusData Job

Data Engineer

InvitusData

1-4 years

Chennai

1 vacancy

Data Engineer

InvitusData

posted 5d ago

Key skills for the job

+ 3 more

Role: Data Engineer Location: Chennai

Roles & Responsibilities

Design, Develop and implement ETL data pipelines that load data into an information product that helps the organization in reaching strategic goals.
Work on ingesting, storing, cleansing, processing and analyzing large data sets from heterogeneous data sources.
Finalizing the scope of the system and delivering Big Data solutions.
Translate complex technical and functional requirements into detailed designs.
Schedule, orchestrate and Implement data pipelines and processes that scale with increase in data volume.
Investigate and analyze alternative solutions to data storing, processing etc. to ensure most streamlined approaches are implemented.
Collaborate with business consultants, data scientists, and application developers to develop analytics solutions.
Help define data governance policies and support data versioning processes.
Maintain security & data privacy working closely with the Data Protection Officer internally.
Analyze a vast number of data stores and uncover insights.
Create data tools for business team members that assist them in analysis that gives them the competitive edge.
Monitor data application performance for potential bottlenecks and resolve performance issues.
Identify and implement cost-saving strategies to reduce ongoing Big Data and Cloud costs/expenses.

Skills & Qualifications

Strong understanding of Data Warehousing concepts and data modeling techniques and columnar databases.
Strong Hands on experience in Data Analysis, preprocessing and validation of the engineered dataset in SQL/NoSQL databases.
Hands-on Experience in data cleansing,processing and loading using Big-data tools mainly (Py)Spark and Hive/Presto.
Exposure to any workflow scheduling & Orchestration tools Airflow/Prefect/SQS would be helpful.
Comfortable working with any programming/scripting language like Python(Preferred)/Scala/Shell scripting.
Strong data engineering skills on any Cloud Platform is essential(Preferred: AWS).
Exposure to data lake and data lake house would be an added advantage.
Solid Understanding of data structures and algorithms.
Knowledge of distributed/MPP systems pertaining to data storage and computing.
Ability to effectively communicate with both business and technical teams.
Good interpersonal skills and positive attitude.
Experience in working with agile methodology in a fast paced environment.