Manager / Data Engineer-Data Architect

Qualification:
B.Tech ( EE,CSE,ECE , IT ) from Top Technology Institute.

Job Responsibility :

- Big Data Architect Solutions, Data Design, Data construction, installation, test and maintain highly scalable data management systems.

- Ensure systems meet business requirements and industry practices

- Build high-performance algorithms, prototypes, predictive models, and proof of concepts

- Research opportunities for data acquisition and new uses for existing data

- Develop data set processes for data modeling, mining, and production

- Integrate new data management technologies and software engineering tools into existing structures

- Create custom software components (e.g. specialized UDFs) and analytics applications

- Employ a variety of languages and tools (e.g. scripting languages) to marry systems together

- Install and update disaster recovery procedures

- Recommend ways to improve data reliability, efficiency, and quality

- Collaborate with data architects and IT team members on project goals.

- Data engineers will be work closely with the data architects (to determine what data management systems are appropriate) and data scientists (to determine which data are needed for analysis).

- Managing complex problems associated with database integration and messy, unstructured data sets.

- The ultimate aim is to provide clean, usable data to whoever may require it.

Technical Skills Required:

- Statistical analysis and modeling.

- Database architectures.

- Hadoop-based technologies (e.g. MapReduce, Hive, and Pig) and Big data technologies such as Spark to forecast and recommend improvements based on how the data is consumed.

- Hadoop map-reduce, Postgre SQL, MySQL, SQL, NoSQL DB: MongoDB Cassandra Redisneo4J, Scala /Python /Spark /Cassandra Hbase, Enterprise architecture, Visio-Data API, Data Ingest, ETL Tools, Unstructured, Semi-Structured, Structured Data modeling and management, Data warehousing.

- Collect,manage,analyse & Visualise Data.

- Build, and deploy Data Infrastructure & Data Architecture.

- Data Road map, Data Analysis, Data Deployment, and Integration.

- SQL-based technologies (e.g. PostgreSQL and MySQL)

- NoSQL technologies (e.g. Cassandra and MongoDB)

- Data modeling tools (e.g. Er Win, Enterprise Architect, and Visio)

- Python, C/C++ Java, Perl.

Experience :
3-15 years working as a Data Architect Manager / Senior Big Data Engineer / Senior Data Engineer with relevant experience in the above skill set in a reputed Big Database Data Science is driven software product development startup.