i
The Digital Group Infotech
31 The Digital Group Infotech Jobs
Data Engineer - ETL (5-10 yrs)
The Digital Group Infotech
posted 27d ago
Flexible timing
Key skills for the job
Job Description :
- 5-10 years of experience in Solution, Design and Development of Cloud based data models, ETL Pipelines and infrastructure for reporting, analytics, and data science.
- Experience working with Spark, Hive, HDFS, MR, Apache Kafka/AWS Kinesis.
- Experience with version control tools (Git, Subversion).
- Experience using automated build systems (CI/CD).
- Experience working in different programming languages (Java, python, Scala).
- Experience working with both structured and unstructured data.
- Strong proficiency with SQL and its variation among popular databases.
- Ability to create the data model from scratch.
- Experience with some of the modern relational databases.
- Skilled at optimizing large, complicated SQL statements.
- Knowledge of best practices when dealing with relational databases.
- Capable of configuring popular database engines and orchestrating clusters as necessary.
- Ability to plan resource requirements from high level specifications.
- Capable of troubleshooting common database issues.
- Experience of Data Structures and algorithms.
- Knowledge of different databases technologies (Relational, NoSQL, Graph, Document, Key-Value, Time Series, etc.).
- Knowledge of ML model deployment.
- Knowledge of Cloud based platforms (AWS).
- Knowledge of TDD/BDD.
- Strong desire to improve upon their skills in software development, frameworks, and technologies.
Functional Areas: Software/Testing/Networking
Read full job descriptionPrepare for Data Engineer roles with real interview advice
I got to work on the new technologies that are being used in ecosystem today. As it has many small project we get to explore more and trending technologies. Job security is very much followed here. Small team sizes and if you like small/medium scale companies then it is a good company to be in.
As there are mostly small projects, there is risk of project being pulled out by client due to cost cutting scenario so don't get much time into diving deeper into projects knowledge and technologies being used. In-depth knowledge and lack of participation on process improvement within the project as clients are too involved or controls the project completely.
Read 1 review