Data Engineer

- 6-8 years of experience in Data Engineering
- Proven expertise in delivering analytics solutions in manufacturing, logistics, and transportation
- Technical expertise in Big Data technologies, distributed computing, and Spark clusters
- Strong programming skills in Python, Py-Spark, and SQL
- Experience with cloud-based storage, relational and NoSQL databases, and BI toolsTechnical Skills:

Data engineering implementation experience with Big Data technologies in cloud and on-prem environments.

Proficiency with big data technologies managing large data sets, databases, data lakes and cloud-based storage.

Expertise in managing and optimizing Spark clusters, along with other implementations of Spark.

Strong programming skills in Python, Py-spark

Strong proficiency in SQL and experience with relational databases (PostgreSQL, MySQL, Oracle, etc.) and NoSQL databases (MongoDB, Cassandra, DynamoDB).

Experienced on the software development using services such as AWS Glue, S3, Lambda, Spark in hyperscaler AWS.

Knowledge of data modeling techniques such as star/snowflake, data vault etc.,

Knowledge of semantic modeling

Familiarity with BI Tools such as Power BI, Oracle Analytics Cloud, etc.,