Data Engineer | Immediate Joiner

Infilon is looking for an experienced Data Engineer for one of its clients Elisa Polystar.

The Data Engineer is responsible for delivery, manipulating, maintaining, improving, and cleaning set of input data to the business operational or analytics databases. The description entails working along with other data engineers/analyst, data analytics team and data warehouse engineer to understand and support in implementing needed database requirements. The data engineer is also expected to resolve existing issues.

The Data Engineer is responsible includes overseeing the data pipeline, designing, developing, and integrating different databases. They must also ensure that data is secure and properly organized.

Location: Ahmedabad

Work Experience: 3+ years

Basic Requirements

• Proficiency in data modeling and database management.
• Strong programming skills particularly in Python
• Proficiency in tools like Apache Spark, Hadoop, and ETL frameworks.
• Knowledge in Kafka and Redis
• Solid Experience with ETL (Extract, Transform, Load) processes.
• Experience in version control systems like Git.
• Solid Experience in creating DAG flow(Airflow)
• Understanding API, API Query and RestAPI
• Familiarity with data warehousing and cloud platforms (e.g., AWS, Azure, or Google Cloud).
• Experience working with relational databases as well as working familiarity with a variety of databases.
• Experience building and optimizing big data data pipelines, architectures, and data sets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
• Familiar in using Regular Expression (RegEx).
• Good understanding and experience in XML.
• Knowledge on Linux Commands particularly file handling and text manipulation commands.
• Strong problem-solving and analytical abilities.
• Eagerness to learn and adapt to new data technologies and tools.

Nice to Have

• Experience in Elastic Kibana.
• Experience in any Business Intelligence application.
• A successful history of manipulating, processing, and extracting value from large, disconnected datasets.
• Working knowledge of message queuing, stream processing, and highly scalable big data data stores.
• Strong project management and organizational skills.
• Experience supporting and working with cross-functional teams in a dynamic environment.

Whats in it for you?

• Opportunity to work autonomously while being part of a dynamic team.
• Tackling daily a wide range of challenges, across multiple customers and continuously growing and expanding your expertise.
• Eternal respect from your colleagues as you improve the system.