Data Engineer

Job Description:

Data Engineer is required to be proactive in designing, building, and maintaining data systems. We are hiring for one of our clients and the role also requires cross-functional collaborations and ensuring the highest standards of data quality and performance by extending his expertise in data engineering, data architecture, pipeline creation, and big data technologies.

Responsibilities:

• Understand the values and vision of the organization
• Protect the Intellectual Property
• Adhere to all the policies and procedures
• Design, develop, and maintain scalable data pipelines for data ingestion, processing and storage.
• Build and optimize data architectures and models for efficient storage and retrieval.
• Develop ETL processes to transform and load data from various sources into data warehouses and data lakes.
• Ensure data integrity, quality, and security across all data systems.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
• Monitor and troubleshoot data pipelines and workflows to ensure high availability and performance.
• Document data processes, architectures, and data flow diagrams.
• Implement and maintain data integration solutions using industry-standard tools and technologies (e.g., Apache Spark, Kafka, Airflow).

Essential Skills:

• Expertise in Data Integration, processing & Storage.
• Expertise in Data optimization architecture, data process and data flow.
• Knowledge of Data integration tools like Apache Spark, Kafka & Airflow.
• Proficiency in SQL and at least one programming language (e.g., Python, Scala).
• Experience with cloud data platforms (e.g., AWS, Azure, GCP) and their data services.
• Experience with data visualization tools (e.g., Tableau, Power BI).
• Excellent communication and interpersonal skills, with the ability to engage with all levels of employees and management.
• A collaborative approach to effectively present and advocate for quick design solutions.
• Stay updated on the latest design trends, tools, and technologies, bringing innovative ideas to enhance the product experience.
• A proactive approach to problem-solving, with a focus on delivering exceptional customer satisfaction.

Preferred Skills:

Job

• Strong knowledge of data management, processing, Architecture and design.
• Sound knowledge of data integration tools like Apache Spark, Kafka & Airflow.
• Identify and resolve customer challenges with a focus on providing high-quality

service and solutions.

Personal

• Demonstrate proactive thinking
• Strong communication and collaboration skills.
• Should have strong interpersonal relations, expert business acumen and mentoring skills
• Strong problem-solving skills with attention to detail.
• Have the ability to work under stringent deadlines and demanding client conditions.
• Strong analytical and problem-solving skills.
• Ability to work independently and as part of a team.

Other Relevant Information

• Bachelors degree in Computer Science, Information Technology, or a related field.
• Minimum 3 years of experience in data engineering & architecture.
• This role offers the flexibility of working remotely in India.