Data Engineer - Java/Python (4-7 yrs)

Job Description :

We are seeking talented Data Engineers with expertise in Data & Analytics to join Xenspire/NTT Data for exciting projects. The ideal candidates will have strong experience in building, optimizing, and maintaining scalable data pipelines and infrastructure while ensuring data quality and governance.

Key Responsibilities :

- Design, build, and maintain scalable and reliable data pipelines to process large volumes of structured, semi-structured, and unstructured data from diverse sources.

- Develop ETL processes to ingest, transform, and load data into data warehouses, ensuring data quality, integrity, and consistency.

- Collaborate with stakeholders, report developers, and data scientists to understand data requirements and translate them into technical solutions.

- Optimize the performance and efficiency of data infrastructure, including storage, processing, and querying.

- Implement data governance policies to ensure compliance, security, and privacy of sensitive data.

- Troubleshoot data-related issues, identify root causes, and deliver timely solutions.

- Stay updated with the latest technologies and tools in the data engineering domain.

Basic Qualifications :

- Bachelor's degree in Technology or a related field.

- 4+ years of experience as a Data Engineer with a strong track record in designing and implementing data solutions.

- Proficiency in programming languages such as Python or Java, with experience in building data pipelines and workflows.

- Hands-on experience with cloud platforms like AWS, Azure, or Google Cloud Platform.

- Expertise in cloud data warehousing technologies such as Snowflake or Redshift.

- Familiarity with distributed computing frameworks like Cloudera, Apache Hadoop, and Spark.

- Experience with AWS services such as S3, EC2, EMR, Glue, CloudWatch, Athena, and Lambda.

- Strong knowledge of database concepts, data modeling, schemas, and query languages like SQL and Hive.

- Hands-on experience with containerization and orchestration tools like Docker and Kubernetes.

- Experience with CI/CD pipelines using tools like GitLab or Bitbucket.

- Familiarity with data pipeline orchestration tools such as Airflow and Jenkins.

Additional Skills (Good to Have) :

- Knowledge of data visualization tools such as MicroStrategy, Tableau, and Power BI.

- Familiarity with data quality and monitoring tools like Great Expectations or similar.

- Experience with data governance tools such as Datahub or equivalent for lineage, cataloging, and dictionaries.

- Experience with streaming data processing technologies like Kafka.

- Background in the retail domain is a plus.

Why Join Us :

- Work on cutting-edge data engineering projects with a dynamic team.

- Be part of a collaborative and innovative environment.

- Opportunity to transition into a long-term role after the contract period.