1,051 Data Pipeline Jobs

Role: Senior Member of Technical Staff

Experience: 4 to 9 years

Location: Manyata Tech Park, Bangalore

Work mode: Hybrid

Skills: Design Data Analytics, Data Engineering, Data Warehouse, Java, SQL, Spark & Spark-SQL, Autonomous Data Warehouse, Object Store, Data Flow/DIS (or similar tech stack), exposure to cloud

Short description :

Looking for a Software Developer (Data Engineer) who are willing to perform Data Engineering tasks with skills sets like SQL, Spark, Big Data Development, Java & Cloud experience.

Job description:

Design, develop, troubleshoot and debug software programs for databases, applications etc. Strong knowledge of SQL is required. You should be having programming experience in any of the Java, Python, Scala etc. You should have a good understanding of the data, so that you can perform the data engineering tasks which involves analyzing the data, doing required transformations and loading the data into the Data Warehouse.

The Reporting and Visualizations knowledge is a very key for this role. You should be able to develop some visualizations using reporting tools when needed. The experience of development in Cloud like working on processing nodes, storing the data in Object Store buckets, knowledge of databases and performance tuning of data engineering pipelines (batch and real time) is very much needed. Deployment of code in Cloud environment is a required skill.

You should have an experience in Agile development. You should be able to perform the Continuous Integration and Continuous deployment of the code we develop.

Responsibilities:

As a member of the software engineering division, you will apply basic to intermediate knowledge of software architecture to perform software development tasks associated with developing, debugging or designing software applications or operating systems according to provided design specifications. Build enhancements within an existing software architecture and occasionally suggest improvements to the architecture.