Data Engineer - ETL/Python (5-7 yrs)

Job Title : Data Engineer-

Location : Bangalore, India-

Experience: 5-7 Years-

Job Summary :

We are seeking a skilled - Data Engineer- with - 5-7 years of experience- in designing, building, and maintaining data pipelines. The ideal candidate should have strong expertise in - Python and PySpark- , along with experience working with big data technologies and cloud platforms.

Key Responsibilities :

- Design, develop, and maintain scalable - ETL/ELT pipelines- for data ingestion and processing.

- Work with - PySpark- and - Python- to implement efficient data transformation logic.

- Optimize and troubleshoot - big data workflows- for performance and reliability.

- Collaborate with - Data Scientists, Analysts, and Business teams- to understand data requirements.

- Manage and process large-scale structured and unstructured datasets.

- Ensure - data quality, governance, and security- across all data pipelines.

- Work with - cloud platforms (AWS/Azure/GCP)- for data storage and processing.

- Monitor and improve - database performance, indexing, and query execution- .

Required Skills :

- Strong hands-on experience with - Python- and - PySpark- .

- Proficiency in - SQL- and relational databases.

- Experience with - big data frameworks- such as - Apache Spark, Hadoop- .

- Familiarity with - cloud-based data services- (AWS, Azure, GCP).

- Expertise in - ETL processes- and - data pipeline orchestration- .

- Strong problem-solving skills and ability to optimize data workflows.

Preferred Skills :

- Experience with - workflow orchestration tools- (Airflow, Luigi, etc.).

- Knowledge of - NoSQL databases- (MongoDB, Cassandra, etc.).

- Exposure to - Kafka, Kinesis, or similar streaming platforms- .

- Understanding of - data security and governance best practices- .

Educational Qualification :

- Bachelor's or Master's degree- in Computer Science, Information Technology, or a related field.

Why Join Us ?

- Opportunity to work on cutting-edge - big data projects- .

- Collaborative and growth-oriented work environment.

- Competitive compensation and - career development opportunities- .