Data Pipeline Engineer (4-5 yrs)

Job Title : Data Pipeline Engineer

Location : Bangalore

Experience : 4-5 Years

About the Role :

Are you a skilled Data Pipeline Engineer looking to take your career to the next level? Join our dynamic team and work on cutting-edge data engineering solutions in a fast-paced environment! You'll have the opportunity to design, implement, and optimize data pipelines that drive business insights and decision making. With a focus on scalability and performance, you'll collaborate closely with cross-functional teams to streamline data processes.

Key Responsibilities :

- Design, develop, and maintain efficient and scalable data pipelines for real-time and batch data processing.

- Utilize Python and SQL to handle complex data transformations and automate workflows.

- Leverage AWS cloud services (S3, Lambda, RDS, etc.) for seamless data integration, storage, and processing.

- Create, integrate, and manage REST APIs to enable smooth data flow between systems and applications.

- Ensure data quality, performance tuning, and monitoring of the data pipeline infrastructure.

- Collaborate with data scientists, analysts, and other engineers to deliver end-to-end data solutions.

Skills and Qualifications :

- Strong programming skills in Python for data manipulation and scripting.

- Advanced knowledge of SQL for querying, transformation, and optimization.

- Hands-on experience with AWS services for cloud-based data solutions.

- Proficient in developing and integrating REST APIs.

- Exposure to Docker and Kubernetes for containerization and orchestration is a plus.

- Excellent problem-solving skills and the ability to work in an agile environment.