Data Engineer II - Python Programming (2-9 yrs)

Job Title : Data engineer II

Job location : Bangalore

Experience : 3+ years

About the Client: A leading global technology company specializing in e-commerce, cloud computing, and digital streaming services. The client is known for their innovative data solutions and cutting-edge technology infrastructure, offering an opportunity to work with the latest tools and technologies in the industry.

Responsibilities :

Data Infrastructure Management :

- Design, implement, and maintain data warehouse/data lake infrastructure utilizing AWS big data stack.

- Ensure seamless integration and scalability of data systems.

AWS Technologies Expertise :

- Work with AWS services such as Redshift, S3, and AWS Glue for data storage, transformation, and processing.

- Optimize data management processes in the AWS ecosystem.

Data Modeling & ETL Pipeline Development :

- Design and implement data models to support efficient warehousing and processing.

- Build and manage ETL pipelines to extract, transform, and load data from various sources.

Essential Job Functions :

Data Modeling & Warehousing :

- In-depth experience in designing and building data models.

- Implement robust data warehousing strategies to store and organize large volumes of data.

ETL Pipeline Development :

- Develop and optimize ETL pipelines to ensure efficient data processing.

- Work with various data sources and integrate them into the data warehouse environment.

Technical Skills :

- Strong proficiency in Python and SQL for data processing and manipulation.

- Experience with AWS Redshift, S3, and AWS Glue for cloud-based data solutions.

Infrastructure Maintenance & Best Practices :

- Experience with maintaining and optimizing cloud-based infrastructure.

- Follow best coding practices, focusing on clean, maintainable code, and documentation.

Qualifications :

- Experience : 3+ years working in data engineering or a related field.

Skills :

- Proficiency in Python and SQL.

- Strong experience with AWS services (Redshift, S3, AWS Glue).

- Proven ability in data modeling, data warehousing, and building ETL pipelines.

About VARITE :

VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 1000 Companies in USA, CANADA and INDIA. VARITE is currently a primary and direct vendors to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.