Blue Cloud - Data Engineer - GenAI (5-10 yrs)

A Data Engineer with a focus on AI is responsible for designing and implementing data pipelines that support machine learning and AI initiatives. Key skills include proficiency in data processing frameworks, programming languages like Python and SQL, and familiarity with AI workflows to ensure data quality and accessibility for analytics and model training.

Job Title : Data Engineer with Python/PySpark, Databricks, SQL & AI

Location : Remote

Job Description :

We are seeking a skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have strong hands-on experience with Databricks, Python/PySpark, and SQL, and will play a crucial role in developing and optimizing data pipelines and analytics projects, with a strong emphasis on AI integration.

Key Responsibilities :

Data Pipeline Development : Design, develop, and optimize data pipelines to ensure efficient data flow and processing, specifically tailored for AI applications.

Analytics Projects : Collaborate with cross-functional teams to build and implement data solutions that support analytics initiatives and machine learning models.

AI Integration : Work on data solutions that facilitate AI workflows, ensuring data quality and accessibility for model training and evaluation.

Team Collaboration : Engage with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality solutions.

Performance Optimization : Monitor and enhance the performance of existing data solutions, ensuring scalability and reliability for AI-driven projects.

Preferred Qualifications :

Technical Skills :

- Proficiency in Databricks for data engineering tasks.

- Strong coding skills in Python and PySpark for data manipulation and processing.

- Solid experience with SQL for querying and managing databases.

AI Exposure : Familiarity with AI workflows and initiatives is essential. Understanding of machine learning concepts and processes will be beneficial for integrating AI into data solutions.

Ideal Candidate Profile :

Problem Solver : Comfortable coding and optimizing data solutions to meet business needs, particularly in the context of AI applications.

Collaborative Team Player : Thrives in a team-oriented environment, contributing to collective goals and sharing knowledge with peers.

Adaptable Learner : Open to learning new technologies and methodologies in the evolving data landscape, especially in AI and machine learning.

If you are passionate about data engineering and eager to contribute to innovative data solutions that leverage AI, we would love to hear from you!