Data Engineer

Orion Innovation has an exciting opportunity for a Data Engineer role, I've mentioned a brief job description below.

Location: Chennai , Mumbai, Pune, Coimbatore, Hyderabad, Kochi

Exp: 8-12 years

Role & responsibilities

• 10+ years of relevant technical/technology experience, with a strong emphasis on GenAI projects
• Python Proficiency: Minimum 3 years of hands-on experience building applications with Python
• Scalable System Design: Solid understanding of designing and architecting scalable Python applications, particularly for Gen AI use cases, with a strong understanding of various components and systems architecture patterns to make cohesive and decoupled, scalable applications.
• Web Frameworks: Familiarity with Python web frameworks (Flask, FastAPI) for building web applications around AI models.
• Modular Design & Security: Demonstrated ability to design applications with modularity, reusability, and security best practices in mind (session management, vulnerability prevention, etc.,).
• Cloud-Native Development: Familiarity with cloud-native development patterns and tools (e.g., REST APIs, microservices, serverless functions).
• Cloud Deployments: Experience deploying and managing containerized applications on Azure/AWS (Azure Kubernetes Service, Azure Container Instances, or similar).
• Version Control (Git): Strong proficiency in Git for effective code collaboration and management.
• CI/CD: Knowledge of continuous integration and deployment (CI/CD) practices on cloud platforms.
• 3-5 years of relevant technical/technology experience, with a focus on GenAI projects.
• Strong programming skills in Python.
• Experience with data processing frameworks like Apache Spark or similar.
• Proficiency in SQL and database management systems.
• Lead the design, development, and maintenance of robust data pipelines and ETL processes for GenAI projects.
• Direct the development and governance of data lakes, ensuring effective management of large volumes of structured and unstructured data.
• Lead the integration of LLM frameworks (such as Langchain and Semantic Kernel) to advance language processing and analytical capabilities.
• Preferred Skills:
• Gen AI Frameworks: Experience with LLM frameworks or tools for interacting with LLMs such as LangChain, Semantic Kernel, LlamaIndex
• Data Pipelines: Experience in setting up data pipelines for model training and real-time inference.

Please share your CV's at nimisha.s@orioninc.com.