Wissen Technology is now hiring Data Engineer ( Python + Spark + AWS)
We are seeking a highly skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have over 4 years of experience in data engineering, with a strong proficiency in Python and Spark. A solid understanding of ML Ops, ML Flow, K-level (clustering or similar algorithms), Hadoop, and on-premise machine learning (ML) infrastructure is highly desirable
Exp erience 5 - 10 years
Location: Bangalore / Mumbai
Notice period- Immediate to currently serving notice period.
Requirements:
- Bacheloror Masterdegree in Computer Science , Information Technology, Data Science, or a related field. - 4+ years of experience in data engineering.
- Strong proficiency in Python and Spark.
- Understanding of ML Ops practices, including ML Flow.
- Familiarity with k-means clustering or similar machine learning algorithms.
- Experience with big data technologies like Hadoop.
- Knowledge of on-premise ML infrastructure.
- Excellent problem-solving and analytical skills.
- Strong communication and teamwork abilities.
Must have skills :
1. Data Pipeline Development: o Design , develop, and maintain scalable data pipelines using Python and Spark. o Implement ETL (Extract, Transform, Load) processes to integrate data from various sources into data warehouses and data lakes. o Good understanding of data warehousing and data management concepts including OLTP, OLAP, Dimensional Modelling, star/snowflake schemas
2. Big Data Management: o Work with big data technologies like Hadoop to manage and process large volumes of data. o Optimize data storage and retrieval processes to enhance system performance and efficiency. o Implement and manage data partitioning, indexing, and other optimization techniques.
3. Machine Learning Operations (ML Ops): o Collaborate with data scientists to deploy machine learning models in production environments. o Implement ML Flow for tracking and managing the lifecycle of ML models. o Ensure models are scalable, reliable, and maintainable within on-premise or cloudbased infrastructure. o Utilize clustering and other machine learning algorithms to analyze and interpret complex data sets.
4. Collaboration and Communication: o Work closely with cross-functional teams, including data scientists, analysts, and IT professionals, to deliver comprehensive data solutions. o Communicate technical concepts and project status to non-technical stakeholders effectively. o Gather and analyze requirements from business stakeholders to ensure data solutions align with organizational goals.
About Wissen Technology:
The Wissen Group was founded in the year 2000. Wissen Technology, a part of Wissen Group, was established in the year 2015. Wissen Technology is a specialized technology company that delivers high-end consulting for organizations in the Banking & Finance, Telecom, and Healthcare domains. We help clients build world class products.
We offer an array of services including Core Business Application Development, Artificial Intelligence & Machine Learning, Big Data & Analytics, Visualization & Business Intelligence, Robotic Process Automation, Cloud Adoption, Mobility, Digital Adoption, Agile & DevOps, Quality Assurance & Test Automation.
Over the years, Wissen Group has successfully delivered $1 billion worth of projects for more than 20 of the Fortune 500 companies. Wissen Technology provides exceptional value in mission critical projects for its clients, through thought leadership, ownership, and assured on-time deliveries that are always first time right .
The technology and thought leadership that the company commands in the industry is the direct result of the kind of people Wissen has been able to attract. Wissen is committed to providing them with the best possible opportunities and careers, which extends to providing the best possible experience and value to our clients.
We have been certified as a Great Place to Work company for two consecutive years (2020-2022) and voted as the Top 20 AI/ML vendor by CIO Insider. Great Place to W ork Certification is recognized world over by employees and employers alike and is considered the Gold Standard . Wissen Technology has created a Great Place to Work by excelling in all dimensions - High-Trust, High-Performance Culture, Credibility, Respect, Fairness, Pride and Camaraderie.