4 3colon33 Jobs
Data Engineer - ETL/Python (6-8 yrs)
3colon33
posted 20d ago
Flexible timing
Key skills for the job
As a Data Engineer, you will play a key role in designing, building, and optimizing data ecosystems for Omya's operational and cloud environments.
Your contributions will enable high-performance data pipelines, reliable data quality, and seamless integration of analytical and visualization layers.
You will collaborate with cross-functional teams to deliver innovative data solutions, ensuring compliance with governance, security, and business requirements.
This position also requires staying updated with emerging data technologies to drive continuous improvement.
Key Responsibilities :
Design & Implementation of Data Ecosystem :
- Build ETL/ELT processes and data pipelines.
- Develop data storage solutions, including databases, data lakes, and modern data warehouses.
- Design and implement data processing engines for pre-analytical layers.
- Establish orchestration and monitoring systems for data workflows.
- Enable analytical and visualization layers through effective data transportation and processing.
Data Quality & Reliability :
- Implement data quality checks, error handling, and monitoring mechanisms.
- Ensure pipeline reliability following industrial resiliency principles.
Optimization & Performance :
- Support RUN teams to enhance data performance and scalability while optimizing costs.
- Design and implement data APIs, catalogs, and microservices for enhanced accessibility.
Collaboration & Governance :
- Work with domains like Manufacturing, Supply Chain, Sales, Finance, and HR to support implementation needs.
- Adhere to data governance, compliance, security, and cybersecurity policies.
Documentation & Communication :
- Document data architecture, models, flows, and processes.
- Communicate solutions effectively with technical and non-technical stakeholders.
Continuous Improvement :
- Identify opportunities for automation and optimization in data workflows.
- Stay current with emerging technologies and evaluate their applicability.
Support & Troubleshooting :
- Assist RUN teams in resolving data issues and troubleshooting problems.
Skills and Qualifications :
Technical Proficiency :
- Experience in technologies like Google BigQuery, Pub/Sub, DataBricks, Microsoft Data Factory, SQL, Power BI, Docker, Kubernetes, Apache Airflow, Python, Java, and SAS.
- Familiarity with data orchestration, workflow management, and messaging systems.
- Knowledge of DevOps principles and the PLAN-BUILD-RUN model.
Certifications (Preferred) :
- At least one certification in data domains.
- Service Management certification (optional).
Soft Skills :
- Strong communication and presentation skills.
- Team-oriented with critical thinking and the ability to challenge the status quo.
- Self-directed and customer-centric attitude with a passion for innovation.
Other Requirements :
- Fluency in English (spoken and written).
- Willingness to travel up to 10%
Functional Areas: Software/Testing/Networking
Read full job descriptionPrepare for Data Engineer roles with real interview advice
5-8 Yrs
Bangalore / Bengaluru, Chennai, Pune +1 more