AmbitionBox
Search
Jobs
- Reviews
- Salaries
- Interview Questions
- About Company
- Benefits
- Jobs
- Office Photos
- Community
Add office photos
All Filters
70 Providence College of Engineering Jobs
Senior Data Engineer
2-5 years
Hyderabad / Secunderabad
1 vacancy
Senior Data Engineer
Providence College of Engineering
posted 16hr ago
Job Role Insights
Key skills for the job
Job Description
- Develop and maintain metadata frameworks, standards, and processes to ensure consistent metadata management.
- Create, update, and manage metadata repositories or catalogs to document data assets and their lineage.
- Collaborate with data stewards to ensure metadata accuracy and completeness.
- Implement metadata-driven governance policies to enforce data quality, security, and compliance.
- Enable data discoverability and traceability by establishing and maintaining data lineage.
- Monitor compliance with regulatory requirements and governance policies using metadata insights.
- Partner with data architects, engineers, and business stakeholders to understand metadata requirements.
- Provide technical guidance on metadata tools, frameworks, and best practices.
- Facilitate workshops or training sessions to promote metadata utilization and governance practices.
- Design and implement processes to capture, integrate, and maintain metadata from diverse systems and tools.
- Automate metadata extraction, processing, and validation using scripting or metadata tools.
- Support the integration of metadata solutions with data platforms, analytics tools, and governance frameworks.
- Ensure that metadata systems are properly configured, updated, and optimized for performance.
- Troubleshoot metadata-related issues and resolve system or data challenges.
- Leverage metadata insights to improve data engineering pipelines and governance workflows.
Who we are looking for ?
- 2 - 5 years of experience with strong knowledge of metadata standards and best practices.
- Hands-on experience with metadata management tools such as Collibra, Alation, Informatica EDC, or Apache Atlas.
- Proficiency in SQL for querying and analyzing metadata and data systems.
- Understanding of ETL/ELT workflows and data integration pipelines.
- Familiarity with cloud data platforms (eg, Snowflake) and their metadata capabilities.
- Comprehensive understanding of data governance frameworks, including data lineage, quality, and privacy.
- Familiarity with data stewardship principles and roles.
- Proficiency in programming or scripting languages like Python for metadata automation.
- Experience in building workflows for metadata extraction, transformation, and integration.
- Ability to analyze metadata patterns and provide insights for improving data usage and governance.
- Strong problem-solving skills to address metadata-related challenges.
- Excellent communication skills to work effectively with technical and non-technical stakeholders.
- Ability to document metadata processes and train teams on metadata tools and practices.
- Experience with data lineage visualization tools and techniques.
- Familiarity with knowledge graphs and semantic metadata for advanced metadata usage.
- Knowledge of distributed data systems and metadata management in big data ecosystems (eg, Hadoop, Spark).
- Hands-on experience with cloud metadata capabilities in platforms like Azure Purview.
- Experience integrating metadata systems with BI tools (eg, Tableau, Power BI) or AI/ML platforms.
- Basic knowledge of how metadata supports AI/ML workflows, such as feature lineage tracking.
- Experience in metadata-driven automation for data governance and quality improvement.
- Familiarity with emerging trends, such as active metadata management or metadata-driven data engineering.
Employment Type: Full Time, Permanent
Read full job description What people at Providence College of Engineering are saying
What Providence College of Engineering employees are saying about work life
based on 4 employees
Day Shift
Providence College of Engineering Benefits
Soft Skill Training 
Team Outings 
Cafeteria 
Education Assistance 
Health Insurance 
Compare Providence College of Engineering with
Indian Institute of Technology Gandhinagar
Compare
National Institute of Technology
Compare
Birla Institute of Technology, Mesra
Compare
VIT University
Compare
Manipal Institute of Technology
Compare
SRM Institute of Science and Technology
Compare
Thapar Institute of Engineering & Technology
Compare
PSG College of Technology
Compare
Delhi Technological University
Compare
Jadavpur University
Compare
Aakash Educational Services
Compare
Frankfinn Institute of Air Hostess Training
Compare
NIIT
Compare
Chandigarh University
Compare
Amity University
Compare
AIIMS
Compare
Podar International School
Compare
Orchids International School
Compare
Sri Chaitanya Educational Institutions
Compare
Kendriya Vidyalaya Sangathan
Compare
Share an Interview