AmbitionBox
Search
Jobs
- Reviews
- Salaries
- Interview Questions
- About Company
- Benefits
- Jobs
- Office Photos
- Community
Add office photos
All Filters
25 Robosoft Technologies Jobs
Tech Lead - Data Bricks
4-7 years
Mumbai, Udupi, Bangalore / Bengaluru
1 vacancy
Tech Lead - Data Bricks
Robosoft Technologies
posted 3mon ago
Job Role Insights
Flexible timing
Key skills for the job
Job Description
We are seeking a skilled Databricks Architect to design, implement, and optimize scalable data solutions within our cloud-based data platform. This role requires extensive knowledge of Databricks (Azure/AWS), data engineering, and a deep understanding of data architecture principles, with the ability to drive strategy, best practices, and hands-on implementation for high-performance data processing and analytics solutions.
Responsibilities:
- Solution Architecture:
- Design and architect end-to-end data solutions using Databricks and Azure/AWS, including data ingestion, processing, and storage.
- Delta Lake Implementation:
- Leverage Delta Lake and Lakehouse architecture to create robust, unified data structures that support advanced analytics and machine learning.
- Data Processing Development:
- Develop, design, and automate large-scale, high-performance data processing systems (batch and/or streaming) to drive business growth and enhance the product experience.
- Performance Tuning:
- Ensure optimal performance of data pipelines and workloads by implementing best practices for resource management, auto-scaling, and query optimization in Databricks.
- Engineering Best Practices:
- Advocate for high-quality software engineering practices in building scalable data infrastructure and pipelines.
- Architecture/Solution Development:
- Develop Architecture or solution for large data project using Databricks.
- Project Leadership:
- Lead data engineering projects to ensure pipelines are reliable, efficient, testable, and maintainable.
- Data Modeling:
- Design data models optimized for storage, retrieval, and critical product and business requirements.
- Logging Architecture:
- Understand and influence logging to support data flow, implementing logging best practices as needed.
- Standardization and Tooling:
- Contribute to shared data engineering tools and standards to boost productivity and quality for Data Engineers across the company.
- Collaboration:
- Work closely with leadership, engineers, program managers, and data scientists to understand and meet data needs.
- Partner Education:
- Use data engineering expertise to identify gaps and improve existing logging and processes for partners.
- Data Governance:
- Collaborate with stakeholders to build data lineage, data governance, and data cataloging using unity catalog.
- Agile Project Management:
- Lead projects using agile methodologies.
- Communication:
- Communicate effectively with stakeholders at all organizational levels.
- Team Development:
- Recruit, retain, and develop team members, preparing them for increased responsibilities and challenges.
- 10+ years of relevant industry experience.
- ETL Expertise:
- Skilled in custom ETL design, implementation, and maintenance.
- Data Modeling:
- Experience in developing and designing data models for reporting systems.
- Databricks Proficiency:
- Hands-on experience with Databricks SQL workloads.
- Data Ingestion:
- Expertise in data ingestion from offline files (e.g., CSV, TXT, JSON) along with API and DB, CDC data ingestion. Should have handled such projects in past.
- Pipeline Observability:
- Skilled in setting up robust observability for complete pipelines and Databricks in Azure/AWS.
- Database Knowledge:
- Proficient in relational databases and SQL query authoring.
- Programming and Frameworks:
- Experience with Java, Scala, Spark, PySpark, Python, and Databricks.
- Cloud Platforms:
- Cloud experience required (Azure/AWS preferred).
- Data Scale Handling:
- Experience working with large-scale data.
- Pipeline Design and Operations:
- Proven experience in designing, building, and operating robust data pipelines.
- Performance Monitoring:
- Skilled in deploying high-performance pipelines with reliable monitoring and logging.
- Cross-Team Collaboration:
- Able to work effectively across teams to establish overarching data architecture and provide team guidance.
- ETL Optimization:
- Ability to optimize ETL pipelines to reduce data transfer and storage costs.
- Auto Scaling:
- Skilled in using Databricks SQL s auto-scaling feature to adjust worker numbers based on workload.
- Cloud Platform:
- Azure/AWS.
- Azure/AWS:
- Databricks SQL Serverless, Databricks SQL, Databricks workspaces, Databricks notebooks, Databricks job scheduling, Data Catalog.
- Data Architecture:
- Delta Lake, Lakehouse concepts.
- Data Processing:
- Spark Structured/Streaming.
- File Formats:
- CSV, Avro, Parquet.
- CI/CD:
- CI/CD for ETL pipelines.
- Governance Model:
- Databricks SQL unified governance model (Unity Catalog) across clouds, supporting open formats and APIs.
Employment Type: Full Time, Permanent
Read full job descriptionRobosoft Technologies Interview Questions & Tips
Prepare for Robosoft Technologies Technical Lead roles with real interview advice
What people at Robosoft Technologies are saying
Rating based on 6 Technical Lead
reviews
Anonymous · Engineering - Software & QA
Likes
Client which I worked for.
- Promotions - Good
Dislikes
Micro Management. No scope of upskilling.
- Skill development - Poor
+2 more
Technical Lead salary at Robosoft Technologies
reported by
77
employees
with 8-13
years exp.
₹11
L/yr - ₹36
L/yr
29%
more
than the average Technical Lead Salary in India
View more details
What Robosoft Technologies employees are saying about work life
based on 283 employees
Flexible timing
Monday to Friday
No travel
Day Shift
Robosoft Technologies Benefits
View more benefits
Compare Robosoft Technologies with
ITC Infotech
Compare
CMS IT Services
Compare
KocharTech
Compare
Xoriant
Compare
Photon Interactive
Compare
Sify Technologies
Compare
CitiusTech
Compare
Team Computers
Compare
Iris Software
Compare
HTC Global Services
Compare
NeoSOFT
Compare
Exela Technologies
Compare
HERE Technologies
Compare
XL Dynamics
Compare
iOPEX Technologies
Compare
IDC Technologies
Compare
Aforeserve
Compare
Clover Infotech
Compare
Evalueserve
Compare
Collabera Technologies
Compare
Similar Jobs for you
Robosoft Technologies Mumbai Office Location
Mumbai Office
Pressman House
70-A, 3rd Floor, Nehru Road, Vile Parle (E)
Mumbai
400099
400099
Robosoft Technologies - Test Engineer - Manual & Automation Testing (4-5 yrs)
4-5 Yrs
Robosoft Technologies - QA Automation Engineer - Python Framework (8-10 yrs)
8-10 Yrs
Robosoft - Pre Sales Analyst - Data & Analytics Domain (10-15 yrs)
10-15 Yrs
Share an Interview