i
Prodapt
Prodapt - Big Data Platform Engineer (6-9 yrs)
Prodapt
posted 2mon ago
Flexible timing
Key skills for the job
Roles and Responsibilities :
- Understand the requirements from Cloud user (Developers/Data scientists/Data analysts) and work with platform/infra teams to onboard their solutions in BigQuery or DataProc platforms.
- Create BQ datasets, Compute projects, Hive tables, GCS buckets and Service accounts etc.
- Grant access to BQ datasets, GCS buckets and Hive tables etc.
- Work closely with Leads, architects, product owners and PMO's to enable new use cases in cloud.
- Administer Cloud platforms (BigQuery and DataProc) and manage reliability of platforms.
- Monitor health of Cloud platforms, proactively identify the issues and address them.
- Monitor the systems, Generate Performance Reports and provide continuous improvements.
- Develop frameworks to automate platform administration and monitoring tasks.
- Develop scripts to automate reports and maintenance activities.
- Work with cross functional teams to set up production environment and enable solutions for business.
- Debug day to day issues in cloud platforms and provide solutions.
- Perform Tuning and increase Operational efficiency on a continuous basis.
- Interact with business users to answer their queries and solve their problems.
- Able to help and Guide L1 support engineers to fix day-to-day Operational issues.
Requirements :
- Minimum 6+ years of work experience and 4-5 years of work experience in Big Data technologies.
- Good experience in Level 2, 3 support for performing hot fixes and dealing with platform issues.
- Experience in working Google cloud platform or other cloud platforms will be plus.
- Good knowledge about Hadoop platform architecture, Hardware specs, Performance Benchmarking.
- Require good Unix skills and good knowledge about Networking architecture, Datacenter issues etc.
- Experience in tool Integration, automation, configuration management in GIT, Jira platforms.
- Should be proficient in writing shell scripts, automating the scripts and designing scheduler processes.
- Should be able to understand Python/Scala/Java programs and debug the issues.
- Excellent oral, written communication and presentation skills, analytical and problem-solving skills.
- Self-driven, Ability to work independently and as part of a team.
Functional Areas: Other
Read full job descriptionPrepare for Prodapt roles with real interview advice
10-15 Yrs
3-6 Yrs