AmbitionBox
Search
Jobs
- Reviews
- Salaries
- Interview Questions
- About Company
- Benefits
- Jobs
- Office Photos
- Community
Add office photos
All Filters
7 SquareShift Jobs
Big Data Engineer
SquareShift
posted 9d ago
Job Role Insights
Flexible timing
Key skills for the job
Job Description
We are seeking a skilled Big Data Engineer with expertise in managing complex migration use-cases in various platforms such as Azure, Snowflake, and programming languages such as SQL, Python and Java. The ideal candidate will have advanced hands-on experience in creating and managing pipelines, datasets, and storage events to fulfill complex migration use-cases.
Key Responsibilities:
- Expertise in ADF pipeline creation, Linked Service configuration, Triggers, and Datasets management.
- Hands-on experience with storage events, Storage Queues, SAS, and SFTP configuration in ADLS Gen2.
- Custom Log Table creation and querying in Log Analytics for migration use-cases.
- Proficiency in Azure Monitor, Key Vault, and Dashboard Hub for day-to-day activities.
- Proficiency in making REST API calls and consuming their responses.
- Advanced hands-on expertise in migrating legacy scripts and workflows across Azure, Databricks and Snowflake.
- Creation and management of data pipelines, datasets, tables, and views to fulfill complex migration use-cases.
- Implementing Python based data processing modules which can run on Snowflake.
- Implementing Kafka and Micro batch Data Ingestion to ADLS or Snowflake.
- Developing PySpark pipelines for some data processing / curating requirements.
- Strong understanding and hands-on experience with data engineering concepts like Queues, Pub-Sub, NoSQL, and Streaming.
Requirements
Requirements
Requirements:
- Advanced expertise in ADF, ADLS Gen2, Log Analytics, and Databricks platforms.
- Proficiency in SQL, Python, and experience in Java is an added advantage.
- Hands-on experience with Azure Storage Explorer, Git, and other standard tools.
- Strong communication and problem-solving skills.
Employment Type: Full Time, Permanent
Read full job descriptionPrepare for Big Data Engineer roles with real interview advice
What people at SquareShift are saying
What SquareShift employees are saying about work life
based on 10 employees
Flexible timing
Monday to Friday
No travel
SquareShift Benefits
View more benefits
Compare SquareShift with
Paytm
Compare
Flipkart
Compare
Amazon
Compare
Infosys
Compare
TCS
Compare
Reliance Industries
Compare
HDFC Bank
Compare
Bharti Airtel
Compare
Aditya Birla Group
Compare
Tech Mahindra
Compare
Accenture
Compare
Wipro
Compare
Cognizant
Compare
Capgemini
Compare
ICICI Bank
Compare
HCLTech
Compare
Genpact
Compare
Teleperformance
Compare
Concentrix Corporation
Compare
Axis Bank
Compare
Similar Jobs for you
Share an Interview