Data Engineer

Job Title: Data Engineer
Reports To: Data Architect / Software Manager
Position Location: Noida, UP
Mode of Work: Work from. Office/ Hybrid
ABOUT THE ROLE
The Data Engineer is an Individual who assists with the development and maintenance of the
company data storage systems and data movement processes. Candidates responsibilities include expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for various projects and functional teams.
The Data Engineer will build new data pipelines and engines using modern cloud data tools that
support our software developers, database architects, data analysts, and data scientists. The
Engineer will ensure optimal data delivery architecture is consistent throughout ongoing projects
and generate new architecture to support our next generation of products and data initiatives.
Candidate must be self-directed and comfortable supporting the data needs of multiple teams,
systems, and products. An enthusiast with good hands-on experience around the prospect of
optimizing or even re-designing existing data architecture to continue to adapt to latest technology.
PRIMARY RESPONSIBILITIES:
• Develop, construct, test and maintain data storage systems including traditional SQL databases, No-SQL Solutions such as Mongo, BLOB Storage, and others.
• Create and maintain optimal data pipelines leveraging SSIS, Data Factory, Databricks, and
others.
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes,
optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Identify ways to improve data reliability, efficiency, and quality.
• Work with data and analytics experts to strive for greater functionality in our data systems.
• Integrate data tools for analytics and data scientist team members and assist them in building
and optimizing our product into an innovative industry leader.

I. Knowledge & Skills Requirement
• Bachelors degree in computer science or related field.
• 3+ years of experience working with Microsoft SQL Databases
• 3 years designing SQL Architecture including table design, index optimization, partitioning
strategies, and others.
• 1- 5 years of experience developing data scripts using Python.
• 1- 3 years working in the Azure Cloud environment
• Experience with Databricks is a plus (required for Mid-Level and Sr)
II. QUALIFICATIONS:
• Working SQL knowledge and experience working with relational databases, query authoring
(SQL) as well as working familiarity with a variety of databases.
• Experience building and optimizing ‘big data’ data pipelines utilizing ETL software including SSIS, Data Factory, and others.
• Python experience with Pandas DataFrames, PySpark, NumPy, and other analytics libraries.
• Experience with RESTful APIs, Service Bus, and other orchestration tools.
• Understanding of working with containerized Apps utilizing Docker and Kubernetes a plus.
• Experience building ETL solutions with non-SQL databases like Mongo DB.
• Understanding of Azure cloud data technologies like Azure SQL, Data Factory, Parallel Data
Warehousing, Azure Databricks, Azure Synapse etc.
• Ability to prioritize and manage work to critical project timelines in a fast-paced environment.
• Proven ability to communicate at all levels with both business and technology leaders, with a
strong understanding of business data requirements and technology capabilities.
• Strong attention to detail.