Data Engineer

Minimum Qualification B. Tech. (or equivalent) from an accredited institution

 

Indicative Experience 4 + years

Domain Corporate Data, Enterprise Data Warehousing

Other benefits Health Insurance, Provident Fund, Life Insurance, Reimbursement of Certification Expenses, Gratuity, 24x7 Health Desk

Norstella is seeking an experienced Data Engineer with a background in Data Warehouse & Technology, to manage and deliver our expanding program of work for integrating business applications to the data warehouse. The Data Engineer will be responsible for designing, implementing, deploying, and supporting various data management technologies and architectures.

You will be a critical team member and developing the means to collect and ingest data, developing data models and data engines, creating automated data pipelines, and taking the lead in making them production ready. You will assist with integrating with existing applications and will have the opportunity to accelerate the delivery of and improve the quality of the enterprise data & insight.

 

Key Duties & Responsibilities

Analyse data sources and prepare data ingestion pipelines.

Stage data, assess the quality of the data, cleanse data.

Design and implement ETL jobs and transformations to populate a data lake and data warehouse.

Integrate data pipelines to the enterprise data warehouse following the architecture principles.

Perform and monitor data loads and optimize data for extraction and reporting use.

Administer the data warehouse by performing appropriate database management functions (e.g., maintain space availability, set indexing, monitor utilization, jobs, performance, check databases integrity) to ensure optimum capacity and data warehouse performance.

Monitor, report, and analyse usage trends to maintain quality control and high performance of the data retrieval from a database or other data storage.

Administer users access with data governance policies.

Participating in data workshops as necessary

Collaborating with business and technology partners to grow and develop the data engineering practice.

Key Requirements

4+ years of experience working in cloud technology especially AWS stack

Aws data stack experience is a must (AWS Glue), Apache airflow experience.

Strong Python, T-SQL, C# development skills (min 4 years hands-on experience) for building and redefining data pipelines is required.

Data modelling experience in data warehouse concepts like fact tables, lookup tables, both designing and creating database objects like tables, views, stored procedures, functions, row level security is a must.

4+ years of experience working with Data Lakehouse especially Snowflake

Good analytical skills, ability to learn quick and synthesize the information.

Experience in fast moving projects with tight deadlines.

Strong communication skills, both verbal and written.

The successful candidates will be expected to communicate effectively with both business and technical teams when troubleshooting issues.

Excellent debugging, problem solving and testing skills.

Good interpersonal skills and capable of working individually and as part of a team.

BS degree in Computer Science, Information Systems, or equivalent experience

 

Nice to Have

Real-time data processing with Apache Kafka

Experience in working with / supplying data to visualization tools such as Qlik, Tableau, Power BI or similar.

Good understanding of data integration patterns.

Experience with / exposure to software development for analytic applications.

Our guiding principles for success at Norstella

01: Bold, Passionate, Mission-First

We have a lofty mission to Smooth Access to Life Saving Therapies and we will get there by being bold and passionate about the mission and our clients. Our clients and the mission in what we are trying to accomplish must be in the forefront of our minds in everything we do.

02: Integrity, Truth, Reality

We make promises that we can keep, and goals that push us to new heights. Our integrity offers us the opportunity to learn and improve by being honest about what works and what doesn t. By being true to the data and producing realistic metrics, we are able to create plans and resources to achieve our goals.

03: Kindness, Empathy, Grace

We will empathize with everyones situation, provide positive and constructive feedback with kindness, and accept opportunities for improvement with grace and gratitude. We use this principle across the organization to collaborate and build lines of open communication.

04: Resilience, Mettle, Perseverance

We will persevere - even in difficult and challenging situations. Our ability to recover from missteps and failures in a positive way will help us to be successful in our mission.

05: Humility, Gratitude, Learning

We will be true learners by showing humility and gratitude in our work. We recognize that the smartest person in the room is the one who is always listening, learning, and willing to shift their thinking.