Lead Data Engineer

Job Description Summary

COMPANY BACKGROUND

Founded in 1897 and headquartered in Franklin Lakes, New Jersey, Becton Dickinson (BD) is a medical technology company that serves healthcare institutions, life science researchers, clinical laboratories, industry and the general public. BD manufactures and sells a broad range of medical supplies, devices, laboratory equipment and diagnostic products. It employs nearly 65,000 people serving more than 190 countries throughout the world.

The companys customers include healthcare institutions, science researchers, clinical laboratories, the pharmaceutical industry and the general public. BD was one of the first companies to sell U.S.-made glass syringes. It was also a pioneer in the production of hypodermic needles.

Becton Dickinson operates through three worldwide segments:

BD Medical

Medication Management Solutions

Medication and Procedural Solutions

Pharmaceutical Systems

BD Life Sciences

Biosciences

Integrated Diagnostic Solutions

BD Interventional

Peripheral Intervention

Surgery

Urology and Critical Care

BD Core Values

We do what is right

We act in alignment with our Company s high ethical standards and protect our Companys reputation, always. We are honest and trustworthy. We speak openly when we have concerns or questions.

We are authentic

We remain true to our Values. We are humble, sincere, transparent and explicit in our intentions. We serve others and guide them to a shared purpose.

We are all accountable

We take personal ownership and responsibility for BD decisions, actions and outcomes, and reliably deliver on personal and professional commitments.

We improve every day

We continuously raise the bar. We relentlessly improve our ideas, products, solutions, services, and processes, to drive the transformation of healthcare, globally. We are curious and never stop learning.

We help each other be great

We support and respect one another, challenge ideas, embrace feedback and work together for the good of our customers, the Company and patients.

Job Description

Position Summary

• 7 years of experience working in data engineering role.

• Expertise in Databricks, with hand-on experience in data transformation using PySpark and Spark SQL.

• In-depth knowledge on Azure Data Factory, Azure Data Lake, Delta Lake, Azure SQL, Azure Blob Storage.

• Comprehensive understanding of ETL and big data principles, including Hive and the Spark framework.

• Experience in troubleshooting and optimizing Spark on Databricks.

• Apply medallion architecture to design and develop data warehouses that support efficient analytics. Ensure data is organized, clean, and easily accessible for reporting purposes.

• Experience with developing solutions on cloud computing services and infrastructure in the data and analytics space.

• Hand-on experience with various file formats, including CSV, JSON, XML, XLS and PARQUET.

• Ability to formulate complex SQL queries and a solid grasp of Data Warehouse principles.

• Knowledge with DevOps and Agile project methodologies, with the ability to implement requirements using Databricks and Azure Data Factory.

• Experience in version control systems such as Git/Bitbucket.

• Familiarity with SAP, MS Azure, and Power BI is a plus.

• Strong work ethic, flexibility to changes in work direction as the project develops and ability to work at an abstract level and gain consensus.

• Passionate about Agile software processes, data-driven development, reliability, and experimentation.

• Self-motivated with strong problem-solving and learning skills.

• Excellent communication, listening, and influencing skills.

• Experience working on a collaborative Agile product team.

Educational Background

• Bachelor s in information technology or computer science

Professional Experience

• 7-12 Years

Job Responsibilities

• Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL and Data Engineering principles and business goals.

• Work with Data Engineering Technical and Functional Lead, SMEs and Business Stakeholders to Provide Data & Analytics solution and support by leveraging Data Engineering standards and guidelines using Azure Databricks and ADF.

• Solve complex data problems to deliver insights that helps the organizations business to achieve their goals.

• Create data products for analytics and data scientist team members to improve their productivity.

• Design the solutions for multiple large data warehouses in Azure cloud environment utilizing the parallel architecture and appropriate technology stack.

• Perform various proof of concepts to test the ideas and technology capabilities and subsequently drives these concepts into real solutions.

• Work with various business units to identify the requirements and build corresponding data models and data pipelines.

• Advise, consult, mentor and coach other data and analytic professionals on data standards and practices.

• Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.

• Lead the evaluation, implementation and deployment of emerging tools and process for analytic data engineering to improve the organizations productivity as a team.

• Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives.

Knowledge and Skills

• ETL and SQL

• Databricks, Azure Data Factory.

• GIT/Bitbucket

• Power BI or similar reporting tool.

• Critical Thinking Skills

• Behavioural Skills

• Soft Skills

• Leadership Skills

Desired / Additional Skills & Knowledge (Not essential to the job but will be an advantage to possess)

• Working experience on Microsoft Azure cloud platform

• Power BI

Any additional Information (Specially if needed for Quality or legal purposes)

Required Skills

Optional Skills

.

Primary Work Location

IND Bengaluru - Technology Campus

Additional Locations

Work Shift

Becton, Dickinson and Company is an Equal Opportunity/Affirmative Action Employer. We do not unlawfully discriminate on the basis of race, color, religion, age, sex, creed, national origin, ancestry, citizenship status, marital or domestic or civil union status, familial status, affectional or sexual orientation, gender identity or expression, genetics, disability, military eligibility or veteran status, or any other protected status.