Onward Technologies - Azure Engineer - Databricks/Data Factory (5-7 yrs)

Job Description :

Responsibilities :

- Develop scripts to process both structured and unstructured data, ensuring efficient data processing and management.

- Recommend, develop, and implement strategies to improve data reliability, efficiency, and quality, driving continuous improvement in our data processes.

- Support the translation of business needs into technical system requirements, collaborating closely with stakeholders to ensure alignment with data objectives.

- Work with stakeholders to understand data needs in terms of structure, availability, scalability, and accessibility, ensuring our data infrastructure meets business requirements.

- Qualification in Computer Science, Engineering, or related field, providing a strong foundation in technical principles.

- Demonstrated experience working with large and complex data sets, with a proven track record of analyzing and deriving insights from data.

- Working knowledge of data engineering tools and technologies, including DataBricks, ADF (Azure Data Factory), data cataloging, Spark Core, and PySpark.

- Strong attention to detail and a commitment to delivering high-quality work that meets the highest standards.

Ideal Profile :

- You possess a degree in Computer Science, Engineering or related field.

- Demonstrated experience working with large and complex data sets as well as experience analyzing volumes of data.

- You have working knowledge of data bricks, adf, data cataloging, sparkcore and pyspark

- You pay strong attention to detail and deliver work that is of a high stand