SysTechCorp - Data Engineer - Azure Data Services (4-5 yrs)

Key Responsibilities :

1. ETL Development & Data Pipeline Design :

- Design, build, and maintain robust ETL pipelines using Azure Data Factory, Databricks, and Python.

- Develop PySpark notebooks to process large datasets efficiently.

- Integrate and transform data from multiple sources into data lakes and other storage systems.

2. Cloud Analytics Solutions :

- Develop and maintain analytics and reporting solutions using Power BI or Oracle Analytics Cloud (OAC).

- Create custom DAX formulas and use Power BI for visualizations and reporting.

- Troubleshoot and resolve issues related to data connectivity, transformation, and visualization.

3. Database Programming & SQL/PLSQL Development :

- Write efficient custom SQL/PLSQL queries for data extraction and manipulation.

- Work with relational and NoSQL databases to design and implement scalable data solutions.

4. Data Modeling & Best Practices :

- Design and implement data models that support business intelligence and reporting needs.

- Ensure adherence to data engineering best practices and industry standards.

5. Collaboration & Support :

- Collaborate with data scientists, analysts, and business stakeholders to understand data needs and provide insights.

- Troubleshoot data and system-related issues to ensure accurate and timely delivery of analytics and reports.

Skills and Qualifications :

Must-Have :

- 4+ years of experience in PL/SQL, SQL development, and ETL tools such as Azure Data Factory and Azure Databricks.

- Strong hands-on experience with Python and PySpark for data processing.

- Experience in developing and maintaining analytics and reporting solutions using Power BI and Oracle Analytics Cloud (OAC).

- Proficiency in writing custom SQL/PLSQL queries.

- Knowledge of data modeling, data transformation, and cloud-based data engineering tools.

Good-to-Have :

- Experience with cloud platforms such as OCI, Azure, or AWS and their respective data engineering tools.

- Strong understanding of DAX formulas for Power BI or other reporting tools