Business Intelligence Developer - PySpark/Data Warehousing (5-10 yrs)

Job Description : BI Developer

Responsibilities :

1. Data Integration and Management :

- Design, develop, and maintain scalable data processing pipelines using Azure Databricks and PySpark/Scala.

- Integrate data from various sources into Azure Data Lake and Azure SQL Data Warehouse.

- Developing and optimizing Apache Spark applications for data processing and analytics.

- Implementing data quality checks and monitoring processes.

- Managing and configuring the Databricks environment, including clusters and notebooks.

- Implement and optimize machine learning workflows using Databricks' integrated machine learning capabilities.

2. Business Intelligence and Reporting:

- Develop interactive dashboards and reports using Power BI to provide insights and support decision-making.

- Connect Power BI to Azure Databricks to leverage its performance and technology for business users.

- Ensure data accuracy and consistency across all reports and dashboards.

- Knowledge of data security best practices and the ability to implement role-level security, row-level security, and data encryption in Power BI.

- Perform complex data analysis tasks using DAX (Data Analysis Expressions) functions to create calculated measures and solve intricate business problems. Develop advanced DAX calculations for financial, statistical, or performance analysis.

- Optimize report and dashboard performance by improving data queries, data model efficiency, and report rendering speed. Identify and address bottlenecks and resource constraints.

3. Collaboration and Communication :

- Work closely with data scientists, engineers, and other stakeholders to gather requirements and deliver solutions.

- Provide training and support to end-users on Power BI and other BI tools.

- Communicate complex technical concepts to non-technical stakeholders effectively.

Requirements :

Technical Skills :

- Proficiency in Azure Databricks, Azure Data Factory, and Azure SQL Data Warehouse. Experience with data processing frameworks such as Apache Spark and PySpark.

- Strong experience with Power BI, including developing reports, dashboards, and data models.

- Knowledge of programming languages such as Python, Scala, or SQL.

Analytical Skills :

- Ability to analyze and interpret complex data sets to provide actionable insights.

- Experience with machine learning and data science workflows is a plus.

Soft Skills :

- Excellent communication and collaboration skills.

- Strong problem-solving abilities and attention to detail.

- Ability to work in a fast-paced, dynamic environment.

Required Skills and Experience :

- Bachelor's degree in computer science, Information Technology, or a related field.

- 5+ years of BI Developer experience (SSAS, DAX, Power BI, Paginated Report, Power BI Gateway, Service, Security)

- 5+ overall industry experience in Data Analytics & Dashboarding/Reporting.

- Strong proficiency in SQL, SSAS/AAS tabular modeling, DAX, Power BI, and Paginated Reports.

- Experience working with Azure-based BI solutions including Azure SQL, Azure Synapse, Data Factory, Blob Storages & Data Lakes.

- Excellent problem-solving and analytical skills.

- Strong communication and collaboration skills.

- Ability to work effectively in a team and independently.

- Relevant certifications (e.g., Microsoft Certified: Data Analyst Associate, Microsoft Certified: Azure Data Engineer Associate, Microsoft Certified: Power BI, etc.) are a plus.