Data Engineer - Hadoop/Spark (7-11 yrs)

Job Description :

We are looking for a skilled Data Analyst/Developer with expertise in SQL Server, Azure Storage solutions, and analytics/reporting tools like Power BI or SSRS. The ideal candidate will be responsible for designing and implementing data storage, analysis, and reporting solutions to provide actionable insights and support business decision-making.

Key Responsibilities :

- Design, develop, and maintain databases and data storage solutions using SQL Server and Azure Storage (including Blob Storage).

- Build and optimize ETL pipelines for data ingestion, transformation, and loading into reporting platforms.

- Develop interactive dashboards and reports using Power BI or SSRS to visualize business performance and insights.

- Analyze large datasets to uncover trends, patterns, and actionable insights.

- Ensure data integrity, consistency, and security across all platforms.

- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.

- Implement data archiving and backup strategies, leveraging Azure Blob Storage and other cloud-native tools.

- Monitor system performance and troubleshoot database and reporting issues.

- Document processes, standards, and data workflows to ensure knowledge transfer and operational continuity.

- Stay up to date with emerging technologies in analytics, reporting, and cloud storage.

Qualifications :

- Bachelor's degree in computer science, Data Science, or a related field.

- 3+ years of experience working with SQL Server for database design and management.

- Strong knowledge of Azure Storage, including Blob Storage.

- Proficiency in analytics and reporting tools like Power BI and/or SSRS.

- Experience in developing data pipelines and ETL workflows.

- Solid understanding of data modeling, data warehousing, and relational databases.

- Familiarity with performance tuning, query optimization, and indexing strategies.

- Strong problem-solving and critical-thinking skills.

- Excellent communication and collaboration abilities.

Preferred Skills :

- Knowledge of Azure Data Factory or Azure Synapse Analytics for advanced data integration.

- Familiarity with scripting languages such as Python or PowerShell for automation.

- Experience with big data tools and platforms like Hadoop, Spark, or Databricks.

- Understanding of data governance, compliance, and security best practices.

- Certification in Microsoft Azure or Power BI is a plus.