Big Data Engineer - ETL/Scala/Python (4-8 yrs)

Role : Big Data Engineer

About Organization :

Our Client is an IT consulting organization focused on providing AI Led Digital Transformation Consulting services to enterprise customers. They have adopted AI First strategy to drive value in form of Agility, Quality, Efficiency, Competitive advantage, Customer experience as core principles. Our focus is to drive data driven decision culture by analyzing vast amount of amount at scale.

Mentorship and enablement is the core culture of the organization, we believe in "The only way to do great work is to love what you do."

Role Description :

- Data modeling and architecture: You would be responsible for designing and implementing data models that are optimized for Azure services, including Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage.

- ETL and data integration: You would be responsible for building and maintaining data pipelines that move data from various sources into Azure, transform the data as necessary, and load it into Azure data stores.

- Data analysis and reporting: You would be responsible for designing and building data analysis and reporting solutions on Azure, using tools such as Azure Analysis Services, Power BI, and Excel.

- Performance tuning and optimization: You would be responsible for monitoring and tuning the performance of Azure data solutions, ensuring that they meet the required performance and scalability requirements.

- Security and compliance: You would be responsible for implementing security and compliance controls for Azure data solutions, including access controls, encryption, and data masking.

- Collaboration and communication: You would work closely with other members of the data engineering team, as well as with stakeholders in other departments, to ensure that Azure data solutions meet business requirements and are integrated into the wider technology landscape.

Required Qualifications :

- Degree in computer science, information technology, or a related field

- Experience with technologies such as Data Lake, SQL, PostgreSQL, Spark, and Azure Data Explorer

- Proficiency in programming languages such as Scala, Java or Python, and experience with distributed computing and database systems.

- Strong problem-solving and analytical skills, as well as excellent communication and collaboration skills, are also important for success in this role.

- Industry experience: 4 Years to 7 years

- Engineers needs to be self-motivated and objective driven.

- He/She should be ready to learn new domain and technology based on organization strategy.

Location : Pune