SRE2 -Data Engineering

About Angel one : Angel One Limited is a Fintech company providing broking services, margin trading facility, research services, depository services, investment education and distributes third party financial products to its clients, on a mission to become the No. 1 fintech organization in India. With over 2 crore+ registered clients, we are onboarding an average of over 800k new clients every month in the current financial year. We are working to build personalized financial journeys for our clients via a single app, powered by new-age tech, AI, Machine Learning and Data Science.We have a flat structure, with ample opportunity to showcase your talent and a growth path for engineers to the very top. We are aggressively hiring Engineers, Product Managers & Data science rockstars across India. Join our team and experience the best of both worlds at Angel One! Check out our careers section! Why Youll Love Working at Angel One! * Ranked Top 25 Companies to Work in India: re proud to be recognized as one of the best workplaces, certified for 8 consecutive years. * Innovative Culture: eate, innovate, and create cutting-edge fintech solutions with AI and Machine Learning. * Be part of something huge: ?span> Be at the Forefront of Fintech Innovation * Bold Approach: re not just growing a customer base; were unlocking potential, aiming to touch a billion lives. Its about more: more drive, more initiative, and a bolder way of working.Job Title: SRE3-Data EngineeringLocation: Bengaluru, KarnatakaWhat you will do: * Design, implement, and maintain scalable data pipelines and infrastructure using Databricks, Redshift, and AWS services. * Set up and manage Big Data environments, ensuring high availability and reliability of data processing systems. * Develop and optimize ETL processes to transfer data between various sources, including S3, Redshift, and Databricks. * Utilize AWS EMR for processing large datasets efficiently, leveraging Spark for distributed data processing. * Implement monitoring solutions to track the performance and reliability of data pipelines and storage solutions. * Use tools like Prometheus and Grafana to visualize metrics and identify bottlenecks in data workflows. * Ensure data integrity and security across all platforms, implementing best practices for data access and management. * Collaborate with data governance teams to establish policies for data quality and compliance. * Work closely with software development teams to integrate data solutions into applications, ensuring minimal disruption and high performance. * Provide insights on data architecture and best practices for leveraging data in applications. * Respond to incidents related to data processing and storage, performing root cause analysis and implementing solutions to prevent recurrence. * Facilitate blameless post-mortems to improve processes and systems continuously.Who you are: * Bachelor s degree in Computer Science, Information Technology, or a related field, or equivalent practical experience. * 4-8 years of experience in Data, Site Reliability Engineering, or a related field with a focus on data engineering within AWS. * Proficiency in Databricks and Redshift, with experience in data warehousing and analytics. * Strong knowledge of AWS services, particularly S3, Athena, and EMR, for data storage and processing. * Experience with programming languages such as Python or Scala for data manipulation and automation. * Familiarity with SQL for querying databases and performing data transformations. * Experience with distributed computing frameworks, particularly Apache Spark, for processing large datasets. * Knowledge of data lake and data warehouse architectures, including the use of Delta Lake for managing data in Databricks. * Proficiency in using tools like Terraform or AWS CloudFormation for provisioning and managing infrastructure. * Familiarity with monitoring tools and practices to ensure system reliability and performance, including the use of AWS CloudWatch.Tools and Technologies * Data Platforms: Databricks, Amazon Redshift, AWS EMR, AWS S3, AWS Athena * Big Data Frameworks: Apache Spark, Delta Lake * Monitoring Tools: Prometheus, Grafana, AWS CloudWatch * Infrastructure Management: Terraform, AWS CloudFormation * Programming Languages: Python, Scala, SQLWhats in it for You? * Hybrid work model span>: Enjoy in-person collaboration a few days a week, striking the perfect balance between productivity and personal preferences. * Empowered Growth: e invest in your growth and empower you to explore your full potential. * Exceptional Benefits: ? ur comprehensive benefits package includes health insurance, wellness programs, learning & development opportunities, and more.For a deeper dive into our company culture and vision, explore our Company Deck.At Angel One, our thriving culture is rooted in Diversity, Equity, and Inclusion (DEI).As an Equal opportunity employer, we wholeheartedly welcome people from all backgrounds irrespective of caste, religion, gender, marital status, sexuality, disability, class or age to be part of our team.We believe that everyones unique experiences and viewpoints make us stronger together. Come and be a part of #OneSpace*, where your individuality is celebrated and embraced.