AWS - Data Engineer

Role: Technical Lead for Data engineering and Tableau

Job Summary

• We are seeking a highly skilled and experienced Data engineering with Tableau skills

Key Responsibilities:

• Minimum 10 yrs with Data engineering with Tableau skills

Mandatory Skills Primary Develops

AWS- AWS ( S3, Lambda, Glue, Step function, Redshift, dynamo DB, Quick sight,)/Python

Technical Skills -

• CI/CD Pipeline Development:
• Design, implement, and optimize CI/CD pipelines using Jenkins , CircleCI , Or GitLab to support rapid software development and deployment.
• Manage and troubleshoot build processes, ensuring high availability and performance.
• AWS Services Management:
• Architect, deploy, and manage data warehousing solutions using AWS Redshift , ensuring data integrity and security.
• Utilize AWS Glue for ETL processes, ensuring seamless data integration and transformation across various sources.
• Automation and Scripting:
• Develop and maintain automation scripts using Python, Bash, or similar languages to streamline processes and reduce manual efforts.
• Implement monitoring and alerting solutions to proactively identify and resolve issues.
• Collaboration and Support:
• Partner with software development teams to understand application requirements and translate them into scalable and maintainable CI/CD solutions.
• Provide technical support and guidance to team members and stakeholders regarding best practices in DevOps and data management.
• Documentation and Process Improvement:
• Maintain comprehensive documentation of system configurations, deployment processes, and operational procedures using Confluence .
• Conduct regular reviews of existing processes to identify areas for improvement and implement solutions.
• Security and Compliance:
• Ensure that CI/CD processes and AWS resources adhere to security best practices and compliance requirements.
• Regularly audit and refine security policies related to data access and infrastructure management.
• Experience with containerization technologies (e.g., Docker, Kubernetes) and orchestration tools.
• Familiarity with other AWS services (e.g., S3, Lambda, EC2) and their integration with data workflows.
• Knowledge of infrastructure as code (IaC) tools such as Terraform or CloudFormation.
• Understanding of Agile methodologies and experience working in Agile environments.
• Familiarity with Confluence for documentation and team collaboration.
• Secondary skill Tableau
  Experience with enterprise data management technologies, including database platforms, ETL tools (Informatica),(PowerBI) and Big Data
• Experience with data modeling for OLPT, Data Lake, Data Warehousing and Big data environments
• Experience in Amazon S3, AWS Redshift & Amazon Glue
• Experience with Cloud and Microservices based Architecture (SOA), enterprise data management, information security, applications development, and cloud-based architectures with federal clients.
• Experience working as a member of distributed data architecture teams
• Experienced in Determining database structural requirements by analyzing client operations, applications, and programming; reviewing objectives with clients; evaluating current systems
• Experience in Developing database solutions by designing proposed system, defining database physical structure and functional capabilities, security, back-up, and recovery specifications
• Installs database systems by developing flowcharts; applying optimum access techniques; coordinating installation actions; documents actions.
• Experience in maintaining database performance by identifying and resolving production and application development problems; calculating optimum values for parameters; evaluating, integrating, and installing new releases; completing maintenance; answering user questions.
• Experience in Coding utilities, database support, responding to user questions, and resolving problems.
• Accomplishes information systems and organization mission by completing related results as needed
• Supervising and guiding the entire Data architectural implements
• Strong Data modeling skills to Design conceptual and logical data models and flowcharts
• Experience in Erwin or equivalent Data modeling tool
• Strong with Governance, Architecture processes, best practices and structure
• Strong in analytical skill and define architecture best suited for the organization (using companies approved stack and tools)
• Understanding of information systems and data life-cycle management best practices and methodologies, formal systems engineering life cycle (SELC), and systems development life cycle (SDLC)
• Strong with Project Management and project planning kills.
• Good knowledge of SDLC for projects using DW concepts and Client/Server technologies.
• Well versed with Backup Procedure, Data security and GDPR

Interpersonal Skills

• Well-developed analytical & problem-solving skills
• Strong oral and written communication skills
• Excellent team player, able to work with virtual teams
• Ability to learn quickly in a dynamic start-up environment
• Excellent leadership skills with ability lead and guide and groom the team
• Self-motivated and capable of working independently with minimal management supervision
• Able to talk to client directly and report to client/onsite
• Flexibility to work on different Shifts and Stretch
• Flexible to travel and relocate in India and Abroad

Industry Knowledge (Any one as per requirement)

• Good Domain Knowledge on Investment Management and Finance.
• Good Domain knowledge on Life insurance products
• Good domain knowledge of Banking with Credit cards
• Good domain knowledge of healthcare industry
• Good domain knowledge of Retail
• Good domain knowledge of telecom

Good to have :

• PL/Sql programming skills
• Unix working knowledge
• Exposure to Alteryx, Spot Fire, Jasper, Cognos BI is an added advantage.
• Data Modelling

Qualification : Any Graduation

Work Location : Bangalore / Mumbai / Hyderabad / Chennai