Senior Associate, Data Engineer

Inviting applications for the role of Senior Associate, Data Engineer
In this role, as a Cloud Engineer you are responsible for designing, implementing, managing, and maintaining cloud infrastructure and services within an organization. Their primary role revolves around leveraging cloud technologies to optimize processes, improve scalability, and enhance reliability.

Responsibilities
Designing cloud architecture and infrastructure solutions based on business requirements, ensuring scalability, security, and reliability.
Deploying applications, services, and databases to the cloud platform. Managing the migration of on-premises infrastructure and applications to the cloud.
Implementing automation scripts and tools for provisioning, configuring, and managing cloud resources. Utilizing infrastructure-as-code (IaC) tools like Terraform or CloudFormation.
Implementing and managing security measures to protect cloud resources, including identity and access management (IAM), encryption, network security, and compliance.
Monitoring and optimizing the performance of cloud infrastructure, services, and applications. Identifying and resolving performance bottlenecks.
Optimizing cloud resource utilization to minimize costs while ensuring performance and scalability. Monitoring usage and implementing cost-saving measures.
Implementing backup and disaster recovery strategies to ensure data integrity and availability. Configuring high availability solutions to minimize downtime.
Collaborating with cross-functional teams, including developers, operations, and security teams, to ensure alignment with business objectives and requirements. Communicating effectively with stakeholders.
Troubleshooting issues related to cloud infrastructure, services, and applications. Providing support to resolve incidents and minimize downtime.
Staying updated with the latest trends, best practices, and technologies in cloud computing. Continuously improving processes and workflows to enhance efficiency and effectiveness.
Documenting configurations, procedures, and best practices. Sharing knowledge and providing training to team members to facilitate skill development and knowledge transfer.

Qualifications we seek in you
Minimum Qualifications
Bachelor s degree in computer science, Information Technology, or related field. Advanced degrees or relevant certifications are a plus.
Proficiency in one or more cloud platforms such as Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), or others.
Strong understanding of database concepts and SQL.
Strong knowledge of Pyspark.
Strong knowledge S3,Athena, EMR, EC2, AWS,Cloud Watch.
Strong understanding of networking concepts, including TCP/IP, DNS, routing, and VPN. Knowledge of cloud networking services such as VPCs, subnets, and load balancers.
Experience with Linux and Windows operating systems, including system administration tasks.
Proficiency in scripting languages like Python, Bash, or PowerShell. Experience with automation tools such as Ansible, Puppet, or Chef.
Familiarity with infrastructure provisioning and management using tools like Terraform, AWS CloudFormation, or Azure Resource Manager.
Knowledge of containerization technologies like Docker and container orchestration platforms such as Kubernetes.
Understanding of cloud security best practices, including identity and access management (IAM), encryption, and network security controls.
Experience with DevOps practices and tools, including CI/CD pipelines, version control systems (e.g., Git), and agile methodologies.
Hands-on experience designing, implementing, and managing cloud infrastructure and services.
SQL is heavily focused. An ideal candidate must have hands-on experience with SQL database design. Plus, Python.
Demonstrably deep understanding of SQL (level advanced) and analytical data warehouses (Snowflake preferred).
Demonstrated ability to write new code i.e., well-documented and stored in a version control system (we use GitHub & Bitbucket)
Extremely talented in applying SCD, CDC and DQ/DV framework.
Familiar with JIRA & Confluence.
Must have exposure to technologies such as dbt, Apache airflow and Snowflake.
Desire to continually keep up with advancements in data engineering practices.
Knowledge on AWS cloud, Python is a plus.

Preferred Qualifications/ Skills
Additional training or coursework in cloud computing, cybersecurity, or related fields.
Relevant certifications in cloud technology.
Additional training or coursework in cloud computing, cybersecurity, or related fields.
Experience leading cloud migration projects or managing a team of cloud engineers may be preferred for managerial positions.