Data Engineer

Role: Data Engineer

Exp: 7+ years

Location: Hyderabad

Skill set: Python, SQL, Airflow, dbt (Data build tool), Cloud (AWS or Azure or GCP)

Job Profile (Brief description)

We are looking for a highly skilled and experienced Senior Data Engineer with 7+ years of experience to join our dynamic team. The ideal candidate will have a strong background in data engineering, with expertise in Python, SQL, Airflow, dbt, and cloud platforms such as AWS or Azure. This role will involve designing, developing, and maintaining scalable data pipelines, ensuring data quality and availability, and collaborating with cross-functional teams to support data-driven decision-making.

Roles & Responsibilities:

• Design, develop, and maintain scalable and robust data pipelines using Python, SQL, Airflow, and dbt.
• Build and optimize data workflows and data integration processes.
• Ensure data quality, consistency, and reliability across various data sources.
• Implement and manage ETL processes to support data analytics and business intelligence.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
• Work with cloud platforms (AWS or Azure) to manage and scale data infrastructure.
• Monitor and troubleshoot data pipelines and workflows to ensure smooth operations.
• Implement best practices for data security, privacy, and compliance.
• Stay updated with the latest trends and technologies in data engineering and recommend improvements to existing processes and tools.

Other specifications

• 6+ years of experience in data engineering or a related role.

• Bachelors or Masters degree in Computer Science, Engineering, or a related field.
• Proficiency in Python for data manipulation and automation.
• Strong SQL skills for querying and managing relational databases.
• Experience with workflow orchestration tools like Airflow.
• Proficiency with dbt (data build tool) for transforming data in the warehouse.
• Hands-on experience with cloud platforms such as AWS or Azure, including services like S3, RDS, Redshift, EC2, Azure Blob Storage, Azure SQL Database, etc.
• Familiarity with data warehousing concepts and technologies.
• Strong problem-solving skills and attention to detail.
• Familiarity with CI/CD pipelines and version control systems like Git.
• Excellent communication and collaboration skills.