Sr Data Engineer

Job Title: Sr Data Engineer

Employment Type: Full-Time

Experience Required: 5+ Years

Job Description

Techiebutler is looking for an experienced Data Engineer to develop and maintain scalable, secure data solutions. You will collaborate closely with data science, business analytics, and product development teams, deploying cutting-edge technologies and leveraging best-in-class third-party tools. You will also ensure compliance with security, privacy, and regulatory standards while aligning data solutions with industry best practices.

Tech Stack:

• Languages: SQL, Python
• Pipeline Orchestration: Dagster (Legacy: Airflow)
• Data Stores: Snowflake, Clickhouse
• Platforms & Services: Docker, Kubernetes
• PaaS: AWS (ECS/EKS, DMS, Kinesis, Glue, Athena, S3)
• ETL: FiveTran, DBT
• IaC: Terraform (with Terragrunt)

Key Responsibilities:

• Design, develop, and maintain robust ETL pipelines using SQL and Python.
• Orchestrate data pipelines using Dagster or Airflow.
• Collaborate with cross-functional teams to meet data requirements and enable self-service analytics.
• Ensure seamless data flow using stream, batch, and Change Data Capture (CDC) processes.
• Use DBT for data transformation and modeling to support business needs.
• Monitor, troubleshoot, and improve data quality and consistency.
• Ensure all data solutions adhere to security, privacy, and compliance standards.

Essential Experience:

• 5+ years of experience as a Data Engineer.
• Strong proficiency in SQL.
• Hands-on experience with modern cloud data warehousing solutions (Snowflake, Big Query, Redshift)
• Expertise in ETL/ELT processes, batch, and streaming data processing.
• Proven ability to troubleshoot data issues and propose effective solutions.
• Knowledge of AWS services (S3, DMS, Glue, Athena).
• Familiarity with DBT for data transformation and modeling.

Desired Experience:

• Experience with additional AWS services (EC2, ECS, EKS, VPC, IAM).
• Knowledge of Infrastructure as Code (IaC) tools like Terraform and Terragrunt.
• Proficiency in Python for data engineering tasks.
• Experience with orchestration tools like Dagster, Airflow, or AWS Step Functions.
• Familiarity with pub-sub, queuing, and streaming frameworks (AWS Kinesis, Kafka, SQS, SNS).
• Experience with CI/CD pipelines and automation for data processes.

Why Join Us?

• Opportunity to work on cutting-edge technologies and innovative data solutions.
• Be part of a collaborative team focused on delivering high-impact results.
• Competitive salary and growth opportunities.

If youre passionate about data engineering and want to take your career to the next level, apply now!

How to Apply:

Interested candidates are invited to submit their resume along with a cover letter detailing their relevant experience and qualifications to lakshay.dang@techiebutler.com

We look forward to reviewing your application and potentially welcoming you to our team!