QBrainX - Data Engineer - Snowflake/Data Bricks/Python/Pyspark/SQL (3-8 yrs)

Job title - Data Engineer (Mid-Level)

Exp - 3+ to 7 years

Job Location : Coimbatore (Work from Office)

Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable format? If so, then we want to hear from you!

We are searching for a Mid-Level Data Engineer to join our growing team. In this role, you will play a key part in designing, developing, and maintaining our data pipelines. You will work closely with data scientists, analysts, and business stakeholders to ensure our data infrastructure meets the ever-evolving needs of the organization.

Responsibilities :

- Design, develop, and maintain scalable data pipelines using technologies like Python and SQL.

- Develop and implement data quality checks and monitoring processes to ensure data integrity.

- Build and automate data ingestion processes from various sources (databases, APIs, etc.) to Snowflake.

- Utilize cloud platforms (AWS, Azure, GCP) to build and manage data infrastructure.

- Leverage Infrastructure as Code (IaC) tools like Terraform to provision and manage cloud resources.

- Collaborate with data scientists and analysts to understand data requirements and translate them into technical solutions.

- Version control code using Git and collaborate with the team through code reviews.

- Document data pipelines and processes for future reference and knowledge sharing.

Qualifications :

- 3+years of experience in data engineering or a related field.

- Proven experience in designing, developing, and deploying data pipelines.

- Hands on experience with Snowflake or Data Bricks, Python or Pyspark and SQL

- Experience with data warehousing and data modeling concepts.

- Experience working with cloud platforms (AWS, Azure, GCP) is a plus.

- Working knowledge of Terraform and Infrastructure as Code (IaC) principles.

- Experience with Git for version control.

- Excellent communication and collaboration skills.

- Ability to work independently and as part of a team.

- Strong problem-solving and analytical skills.

Bonus Points :

- Experience with data orchestration tools (Airflow, Luigi, etc.).

- Experience with data visualization tools (Tableau, Power BI, etc.)