6 Biostadt Jobs

Job Title: Data Engineer
Location: [Mumbai, Full time]
Company: [Biostadt India Limited]

Job Overview:
We are seeking a highly skilled Data Engineer to join our team and play a critical role in shaping the data architecture, building efficient data pipelines, and implementing robust ETL processes to support data analysis and business analytics initiatives. The ideal candidate will have deep expertise in SQL, data modeling, and ETL development, and be passionate about optimizing data flows and enabling data-driven decision-making.

Key Responsibilities:

• Data Architecture Design:
• Design, develop, and maintain scalable, high-performance, and reliable data architectures to support business analytics and data analysis workflows.
• Collaborate with data analysts, data scientists, and business teams to understand data needs and build robust data solutions.

• Data Pipeline Development:
• Build, test, and maintain data pipelines for batch and real-time data processing, ensuring data quality and consistency across all stages.
• Integrate data from a variety of internal and external sources (structured and unstructured data) into a unified data repository.

• ETL Process Implementation:
• Design and implement ETL (Extract, Transform, Load) processes to automate the ingestion, transformation, and loading of data from multiple sources into the data warehouse.
• Optimize ETL workflows to handle large volumes of data and ensure the efficient movement of data from source systems to target systems.

• SQL Expertise:
• Develop complex SQL queries to extract, manipulate, and analyze data, ensuring optimal performance for reporting and analytical purposes.
• Conduct data analysis to support business intelligence efforts, using SQL and other tools to generate meaningful insights for decision-making.

• Data Quality & Governance:
• Implement data quality checks, error handling, and validation rules to ensure the integrity and accuracy of data pipelines.
• Collaborate on establishing data governance practices, ensuring compliance with data privacy and security regulations.

• Collaboration and Reporting:
• Work closely with data scientists, business analysts, and other stakeholders to translate business needs into technical solutions.
• Provide ongoing support for business analytics teams by delivering data in a clean, structured, and accessible format.

Qualifications:

• Education: Bachelors degree in Computer Science, Information Technology, Engineering, or a related field.
• Experience: 3-5+ years of experience as a Data Engineer or similar role, with demonstrated experience in data architecture, pipeline development, and ETL processes.

Technical Skills:

• SQL: Expertise in writing complex SQL queries for data extraction, manipulation, and analysis (MySQL, PostgreSQL, SQL Server, etc.).
• Data Warehousing: Amazon Redshift (fully managed data warehouse), RDS (relational databases), and Amazon S3 (as a data lake with tools like Athena and Redshift Spectrum).
• ETL Tools: AWS Glue (most popular for managed ETL), Lambda, EMR (for big data), Step Functions (for workflow orchestration), and Kinesis (for real-time ETL).
• Data Architecture: Proficiency in data modelling, schema design, and optimization of data architectures.
• Cloud Technologies: Experience with cloud platforms like AWS Cloud for data storage, processing, and deployment.
• Programming: Proficiency in Python, Java, or Scala for data processing.

Soft Skills:

• Problem-solving: Strong analytical and problem-solving skills to tackle complex data challenges.
• Communication: Excellent communication skills with the ability to explain technical details to non-technical stakeholders.
• Teamwork: Ability to collaborate effectively with cross-functional teams, including data analysts, data scientists, and business stakeholders.