BigThinkCode - Senior Software Engineer - Data Engineering (4-6 yrs)

We are seeking a skilled Data Engineer to design, build, and maintain robust data pipelines and infrastructure. You will play a pivotal role in optimizing data flow, ensuring scalability, and enabling seamless access to structured/unstructured data across the organization. This role requires technical expertise in Python, SQL, ETL/ELT frameworks, and cloud data warehouses, along with strong collaboration skills to partner with cross-functional teams.

Company : BigThinkCode Technologies

URL : https://www.bigthinkcode.com/

Experience : 4-6 Years

Location : Chennai (Work from Office/Hybrid )

Key Responsibilities :

- Design, develop, and maintain scalable ETL/ELT pipelines to process structured and unstructured data.

- Optimize and manage SQL queries for performance and efficiency in large-scale datasets.

- Experience working with data warehouse solutions (e.g., Redshift, BigQuery, Snowflake) for analytics and reporting.

- Collaborate with data scientists, analysts, and business stakeholders to translate requirements into technical solutions.

- Experience in Implementing solutions for streaming data (e.g., Apache Kafka, AWS Kinesis) is preferred but not mandatory.

- Ensure data quality, governance, and security across pipelines and storage systems.

- Document architectures, processes, and workflows for clarity and reproducibility.

Required Technical Skills :

- Proficiency in Python for scripting, automation, and pipeline development.

- Expertise in SQL (complex queries, optimization, and database design).

- Hands-on experience with ETL/ELT tools (e.g., Apache Airflow, dbt, AWS Glue).

- Experience working with structured data (RDBMS) and unstructured data (JSON, Parquet, Avro).

- Familiarity with cloud-based data warehouses (Redshift, BigQuery, Snowflake).

- Knowledge of version control systems (e.g., Git) and CI/CD practice

Preferred Qualifications :

- Experience with streaming data technologies (e.g., Kafka, Kinesis, Spark Streaming).

- Exposure to cloud platforms (AWS, GCP, Azure) and their data services.

- Understanding of data modeling (dimensional, star schema) and optimization techniques.

Soft Skills :

- Team player with a collaborative mindset and ability to mentor junior engineers.

- Strong stakeholder management skills to align technical solutions with business goals.

- Excellent communication skills to explain technical concepts to non-technical audiences.

- Proactive problem-solving and adaptability in fast-paced environments.