Data Engineer - SQL/Python (5-10 yrs)

Overview :

The Data Engineer plays a crucial role in our organization, tasked with designing and implementing systems that help manage, store, and analyze data effectively.

In this position, you will collaborate with data scientists, analysts, and software engineers to create robust data pipelines and ensure seamless data flow across various sectors of the business.

Your work will help drive data-informed decisions and enhance operational efficiency across departments.

In a rapidly evolving data landscape, your skills will be integral in leveraging big data technologies, ensuring data availability, integrity, and accessibility while adhering to best practices in data management.

As a Data Engineer with five years of experience, you will tackle complex data challenges and introduce innovative solutions that facilitate data analysis and reporting.

Your expertise in data architecture and engineering will contribute significantly to maximizing the value and utilization of our organizational data assets.

Key Responsibilities :

- Design and implement scalable data pipelines to ingest, process, and analyze large volumes of data.

- Manage and optimize ETL processes to ensure efficient data flow.

- Develop data models to support analytics and reporting initiatives.

- Collaborate with cross-functional teams to gather requirements and translate them into data solutions.

- Ensure data quality, integrity, and availability through rigorous quality checks.

- Utilize cloud platforms to optimize data storage and processing solutions.

- Monitor and improve system performance for data ingestion and processing.

- Implement data governance best practices, ensuring compliance with regulations.

- Conduct performance tuning and optimization of existing data systems.

- Assist in the integration of new data sources into existing frameworks.

- Work with data architects and data scientists to develop advanced analytics solutions.

- Document data processes and create technical specifications for data management solutions.

- Stay current with industry trends and emerging technologies related to data engineering.

- Participate in troubleshooting data-related issues and provide solutions.

- Train and mentor junior data team members as needed.

Required Qualifications :

- Bachelor's degree in Computer Science, Engineering, or a related field.

- Minimum of 5 years of experience in data engineering or a related role.

- Proven expertise in SQL and relational database management systems.

- Strong understanding of data warehousing concepts and methodologies.

- Experience with big data technologies such as Hadoop or Spark.

- Proficiency in programming languages such as Python or Java.

- Hands-on experience with cloud-based data services (AWS, Azure, GCP).

- Knowledge of data visualization tools like Tableau or Power BI.

- Familiarity with data governance frameworks and practices.

- Excellent problem-solving skills and a results-oriented mindset.

- Ability to work collaboratively in cross-functional teams.

- Strong communication skills, both verbal and written.

- Experience with containerization tools like Docker or Kubernetes is a plus.

- Certification in data engineering or cloud technologies is a bonus.

- Experience with Agile methodologies is preferred.