Sr Data Engineer

We are seeking a talented and motivated Data Engineer / Data Scientist with a strong background in Python, Snowflake, PySpark, SQL, and Machine Learning. The ideal candidate will have at least 2 years of experience in data engineering, data analysis, and machine learning, and will play a key role in designing, developing, and optimizing our data infrastructure and models. You will work with large datasets, develop data pipelines, and contribute to machine learning initiatives to drive insights and improve business decision-making.

Responsibilities:

• ⁠ ⁠Design, develop, and optimize data pipelines using Python, PySpark, and SQL for large-scale data processing.
• ⁠ ⁠Work with Snowflake to store, manage, and query structured and semi-structured data.
• ⁠ ⁠Collaborate with cross-functional teams to gather requirements, design solutions, and deliver high-quality data products.
• ⁠ ⁠Build and deploy machine learning models for predictive analytics and automation using relevant tools and frameworks.
• ⁠ ⁠Write efficient and maintainable code to process, clean, and transform data.
• ⁠ ⁠Optimize SQL queries for better performance on large datasets and create automated reporting solutions.
• ⁠ ⁠Implement best practices for data modeling, security, and data governance.
• ⁠ ⁠Participate in data validation, testing, and debugging.
• ⁠ ⁠Continuously stay up to date with new technologies and trends in data science and engineering.

*Requirements:

• ⁠ ⁠At least 2 years of experience in Python, PySpark, SQL, and Snowflake.
• ⁠ ⁠Solid understanding of Machine Learning concepts and hands-on experience with relevant libraries and frameworks.
• ⁠ ⁠Experience building and optimizing data pipelines for large-scale data processing.
• ⁠ ⁠Strong proficiency in SQL, including the ability to write complex queries, manage databases, and optimize performance.
• ⁠ ⁠Familiarity with data warehousing concepts and experience working with Snowflake or similar platforms.
• ⁠ ⁠Ability to analyze, clean, and prepare data for analysis and model training.
• ⁠ ⁠Excellent problem-solving skills and ability to work with large datasets.
• ⁠ ⁠Strong communication skills and ability to collaborate effectively with cross-functional teams.

Preferred Skills:

• ⁠ ⁠Experience with cloud platforms (AWS, GCP, Azure).
• ⁠ ⁠Knowledge of Apache Spark and other big data technologies.
• ⁠ ⁠Experience working with ETL processes and tools.
• ⁠ ⁠Exposure to deep learning or advanced machine learning techniques.