Sr Data Engineer

Responsibilities

• Implementation, optimization, and maintenance of our data pipelines, ensuring they are scalable, secure, and reliable for processing vast amounts of legal data.
• Architect and implement solutions involving Large Language Models (LLMs) and Natural Language Processing (NLP) to extract insights and create advanced features for our analytics platforms.
• Collaborate closely with product, engineering, and domain experts to build intelligent data systems that enhance the user experience.
• Write quality code, and ability to adhere to the coding guidelines.
• Pursue opportunities to improve delivery quality and efficiency within the organization.
• Follow, learn and apply new big data technologies and innovations.
• Ensure data accuracy and integrity across multiple sources and systems.

Knowledge and Experience

• 7+ years of experience in data engineering within a production environment.
• Experience with SQL/NoSQL databases, preferably MongoDB (Medium level 4+ years).
• Strong programming skills in languages such as Python, and experience with data processing frameworks like Apache Spark, Airflow, or Kafka. (High level, 6-7+ years).
• Experience building interactive dashboards with Streamlit or Plotly Dash (Medium level 2+ years).
• Familiarity with cloud platforms (AWS, GCP, Azure) and containerization technologies like Docker and Kubernetes.

Schedule

This role offers work from home flexibility of one day per week.