Part time job opportunity-. . Data Scientist For Feedback and Metrics

Data Scientist for Feedback and Metrics

Job Description

Were hiring a Data Scientist to power the fine-tuning of OpenAI-based agents through data-driven insights. You’ll preprocess datasets for Supervised Fine Tuning (SFT) and analyze human feedback for Reinforcement Learning from Human Feedback (RLHF) to build robust reward models. Using OpenAI’s embeddings and your analytical skills, you’ll measure and improve agent performance. If you love turning raw data into AI excellence, apply now!

• Responsibilities:
  
  
• Prepare and clean SFT datasets in OpenAI-compatible formats (e.g., JSONL).
• Analyze RLHF feedback (e.g., rankings, scores) to train reward models.
• Leverage OpenAI embeddings to encode user preferences and agent outputs.
• Define and track metrics (e.g., task completion, BLEU scores) to assess agent success.
• Collaborate with engineers to automate data pipelines and feedback loops.
• 
  
• Qualifications:
  
  
• Bachelor’s/Master’s in Data Science, Statistics, Computer Science, or related.
• 2+ years in data science, with experience in NLP or AI projects.
• Proficiency in Python, pandas, and OpenAI’s embeddings API.
• Knowledge of A/B testing, statistical analysis, and reward modeling.
• Strong organizational skills for managing complex datasets.
• 
  
• Keywords: Data Science, OpenAI, SFT, RLHF, Embeddings, Reward Modeling, NLP Metrics, Python, Data Pipeline, AI Feedback Analysis.