Responsibilities

• Develop and implement novel AI algorithms to automate improvements of LLM applications
• Train fine-tuned and reward models based on large datasets to reflect human preferences of domain experts
• Invent synthetic data generation algorithms to train custom evaluation models and augment human review
• Collaborate with cross-functional teams to integrate AI solutions into our LLMOps product offerings
• Stay updated with the latest trends and developments in LLMs, especially evaluations, prompt engineering, fine-tuning and open source models (DBRX, Mistral, Mixtral, Llama-3 etc.)
• Document and present research findings and methodologies to both internal and external stakeholders

Requirements

• Master’s or PhD in Computer Science, Machine Learning, Artificial Intelligence, or a related field
• Proven experience with machine learning algorithms and statistical models. Solid understanding of NLP and experience working with LLMs.
• Strong programming skills in Python and experience with AI/ML frameworks like TensorFlow, PyTorch, etc.
• Excellent problem-solving and analytical skills
• Ability to work independently in an organized manner. Strong communication and collaboration skills
• Comfortable working with version control (git)
• Significant post-academic experience

Nice to have

• Experience in a startup environment
• Experience with evaluating LLMs, familiarity with research in LLM evaluation, e.g. Prometheus
• Experience in logging, debugging and fine-tuning large language models
• Experience developing end-to-end machine learning systems
• Publications in relevant AI/ML conferences and journals
• Experience with cloud computing platforms like AWS, GCP, or Azure
• Knowledge of containerization and orchestration technologies (e.g., Docker, Kubernetes)

We provide a competitive salary, equity, and the chance to develop foundational systems that will redefine how companies build AI. This is a high-impact, high-autonomy role for someone eager to take on technical ownership and leadership. If this matches your background and ambitions, we'd love to hear from you!