Senior Applied AI Research: shipping products and running experiments

About Galileo

Galileo is the leading platform for Gen AI evaluation and observability, with a mission to democratize building safe, reliable and robust applications in the new era of AI powered software development. Our foundation is built on pioneering the early technology behind the world's most ubiquitous AI applications including Apple's Siri, Google Brain and Google Speech. We firmly believe that AI developers require meticulously crafted, proprietary research-driven tools to create trustworthy and high-quality generative AI applications that will revolutionize our work and lifestyle.

Galileo addresses the complexities inherent in experimenting with, evaluating, and monitoring GenAI applications, optimizing the development process for both individual developers and teams by offering a comprehensive platform that spans the full AI development lifecycle. Galileo bridges critical gaps, significantly enhancing developers' ability to refine and deploy reliable and precise GenAI applications.

Since its inception, Galileo has rapidly gained traction, serving Fortune 100 banks, Fortune 50 telecom companies, as well as AI teams at prominent organizations such as Reddit and Headspace Health, among dozens of others.

Galileo has AI research at its core, having started out of the Stanford AI Lab, it is now a Series B business, backed by tier 1 investors such as Battery Ventures, Scale Venture Partners, Databricks Ventures, and others with $68M in total funding, with offices strategically located in New York and San Francisco, and is growing rapidly.

Role Description

• Work with top applied AI researchers in pushing the envelope of trustworthy GenAI development
• Be a strong source of ideas, communicated often to push the boundaries of the product to improve the lives of AI developers.
• Collaborate with engineering and product management to deeply understand the use cases of AI developers, and build first-of-their-kind features
• Read and research the latest LLM evaluation literature and apply them to Galileo's product offerings
• Work with Platform Engineering and Frontend teams, to ensure efficient computation times and delivery of robust AI algorithms

Minimum Qualifications

• 5+ years of experience in Applied AI Research, exploring new model architectures and implementing ML algorithms from scratch to launch products at scale.
• Strong experience with Pytorch, TensorFlow, Keras, or other Deep Learning frameworks
• Strong Experience with Generative or Seq-2-Seq Models
• Strong understanding of advanced evaluation techniques in Machine Learning
• Strong Python programming skills. Write efficient, clean, and scalable code.
• Strong communication skills, ability to understand complex technical concepts.
• Strong Research report writing skills
• Strong ML problem-solving skills, ability to do independent experiments (a self-starter mindset), but also collaborate in a team environment

If you are passionate about Machine Learning and have experience in being a Tech Lead in an ML team, this is a great opportunity for you. You will get to work on a groundbreaking product poised to revolutionize the way companies approach LLM Evaluations. Join our team at Galileo and help us build the future of Evaluations in Generative AI.

Why Galileo

• This is an opportunity to join a seasoned founding team that has previously led product and engineering teams from 0 to $100M+ in revenue and from 0 to 1B+ users globally
• We obsess over our team’s culture driven by inclusivity, empathy and curiosity
• We invest in our team’s development and happiness because our employees are the keys to our success and ensuring happy customers – towards that end, we offer: 
• • Unlimited PTO
  • Parental leave – 100% pay for 8 weeks
  • Medical, Dental and Vision Insurance
  • 401 (K) Retirement Savings Plan
  • Early stage equity 
  • Mental and Physical Wellness Stipend
  • Daily Lunch Stipend 
  • Offices in San Francisco and New York