This is an hybrid role based in Bangalore, India with the team working together in person 2 days per week.

About Galileo

Galileo is the leading platform for Gen AI evaluation and observability, with a mission to democratize building safe, reliable and robust applications in the new era of AI powered software development. Our foundation is built on pioneering the early technology behind the world's most ubiquitous AI applications including Apple's Siri and Google Speech. We firmly believe that AI developers require meticulously crafted, research-driven tools to create trustworthy and high-quality generative AI applications that will revolutionize our work and lifestyle.

Galileo addresses the complexities inherent in implementing, evaluating, and monitoring GenAI applications, optimizing the development process for both individual developers and teams by offering a comprehensive platform that spans the full AI development lifecycle. Galileo bridges critical gaps, significantly enhancing developers' ability to refine and deploy reliable and precise GenAI applications.

Since its inception, Galileo has rapidly gained traction, serving Fortune 100 banks, Fortune 50 telecom companies, as well as AI teams at prominent organizations such as Reddit and Headspace Health, among dozens of others.

Galileo has AI research at its core, with the founders coming from Google and Uber where they solved challenging AI/ML problems in the Speech, Evaluation and ML Infra domains. It is now a Series B business backed by tier 1 investors including Battery Ventures, Scale Venture Partners, and Databricks Ventures, with $68M in total funding. We are headquartered in San Francisco with locations such as New York and Bangalore, India forming our areas of future growth.

About the role

As an Applied Data Scientist at Galileo, you will be at the forefront of deploying and customizing advanced generative AI technologies for a diverse set of customers. Your role involves a dynamic combination of technical expertise and customer engagement, where you will work closely with customers to understand their unique AI challenges and deliver tailored solutions. Leveraging cutting-edge tools like retrieval augmented generation (RAG), large language models (LLM), and Galileo's proprietary technologies, you will develop, optimize, and integrate AI systems that drive significant improvements in customer workflows and decision-making processes.

In this role, you will also play a critical part in the iterative improvement of our technologies through continuous feedback and performance monitoring. You will provide expert-level support, troubleshoot and resolve issues, and conduct training sessions to empower users with the tools and knowledge needed to maximize the benefits of Galileo’s solutions. Your contributions will directly influence product strategy and development, ensuring that our solutions remain at the leading edge of industry standards and client expectations.

Main Responsibilities

• Implement Advanced ML Techniques: Work hands-on with state-of-the-art machine learning technologies, including Multi-agents, retrieval augmented generation (RAG), tools, and other cutting-edge LLM technologies, to enhance Galileo’s AI features.
• Develop and Optimize LLMs: Build, train, and refine large language models such as Llama and Mistral tailored for Galileo's users. Utilize the Galileo platform to enhance the performance and efficiency of these models, ensuring they meet specific customer requirements.
• Own and Evolve Metrics: Design, implement, and maintain evaluation metrics that power Galileo’s model intelligence system. Create high-quality datasets, engineer new prompts, and iterate on measurement frameworks to improve model performance tracking and interpretability.
• Collaborate Closely with Customers: Engage directly with Galileo's customers to deliver solutions that address their specific generative AI challenges. This involves understanding their unique needs and proposing tailored applications of Galileo’s technologies
• Contribute to Product Strategy: Provide insights and feedback from customer experiences to the product development teams to inform future product enhancements and new features. This role acts as a bridge between customer needs and the technical capabilities of Galileo.

Minimum Qualifications

• Bachelor’s degree in Data Science, Computer Science, Statistics, Mathematics, or a related quantitative field.
• At least 3 years of professional experience applying deep learning frameworks such as PyTorch, TensorFlow, or Keras to real-world business or product challenges
• A minimum of 1 year of hands-on experience working with large language models (LLMs) in production or applied settings.
• Proficiency in statistical analysis and data science methodologies using Python, R, or SQL
• Demonstrable experience in building and optimizing machine learning models.

Preferred Qualifications

• Master’s or Ph.D. in Data Science, Machine Learning, Computer Science, or a related field.
• Experience with large language models (LLMs) and technologies such as retrieval augmented generation (RAG) or similar ML models in production environments.
• Prior experience in implementing AI solutions in real-world applications, particularly in sectors relevant to Galileo's client base.
• Strong project management skills with a proven track record of leading projects from conception to implementation.
• Excellent communication and interpersonal skills, capable of explaining complex technical details to non-technical stakeholders and conducting effective training sessions.

Why Galileo

• Join a seasoned founding team that has previously led product and engineering teams from 0 to $100M+ in revenue and from 0 to 1B+ users globally
• We obsess over our team’s culture driven by inclusivity, empathy and curiosity
• We invest in our team’s development and happiness because our employees are the keys to our success and ensuring happy customers – towards that end, we offer: 
• • 🌴 Unlimited PTO
  • 👶 Parental Leave (birthing & non-birthing) – 100% pay for 8 weeks
  • 📈 Pre-IPO Stock Options
  • 🚌 Commuter Benefits (pre-tax + company sponsored)
  • 🧘 Mental & Physical Wellness Stipend
  • 🍱​ Catered Meals on in-office days
  • 🏢 HQ in Burlingame + hub in Brooklyn + hub in Bangalore
  • 🤝 Build the company alongside the Founders

*Benefits/perks may vary by state, country and employment type - please reach out to your recruiter for more information.

Galileo is an equal opportunity employer supporting workforce diversity. We do not discriminate on the basis of race, religion, color, national origin, gender identity, sexual orientation, age, marital status, protected veteran status, disability status, or any other unlawful factor.

Galileo is committed to providing any necessary accommodations for individuals with disabilities within our application and interview process. To request accommodation due to a disability, please inform your recruiter.

#LI-MA1