About Outsmart

Outsmart is an early‑stage startup on a mission to reimagine higher education. We are democratizing access to higher education by creating an entirely new collegiate experience. With $38M in backing from firms such as Khosla Ventures, Forerunner, DST Global Partners, and Lightspeed - and a founding team of former Duolingo executives - Outsmart is bringing together mission-oriented, detail-obsessed, high-impact team players to build the learning experiences of tomorrow.

About the role

• The Assessment Lead will be Outsmart's designated psychometrics and assessment expert, owning the design, development, validity, and quality assurance of a wide range of assessments across all of Outsmart learning experiences. You will leverage your expertise in psychometrics, assessment methodologies, and AI to build innovative, rigorous, and scalable assessment solutions that accurately measure student mastery and drive continuous product improvement.
• You'll bring the depth of a research scientist and the instincts of a product builder. That means rigorously applying psychometric principles to design valid and reliable AI-enabled assessments, collaborating closely with Academics, Product, Design and Engineering to ship novel assessment features, and solidifying Outsmart's reputation by publicly sharing research on our assessment validity.
• Location: Culver City, CA or Lehi, UT
• Reporting: Works in close partnership with the Head of Academics & Learning Engineering and the CEO.

Qualities We're Seeking

• Deep disciplinary expertise in Psychometrics, Educational Measurement, or a related field; comfortable applying various assessment methodologies
• High-energy, accountable, resourceful, and mission-driven — thrives in an early-stage environment
• Enthusiasm for leveraging AI and modern tooling to design scalable, secure, and engaging tech-enabled assessments.
• Track record of disseminating assessment results to both academic and public audiences.

What you'll do

• Drive the design, development, and psychometric validation processes for all Outsmart formative and summative assessments.
• Research and integrate cutting-edge assessment types, leveraging AI for item generation, scoring, and adaptive testing to enhance efficacy and student experience.
• Partner with Design, Product, Academic, and Engineering teams to transform assessment opportunities into high-quality, scalable, and technology-enabled product features.
• Lead the initiative to conduct and publish scholarly research on the validity, reliability, and efficacy of Outsmart's assessment suite in peer-reviewed journals and public forums, enhancing institutional credibility.
• Ensure all assessment practices meet institutional, accreditation, and regulatory standards for fairness, security, and rigor; contribute essential evidence for continuous improvement cycles.

Qualifications

• Degree in Psychometrics, Educational Measurement, Quantitative Psychology, or a closely related field; PhD preferred.
• 3+ years experience designing, validating, and managing assessments, ideally in a high-stakes, EdTech, or higher education context.
• Proven fluency with psychometric software/programming (e.g., R, Python) and statistical analysis for large-scale data sets.
• Demonstrated experience translating psychometric and measurement theory into practical, technology-enabled assessment product features.
• Strong publication record or proven ability to communicate complex research findings clearly to diverse audiences.

Perks

• Competitive salary and equity
• Healthcare for you and your dependents (medical, dental, and vision)
• Parental leave for any full-time employee who has been with us for at least 6 months (includes birthing, non-birthing, and adoptive parents)
• 10 PTO days per year and 12+ paid company holidays per year
• Remote work days
• Lunch provided in-office daily
• Work with super talented people who want to make a difference in the world