Opening
Lenny Rachitsky (00:00:00): To build great AI products, you need to be really good at building evals. It's the highest ROI activity you can engage in. Hamel Husain (00:00:05): This process is a lot of fun. Everyone that does this immediately gets addicted to it. When you're building an AI application, you just learn a lot. Lenny Rachitsky (00:00:12): What's cool about this is you don't need to do this many, many times. For most products, you do this process once and then you build on it....
The segment is an original transcript moment first. The interpretation should stay attached to what the language actually does.
Low-ego framing
title: "Why AI evals are the hottest new skill for product builders | Hamel Husain & Shreya Shankar (creators of the #1 eval course)" date: "2025-09-25" type: "podcast" guest: "Hamel Husain &...
Uses we/us, uncertainty, or learner framing instead of performing authority.
Accept praise cleanly
Hamel Husain (00:05:04): Thank you for having us. Shreya Shankar (00:05:05): Yeah, super excited. Lenny Rachitsky (00:05:07): I'm even more...
Accepts praise without shrinking from it or turning it into a performance.
Name the work
" But it doesn't work. Lenny Rachitsky (00:00:45): A term that you used in your posts that I love is this idea of a benevolent dictator. Hamel Husain (00:00:49): When you're doing this open coding,...
Names a concrete strength, artifact, or contribution instead of offering generic praise.
Low-ego framing
y. I only need to do 40, I only need to do 60. Actually, I only need to do 15." I don't know. Depends on the application and depends on how savvy you are with error analysis for sure. Lenny Rachitsky...
Uses we/us, uncertainty, or learner framing instead of performing authority.
Accept praise cleanly
Lenny Rachitsky (01:45:54): Amazing. Very generous. Thank you two, so much for being here. I really appreciate it, and you guys have a lot going on, so thank you. Shreya...
Accepts praise without shrinking from it or turning it into a performance.