Doors08:30→08:30
MAINSTAGE
Next up
Home
TalkAI & Agents
Evals are the new unit tests
- Day
- Day 1 · Tue 18 May
- Time
- 15:30
- Length
- 40 min
- Room
- Room Tejo
About this session
How to grow an evaluation suite from forty examples to forty thousand, keep it fast, and make it block a release when it should.
Sofia shows the test cases that caught the worst regressions and the ones that turned out to be noise. The suite runs in six minutes on every pull request.
You will leave with
- How to write your first fifty eval cases
- Keeping a large suite fast
- Making evals block a release
Saves a calendar file with the room and the time in Lisbon time.
Next in Room Tejo
TalkAI & Agents
Evals are the new unit tests
- Day
- Day 1 · Tue 18 May
- Time
- 15:30
- Length
- 40 min
- Room
- Room Tejo
About this session
How to grow an evaluation suite from forty examples to forty thousand, keep it fast, and make it block a release when it should.
Sofia shows the test cases that caught the worst regressions and the ones that turned out to be noise. The suite runs in six minutes on every pull request.
You will leave with
- How to write your first fifty eval cases
- Keeping a large suite fast
- Making evals block a release
Saves a calendar file with the room and the time in Lisbon time.
Next in Room Tejo
TalkAI & Agents
Evals are the new unit tests
- Day
- Day 1 · Tue 18 May
- Time
- 15:30
- Length
- 40 min
- Room
- Room Tejo
About this session
How to grow an evaluation suite from forty examples to forty thousand, keep it fast, and make it block a release when it should.
Sofia shows the test cases that caught the worst regressions and the ones that turned out to be noise. The suite runs in six minutes on every pull request.
You will leave with
- How to write your first fifty eval cases
- Keeping a large suite fast
- Making evals block a release
Saves a calendar file with the room and the time in Lisbon time.
Next in Room Tejo
11 · See you there
See you in Lisbon.
Doors open · Tue, 18 May 2027 at 09:00 · Pavilhão do Rio
11 · See you there
See you in Lisbon.
Doors open · Tue, 18 May 2027 at 09:00 · Pavilhão do Rio
11 · See you there
See you in Lisbon.
Doors open · Tue, 18 May 2027 at 09:00 · Pavilhão do Rio