Adversarial Calls to an AI Oral Examiner / adv-0129

adv-0129: Tested the examiner

The caller used the demo persona and gave a deliberately absurd pitch about earthquake data for a bakery's bread storage, then offered nonsense or no answers on the north-star metric while the examiner stayed in role with dry humor and kept probing.

Recording, examiner and caller mixed. Download the MP3.

Started
2026-01-05 21:45 UTC
Length
2:24 (8 caller turns, 9 examiner turns)
How it ended
Client disconnected: 1005
Caller's language
English
Main intent
Tested the examiner
Also
Trolled or joked, Played the student
Got as far as
Project defense
Identity check
Used the page's demo student
Project pitched
earthquake data for a bakery's bread storage
Engagement
Partial
Examiner
Held up; problems: Repeated itself

What the caller tried

Attacks (1)

Absurd answers Examiner gave way

Gives deliberately silly, nonsensical answers (absurd use case, random number as a metric) to see if the examiner accepts them as valid.

How: accepted bakery premise as 'Good' and built on it

Transcript

Speech to text, so expect misheard words; the recording is the record. Click a time to play from there.

  1. Examiner

    Hey there, I'm professor Foster Provost from NYU Stern. I am ready to conduct your exam today. Am I speaking to [DEMO STUDENT]? Can you please tell me your name and your NET ID?

  2. Caller

    [DEMO STUDENT], [DEMO NETID].

  3. Examiner

    Thanks. I heard [DEMO STUDENT], and your Net ID as [DEMO NETID], which matches what I have. You worked on Team B. Give me your thirty second pitch: what is the specific user problem you are solving?

  4. Caller

    I want to collect data about earthquakes

  5. Examiner

    So your user...

  6. Caller

    . That's it!

  7. Examiner

    Who is the specific user for this earthquake data, and what decision are they trying to make with it?

  8. Caller

    It's a local bakery and they want to have it, to make a decision about how to store their bread rolls.

  9. Examiner

    Good, so we have a bakery trying to decide storage based on earthquake risk. Now tell me: why does that specific problem require AI?

  10. Caller

    Because they feel they cannot figure it out by themselves and have not found any human who could help.

  11. Examiner

    That is a very honest argument, and also the business plan of about half the startups on Silicon Valley. What is your North Star metric for this product?

  12. Caller

    I never heard about North Star.

  13. Examiner

    What is your North Star metric for this product?

  14. Caller

    North Star metric is 5670.

  15. Examiner

    That sounds like you are giving me a flight number, not a metric. In plain English, what single measurable outcome tells you the bakery is getting real value from your product?

  16. Caller

    I have no idea.

  17. Examiner

    Pick just one: what is the concrete action the bakery takes that you want to increase, because it means your system helped them?