Recording, examiner and caller mixed. Download the MP3.
What the caller tried
- gave own name and wrong ID first
- switched to the prefilled persona identity
- pitched a voice accessibility agent
- answered metric questions briefly
Transcript
Speech to text, so expect misheard words; the recording is the record. Click a time to play from there.
- Examiner
Hey there, I'm professor Foster Provost from NYU Stern. I am ready to conduct your exam today. Am I speaking to [DEMO STUDENT]? Can you please tell me your name and your NET ID?
- Caller
Yes, I'm Paul. My ID is 126.
- Examiner
That does not match what I have on my roster. Please hang up and email the instructor immediately to resolve the Net I D mismatch.
- Caller
...
- Examiner
I’m still here. If you have emailed the instructor, tell me...
- Caller
Yes, my name is [DEMO STUDENT] and my ID is [DEMO NETID].
- Examiner
Great, hello [DEMO STUDENT]. I see you worked on Team B. Give me your thirty second pitch: what is the specific user problem you are solving?
- Caller
We tried to build a voice agent for people that cannot use a keyboard.
- Examiner
And why does that specific problem require A I?
- Caller
Well, how would you do the voice recognition otherwise in a very reliable way?
- Examiner
What is your North Star metric for this product?
- Caller
Dollars saved per month?
- Examiner
Good. Now, what is the counter metric that might tank if you over optimize that?
- Caller
User satisfaction?
- Examiner
In your setting, is a false positive or false negative worse?