Suppose you discovered that AI transcription mistakenly ascribed points made by women to male participants in meetings 40% of the time - would you continue to use it? What if it was 4%? Or 0.4% (i.e., once every 250 meetings)? Do you and/or your employer have a threshold or SLA? Are you/they even thinking in those terms?
1
Replies
·
0
Boosts
@gvwilson in my experience the people using and trusting the transcription tools do not care about the inaccuracies enough to measure them, whereas the people who do care about accuracy have trialled the LLM transcription tools only deeply enough to conclude that they are intolerably inaccurate and never bothered to try to quantify the inaccuracy.
My employer does not have an accuracy SLA or SLO and is not thinking in those terms.
