Notify and Identify Videos with ASR Transcripts and Closed Captions
being evaluated
M
Mark van de Velde
NOTIFY: After a video is uploaded and the institution has ASR Transcripts and/or auto CC enabled, the owner should receive an email with the Transcript accuracy score and (if enabled) the auto Transcript to Closed Caption status (successful or not).
IDENTIFY: In the Library List View, (and somewhere in the Course view) there should also be a column showing videos with/without Transcripts and Closed Captions.
Mikee Elliott
Steve Garwood - the Transcribe service has a 'confidence' metric, and I think that's perhaps what the request is after. Some additional detail on the text-word-outputter would be great, like processing start-stop-result-confidence
S
Steve Garwood
Mikee Elliott Understood. Unfortunately "Confidence" doesn't mean much. It's a goal not a reality. Perhaps if there was a secondary program to correct the transcript and determine a true accuracy rate that would be helpful. ASR generally does a good job with western, male voices speaking at a modest cadence, but is challenged with other voices.
S
Steve Garwood
You can't really get a Transcript accuracy rate w/out an edited transcript. I'm not sure even AI could do that well if the original ASR didn't do a good job. I like the idea, I just don't think we're there yet.
Simon Durrant
Would it be better to report on videos that have no Closed Captions or Transcripts, especially when you have closed captions turned on by default? That would then highlight that there was an audio issue on an audio issue on the recording, and a possible hardware fault.
Marc Jennings
marked this post as
being evaluated