Posted by Ross Stuckless on March 01, 1998 at 10:53:27:
I'm engaged in a number of applied research activities pertaining to ASR applications with people who are deaf or hard of hearing, and need a consistent method of assessing transcription accuracy. Developers and users regularly report accuracy by percentage, but rarely if ever report on how they arrived at their figures (or error types). The ARPA standards don't really help much in this regard.
By default I'm working on a protocol now, but would appreciate any comments you might have on the subject, and particularly about any documentation already out there.
Ross Stuckless