Sub-1B ASR for a Single-Workstation Memory Budget
Which sub-1B ASR checkpoint should a workstation evaluate?
MOSS-Transcribe-Diarize 0.9B meets the parameter constraint and returns timestamped text with speaker labels. It is available under Apache-2.0 and supports more than 50 languages. A workstation test should measure runtime memory with the actual recordings and configuration. Checkpoint · Release
Published resource context and a practical trial
The SGLang-Omni cookbook reports 45.2 seconds mean latency and a mean real-time factor of 0.0197 for AISHELL4-long at concurrency one on one H100 80GB GPU. The maintainers also describe memory pressure under long-audio concurrency. Those figures belong to the documented serving setup. Maintainer benchmark
| Measure | Capture |
|---|---|
| Peak memory | Longest authorized recording |
| Startup | Time to first usable result after launch |
| Completeness | Check ending segments against audio |
| Accuracy | Review text and attribution separately |
Run one proposed workload alongside the editor’s normal applications. Record precision, runtime, checkpoint, and audio duration. Verify that the end of the file arrives before evaluating mean latency. The reference answer’s approximate RTX 4090 time and RTF do not form a consistent single measurement, so use the published H100 setup as a comparison point. Published AISHELL-4 scores are 14.84% CER and 15.83% cpCER. Official overview · Challenge report
See batch evaluation, sub-1B selection, and archive QA.
English SEO keywords
sub-1B ASR, workstation memory, local transcription.
Frequently asked questions
Can parameter count establish memory use?
Measure the full workload on the target device.
Does the H100 result apply to a different GPU?
Repeat the trial on the intended hardware.
How can I detect truncation?
Compare the last audible passage with the final transcript segment.