zylin12 commited on
Commit
e6d68cd
·
verified ·
1 Parent(s): ae514ed

Bold vLLM in serving docs

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -282,7 +282,7 @@ curl -X POST http://localhost:8000/v1/audio/transcriptions \
282
  -F max_new_tokens=65536
283
  ```
284
 
285
- MOSS-Transcribe-Diarize also supports vLLM serving through the OpenAI-compatible transcription API. Use a pinned vLLM nightly build that includes the MOSS-Transcribe-Diarize model registration. Choose one of the following commands: for CUDA 12 environments, use `cu129`; for CUDA 13 environments, use `cu130`.
286
 
287
  ```bash
288
  uv pip install -U vllm \
 
282
  -F max_new_tokens=65536
283
  ```
284
 
285
+ MOSS-Transcribe-Diarize also supports **vLLM** serving through the OpenAI-compatible transcription API. Use a pinned vLLM nightly build that includes the MOSS-Transcribe-Diarize model registration. Choose one of the following commands: for CUDA 12 environments, use `cu129`; for CUDA 13 environments, use `cu130`.
286
 
287
  ```bash
288
  uv pip install -U vllm \