vLLM · Open Collection

vLLM OpenAI-Compatible Server

12
Requests
6
Folders
1
Version
View on GitHub Raw JSON LLMInferenceOpen SourceGPUOpenAI CompatibleSelf-HostedOpen Collection

Overview

vLLM OpenAI-Compatible Server is a Open Collection published by vLLM on the APIs.io network, version 1.

The collection contains 12 requests organised into 6 folders.

Tagged areas include LLM, Inference, Open Source, GPU, and OpenAI Compatible.

Requests & Folders

Chat
Completions
Embeddings
Audio
Scoring
Tokenize
Back to vLLM · All Collections · GitHub