LLM Inference

Inference routing for Federal Frontier — the Frontier llm-router, self-hosted llm-d and vLLM, local workstation, and commercial frontier models including Bedrock.

Inference routing for Federal Frontier — the Frontier llm-router, self-hosted llm-d and vLLM, local workstation, and commercial frontier models including Bedrock.

In this section

• Overview
• Model Selection
• vLLM Production