RouteLLM

Details

Photo

—

Name

—

Description

Framework for serving and evaluating LLM routers - save LLM costs without compromising quality. Drop-in replacement for OpenAI's client to route simpler queries to cheaper models.

Category

Routers

URL

https://github.com/lm-sys/RouteLLM