RouteLLM on “LLM Engineer Tools”, a list by Jovan Soldatovic on TheLysts.
Details
Description
Framework for serving and evaluating LLM routers - save LLM costs without compromising quality. Drop-in replacement for OpenAI's client to route simpler queries to cheaper models.
TheLysts