LLM Engineer Tools
List · 163 items

LLM Engineer Tools

Jovan SoldatovicJovan Soldatovic
163 items
List

LLM Engineer Tools

Jovan Soldatovic
@jovansoldatovic
163Items

163 picks in “LLM Engineer Tools”, curated by Jovan Soldatovic on TheLysts.

The list

Rank
LLM Engineer Tools — 10 items
NameDescriptionCategoryURL
120Weights & Biases (W&B)W&B provides features for tracking LLM performance.LLM Monitoringhttps://github.com/wandb/wandb
121HeliconeOpen source LLM-Observability Platform for Developers. One-line integration for monitoring, metrics, evals, agent tracing, prompt management, playground, etc.LLM Monitoringhttps://github.com/Helicone/helicone
122EvidentlyAn open-source ML and LLM observability framework.LLM Monitoringhttps://github.com/evidentlyai/evidently
123PhoenixAn open-source AI observability platform designed for experimentation, evaluation, and troubleshooting.LLM Monitoringhttps://github.com/arboretum-ai/phoenix
124ObserversA Lightweight Library for AI Observability.LLM Monitoringhttps://github.com/observerly/observers
125PCToolkitA Unified Plug-and-Play Prompt Compression Toolkit of Large Language Models.LLM Promptshttps://github.com/mit-han-lab/pctoolkit
126Selective ContextCompresses your prompt and context to allow LLMs (such as ChatGPT) to process 2x more content.LLM Promptshttps://github.com/selective-context/selective-context
127LLMLinguaLibrary for compressing prompts to accelerate LLM inference.LLM Promptshttps://github.com/llmlingua/llmlingua
128BetterpromptTest suite for LLM prompts before pushing them to production.LLM Promptshttps://github.com/betterprompt/betterprompt
129PromptifySolve NLP Problems with LLMs & easily generate different NLP Task prompts for popular generative models like GPT, PaLM, and more.LLM Promptshttps://github.com/promptslab/Promptify
153 more items in this listSign up free to see them all, with every column and every photograph.Sign up free