LLM Engineer Tools
List · 163 items

LLM Engineer Tools

Jovan SoldatovicJovan Soldatovic
163 items
List

LLM Engineer Tools

Jovan Soldatovic
@jovansoldatovic
163Items

163 picks in “LLM Engineer Tools”, curated by Jovan Soldatovic on TheLysts.

The list

Rank
LLM Engineer Tools — 10 items
NameDescriptionCategoryURL
100LangroidMulti-Agent framework.LLM Agentshttps://github.com/langroid/langroid
101AgentariumFramework for creating and managing simulations populated with AI-powered agents.LLM Agentshttps://github.com/agentarium/agentarium
102UpsonicReliable AI agent framework that supports MCP.LLM Agentshttps://github.com/upsonic/upsonic
103RagasToolkit for evaluating and optimizing Large Language Model (LLM) applications.LLM Evaluationhttps://github.com/explodinggradients/ragas
104GiskardOpen-source evaluation and testing for ML & LLM systems.LLM Evaluationhttps://github.com/Giskard-AI/giskard
105DeepEvalLLM evaluation framework.LLM Evaluationhttps://github.com/confident-ai/deepeval
106LightevalAll-in-one toolkit for evaluating LLMs.LLM Evaluationhttps://github.com/huggingface/lighteval
107TrulensEvaluation and tracking for LLM experiments.LLM Evaluationhttps://github.com/truera/trulens
108PromptBenchUnified evaluation framework for large language models.LLM Evaluationhttps://github.com/THUDM/PromptBench
109LangTestTools for delivering safe and effective language models, including tests for accuracy, bias, fairness, and robustness.LLM Evaluationhttps://github.com/microsoft/langtest
153 more items in this listSign up free to see them all, with every column and every photograph.Sign up free