LLM Engineer Tools
List · 163 items

LLM Engineer Tools

Jovan SoldatovicJovan Soldatovic
163 items
List

LLM Engineer Tools

Jovan Soldatovic
@jovansoldatovic
163Items

163 picks in “LLM Engineer Tools”, curated by Jovan Soldatovic on TheLysts.

The list

Rank
LLM Engineer Tools — 10 items
NameDescriptionCategoryURL
50RAG to RichesBuild, scale, and deploy state-of-the-art Retrieval-Augmented Generation applications.LLM RAGhttps://github.com/SciPhi-AI/R2R
51BeyondLLMAn all-in-one toolkit for experimentation, evaluation, and deployment of Retrieval-Augmented Generation (RAG) systems.LLM RAGhttps://github.com/aiplanethub/beyondllm
52SQLite-VecA vector search SQLite extension that runs anywhere!LLM RAGhttps://github.com/asg017/sqlite-vec
53FastRAGA research framework for efficient and optimized retrieval-augmented generative pipelines, incorporating state-of-the-art LLMs and Information Retrieval.LLM RAGhttps://github.com/IntelLabs/fastRAG
54FlashRAGA Python toolkit for efficient RAG research.LLM RAGhttps://github.com/RUC-NLPIR/FlashRAG
55LlmwareUnified framework for building enterprise RAG pipelines with small, specialized models.LLM RAGhttps://github.com/llmware/llmware
56RerankersA lightweight unified API for various reranking models.LLM RAGhttps://github.com/AnswerDotAI/rerankers
57VectaraBuild agentic RAG applications.LLM RAGhttps://www.vectara.com/
58LLM CompressorTransformers-compatible library for applying various compression algorithms to LLMs for optimized deployment.LLM Inferencehttps://github.com/vllm-project/llm-compressor
59LightLLMPython-based LLM inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.LLM Inferencehttps://github.com/LightLLM/LightLLM
153 more items in this listSign up free to see them all, with every column and every photograph.Sign up free