Ferramentas de engenheiro LLM

List · 163 items

Ferramentas de engenheiro LLM

Jovan Soldatovic · 2 likes

163 itemsUpdated há 2 meses

ListServices · Products/Services

Ferramentas de engenheiro LLM

Jovan Soldatovic

@jovansoldatovic

163Items

2Likes

163 picks in “LLM Engineer Tools”, curated by Jovan Soldatovic on TheLysts.

See all 163 items Follow Jovan SoldatovicOpen in app

The list

Showing 61–70 of 163

Ferramentas de engenheiro LLM — 10 items
Name	Description	Category	URL
61VLLM	High-throughput and memory-efficient inference and serving engine for LLMs.	LLM Inference	https://github.com/vllm-project/vllm
62Torchchat	Run PyTorch LLMs locally on servers, desktop, and mobile.	LLM Inference	https://github.com/torchchat/torchchat
63TensorRT-LLM	TensorRT-LLM is a library for optimizing Large Language Model (LLM) inference.	LLM Inference	https://github.com/NVIDIA/TensorRT-LLM
64WebLLM	High-performance In-browser LLM Inference Engine.	LLM Inference	https://github.com/mlc-ai/web-llm
65Langcorn	Serving LangChain LLM apps and agents automagically with FastAPI.	LLM Serving	https://github.com/msoedov/langcorn
66LitServe	Lightning-fast serving engine for any AI model of any size. It augments FastAPI with features like batching, streaming, and GPU autoscaling.	LLM Serving	https://github.com/Lightning-AI/LitServe
67Crawl4AI	Open-source LLM-friendly web crawler and scraper.	LLM Data Extraction	https://github.com/unclecode/crawl4ai
68ScrapeGraphAI	Web scraping Python library that uses LLM and direct graph logic to create scraping pipelines for websites and local documents (XML, HTML, JSON, Markdown, etc.).	LLM Data Extraction	https://github.com/ScrapeGraphAI/ScrapeGraphAI
69Docling	Parses documents and exports them to the desired format with ease and speed.	LLM Data Extraction	https://github.com/Docling/Docling
70Llama Parse	GenAI-native document parser that can parse complex document data for any downstream LLM use case (RAG, agents).	LLM Data Extraction	https://github.com/LlamaParse/LlamaParse
153 more items in this listSign up free to see them all, with every column and every photograph.Sign up free