LLM Compressor on “LLM Engineer Tools”, a list by Jovan Soldatovic on TheLysts.

Details

Description
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment.
Category
LLM Inference