LLM Compressor: Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment.

Details

Photo
—
Name
—
Description
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment.
Category
LLM Inference