Home/LLM Engineer Tools/TensorRT-LLMItemTensorRT-LLMin LLM Engineer Tools by Jovan SoldatovicLike this itemFollow Jovan SoldatovicOpen in appTensorRT-LLM on “LLM Engineer Tools”, a list by Jovan Soldatovic on TheLysts.DetailsDescriptionTensorRT-LLM is a library for optimizing Large Language Model (LLM) inference.CategoryLLM InferenceURLhttps://github.com/NVIDIA/TensorRT-LLMPreviousTorchchatNextWebLLMRelated itemsLangChainHugging Face TransformersOpenAI GPT-3CohereReport
TheLysts