📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
-
Updated
Sep 19, 2024
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
[Paper List] Papers integrating knowledge graphs (KGs) and large language models (LLMs)
Add a description, image, and links to the awesome-llm topic page so that developers can more easily learn about it.
To associate your repository with the awesome-llm topic, visit your repo's landing page and select "manage topics."