https://huggingface.co/blog/optimize-llm
Optimizing your LLM in production
Optimizing your LLM in production Note: This blog post is also available as a documentation page on Transformers. Large Language Models (LLMs) such as GPT3/4, Falcon, and LLama are rapidly advancing in their ability to tackle human-centric tasks, establish
huggingface.co
'Daily-Trend-Review' 카테고리의 다른 글
| 2024/01/02: Transformer inference tricks (0) | 2024.01.02 |
|---|---|
| 2023/12/25: Towards 100x Speedup: Full Stack Transformer Inference Optimization (0) | 2023.12.25 |
| 2023/12/23: RAG 101 (0) | 2023.12.23 |
| 2023/12/23: how to make LLMs go fast (0) | 2023.12.23 |
| 2023/12/18: Mixtral 8x7B (1) | 2023.12.18 |