https://www.artfintel.com/p/transformer-inference-tricks
Transformer inference tricks
How to make your model run faster than a greased pig
www.artfintel.com
'Daily-Trend-Review' 카테고리의 다른 글
| 2024/01/20: LLM Agents, DPO (0) | 2024.01.20 |
|---|---|
| 2024/01/05: Decoding Strategies in Large Language Models (1) | 2024.01.05 |
| 2023/12/25: Towards 100x Speedup: Full Stack Transformer Inference Optimization (0) | 2023.12.25 |
| 2023/12/23: optimizing your llm in production (0) | 2023.12.23 |
| 2023/12/23: RAG 101 (0) | 2023.12.23 |