2023/04/05: transformer 추론 연산, Check your facts and try again 등

1. Five years of GPT progress

source: https://finbarr.ca/five-years-of-gpt-progress/?

2. Large language models aren't trained enough.

source: https://finbarr.ca/llms-not-trained-enough/

3. Transformer Inference Arithmetic

source: https://kipp.ly/blog/transformer-inference-arithmetic/

4. Transformer Taxonomy (the last lit review)

source: https://kipp.ly/blog/transformer-taxonomy/

5. What can RL do?

source: https://ropiens.tistory.com/215?fbclid=IwAR1kGG2H8mwoQG7NwNqIUoO0U2-n9__S1RMST2Bb1fBEkSqy3S11B6ts4xQ

6. Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedback

source: https://arxiv.org/pdf/2302.12813.pdf
source: https://www.microsoft.com/en-us/research/group/deep-learning-group/articles/check-your-facts-and-try-again-improving-large-language-models-with-external-knowledge-and-automated-feedback/