KV Cache, ChatGPT’s Memory
Last Update: April 23rd, 2024 Note: To Truly grasp the key concepts derived from the following article, I highly suggest you take a look first at my previous post where I dive deep into the attention mechanism. There’s a critical piece in the attention mechanism that is rarely mentioned but is really important going by […]
