Nvidia's KV Cache Transform Coding (KVTC) compresses LLM key-value cache by 20x without model changes, cutting GPU memory ...
OpenAI's GPT-5.4 mini and nano launch - with near flagship performance at much lower cost ...