[D] Will Google’s TurboQuant algorithm hurt AI demand for memory chips? [D]
Google's TurboQuant claims to compress the KV cache by up to 6x with 'little apparent loss in accuracy' by reconstructing it on the fly. For those who have looked into similar KV cache compression techniques, is a 6x reduction without notic…