MTP vs non-MTP vram usage difference?
As per title, assuming you run both with the same context and quantization in llama.cpp is there any difference in vram usage? submitted by /u/DeepBlue96 [link] [comments]
LocalLLaMA
As per title, assuming you run both with the same context and quantization in llama.cpp is there any difference in vram usage? submitted by /u/DeepBlue96 [link] [comments]