 | Run on my rtx4090 llama.cpp params: Power limit was set using sudo nvidia-smi -pl N On my observation, GPU constantly hitting power limit, so its safe to say that it actual consumption. You can cut power consumption to 40% without losing performance(and also reduce noise, heat from pc, and extend lifespan of gpu). [link] [comments] |