24GB M4 Mac – is Qwen 9B only option while system is running?
I have mac at work that I want to use local model for prototyping and basic prompts that needs to stay on device. What sort of model I can run that I can fit at least 64k context ? Any setups sbare or guides welcome. I need to have firefox open with on…