Best LLM for Mac Mini M4 Pro (64GB RAM) – Focus on Agents, RAG, and Automation?

Hi everyone!

I just got my hands on a Mac Mini M4 Pro with 64GB. My goal is to replace ChatGPT on my phone and desktop with a local setup.

I’m specifically looking for models that excel at:

  1. Web Search & RAG: High context window and accuracy for retrieving info.
  2. AI Agents: Good instruction following for multi-step tasks.
  3. Automation: Reliable tool-calling and JSON output for process automation.
  4. Mobile Access: I plan to use it as a backend for my phone (via Tailscale/OpenWebUI).

What would be the sweet spot model for this hardware that feels snappy but remains smart enough for complex agents? Also, which backend would you recommend for the best performance on M4 Pro? (Ollama, LM Studio, or maybe vLLM/MLX?)

Thanks!

submitted by /u/farmatex
[link] [comments]

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top