ai, coding-agents, generative-ai, georgi-gerganov, LLMs, local-llms

Quoting Georgi Gerganov

Note that the main issues that people currently unknowingly face with local models mostly revolve around the harness and some intricacies around model chat templates and prompt construction. Sometimes there are even pure inference bugs. From typin…