How to design capacity for running LLMs locally? Asking for a startup
Hello everyone. I'm at a startup of a team of less than 10 ppl. Everyone in our team wants to use AI to speed up their work and iron out issues faster, which LLMs can be used for. The purposes we use LLMs can be coding, sales presentations, pitch p…