LocalLLaMA

Got OpenAI’s privacy filter model running on-device via ExecuTorch

Been experimenting with running OpenAI's privacy filter model on mobile through ExecuTorch. Sharing in case it's useful to others working on similar problems. Setup: – Runtime: ExecuTorch – Memory footprint: ~600 MB RAM – Bridge: react-na…