4GB "Gemini Nano" model GGUF anyone?

Hi everyone,

I saw an article saying Chrome silently downloads a ~4GB AI model (likely "Gemini Nano") to your computer for features like text summarization.

Two questions:

  1. What is the exact name/version of this model?
  2. Is there a GGUF file available for download so I can run it locally with llama.cpp?

I want to use it locally instead of letting Chrome run it in the background.

Thanks!

submitted by /u/TruckUseful4423
[link] [comments]

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top