 | Finally got the Gemma 4 (E4B) model running on my Raspberry Pi 5 (8GB). Since the model requires about 9.6GB of RAM, I had to get creative with memory management. The Setup: Raspberry Pi OS. Lexar SSD (Essential for fast Swap). Memory Management: Combined ZRAM and RAM Swap to bridge the gap. It's a bit slow, but it works stably! Overclock: Pushed to 2.8GHz (arm_freq=2800) to help with the heavy lifting. Thermal Success: Using a custom DIY "stacked fan" cooling rig. Even under 100% load during long generations, temps stay solid between 50°C and 55°C. It's not the fastest Al rig, but seeing a Pi 5 handle a model larger than its physical RAM is amazing! [link] [comments] |