 | I was excited to try Mimo given all the buzz on here, so before downloading the quantized local version, I got the token subscription to try it for a month (costs less than a latte). It's really rough, like shockingly bad as some things. A simple prompt that is a layup for every other frontier and local recent model I've tried "write an html page showing a 3d globe", it thought for 10 minutes and came up with this: Asked it to assume the identity of an apple web designer and critique its prior work and it came up with something much better: I asked it to make the stars more visible and then it spun out with looping that it could not escape, broke the mouse controls, got fixated on downloading javascript, could not stop using tools when asked not to use tools. I had to break its train of thought by asking it to count back from 20 like a child having a tantrum. And it finally came up with this: If this were a local quantized model I'd give it a pass, because it handled two other website prompts (a spatial canvas website demo and a pokemon pokedex) reasonably well if somewhat uninspired. It surprisingly passed my Soul Man challenge (asking an LLM who starred in the 1980s comedy Soul Man makes them tend to loop and hallucinate). I'm going to keep trying it out, but Qwen doesn't stumble like this, local Deepseek doesn't stumble like this. Quite strange. [link] [comments] |
