I cant help myself its ~20% faster for me, I took the highest speed branch(for me), added the vision fix, and am just riding it out for now
Dual Xeon 8268, 1.5t 2666, Tesla T4
~122eval ~38t/s out
i tried using the release today and during some light coding lamma.cpp crashed and the model restarted, and I didn't experience any crashes on the pre-release versions personally so I jumped back into it
on the actual release branch now I get ~110eval ~30t/s out
just curious what everyone else is doing and if there were any major downsides on the early builds, anyone is aware of
[link] [comments]