VIN 
🇺🇦
🇺🇦
@nelov@social.linux.pizza
Software QA Engineer(tester) and linux user for 15 years. I like and do Linux, KDE & plasma, a bit of python & JS scripting and test automation.
social.linux.pizza
I've been playing with #LMStudio for #localLLM with mediocre results. However #gemma4 really changed that. It's faster and is more capable then the other models I could try on my hardware. It has recent data and is able to use a fetch tool(among others) to get info on stuff it doesn't know!
So I installed #ollama and now it runs even faster, to the point where delay(waiting) is not that noticeable.
Since I am a lightweight user, I can see myself using it as mainly source.
0
0
0
Larvitz 
@Larvitz@burningboard.net
IT Consultant from Germany, Linux enthusiast, BSD fanboy and firmly convinced that Ancient Domains of Mystery is the greatest video game of all time (and always will be). You'll find me here talking about Open Source, self-hosting, advanced networking (proud operator of AS201379), smart home shenanigans, and anything you can torment with a terminal. Cat pictures also welcome. Left, antifascist, vegan. The trifecta your uncle warned you about.
burningboard.net
Larvitz
@Larvitz@burningboard.net
IT Consultant from Germany, Linux enthusiast, BSD fanboy and firmly convinced that Ancient Domains of Mystery is the greatest video game of all time (and always will be). You'll find me here talking about Open Source, self-hosting, advanced networking (proud operator of AS201379), smart home shenanigans, and anything you can torment with a terminal. Cat pictures also welcome. Left, antifascist, vegan. The trifecta your uncle warned you about.
burningboard.net
@Larvitz@burningboard.net
·
Apr 11, 2026
I tried out the Gemma AI models from Google, running locally on my AMD APU (Ryzen 7 Pro 7840U with Radeon 780M) and asked it some questions about ZFS send / receive.
gemma-4-26B-A4B-Q4_K_M:
14.29 tok/sec . The information, it generated, was factually correct and well laid out. Not the fasted, and surprisingly good.
gemma-4-E4B-Q4-K_M:
26 tok/sec. The information was completely wrong BS with made up parameters. The presentation was confident and well laid out. But it generated it quickly 😂
Bottom line: confidently incorrect at high speeds.
#ai #gemma #lmstudio #llm #generativeAI #amd #radeon
10
2
3
You've seen all posts