The full Gemma 3 27B model runs smoothly on Framework Desktop with Ryzen AI Max! (note: not performance optimized yet)
@frameworkcomputer Which model of the desktop is this running on?
@samthecoy Appears to be Google's Gemma-3-27b
@frameworkcomputer I mean which desktop
@frameworkcomputer Video for speed?
@frameworkcomputer i realize that at this point you're locked into promoting this thing since you're already committed to making it but i gotta say the framework desktop seems like by far the worst thing you've made, and a stain on your reputation. soldered ram so that people can have the memory bandwidth to run shitty little llms really doesn't seem like something worthwhile.
@frameworkcomputer
Got it. Framework is not an ally to human beings.
I really misjudged this company. Shows me for thinking there is such a thing as a good company.
@halotroop2288 @frameworkcomputer I would not be too concerned here.
The desktop is clearly a marketing stunt from AMD, trying to push their AI crap by using the #Framework brand.
It gives them money to work on actually good (i.e. repairable and customizable) devices.
@dirk
@frameworkcomputer
Then fuck AMD, too. But clearly Framework is to blame for what is literally their posts, and their hardware. Whether that's because they agreed to something AMD came up with, or they came up with it themselves.
It's shitty, anti-consumer, anti-human behavior. There's no excuse for it.
@halotroop2288 @frameworkcomputer This MUST be something they agreed to because if they came up with it on their own, they had a stroke or something. The desktop is not modular, nor repairable, cannot be upgraded, and defective parts cannot be changed.
For a desktop this is the least "desktop-y" device imaginable with soldered RAM and no proper card slots. Even the worst desktop hardware I had to work on was more modular and flexible than this AI box.
If #Framework really came up with this on their own, then they entirely failed their promise and proclaimed morale.
@dirk
@frameworkcomputer
I argue that the last part is true regardless of whether it was their idea initially because in the end, they went through with it! And that part was a continuous decision that had to take a lot of R&D. And at no point did they stop the project to re-examine their core values and say that this is not OK.
@frameworkcomputer does it recognize the Framework in the image or thinks it's a mac?
@joaquimCarneiro Did not run this model myself, but the actual image is a Framework product.
@frameworkcomputer my question was a reference to Framework AI test Youtube video (https://youtu.be/GbOzaYU694U) where the AI (old model) recognized the framework laptop as a macbook
(edit: sorry wrong link, updated...)
@frameworkcomputer man I'd love to get one of these someday! What a beast of an AI homelab server!