Strata: Run decent models on small hardware
-
Well someone finally made a decent engine for (smaller) MoE's such as Qwen 3.8 Flash Next for hardware that mere mortals can also own.
Link hereThe numbers provided in the repo's README file are impressive, I hope there's more work put into this.
Unfortunately it only works on NVIDIA GPUs, and also has barebones support for multi-GPU setups.No AI used
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login