ReBAR "alternatives" for modified GPUs
-
So, I have 2x RTX 3080's with 20GB VRAM each (modified), and I saw that ReBAR is entirely broken on these cards.
Fortunately, there is some sort of "fix/alternative" to atleast get some of that performance back, although it's largely untested, found on this reddit thread, reading the messages from u/Difficult_Tip_6669.
The repo mentioned on the reddit thread seems to have some PoC on how to get barlink working again, although the repository seems shallow and unmaintained. I do believe there is some sort of untapped potential here to get these cards some needed performance boost.
Update: I got it working and made a script for it to be installed easily and working on vLLM/SGLang:
https://github.com/fedes1to/nvidia-modded-p2p/No AI used -
F fedes1to referenced this topic on
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login