Skip to content
AIRigs
  1. Home
  2. Hardware

Hardware

5 Topics 5 Posts

GPUs, CPUs, memory, storage, cooling and power — the metal that runs the model.

This category can be followed from the open social web via the handle hardware@airigs.net

Subcategories

  • Consumer cards, datacentre parts and everything in between.

    4 4
    4 Topics
    4 Posts
    F
    So, Nvidia released the CMP series of cards long ago, targetting the crypto craze from back them, these are pretty much locked down A100's, but locked to low PCIe lanes on an old revision, bad compute for pretty much anything else and only 8-10GB of VRAM. Now, these cards do phisically have better capabilities, and they can get back the VRAM and the compute, although they still lack in PCIe speeds. Unlock instructions (repo) here: https://github.com/amoghmunikote/cmpunlocker

  • Core counts, memory channels, PCIe topology, sockets.

    0 0
    0 Topics
    0 Posts
    No new posts.

  • Capacity, bandwidth, NVMe, unified memory.

    0 0
    0 Topics
    0 Posts
    No new posts.

  • Airflow, water, PSU sizing, noise.

    0 0
    0 Topics
    0 Posts
    No new posts.

  • Version matrices and the fights they cause.

    1 1
    1 Topics
    1 Posts
    F
    So, I have 2x RTX 3080's with 20GB VRAM each (modified), and I saw that ReBAR is entirely broken on these cards. Fortunately, there is some sort of "fix/alternative" to atleast get some of that performance back, although it's largely untested, found on this reddit thread, reading the messages from u/Difficult_Tip_6669. The repo mentioned on the reddit thread seems to have some PoC on how to get barlink working again, although the repository seems shallow and unmaintained. I do believe there is some sort of untapped potential here to get these cards some needed performance boost. Update: I got it working and made a script for it to be installed easily and working on vLLM/SGLang: https://github.com/fedes1to/nvidia-modded-p2p/

  • Post the build as it happens: decisions, failures, wattage.

    0 0
    0 Topics
    0 Posts
    No new posts.