I was found a listing on eBay for a “Mellanox CX354A ConnectX-3 FDR Infiniband 40GbE QSFP+” card for quite cheap. By the sound of the listing title it supports both infiniband and 40GbE, is that right? I would like to try out infiniband, but I would be buying for the 40GbE. And are there good drivers for modern linux distros for this card? Also, do I just buy some QSFP cables to direct attach them?

  • Thomas Douwes@sopuli.xyzOP
    4·
    7 months ago

    Thanks for the detailed reply. I found a QSFP+ DAC that says it supports IB and Ethernet.
    I don’t have enough computers to set up a fabric, only the 2 I would be direct attaching have PCIE slots.

    I’ve never used infiniband before so my reason for wanting to try it is just to learn what it is, and how it works. That said, some of those use-cases look very interesting, especially transporting NVMe namespaces, I didn’t know that was possible.