Driver FixRecommendedSound, Wi-Fi or graphics acting up? Check drivers firstFind missing or outdated drivers fast.Check DriversHalloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsPC HealthRecommendedCrashes, freezes, slowdowns? Check your PC nowSpot repairable issues before they interrupt work.Check PC×
FREEDOM251

Freedom251 › Blog › AI infrastructure

How to Choose Ethernet Switches and Adapters for an AI Cluster

By Freedom251 Team · · 10 min read

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Choose the network adapter and switch fabric as one, platform-specific design. Start with the GPU/server platform and its validated reference architecture, then select the adapter family, plane topology, switch ports, and physical links that the architecture supports. The fastest adapter on a product page is not automatically the right choice: NVIDIA’s current documentation ties particular adapters and plane arrangements to particular systems, Network Operator releases, and configuration profiles.

What you are actually designing

An AI cluster’s Ethernet fabric carries the GPU-to-GPU traffic that NVIDIA calls the compute or east-west network. In a distributed training job, this traffic can dominate application behavior, so the network has to be considered alongside the GPU platform, host firmware, operating system, Kubernetes configuration, and accelerator software.

As an Amazon Associate I earn from qualifying purchases.

NVIDIA describes Spectrum-X as an AI-optimized Ethernet platform combining Spectrum switches with BlueField-3 SuperNIC, ConnectX-7 NIC, and ConnectX-8 SuperNIC families for high-bandwidth, lossless RoCE. That description identifies a coordinated platform, not a universal bill of materials. The exact switch SKU, port count, signaling rate, optics or cables, and reach still depend on the server design and the physical layout.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

A sound decision therefore answers five questions in order:

#1 Best Overall
Elebase USB to USB C Adapter for iPhone 18 Pro Max,USBC Car Charger Adapter | 4Pack Type C Female to A Male Cable Converter for Apple Duo 17 16 15 14 Plus,iWatch Watch 12 11 10,iPad 9 8 Air,Airpods 5 4
  • Read Before You Buy — No Video Output: These adapters support charging and USB 2.0 data transfer, but cannot transmit video signals. Except for standard USB webcams (which use USB data only), they are not compatible with HDMI/DisplayPort cables, video-capable USB-C hubs, or docking stations with video output.
  • Convert USB-A Ports to USB-C: Designed to connect USB-C earphones, cables, flash drives, card readers, and other USB-C accessories to standard USB-A ports. Plug-and-play with no drivers or software required.
  • Aluminum Alloy Housing: Built with a sturdy aluminum alloy shell that aids in heat dissipation and protects against daily wear and scratches. Designed to maintain a stable and secure connection.
  • Compact & Travel-Friendly: The ultra-compact design allows the adapter to stay plugged into your device without blocking adjacent ports or adding bulk, reducing wear and tear on your original USB ports.
  • 12-Month Warranty: Backed by a 12-month manufacturer warranty for peace of mind. Designed to meet strict quality control standards for reliable everyday performance.
  • Which GPU/server platform and reference architecture are you implementing?
  • Does the design use one, two, or four network planes?
  • Which adapter family and Network Operator release are validated for that platform?
  • How many switch ports and what media are required for the actual host and uplink count?
  • Can the complete configuration be installed, tuned, supported, and serviced as one system?

Start with the validated GPU and server platform

Record the server model, GPU generation, number and type of adapter ports per host, intended east-west workload, and software release before requesting switch quotes. NVIDIA’s architecture page, updated September 9, 2026, lists Network Operator 26.7.x with Spectrum-X reference architecture 2.3 at general-availability support. Use that page and the matching platform guide as the authority for your specific system rather than inferring support from a similar-looking adapter.

Documented platform example Topology described Adapter family named by NVIDIA
HGX H100, HGX H200, or HGX B200 Single-plane BlueField-3
GB200 Single-plane ConnectX-7
GB200 Single-plane option ConnectX-8 is permitted in the cited platform guidance
B300 or GB300 Single-plane ConnectX-8
B300 or GB300 Multiplane ConnectX-8

These are architecture mappings, not a claim that every server containing one of those GPUs has identical support. Confirm the server’s exact adapter placement, firmware, switch combination, and software release in the solution-stack documentation or with the system integrator.

Why platform-first selection matters

Reference architectures constrain more than link speed. They can determine the supported NIC family, the number of planes, the load-balancing mode, required virtual functions, host kernel preparation, and the profile used by the Kubernetes operator. Replacing a named adapter with a newer or faster model can move the installation outside the validated configuration even when the connector and advertised Ethernet rate appear compatible.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Choose the plane topology before buying ports

A plane is an independent network path used by the platform’s fabric design. Single-plane systems have one path. The cited NVIDIA multiplane quick start defines two planes for a dual-plane configuration and four planes for a quad-plane configuration. Those counts are configuration values, not measured throughput results.

Topology Documented plane count Load-balancing guidance
Single-plane One No multiplane load-balancing mode
Dual-plane Two Use the mode supported by the platform and release
Quad-plane Four Use the mode supported by the platform and release

For the documented B300 and GB300 multiplane deployment, ConnectX-8 supports hardware plane load balancing (hwplb) and software plane load balancing (swplb). NVIDIA identifies hardware multiplane load balancing as the recommended mode on multiplane platforms. Treat that as architecture guidance, not as an independent performance benchmark.

Hardware versus software plane balancing

Hardware balancing places the distribution function in supported NIC hardware; software balancing performs it through the host networking stack. The choice is not interchangeable across adapters. NVIDIA’s NIC configuration documentation restricts hwplb to ConnectX-8 or ConnectX-9. ConnectX-9 Spectrum-X use is marked Tech Preview in Network Operator 26.7 and is not covered by Spectrum-X reference architecture 2.3 validation, so its general support for a feature must not be presented as proof of validated RA 2.3 support.

Do not add planes merely because a switch has spare ports. Each additional plane affects adapter count, switch count or port allocation, cabling, host configuration, and failure-domain planning.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Rank #2
Sale
Anker USB-C Hub, 5-in-1 USB Hub for Laptops, 4K HDMI Multiport Adapter | USB C Dongle with 90W Max Power Delivery, 3×5Gbps USB A Data Ports, for MacBook, Dell, and More (Charger Not Included)
  • 5-in-1 USB-C Hub: Experience comprehensive connectivity featuring a Power Delivery input, two USB-A 2.0 ports, a USB-A 3.0 port, and an HDMI port. (Note: The USB-C power delivery input port is only for connecting an external wall charger to power your laptop and cannot power peripheral devices.)
  • 90W Pass-Through Charging: Achieve optimal charging with 90W pass-through power to your laptop, supported by a total input of 100W, with the hub reserving 10W for operational efficiency. (Note: Wall charger not included.)
  • Quick Data Transfers: Accelerate your productivity with rapid data transfers using a high-speed 5Gbps USB 3.0 port and two 480Mbps USB 2.0 ports.
  • 4K HDMI Display: Enhance your visual experience with a hub capable of delivering 4K resolution at 30Hz in both mirror and extend modes. Please note that this hub is compatible with MacBook (macOS 12 and newer), Windows 10 and 11, ChromeOS, and laptops equipped with DP Alt Mode and Power Delivery. Note: This device is not compatible with Linux.
  • What You Get: Anker USB-C Hub (5-in-1, 4K HDMI), welcome guide, 18-month warranty, and our friendly customer service.

Select the adapter and software stack together

Validated adapter choices

For the platform examples above, use the named BlueField-3, ConnectX-7, or ConnectX-8 family first. NVIDIA’s documentation also describes ConnectX-6 Dx as an Ethernet adapter with RoCE support, making it a bounded option for compatible RoCE Ethernet designs. The available documentation does not establish ConnectX-6 Dx as the current Spectrum-X RA 2.3 adapter choice; treat it as a separate, compatibility-reviewed design rather than a drop-in substitute.

Adapter family What the cited documentation establishes How to treat it in a purchase decision
BlueField-3 Named for single-plane HGX H100, H200, and B200 examples Use when the exact HGX solution stack validates it
ConnectX-7 Named for the GB200 single-plane example Match to the GB200 reference architecture and release
ConnectX-8 Named for B300/GB300 multiplane deployments and permitted for documented single-plane use Use for the corresponding validated platform and plane count
ConnectX-9 Spectrum-X use is Tech Preview and outside RA 2.3 validation Do not describe it as a validated RA 2.3 choice
ConnectX-6 Dx RoCE on Ethernet is documented Consider only after a separate compatibility review

Required Network Operator settings

The Network Operator 26.7 NIC configuration for Spectrum-X requires Ethernet link type and one virtual function. In configuration terms, the relevant values are linkType: Ethernet and numVfs: 1. The operator also requires the appropriate reference-architecture tuning profile to be supplied as a ConfigMap and referenced by name. Earlier operator releases included some tuning internally; do not assume that behavior in 26.7.

Capture the exact operator version, profile ConfigMap name, adapter PCI identity, and intended plane count in the deployment record. A configuration that omits the profile can install without applying the tuning expected by the reference architecture.

Prepare the host before deployment

The quick-start guidance calls out SR-IOV and IOMMU capability and RDMA network-namespace configuration. These host changes take effect after a reboot. Build the reboot into the installation window, then verify that the operating system exposes the expected virtual-function and RDMA devices before joining production workloads.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
  • Confirm that the server firmware and operating system expose SR-IOV and IOMMU.
  • Apply the host preparation required by the chosen operator release.
  • Configure the RDMA network namespace as specified for the platform.
  • Reboot, then verify the adapter and virtual-function state.
  • Apply the named profile ConfigMap and check that the operator reports the intended settings.

Choose the switch only after the port map exists

NVIDIA identifies Spectrum switches as the switch family in the Spectrum-X platform description, but the cited architecture material does not specify one universal switch model. A switch that has the right nominal speed can still be wrong because it lacks enough downlinks, uses an incompatible breakout mode, or cannot accept the chosen transceiver.

Create a port map from the server inventory. Count every adapter port consumed by every plane, reserve ports for uplinks between tiers, and account for spare capacity and maintenance. Then verify the exact switch SKU with the platform solution stack or integrator.

Switch decision What to verify
Exact model The SKU appears in, or is accepted by, the platform solution stack
Port count Enough host downlinks, plane-specific links, uplinks, and service spares
Per-port signaling Matches the adapter port mode and the selected architecture
Connector and breakout Matches the NIC port, switch cage, and any breakout arrangement
Optics or direct-attach cable The transceiver or cable type is supported at both ends
Reach and media Fiber or copper type and length fit the rack and row distances
Software and firmware Versions are compatible with the reference architecture and support plan

Single-tier and two-tier planning

NVIDIA’s architecture page describes Ethernet scaling from thousands to hundreds of thousands of GPUs in a flat, two-tier topology. That is NVIDIA’s platform description, not an independently measured benchmark and not a promise that any two switch models will scale to those counts. For a real cluster, determine whether the required host count fits a single tier; if not, design the uplink tier and its oversubscription and failure domains with the same reference architecture.

Rank #3
Sale
Anker USB C Hub, 7in1 Multi-Port USB Adapter, 4K@60Hz USBC to HDMI Splitter | 85W Max PD, 2 USB 3.0 & 1 USBC Data Ports, SD/TF Card Reader, for Laptops/Mac and Other Type C Devices (Charger Not Included)
  • Sleek 7-in-1 USB-C Hub: Features an HDMI port, two USB-A 3.0 ports, and a USB-C data port, each providing 5Gbps transfer speeds. It also includes a USB-C PD input port for charging up to 100W and dual SD and TF card slots, all in a compact design.
  • Flawless 4K@60Hz Video with HDMI: Delivers exceptional clarity and smoothness with its 4K@60Hz HDMI port, making it ideal for high-definition presentations and entertainment. (Note: Only the HDMI port supports video projection; the USB-C port is for data transfer only.)
  • Double Up on Efficiency: The two USB-A 3.0 ports and a USB-C port support a fast 5Gbps data rate, significantly boosting your transfer speeds and improving productivity.
  • Fast and Reliable 85W Charging: Offers high-capacity, speedy charging for laptops up to 85W, so you spend less time tethered to an outlet and more time being productive.
  • What You Get: Anker USB-C Hub (7-in-1), welcome guide, 18-month warranty, and our friendly customer service.

Match every physical link

Physical compatibility is a four-way match among the adapter port, switch port, transceiver or cable, and distance. Obtain the supported-media list for the exact switch and NIC rather than ordering a generic cable based only on connector shape.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
  • Record whether each link is copper, active copper, active optical, or fiber.
  • Record connector type, breakout ratio, lane arrangement, and maximum supported reach.
  • Use the same signaling mode at both ends, including any adapter port configuration required by the platform.
  • Keep a per-link label that identifies host, plane, switch, port, and cable or optic part number.
  • Order spares for the media type that is hardest to replace on site.

The architecture sources do not establish a universal transceiver, cable, or reach list. A complete bill of materials therefore needs the exact switch SKU, server layout, and row distances; do not treat a generic Spectrum-X description as that list.

A practical selection workflow

  1. Inventory the compute nodes. Write down the GPU platform, server model, adapter family currently installed or planned, number of ports per host, and rack or row location.
  2. Freeze the software baseline. Record the Kubernetes distribution, Network Operator release, firmware baseline, and the reference-architecture revision. NVIDIA lists Network Operator 26.7.x with Spectrum-X RA 2.3 as GA on the current architecture page.
  3. Choose the plane count. Select single-plane, dual-plane, or quad-plane according to the platform guide. For the cited multiplane quick start, dual means two planes and quad means four.
  4. Choose the validated adapter family. Use the platform mapping rather than maximum advertised bandwidth. Treat ConnectX-9 Spectrum-X as Tech Preview, not RA 2.3 validated, and review ConnectX-6 Dx separately.
  5. Choose the balancing mode. On a supported multiplane platform, compare hwplb and swplb; NVIDIA recommends hardware balancing for the documented multiplane design. Confirm that the selected NIC supports the mode.
  6. Build the port map. Assign every host port to a plane and switch, then add uplinks, spares, and management connections. This produces the downlink and uplink counts needed for a switch SKU.
  7. Validate media and reach. Match port mode, breakout, transceiver or cable, fiber or copper type, and distance at both ends. Obtain the supported-part list for the exact hardware.
  8. Prepare and configure hosts. Enable the required SR-IOV/IOMMU capability, configure RDMA namespaces, set linkType: Ethernet and numVfs: 1, provide the profile ConfigMap, and reboot where required.
  9. Review the complete design. Have the server OEM, qualified integrator, or platform support team confirm the adapter, switch, firmware, optics, plane count, and operator profile as one supported stack before placing the order.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Common mistakes and recovery paths

Buying the highest-rate NIC first

Symptom: The adapter has an attractive specification but is absent from the platform matrix.

Fix: Return to the GPU/server reference architecture and select the named family. A higher advertised rate does not establish software, firmware, or topology validation.

Treating preview support as production validation

Symptom: ConnectX-9 Spectrum-X is described as an RA 2.3 design because the hardware supports related networking features.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Fix: Keep the statuses separate. Network Operator 26.7 marks ConnectX-9 Spectrum-X use as Tech Preview and outside RA 2.3 validation. Use it only under a separately approved preview plan.

Leaving out the tuning profile

Symptom: The operator is installed, but the expected reference-architecture tuning is not present.

Rank #4
Sale
UGREEN USB to USB C Adapter Combo 4-Pack, 10Gbps USB C Converter Space Gray | Data transfer & Fast charging for MacBook, iPhone 17/16/15, iPad, Samsung Galaxy, Apple Watch
  • Dual Converters, Infinite Potential:Includes 2× USB C male to USB A female adapters and 2× USB A male to USB C female adapters. Perfect for a wide range of uses—tablets with Bluetooth keyboards, expand USB ports on macbook, and more. Two different converters for all your daily needs
  • Next-Level 10Gbps & 3A Charging: No more slow 480Mbps, this usb to usb c adapter has a transfer speed of up to 10Gbps, allowing you to do more transferring in less time. This usb adapter fits both USB A and USB C charger, supporting up to 3A fast charging
  • Upgraded Exquisite Craftsmanship: With an aluminum alloy housing and metal connector, the usbc to usb adapter is extremely durable and sturdy. Rigorously tested to withstand more than 10,000 times of plugging and unplugging, ensuring long-lasting performance
  • Broad Compatible: The usb c to usb adapter widely supports all USB C/ USB A devices like laptops, tablets, cellphones, car chargers, and phone chargers. Such as compatible with MacBook Pro/Air 2023/2022, Thunderbolt 4/3 Devices,Apple MagSafe Watch 9/8/7/SE/Ultra, iPad Pro 2022/2021, Samsung Galaxy S23/S20/S10, and iPhone 17/16/15 Pro. Plug and play
  • Please Note: To reach 10Gbps speed, keep the cable under 3.3 ft. For USB A Male to USB C adapters, try flipping the USB C connector. USB C Male to USB A adapters support bidirectional 10Gbps transfer within 3.3 ft

Fix: Supply the release-appropriate profile ConfigMap and reference its name in the operator configuration. Check the resulting status rather than assuming built-in defaults.

Changing host settings without rebooting

Symptom: SR-IOV, IOMMU, or RDMA namespace changes appear configured but the devices are not available to workloads.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Fix: Reboot after host preparation, then verify virtual functions, RDMA devices, and namespace placement before scheduling training jobs.

Ordering switches before counting ports

Symptom: The switch has insufficient downlinks, incompatible breakout, or no room for uplinks and spares.

Fix: Complete the host-to-plane port map first. Recheck both the per-host port count and the number of planes before selecting a SKU.

Assuming an Ethernet cable is interchangeable

Symptom: A link stays down or reports an unsupported module.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Fix: Replace the generic part with a transceiver or cable approved for both exact endpoints, then verify reach, lane mode, and firmware compatibility.

Best Value
Sale
Anker USB C Hub, 5-in-1 USBC to HDMI Splitter with 4K Display | 85W Max PD, 1 Powered USB-C 5Gbps & 2 Powered USB-A 3.0 5Gbps Data Ports, for MacBook Pro, MacBook Air, Dell and More (Black)
  • 5-in-1 Connectivity: Equipped with a 4K HDMI port, a 5 Gbps USB-C data port, two 5 Gbps USB-A ports, and a USB C 100W PD-IN port. Note: The USB C 100W PD-IN port supports only charging and does not support data transfer devices such as headphones or speakers.
  • Powerful Pass-Through Charging: Supports up to 85W pass-through charging so you can power up your laptop while you use the hub. Note: Pass-through charging requires a charger (not included). Note: To achieve full power for iPad, we recommend using a 45W wall charger.
  • Transfer Files in Seconds: Move files to and from your laptop at speeds of up to 5 Gbps via the USB-C and USB-A data ports. Note: The USB C 5Gbps Data port does not support video output.
  • HD Display: Connect to the HDMI port to stream or mirror content to an external monitor in resolutions of up to 4K@30Hz. Note: The USB-C ports do not support video output.
  • What You Get: Anker 332 USB-C Hub (5-in-1), welcome guide, our worry-free 18-month warranty, and friendly customer service.

Turning configuration counts into performance promises

Symptom: Two or four planes are presented as a guaranteed throughput multiplier.

Fix: Describe them as architecture counts. The cited material provides no comparative benchmark or measured throughput result; validate application performance separately under the final workload.

Three example decision paths

HGX H100, H200, or B200 single-plane system

Begin with the BlueField-3 mapping in the platform guide. Use a single-plane port map, select a switch SKU accepted by that solution stack, and verify the host’s Ethernet, RoCE, SR-IOV/IOMMU, and operator requirements. Do not add extra planes simply because the chassis has unused slots.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

GB200 single-plane system

Use the documented ConnectX-7 single-plane path, or the explicitly permitted ConnectX-8 option when the exact platform documentation supports it. Keep one plane in the switch and cable map, and validate the adapter firmware and operator profile against the chosen release.

B300 or GB300 multiplane system

Use ConnectX-8 for the documented multiplane design. Decide whether the deployment is dual-plane or quad-plane; the quick start defines those as two or four planes. On this documented multiplane platform, hardware plane load balancing is NVIDIA’s recommended mode, provided the release and configuration support it. The resulting port map must allocate every plane consistently across hosts and switches.

Cost, support, and serviceability questions to put in the quote

No current prices, inventory, or universal switch SKU are established by the cited documentation, so request comparable vendor or integrator quotes only after the design is fixed. Ask each quote to identify:

  • Exact server, adapter, switch, firmware, and software versions.
  • Downlink and uplink port counts by plane, including reserved spares.
  • Every optic, direct-attach cable, breakout, and supported reach.
  • Power, airflow direction, rack-unit requirements, and replacement procedure.
  • Support entitlement for the reference architecture and the planned Network Operator release.
  • Whether the quoted configuration is GA validated, separately qualified, or preview status.

Have one party own the compatibility review. Splitting responsibility among a server seller, switch seller, and cable reseller can leave no one accountable for the complete RoCE fabric.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Final decision record

Before purchase, keep a one-page record containing the GPU/server platform; reference-architecture and operator versions; adapter family; plane count; load-balancing mode; host requirements; switch SKUs; port and breakout map; media part numbers and reach; firmware baseline; and the person who approved the complete stack. Recheck that record whenever NVIDIA updates the architecture page, operator release, or platform guide. As of the architecture page revision dated September 9, 2026, the supported choices and preview boundaries above are the ones to verify against your exact system.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

AI infrastructureEthernet SwitchesGPU clustersNetwork adaptersNVIDIA Spectrum-XRoCE

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Recommended PC Tool
Recommended PC Tool
PC Slower Than It Used to Be?Free scan - under a minute
Outdated Drivers Are Slowing You DownFree scan - exact matches

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.