October DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsClean PCRecommendedOne scan can reveal what keeps slowing WindowsLook for cleanup and repair opportunities.Run ScanOctober DealsAmazon USDeal season is back - check today's better picksAmazon US: current deals, useful picks and tech finds.See Picks×
Skip to content
World desk6 min

How to Build an NFS Storage Server for AI Workloads

NFS can serve as shared storage for smaller AI deployments, but performance depends on the full path from dataset layout and storage media to network, server, and GPU clients.
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

NFS can be a practical shared-storage starting point for a small AI deployment, but a fast server is only as fast as its slowest link: the dataset layout, storage devices, server, network, NFS configuration, or client topology. Size and measure that whole path before deciding whether NFS is enough or a scale-out filesystem is a better fit.

Is NFS good for AI workloads?

Often, for a smaller GPU cluster with a manageable number of clients and a properly sized storage server and network. NFS gives multiple Linux systems shared access to files without requiring every training node to hold a separate dataset copy. NVIDIA’s DGX storage guidance describes it as a good starting point for small GPU server configurations when storage and network bandwidth are sized appropriately.

As an Amazon Associate I earn from qualifying purchases.

That is not a universal performance guarantee. A single NFS server can become a bandwidth, metadata, or availability constraint as more GPUs read concurrently. Whether it is suitable depends on the workload’s data rate, access pattern, concurrency, and tolerance for a central point of service.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

How much throughput can NFS deliver?

NVIDIA’s DGX storage guidance says NFS over 10Gb/s Ethernet can provide up to 1.25 GB/s of I/O throughput for large block sizes. This is a stated upper reference for that configuration, not a benchmark result for every server or a promise of sustained application throughput. Small files, protocol overhead, storage media, server limits, and network contention can all lower observed results.

The same guidance identifies deployments needing more than 10 GB/s, or serving hundreds or thousands of nodes, as situations where other technologies may be more efficient or scale better. Treat those as prompts to model the system, not hard cutoffs: client concurrency, resilience needs, and the performance of a candidate design still matter.

How do I size the whole storage path?

Start with what the training job consumes, then compare its demand with every component between the data and the GPUs. A nominal link speed alone says little about application throughput if the disks, server, switch, or client-side path cannot keep up.

  1. Estimate workload demand. Determine the data rate each GPU needs, the number of GPUs and clients reading at once, whether access is mostly sequential or metadata-heavy, and how much data is likely to be cached.
  2. Check storage media and server capacity. Compare expected aggregate reads with the storage devices’ throughput and the server’s ability to serve them. Account for simultaneous clients and writes, not just a single sequential read.
  3. Map the network path. Check the server and client interfaces, switch capacity, uplinks, and every intervening link. A fast server port cannot compensate for a slower or congested hop.
  4. Validate the client path and topology. Include the NFS version and settings, client interfaces, GPU/NIC placement, and any PCIe constraints relevant to accelerated I/O.
  5. Measure with the real workload. Track aggregate throughput, latency, I/O-size distribution, GPU activity, and network and storage utilization. A synthetic large-block test alone will not reveal small-file or application-level bottlenecks.

If actual throughput is far below NVIDIA’s large-block 10Gb/s reference, investigate constrained network hops, server misconfiguration, and inconsistent MTU settings along the path before assuming that NFS itself is the limiting factor.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

What network speed does an AI storage server need?

There is no single required link speed. The appropriate network depends on the aggregate data rate demanded by concurrent clients and on the throughput the storage server can actually supply. For example, NVIDIA’s reference of up to 1.25 GB/s applies to large-block NFS I/O over 10Gb/s Ethernet; it does not establish what a particular training job will achieve.

Rank #2
LincStation N2 6-Bay NAS Server, Intel N100 16GB LPDDR5 RAM, 10GbE NAS Storage, 2X SATA Bays, 4X M.2 NVMe Slots, DIY NAS for Plex, Docker, Private Cloud, Unraid Starter License Included, Diskless
  • Unmatched Performance with Intel Alder Lake-N N100: Experience fast, efficient data handling with a modern 4-core, 4-thread Intel processor (up to 3.4GHz) and onboard 16GB LPDDR5 memory, enabling smooth 4K media streaming, rapid backups, and seamless multitasking for demanding applications.
  • Ultra-Fast 10 Gigabit Ethernet (10GbE): Quadruple the speed of standard 2.5GbE connections. The built-in 10GbE port facilitates lightning-fast file transfers, lag-free high-resolution video editing, and robust support for multiple users in collaborative environments.
  • Flexible & High-Speed 6-Bay Storage Configuration: This versatile NAS features 2 dedicated SATA bays for 2.5" HDDs and 4 M.2 NVMe slots for 2280 SSDs. Mix and match drives for the perfect balance of high-capacity storage and blazing-fast NVMe performance in one compact system.
  • Included Unraid OS Starter License: Unlock ultimate storage flexibility right out of the box. Unraid OS allows you to use drives of different sizes and types together in one array, maximize usable capacity with its efficient parity system, and enjoy a vast library of community applications for media serving, virtualization, and more.
  • Compact, Cool, and Connectivity-Rich Design: Its space-saving metal shell design fits anywhere. Strategically placed cooling vents ensure optimal thermal performance for 24/7 operation. Connect effortlessly via USB-C (10G), USB 3.2 Gen2, HDMI 2.0 for direct 4K display output, and a 3.5mm audio port.

Compare aggregate demand with the usable capacity of the server interface, switches and uplinks, and client paths. Check for oversubscription where many clients share an uplink. If one link is saturated while storage devices remain underused, the network path may be the constraint. If the network has headroom but storage or server utilization is maxed out, adding a faster network link alone is unlikely to solve the problem.

How do small files affect NFS performance?

Many small files can generate substantial filesystem metadata activity as clients locate, open, and close files. NVIDIA’s DGX best-practices document warns that reading or writing large numbers of small files can reduce performance on network and local filesystems alike.

Where the training framework and workflow support it, packaging data into database or archive formats such as HDF5, LMDB, or TFRecord can reduce metadata operations. The trade-off is that these formats can use more memory or depend on fast mmap() performance, and they may change how data is prepared and consumed. Test the actual pipeline rather than assuming repackaging will help.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The same NVIDIA document gives a planning estimate of 150–200 MB/s per GPU for 1080p files, with more required for 4K or uncompressed data. It also says uncompressed images are 5–10 times larger than compressed ones. These are older, document-specific planning figures, not universal requirements: resolution, compression, preprocessing, caching, and the workload all affect demand.

Rank #3
VIVO 12U Freestanding Server Rack Cart
  • Data Storage Solution: This 12U mobile server cart contains 4 vertical support rails for servers, UPS's, patch panels, switches, and other networking or AV equipment. Product has a length of 23.5" and a height of 28.3"
  • Adjustable Depth: The rack features a depth range of 22" to 40" to accommodate the size of your equipment with precise 1" adjustment settings. Provides plenty of space while easily fitting into utility and server closets
  • Sturdy Open Frame Design: Extend the life of your valuable equipment by giving it maximum airflow and ventilation for sufficient cooling. Solid steel construction supports up to 1200 lbs of weight with ease
  • Smooth Mobility: Four durable casters provide nearly effortless motion for a variety of floor types, and optional leveling feet are included to make the cart stationary when desired
  • Simple Assembly: All hardware and step-by-step instructions are provided to get your new server rack assembled in no time

Can GPUDirect Storage use NFS?

Yes, in supported configurations. NVIDIA’s GPUDirect Storage guidance describes NFS using RDMA transport in its documented GDS setup. GDS can provide a direct DMA data path from supported local or remote storage, including NFS, toward GPU memory, reducing the CPU bounce-buffer path.

That does not make the entire system CPU-free or remove other bottlenecks. Compatibility depends on the system, hardware and PCIe topology, drivers, software stack, workload, and configuration. NVIDIA’s guidance discusses RDMA traffic over InfiniBand interfaces and DMA transfers between network adapters and GPUs; bandwidth, protocol overhead, MTU, NFS attributes, and workload characteristics all affect results.

Before adopting this path, confirm support for the specific hardware and software combination, including GPU and network-adapter placement. Measure end-to-end training behavior: a shorter data path cannot compensate for slow storage, a saturated network, or a workload that is limited elsewhere.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

How should an NFS/RDMA setup be approached?

Linux kernel documentation covers NFS/RDMA client and server functionality, including exports, enabling the RDMA server transport, mounting with the RDMA option, and checking the mount protocol. The exact steps depend on the distribution, kernel, NFS utilities, and vendor-supported RDMA stack.

Do not copy commands from an old setup guide without checking that they apply to the installed system. The historical kernel NFS/RDMA guide is dated; use current distribution and hardware-vendor documentation for supported packages, service configuration, export settings, mount options, and troubleshooting. Verify that the mount is actually using the intended transport rather than assuming that a successful mount proves RDMA is active.

When should I move from NFS to a parallel or distributed filesystem?

Consider alternatives when measured aggregate demand exceeds what a single server and its network path can serve efficiently, when many clients create contention, or when resilience and scale-out operations require a different architecture. NVIDIA’s DGX guidance points to workloads above 10 GB/s and deployments serving hundreds or thousands of nodes as cases where other technologies may scale more efficiently.

Compare candidates using the same representative workload and concurrency. Evaluate aggregate throughput and per-client performance, latency and I/O sizes, metadata behavior, scale limits, fault tolerance, compatibility, and operating effort. A parallel or distributed system may spread work across multiple servers, but it also brings its own deployment, tuning, and support requirements.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Consideration NFS with a shared server Parallel or distributed filesystem
Fit Often a simpler starting point for smaller deployments with moderate aggregate demand. Worth evaluating when aggregate load, client count, or resilience needs outgrow a single-server model.
Scaling model Capacity depends heavily on the server, its storage, and the network path to clients. May distribute service across multiple systems; actual scale depends on the product and design.
Operational effort Typically centered on the NFS server, exports, clients, and network. Can require more components and architecture-specific administration.
Decision evidence Measure workload throughput, latency, metadata behavior, and contention at expected concurrency. Benchmark the same workload and verify compatibility, fault tolerance, and operational requirements.

Neither architecture is automatically faster for every workload. Choose from measured behavior and operational requirements, not the filesystem label alone.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
Outdated Drivers Are Slowing You DownFree scan - exact matches
PC Slower Than It Used to Be?Free scan - under a minute

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.