October DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsWindows FixRecommendedWindows errors stealing your time? Find the fix fastScan stability, cleanup and performance issues.Fix NowOctober DealsAmazon USDeal season is back - check today's better picksAmazon US: current deals, useful picks and tech finds.See Picks×
Skip to content
World desk6 min

How to Size pNFS Metadata Servers and AFF Data Nodes for AI Workloads

Size pNFS metadata service and AFF data capacity separately. Measure metadata operations, data throughput, client distribution, path reachability and connection demand on the exact hardware and ONTAP release.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

There is no workload-neutral formula for choosing an AFF node count or a pNFS metadata-server-to-client ratio. Size metadata service and data-serving capacity separately, then validate both against your AI workload on the intended AFF hardware, ONTAP release, clients and network. pNFS keeps metadata requests on the connection established when a client mounts; file data can use advertised, localized data paths. A balanced design must therefore handle metadata operation rate as well as data throughput, client connections and path reachability.

What pNFS changes—and what it does not

With pNFS, the client establishes a metadata-server connection when it mounts the file system. Metadata requests for that mount remain on that connection, while file data can be directed to advertised data paths. This separates two capacity questions: whether metadata work is balanced across endpoints, and whether data-serving nodes, interfaces and clients can deliver the required I/O.

As an Amazon Associate I earn from qualifying purchases.

Do not assume pNFS automatically moves an existing mount’s metadata connection when the cluster is busy. Plan how clients land on metadata endpoints, validate that placement, and define how remounting will rebalance clients when needed. NetApp’s pNFS planning and tuning guidance discusses distributing mounts across nodes and data interfaces; round-robin DNS may be appropriate where it fits the environment.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Measure the workload before choosing nodes

AI jobs can place very different demands on storage in different phases. A large sequential training read, a burst of small-file opens at job startup, directory enumeration across a dataset, and checkpoint writes are not interchangeable sizing cases. Record the workload inputs before comparing AFF layouts.

#1 Best Overall
Seagate IronWolf Pro, 20 TB, Enterprise NAS Internal HDD –CMR 3.5 Inch, SATA 6 Gb/s, 7,200 RPM, 256 MB Cache for RAID Network Attached Storage (ST20000NT001)
  • High Performance: All-CMR (conventional magnetic recording) portfolio enables consistent, industry-leading 24×7 performance allowing users to access data anytime, anywhere.Average Operating Power (W) - 7.7W, Operating Temperature (drive reported, max °C) : 65, Operating Temperature (ambient, min °C) : 0
  • Class-Leading Dependability: Up to 550TB/year workload rating, 2.5M hours MTBF, and 5-year limited warranty for unparalleled total cost of ownership (TCO)
  • Peace of Mind with Data Recovery: Complimentary 3 year Rescue Data Recovery Services for a hassle-free, zero-cost data recovery experience
  • IronWolf Health Management: Helps protect data with prevention, intervention, and recovery recommendations to ensure peak system health
  • Optimized for NAS: AgileArray with dual-plane balancing, time-limited error recovery (TLER), and rotational vibration (RV) sensors to deliver top RAID performance in multi-bay environments
  • Clients and concurrency: number of GPU servers or clients, concurrent jobs, expected mount count, and whether many clients start together.
  • Namespace and file mix: total file count, file-size distribution, directory structure, and expected create, lookup, GETATTR/SETATTR, open/close, rename, enumeration and delete rates.
  • Data I/O: read/write mix, sequential versus random access, typical I/O sizes, aggregate and per-client throughput targets, and latency targets.
  • Bursts and recovery: job startup, dataset scans, checkpointing, mount storms, failover expectations and recovery behavior.

Track metadata operations per second separately from bytes per second. A high-file-count workload can generate substantial create, lookup, attribute and directory work even when its byte throughput is modest. NetApp cautions that high metadata call rates can tax NFS server CPU and bottleneck a single connection, so an aggregate bandwidth figure alone is not a sufficient sizing input.

Size metadata distribution and data capacity as separate limits

Resource to size What to map and measure Evidence of a bottleneck Design response to test
Metadata service Which node and interface each mount uses; mounts per endpoint; metadata operation rate; metadata CPU and tail latency. Metadata CPU or latency rises with file operations, or client mounts are concentrated on one node despite available peers. Redistribute mounts across nodes and interfaces; validate the placement method and remount behavior. Test whether the intended layout spreads metadata work.
Data-serving paths Volume and FlexGroup constituent placement; accessible node-local data paths; interface speed and count; client-to-path reachability; network oversubscription. Aggregate or per-client throughput, latency, or node locality is limiting while metadata service is not the constraint. Test data-path and data-layout changes, including constituent distribution and available network capacity. NetApp recommends FlexGroup for best overall pNFS results.
Clients and connections Client count, nconnect setting, eligible advertised addresses, TCP sessions per mount and platform connection limits. Connection count or burst headroom approaches the applicable platform limit, or connection setup/recovery fails under concurrency. Model sessions for normal and burst conditions against the limits for the exact platform and release; validate with representative mount concurrency.

These are diagnostic dimensions, not a numerical formula. If metadata CPU or latency is the constraint, adding data paths alone may not address it. If bandwidth, latency or data locality is the constraint, spreading metadata mounts alone will not provide the missing data-serving capacity.

Rank #2
Synology DS1825+ Enterprise Video Production & Storage - Scale to 360TB, 25GbE Speed & Mission-Critical Reliability (8-Bay Diskless NAS)
  • Multi-User Video Editing - Support 50+ concurrent users editing 4K/8K projects with 2,239 MB/s speeds; run databases, VMs and media services simultaneously
  • Expansive Production Storage - Grow from 160TB to 360TB using expansion units; perfect for growing video archives, post-production workflows and broadcast media
  • Flexible High-Speed Networking - Choose 10GbE or 25GbE network upgrade cards to support demanding creative teams and large file transfers
  • Enterprise Data Protection - High-availability clustering, automated failover and comprehensive backup to prevent any data loss scenario
  • 3-Year Warranty & Enterprise Support - Dedicated technical account management is available for business-critical production environments

Confirm pNFS and network prerequisites

Before benchmarking a layout, confirm the protocol and reachability conditions for the exact client and ONTAP combination. The pNFS deployment guidance calls for NFSv4.1 or later, pNFS enabled, matching NFSv4 ID domains, and routable per-node data interfaces. Clients must be able to reach both metadata and advertised data paths; a path that exists in the configuration but is not reachable from a client does not contribute usable capacity.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
  • Verify pNFS support and configuration on each client platform and kernel in the deployment.
  • Check NFSv4 identity-domain consistency and access controls across the participating systems.
  • Confirm routing, firewall rules and interface availability for every metadata and data address clients may use.
  • Include nconnect and the number of eligible pNFS addresses in the connection model. Their combination can multiply TCP connections per mount; do not estimate connection demand from mount count alone.
  • Check current hardware, protocol and connection-limit guidance for the precise AFF model and ONTAP release rather than applying limits from another platform.

NetApp documentation describes NFS over RDMA as enabling NVIDIA GPUDirect Storage beginning with ONTAP 9.10.1 on supported GPU hosts. That does not establish support for every AFF model, adapter, client or software combination: verify the current compatibility matrix for the intended system. RDMA should be measured as part of the actual design, not assumed to remove a bottleneck.

Rank #3
Western Digital 20TB WD Red Pro NAS Internal Hard Drive HDD - 7200 RPM, SATA 6 Gb/s, CMR, 512 MB Cache, 3.5" - WD202KFGX
  • (1) 1GB = 1 billion bytes and 1TB = 1 trillion bytes. Actual user capacity may be less depending on operating environment.
  • For RAID-optimized NAS systems with unlimited number of bays
  • Rated for 550TB/yr workload rate(2) | (2) Annualized Workload Rate = TB transferred x (8760 / recorded power-on hours). The maximum rated workload is specified for operating at typical temperature of 40C. Workload Rate will vary depending on your hardware and software components and configurations.
  • Designed to handle the demands of high-intensity 24x7 multi-user NAS environments
  • Western Digital partners with a wide range of NAS system vendors for extensive testing to ensure compatibility with most NAS enclosures

Benchmark candidate layouts under representative AI phases

  1. Establish a baseline. Record the ONTAP release, AFF model and node layout, client kernel and configuration, data layout, network topology, security settings, mount options and workload inputs. Keep these fixed when comparing layouts.
  2. Test metadata-intensive work. Exercise representative file creation, lookup, attribute, open/close and directory-enumeration patterns. Measure operation rate, metadata CPU, latency (including tail latency) and distribution across nodes and interfaces.
  3. Test data-intensive work. Measure aggregate and per-client throughput, latency, read/write mix and I/O size for the workload’s sequential and random phases. Check whether data locality across FlexGroup constituents and accessible paths affects results.
  4. Run combined and burst cases. Exercise metadata and data demand together, plus job startup, mount storms and checkpointing at realistic concurrency. Include the expected failover and recovery cases rather than relying only on steady-state results.
  5. Compare connection and protocol behavior. Observe TCP connection counts and headroom at normal load and during bursts. Where RDMA is supported, compare measured results with and without it under the same workload and configuration.
  6. Change one design variable at a time, then retest. Compare mount distribution, interface and data layout, client settings, or node configuration without treating a result from one setup as transferable to another. Re-run validation after a material change to release, clients, network, data placement or mount parameters.

NetApp’s 2026 AFX report says tested NFSv4.x metadata-heavy performance on AFX with ONTAP 9.18.1 was within 15% of NFSv3 in that report’s test context. The same report describes nearly 30% sequential-read and 10% sequential-write improvements in its standard fio tests. These are report-specific AFX results, not forecasts for AFF or an arbitrary AI workload. NetApp’s 2026 benchmark tips characterize RDMA as improving latency or throughput by roughly 10–30% for most workloads; that approximate vendor-reported range is not a guarantee for a particular deployment. Use these findings to motivate a controlled comparison, not as sizing multipliers.

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Choose AFF capacity from measured bottlenecks

After testing, select node count and layout using model-specific guidance and the observed limiting resource. If metadata operations concentrate on a subset of nodes or metadata CPU and latency become limiting, test a more even mount distribution and endpoint layout. If data bandwidth, latency or locality is limiting, test data capacity, paths, interface capacity and placement. Then verify that client connection demand remains within platform limits under normal load and bursts.

Rank #4
Western Digital 16TB WD Red Pro NAS Internal Hard Drive HDD - 7200 RPM, SATA 6 Gb/s, CMR, 512 MB Cache, 3.5" - WD161KFGX
  • Available in capacities ranging from 2 to 22TB(1) | (1) 1GB = 1 billion bytes and 1TB = 1 trillion bytes. Actual user capacity may be less depending on operating environment.
  • For RAID-optimized NAS systems with unlimited number of bays
  • Rated for 550TB/yr workload rate(2) | (2) Annualized Workload Rate = TB transferred x (8760 / recorded power-on hours). The maximum rated workload is specified for operating at typical temperature of 40C. Workload Rate will vary depending on your hardware and software components and configurations.
  • Designed to handle the demands of high-intensity 24x7 multi-user NAS environments
  • Western Digital partners with a wide range of NAS system vendors for extensive testing to ensure compatibility with most NAS enclosures

NetApp’s pNFS tuning guidance cautions that pNFS and NFSv4.x generally may be a poor fit for performance-dependent high-metadata workloads because statefulness, locking and some security features can negatively affect CPU utilization and latency. That warning should be considered alongside the newer, release- and platform-specific AFX results above; neither establishes that pNFS will or will not meet a given AFF workload’s target. Benchmark the workload and compare protocol choices where metadata performance is critical.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

NetApp’s AI/ML material gives a DGX A100 connected to a four-HA-pair AFF A800 cluster as an example architecture, not a universal recipe or performance promise. It does not establish a generally applicable AFF node count or metadata-server-to-client ratio. Use current NetApp sizing tools and hardware guidance for model-level planning, then validate the intended configuration under the measured workload.

Quick Recap

Bestseller No. 3
Western Digital 20TB WD Red Pro NAS Internal Hard Drive HDD - 7200 RPM, SATA 6 Gb/s, CMR, 512 MB Cache, 3.5' - WD202KFGX
Western Digital 20TB WD Red Pro NAS Internal Hard Drive HDD - 7200 RPM, SATA 6 Gb/s, CMR, 512 MB Cache, 3.5" - WD202KFGX
For RAID-optimized NAS systems with unlimited number of bays; Designed to handle the demands of high-intensity 24x7 multi-user NAS environments
$885.83
Bestseller No. 4
Western Digital 16TB WD Red Pro NAS Internal Hard Drive HDD - 7200 RPM, SATA 6 Gb/s, CMR, 512 MB Cache, 3.5' - WD161KFGX
Western Digital 16TB WD Red Pro NAS Internal Hard Drive HDD - 7200 RPM, SATA 6 Gb/s, CMR, 512 MB Cache, 3.5" - WD161KFGX
For RAID-optimized NAS systems with unlimited number of bays; Designed to handle the demands of high-intensity 24x7 multi-user NAS environments
$714.99

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
Outdated Drivers Are Slowing You DownFree scan - exact matches
PC Slower Than It Used to Be?Free scan - under a minute

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.