Driver FixRecommendedSound, Wi-Fi or graphics acting up? Check drivers firstFind missing or outdated drivers fast.Check DriversOctober DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsWindows FixRecommendedWindows errors stealing your time? Find the fix fastScan stability, cleanup and performance issues.Fix Now×
Skip to content
World desk4 min

How to Check GPU Usage and Temperature on a Remote Server

Run vendor tools on the GPU host for a quick remote check, or collect NVIDIA telemetry centrally with DCGM Exporter and Prometheus.
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

For a quick check, connect to the GPU server and run nvidia-smi for NVIDIA hardware. For continuous NVIDIA monitoring, run DCGM Exporter on each GPU node and let Prometheus scrape its metrics endpoint. AMD users can use AMD SMI’s monitor options from a remote shell. The commands execute on the GPU host; connecting remotely simply lets you inspect it from elsewhere.

Check GPU telemetry from a remote shell

Use your approved remote shell to log in to the GPU host, then run the vendor’s tool there. This checks what the server can see, rather than the GPU in the computer you used to connect.

As an Amazon Associate I earn from qualifying purchases.

NVIDIA: use nvidia-smi

Run nvidia-smi on the server. NVIDIA recommends it as an initial diagnostic check to confirm that the driver detects the GPUs before troubleshooting DCGM Exporter. Available readings and their presentation can vary by GPU and software version, so check the output on your system rather than assuming every model exposes identical fields. See NVIDIA’s DCGM Exporter installation and troubleshooting guide.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

AMD: use AMD SMI monitor options

With AMD SMI installed, its CLI can report temperature in Celsius, graphics and memory utilization, and VRAM use. Use its --watch INTERVAL option to repeat output at the interval you specify in seconds. The documented CLI route is useful for interactive checks; the cited AMD documentation does not establish an equivalent standardized Prometheus exporter workflow. See AMD’s AMD SMI CLI usage guide.

#1 Best Overall
ASUS Dual Radeon RX 9060 XT 16GB GDDR6 Gaming Graphics Card
  • Axial-tech fans now feature a smaller fan hub that facilitates longer blades and a barrier ring that increases downward air pressure
  • 2.5-slot design allows for greater build compatibility while maintaining cooling performance
  • 0dB technology lets you enjoy light gaming in relative silence
  • Dual BIOS switch lets you toggle between Quiet and Performance BIOS profiles
  • Dual ball fan bearings last up to twice as long as sleeve bearing designs

Keep NVIDIA metrics for dashboards and alerts

A command-line watch is an immediate view, not a central history. To retain and chart NVIDIA telemetry, run DCGM Exporter on each GPU node and configure Prometheus to scrape the exporter’s /metrics endpoint. NVIDIA describes DCGM Exporter as converting selected DCGM telemetry fields to Prometheus exposition format. Prometheus can run on another host, but it must be able to reach the exporter over the network.

Choose how to run the exporter

Deployment Fits Operational note
Package-managed service A host-managed installation on a server NVIDIA documents a systemd service option.
Standalone OCI container A container-managed service on a host Review required device access and runtime privileges, especially if enabling profiling fields.
Helm on Kubernetes A Kubernetes cluster with selected GPU nodes The guide documents deploying exporter pods through Helm.
NVIDIA GPU Operator A Kubernetes environment where GPU software lifecycle is already managed by the Operator Use the Operator’s lifecycle rather than introducing a separately managed deployment without checking how the cluster is configured.

These options manage deployment differently; they do not change the need for compatible GPU, driver, DCGM, and exporter versions. NVIDIA documents these installation paths in its DCGM Exporter installation guide.

Rank #2
GIGABYTE GeForce RTX 5070 Ti Gaming OC 16G Graphics Card, 16GB 256-bit GDDR7, PCIe 5.0, WINDFORCE Cooling System, GV-N507TGAMING OC-16GD Video Card
  • Powered by the NVIDIA Blackwell architecture and DLSS 4
  • Powered by GeForce RTX 5070 Ti
  • Integrated with 16GB GDDR7 256bit memory interface
  • PCIe 5.0
  • WINDFORCE cooling system

Verify the endpoint

  1. On the GPU host, check driver discovery with nvidia-smi.
  2. Start DCGM Exporter using the installation method appropriate to the host or cluster.
  3. On a host deployment, check the local endpoint with curl --fail http://localhost:9400/metrics. The default listener is :9400; the response should include metric names beginning with DCGM_.
  4. For Kubernetes, follow NVIDIA’s documented service-forwarding procedure before checking the endpoint. Then configure Prometheus to scrape the address it can reach.
  5. From the Prometheus host or network, verify that the endpoint is reachable and that scraping succeeds before building dashboards or alerts.

The listener and verification procedure are documented in NVIDIA’s installation guide and exporter command reference.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Choose fields and collection cadence deliberately

DCGM Exporter exposes selected fields, not every possible reading by default. NVIDIA’s guide includes examples for GPU utilization and framebuffer memory in MiB, as well as a watch group for GPU temperature and board power. Confirm that the fields you need are supported by your GPU or entity and software combination using NVIDIA’s DCGM documentation.

Rank #3
Sale
GIGABYTE GeForce RTX 5060 WINDFORCE OC 8G Graphics Card, Cooling System, 8GB 128-bit GDDR7, PCIe 5.0, Manufactured by NVIDIA, DisplayPort & HDMI - Video Output Interface, GV-N5060WF2OC-8GD Video Card
  • Powered by the NVIDIA Blackwell architecture and DLSS 4
  • Powered by GeForce RTX 5060
  • Integrated with 8GB GDDR7 128bit memory interface
  • PCIe 5.0
  • WINDFORCE cooling system

The exporter documentation gives a default collection interval of 30,000 ms and shows a 5-second temperature and board-power watch-group example. These are configurable settings, not guarantees of a universal refresh rate. Each HTTP scrape returns the latest cached sample; it does not create a separate telemetry capture. Configure collection and Prometheus scrape intervals to suit the freshness and storage needs of your monitoring setup.

Troubleshoot missing readings

Work from the GPU outward: first establish that the host sees the hardware, then confirm the exporter is running and its endpoint is reachable, and finally check whether the requested fields are supported.

Rank #4
Sale
GIGABYTE Radeon RX 9070 XT Gaming OC 16G Graphics Card, PCIe 5.0, 16GB GDDR6, GV-R9070XTGAMING OC-16GD Video Card
  • Powered by Radeon RX 9070 XT
  • WINDFORCE Cooling System
  • Hawk Fan
  • Server-grade Thermal Conductive Gel
  • RGB Lighting
  • No GPU detected: Run nvidia-smi on the host. If the driver does not detect the device, address that before debugging exporter metrics.
  • Exporter is unavailable: Check the service or pod state and logs, then confirm that the listener is published and that port 9400 is reachable from the Prometheus network.
  • Some metrics are absent: Check the selected field configuration and whether the field is supported for the GPU, entity, and software versions in use.
  • Remote host-engine issues: If the deployment uses a separately managed host engine, check its transport and confirm that the DCGM client library is at least as new as the host engine.
  • Profiling metrics are missing: NVIDIA notes that profiling metrics can have GPU support and SYS_ADMIN requirements. Check the relevant support guidance and review whether the required privileges are appropriate for your environment.

NVIDIA pairs exporter releases with DCGM versions. An unmatched combination may work, but NVIDIA does not test or support every mismatch. Confirm the supported GPU, driver, DCGM, and exporter combination; satisfying the client-library version requirement alone does not make an otherwise unsupported release pairing supported. Follow the documented troubleshooting sequence.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Protect the metrics endpoint

Do not expose the exporter broadly just because Prometheus needs access. Restrict network reachability to the monitoring systems that require it. NVIDIA documents TLS or basic authentication using the exporter’s --web-config-file option; see the DCGM Exporter command reference.

Best Value
Sale
ASUS Prime Radeon RX 9070 XT 16GB GDDR6 OC Edition Gaming Graphics Card
  • Axial-tech fans now feature a smaller fan hub that facilitates longer blades and a barrier ring that increases downward air pressure
  • Phase-change GPU thermal pad helps ensure optimal heat transfer, lowering GPU temperatures for enhanced performance and reliability
  • 2.5-slot design allows for greater build compatibility while maintaining cooling performance
  • Dual-ball fan bearings last up to twice as long as standard conventional sleeve bearings designs
  • 0dB technology lets you enjoy light gaming in relative silence

Also protect runtime sockets, debug dumps, and profiling endpoints: they can reveal host, process, or workload information. Some container configurations require elevated capabilities for profiling fields. Review the privileges granted to the exporter and enable only those needed for the metrics you intend to collect.

Quick Recap

Bestseller No. 1
ASUS Dual Radeon RX 9060 XT 16GB GDDR6 Gaming Graphics Card
ASUS Dual Radeon RX 9060 XT 16GB GDDR6 Gaming Graphics Card
0dB technology lets you enjoy light gaming in relative silence; Dual BIOS switch lets you toggle between Quiet and Performance BIOS profiles
$529.99
Bestseller No. 2
GIGABYTE GeForce RTX 5070 Ti Gaming OC 16G Graphics Card, 16GB 256-bit GDDR7, PCIe 5.0, WINDFORCE Cooling System, GV-N507TGAMING OC-16GD Video Card
GIGABYTE GeForce RTX 5070 Ti Gaming OC 16G Graphics Card, 16GB 256-bit GDDR7, PCIe 5.0, WINDFORCE Cooling System, GV-N507TGAMING OC-16GD Video Card
Powered by the NVIDIA Blackwell architecture and DLSS 4; Powered by GeForce RTX 5070 Ti; Integrated with 16GB GDDR7 256bit memory interface
$1,162.49
SaleBestseller No. 3
GIGABYTE GeForce RTX 5060 WINDFORCE OC 8G Graphics Card, Cooling System, 8GB 128-bit GDDR7, PCIe 5.0, Manufactured by NVIDIA, DisplayPort & HDMI - Video Output Interface, GV-N5060WF2OC-8GD Video Card
GIGABYTE GeForce RTX 5060 WINDFORCE OC 8G Graphics Card, Cooling System, 8GB 128-bit GDDR7, PCIe 5.0, Manufactured by NVIDIA, DisplayPort & HDMI - Video Output Interface, GV-N5060WF2OC-8GD Video Card
Powered by the NVIDIA Blackwell architecture and DLSS 4; Powered by GeForce RTX 5060; Integrated with 8GB GDDR7 128bit memory interface
$459.99
SaleBestseller No. 4
GIGABYTE Radeon RX 9070 XT Gaming OC 16G Graphics Card, PCIe 5.0, 16GB GDDR6, GV-R9070XTGAMING OC-16GD Video Card
GIGABYTE Radeon RX 9070 XT Gaming OC 16G Graphics Card, PCIe 5.0, 16GB GDDR6, GV-R9070XTGAMING OC-16GD Video Card
Powered by Radeon RX 9070 XT; WINDFORCE Cooling System; Hawk Fan; Server-grade Thermal Conductive Gel
$814.99
SaleBestseller No. 5
ASUS Prime Radeon RX 9070 XT 16GB GDDR6 OC Edition Gaming Graphics Card
ASUS Prime Radeon RX 9070 XT 16GB GDDR6 OC Edition Gaming Graphics Card
0dB technology lets you enjoy light gaming in relative silence; Dual BIOS switch lets you toggle between Quiet and Performance BIOS profiles
$829.00

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
Outdated Drivers Are Slowing You DownFree scan - exact matches
Windows Errors? Fix Them Before They SpreadFree repair scan

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.