nvhtop

A tool for enriching the output of nvidia-smi forked from peci1/nvidia-htop.

Install

$ pip install nvhtop

Usage

usage: nvhtop [-h] [-l [COMMAND_LENGTH]] [-c]

print GPU utilization with usernames and CPU stats for each GPU-utilizing
process

optional arguments:
  -h, --help            show this help message and exit
  -l [COMMAND_LENGTH], --command-length [COMMAND_LENGTH]
                        Print longer part of the commandline. If `length' is
                        provided, use it as the commandline length, otherwise
                        print first 100 characters.
  -c, --color           Colorize the output (green - free GPU, yellow -
                        moderately used GPU, red - fully used GPU)

Note: for backward compatibility, nvidia-smi | nvhtop [-l [length]] is also supported.

Example output

$ nvhtop -l

Mon May 21 15:06:35 2018
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 390.25                 Driver Version: 390.25                    |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  GeForce GTX 108...  Off  | 00000000:04:00.0 Off |                  N/A |
| 53%   75C    P2   174W / 250W |  10807MiB / 11178MiB |     97%      Default |
+-------------------------------+----------------------+----------------------+
|   1  GeForce GTX 108...  Off  | 00000000:05:00.0 Off |                  N/A |
| 66%   82C    P2   220W / 250W |  10783MiB / 11178MiB |    100%      Default |
+-------------------------------+----------------------+----------------------+
|   2  GeForce GTX 108...  Off  | 00000000:08:00.0 Off |                  N/A |
| 45%   67C    P2    85W / 250W |  10793MiB / 11178MiB |     51%      Default |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
|  GPU   PID     USER    GPU MEM  %MEM  %CPU  COMMAND                         |
|    0  1032 anonymou   10781MiB   308   3.7  python train_classifier.py      |
|    1 11021 cannotte   10765MiB   114   1.5  python3 ./train.py              |
|    2 25544 nevermin   10775MiB   108   2.0  python -m xxxxxxxxxxxxxxxxxxxxx |
+-----------------------------------------------------------------------------+

Screenshot with output coloring