New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

PyTorch Nightly support in Dockerfile #2657

Open

sbhavani opened this issue Jan 3, 2025 · 0 comments

Assignees

Labels

sbhavani commented Jan 3, 2025

In https://github.com/NVIDIA/TensorRT-LLM/blob/main/docker/common/install_pytorch.sh, we support the latest PyT stable version (e.g. 2.5.1) that corresponds with NGC version (e.g. 24.11). However, the stable version lags behind the w.r.t. to CUDA, cuDNN, NCCL, etc.

It would be helpful to also support the PyT nightly wheel that corresponds with the NGC release which would include more bug fixes and features.

nv-guomingz assigned Shixiaowei02

nv-guomingz added the Installation label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment