A1111: nVidia TensorRT Extension for Stable Diffusion (Tutorial)

Опубликовано: 10 Декабрь 2023
на канале: ControlAltAI

13,198

232

nVidia TensorRT Extension is an official extension for Stable Diffusion WebUI which allows you to use the Tensor Cores in your nVidia GPU for image generation performance boost. During my testing on an RTX 4090, I observed somewhere from 20% to 50% performance improvement when using TensorRT. However, it does have its limitations and bugs. In this tutorial, I cover everything from how it works, to installing it, removing launching errors, and explaining the exact settings for the training of the TensorRT Engine Profile.

------------------------

Relevant Links:

Onnx and RT FIles (YouTube Membership): https://www.youtube.com/@controlaltai...

A1111 GitHub: https://github.com/AUTOMATIC1111/stab...
nVidia TensorRT Extension: https://github.com/NVIDIA/Stable-Diff...

Checkpoints
SDXL: Hugging Face SDXL Base: https://huggingface.co/stabilityai/st...
SDXL VAE: https://huggingface.co/stabilityai/sd...
Juggernaut XL (Vae Auto): https://civitai.com/models/133005?mod...
DreamShaper (VAE Auto): https://civitai.com/models/4384?model...

Python and Git:
Python 3.10.11: https://www.python.org/downloads/rele...
Git Windows: https://git-scm.com/download/win

------------------------

Dev Branch Commands:
git branch -a
git checkout dev

Error Fixing Commands:
venv\scripts\activate.bat
pip uninstall tensorrt
pip cache purge
pip install --pre --extra-index-url https://pypi.nvidia.com tensorrt==9.0.1.post11.dev4
pip uninstall -y nvidia-cudnn-cu11
pip install onnxruntime
pip install colored
pip install onnx
venv\Scripts\deactivate.bat
webui.bat

Xformers Command:
pip3 install -U xformers --index-url https://download.pytorch.org/whl/cu121

PIP Upgrade Command:
python.exe -m pip install --upgrade pip

Cuda 12.1 Torch 2.1.1 Cdmmand:
pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121

------------------------

Timestamps:

0:00 Intro.
0:58 About TensorRT.
3:52 A1111 Dev Branch Install.
7:39 Fixing Errors.
14:25 nVidia CP Setting.
15:27 RT Engine Configuration.
21:03 Exporting Process.
23:00 Testing with ADetailer.

На этой странице сайта вы можете посмотреть видео онлайн A1111: nVidia TensorRT Extension for Stable Diffusion (Tutorial) длительностью часов минут секунд в хорошем качестве, которое загрузил пользователь ControlAltAI 10 Декабрь 2023, поделитесь ссылкой с друзьями и знакомыми, на youtube это видео уже посмотрели 13,198 раз и оно понравилось 232 зрителям. Приятного просмотра!

142