A1111: nVidia TensorRT Extension for Stable Diffusion (Tutorial)
nVidia TensorRT Extension is an official extension for Stable Diffusion WebUI which allows you to use the Tensor Cores in your nVidia GPU for image generation performance boost. During my testing on an RTX 4090, I observed somewhere from 20% to 50% performance improvement when using TensorRT. However, it does have its limitations and bugs. In this tutorial, I cover everything from how it works, to installing it, removing launching errors, and explaining the exact settings for the training of the TensorRT Engine Profile.
------------------------
Relevant Links:
Onnx and RT FIles (YouTube Membership): https://www.youtube.com/@controlaltai...
A1111 GitHub: https://github.com/AUTOMATIC1111/stab...
nVidia TensorRT Extension: https://github.com/NVIDIA/Stable-Diff...
Checkpoints
SDXL: Hugging Face SDXL Base: https://huggingface.co/stabilityai/st...
SDXL VAE: https://huggingface.co/stabilityai/sd...
Juggernaut XL (Vae Auto): https://civitai.com/models/133005?mod...
DreamShaper (VAE Auto): https://civitai.com/models/4384?model...
Python and Git:
Python 3.10.11: https://www.python.org/downloads/rele...
Git Windows: https://git-scm.com/download/win
------------------------
Dev Branch Commands:
git branch -a
git checkout dev
Error Fixing Commands:
venv\scripts\activate.bat
pip uninstall tensorrt
pip cache purge
pip install --pre --extra-index-url https://pypi.nvidia.com tensorrt==9.0.1.post11.dev4
pip uninstall -y nvidia-cudnn-cu11
pip install onnxruntime
pip install colored
pip install onnx
venv\Scripts\deactivate.bat
webui.bat
Xformers Command:
pip3 install -U xformers --index-url https://download.pytorch.org/whl/cu121
PIP Upgrade Command:
python.exe -m pip install --upgrade pip
Cuda 12.1 Torch 2.1.1 Cdmmand:
pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121
------------------------
Timestamps:
0:00 Intro.
0:58 About TensorRT.
3:52 A1111 Dev Branch Install.
7:39 Fixing Errors.
14:25 nVidia CP Setting.
15:27 RT Engine Configuration.
21:03 Exporting Process.
23:00 Testing with ADetailer.
En esta página del sitio puede ver el video en línea A1111: nVidia TensorRT Extension for Stable Diffusion (Tutorial) de Duración hora minuto segunda en buena calidad , que subió el usuario ControlAltAI 10 diciembre 2023, comparta el enlace con amigos y conocidos, en youtube este video ya ha sido visto 13,198 veces y le gustó 232 a los espectadores. Disfruta viendo!
