Boosting Performance and Utilization with Multi-Instance GPU

Published: 22 June 2020
on channel: NVIDIA Developer

2,420

Multi-Instance GPU (MIG) on the NVIDIA A100 Tensor Core GPU can guarantee performance for up to seven jobs running concurrently on the same GPU—and each GPU instance is fully isolated with its own compute, memory, and bandwidth. This unique capability of the A100 GPU offers the right-sized GPU for every job and maximizes data center utilization. This demo shows inference performance on a single slice of MIG and then scales linearly across the entire A100.

On this page of the site you can watch the video online Boosting Performance and Utilization with Multi-Instance GPU with a duration of hours minute second in good quality, which was uploaded by the user NVIDIA Developer 22 June 2020, share the link with friends and acquaintances, this video has already been watched 2,420 times on youtube and it was liked by 72 viewers. Enjoy your viewing!

1,699