by Chunhui Mo, Huawei.
Large Language Models (LLMs) are being distributed across many devices and platforms; having these models available on-device can help reduce the need for sending private data to cloud-hosted systems. Chunhui Mo (Huawei) explores what it would take to expose these LLMs to web applications through a Web API and the advantages it could bring in terms of privacy, security and performance.
On this page of the site you can watch the video online Use case for Web API accessing LLMs data with a duration of hours minute second in good quality, which was uploaded by the user W3C 16 May 2024, share the link with friends and acquaintances, this video has already been watched 135 times on youtube and it was liked by 6 viewers. Enjoy your viewing!