ML Interpretability: feature visualization, adversarial example, interp. for language models
In this video, I will be introducing Machine Learning Interpretability, a vast topic that aims at understanding the inner mechanisms of how machine learning models make their predictions, with the aim of debugging them, making them more transparent and trustworthy.
I will start by reviewing deep learning and the back-propagation algorithm, which are necessary for understanding adversarial example generation and feature visualization for computer vision classification models. In the second part, I will show how we can leverage the knowledge built in the first part of the video and apply it to language models. In particular, we will see how we can get insights on the bias of a language model by generating a prompt that maximizes the likelihood of the next token being a certain concept of our choice. This allows us to answer questions like:
"What does my language model think of women?"
"What does my language model think of minorities?"
This video has been built in collaboration with Leap Labs - an AI research lab that deals with machine learning interpretability and built the Leap Labs Interpretability Engine, which allows to get insights on how computer vision models work and how to improve them by generating prototypes, isolating features and understanding entanglement between classes.
Leap Labs: https://www.leap-labs.com/
Leap Labs Tutorials: https://docs.leap-labs.com/tutorial
As usual, the code and PDF slides are available at the following links:
PDF slides: https://github.com/hkproj/ml-interpre...
Adversarial Example Generation (tricking a classifier): https://github.com/hkproj/adversarial...
Generate inputs for language models: https://github.com/jessicarumbelow/Ba...
On this page of the site you can watch the video online ML Interpretability: feature visualization, adversarial example, interp. for language models with a duration of hours minute second in good quality, which was uploaded by the user Umar Jamil 20 May 2024, share the link with friends and acquaintances, this video has already been watched 7,349 times on youtube and it was liked by 315 viewers. Enjoy your viewing!
![BERT explained: Training, Inference, BERT vs GPT/LLamA, Fine tuning, [CLS] token](https://image.4k-video.ru/id-video/90mGPxR2GgY)
