ML Interpretability: feature visualization, adversarial example, interp. for language models

Veröffentlicht am: 20 Mai 2024
auf dem Kanal: Umar Jamil

7,349

315

In this video, I will be introducing Machine Learning Interpretability, a vast topic that aims at understanding the inner mechanisms of how machine learning models make their predictions, with the aim of debugging them, making them more transparent and trustworthy.
I will start by reviewing deep learning and the back-propagation algorithm, which are necessary for understanding adversarial example generation and feature visualization for computer vision classification models. In the second part, I will show how we can leverage the knowledge built in the first part of the video and apply it to language models. In particular, we will see how we can get insights on the bias of a language model by generating a prompt that maximizes the likelihood of the next token being a certain concept of our choice. This allows us to answer questions like:
"What does my language model think of women?"
"What does my language model think of minorities?"

This video has been built in collaboration with Leap Labs - an AI research lab that deals with machine learning interpretability and built the Leap Labs Interpretability Engine, which allows to get insights on how computer vision models work and how to improve them by generating prototypes, isolating features and understanding entanglement between classes.

Leap Labs: https://www.leap-labs.com/
Leap Labs Tutorials: https://docs.leap-labs.com/tutorial

As usual, the code and PDF slides are available at the following links:

PDF slides: https://github.com/hkproj/ml-interpre...
Adversarial Example Generation (tricking a classifier): https://github.com/hkproj/adversarial...
Generate inputs for language models: https://github.com/jessicarumbelow/Ba...

Auf dieser Seite können Sie das Online-Video ML Interpretability: feature visualization, adversarial example, interp. for language models mit der Dauer stunde minuten sekunde in guter Qualität ansehen, das der Benutzer Umar Jamil 20 Mai 2024 hochgeladen hat, den Link mit Freunden und Bekannten teilen, dieses Video wurde auf Youtube bereits 7,349 Mal angesehen und es wurde von 315 den Zuschauern gefallen. Viel Spaß beim Betrachtenden Zuschauern gefallen!

113,757

2.8K