Decoding perspective on model complexity (ECE592 Module 7C)
Here we take a decoding perspective, and show that we can differentiate between ~sqrt(N) parameters. Combined with Module 7B, we see that ~sqrt(N) quantization levels per parameter is the sweet spot, hence the complexity of a model class is roughly 0.5log2(N) bits per parameter.
On this page of the site you can watch the video online Decoding perspective on model complexity (ECE592 Module 7C) with a duration of hours minute second in good quality, which was uploaded by the user Dror Baron 01 September 2022, share the link with friends and acquaintances, this video has already been watched 113 times on youtube and it was liked by 0 viewers. Enjoy your viewing!
