workshop

Assessing Neural Network Representations During Training Using Data Diffusion Spectra
We proposed an information-theory based framework to measure the entropy and mutual information of neural network representations.
Danqi Liao, Chen Liu, Alexander Tong, Guillaume Huguet, Guy Wolf, Maximilian Nickel, Ian Adelstein, Smita Krishnaswamy
Assessing Neural Network Representations During Training Using Data Diffusion Spectra