Skip to content

Information Bottleneck

Blog

  • Steps Towards Understanding Deep Learning: The Information Bottleneck Connection (Part 1) - blog
  • On the information bottleneck theory of deep learning - Adrian Colyer (2017) - blog

Discussions

  • What is the status of the "Information Bottleneck Theory of Deep Learning"? - reddit
  • On the information bottleneck theory of deep learning - reddit

Papers

  • The HSIC Bottleneck: Deep Learning without Back-Propagation - Kurt Ma et al (2019) - [arxiv] | paper | code
  • Learning Representations for Neural Network-Based Classification Using the Information Bottleneck Principle - Amjad & Geiger (2019) - arxiv | paper