Scientists want to do ‘informative’ experiments. What makes an experiment informative? I believe that information theory has a lot of answers. In this post I will try to explain information theory’s d…
NOTE this blog post can be run as a jupyter notebook. I re-ordered the cells to make it easier to read; to re-produce all the plots see instructions at the end of the post. Background ’Diverse optimiz…