In fall 2018, I was taking courses on
natural language processing
. When learning about Maximum Entropy Markov Models, I was curious how the term "maximum entropy" came about, so I decided to do some research of my own. Check out the PDF below to learn more about the connections between information theory, optimization theory, and logistic regression.