In fall 2018, I was taking courses on convex optimization and on natural language processing. When learning about Maximum Entropy Markov Models, I was curious how the term "maximum entropy" came about, so I decided to do some research of my own. Check out the PDF below to learn more about the connections between information theory, optimization theory, and logistic regression.