Minimizing KL Divergence as a Form of Conservatism
At the Boundary between The Old Distribution and The New Distribution
Conservatism is a style of thinking: Cicrumstances changes, there might be new objectives pops up. THe old way of doing things might no longer be compatable to reaching the desired objective, so what are the guiding principles as we make changes? A more drastic style is to just abandom the old and build around the new. However, while it might sounds good, there are drawbacks. What if the seemingly good new has potential downside that we can yet understand? A more reasonable aproach is to acknowledge the wisdom in a system that already works, and seek to propose changes in...
[Read More]