Press "Enter" to skip to content

Tag: maxent

RS: Maximum Entropy Model

I’m preparing a presentation involving the Maximum Entropy Model, and here are some materials collected for current and future reference.

Natural Language Processing Lecture Slides from the Stanford Coursera course by Dan Jurafsky and Christopher Manning: https://web.stanford.edu/~jurafsky/NLPCourseraSlides.html

The equivalence of logistic regression and maximum entropy models: http://www.win-vector.com/dfiles/LogisticRegressionMaxEnt.pdf

[CN]为什么 LR 模型要使用 sigmoid 函数,背后的数学原理是什么? http://zhihu.com/question/35322351/answer/67193153

Softmax function: https://en.wikipedia.org/wiki/Softmax_function

Exponential family: https://en.wikipedia.org/wiki/Exponential_family

生成模型和判别模型不得不说的故事: http://marvin-space.info/2013-07-07-gm-dm/

Joint versus Conditional Densities – Pros and Cons: http://www.cs.columbia.edu/~jebara/htmlpapers/ARL/node33.html

[CN]最大熵模型简介[例子+推导+GIS求解]: http://www.fuqingchuan.com/2015/03/714.html

[CN]从对偶问题到KKT条件: http://xuehy.github.io/%E4%BC%98%E5%8C%96/2014/04/13/KKT/

[CN]拉格朗日对偶性(Lagrange Duality): http://www.wengweitao.com/la-ge-lang-ri-dui-ou-xing-lagrange-duality.html

支持向量机:Duality: http://blog.pluskid.org/?p=702

[CN]优化问题中的对偶性理论: http://xiaoyc.com/duality-theory-for-optimization/

[CN]最大熵模型中的数学推导: http://blog.csdn.net/v_july_v/article/details/40508465

[CN]数学之美系列十六 — 谈谈最大熵模型: http://www.cnblogs.com/KevinYang/archive/2009/02/01/1381798.html

[CN]熵导论与最大熵模型: http://pan.baidu.com/s/1qWLSehI

Hierarchical Training Model: http://www.cs.jhu.edu/~junwu/publications/ch3.pdf

[CN]最大熵模型:读书笔记: http://jiangtanghu.com/docs/cn/maxEnt.pdf

[CN]MaxEnt: 最大熵模型(Maximum Entropy Models)(一): http://www.zhizhihu.com/html/y2011/3489.html

[CN]Variational Bayes: http://www.blog.huajh7.com/variational-bayes/

[CN]理想的机器学习书: http://www.52cs.org/?p=70

Picturing the Universe: The Contemporary Paintings of Ejay Weiss: http://www.artesmagazine.com/2015/04/picturing-the-universe-the-contemporary-paintings-of-ejay-weiss/

Continue reading RS: Maximum Entropy Model