Variational Inference Guide

Neil D. Lawrence
, 2002.

Abstract

This report is a brief introduction to variational inference for Bayesian models from the perspective of the Expectation Maximisation (EM) algorithm @Dempster:EM77. We start with an overview of the EM algorithm from the perspective of variational inference and then we show how approximate inference may also be performed. We discuss briefly when variational inference may be used and finally we mention the variational importance sampler as an alternative approach.

Cite this Paper

BibTeX
@Misc{lawrence:variationalguide02, title = {Variational Inference Guide}, author = {Lawrence, Neil D.}, year = {2002}, pdf = {https://inverseprobability.com/publications/files/variationalInference.pdf}, url = {http://inverseprobability.com/publications/lawrence-variationalguide02.html}, abstract = {This report is a brief introduction to variational inference for Bayesian models from the perspective of the Expectation Maximisation (EM) algorithm @Dempster:EM77. We start with an overview of the EM algorithm from the perspective of variational inference and then we show how approximate inference may also be performed. We discuss briefly when variational inference may be used and finally we mention the variational importance sampler as an alternative approach.} }
Endnote
%0 Generic %T Variational Inference Guide %A Neil D. Lawrence %D 2002 %F lawrence:variationalguide02 %U http://inverseprobability.com/publications/lawrence-variationalguide02.html %X This report is a brief introduction to variational inference for Bayesian models from the perspective of the Expectation Maximisation (EM) algorithm @Dempster:EM77. We start with an overview of the EM algorithm from the perspective of variational inference and then we show how approximate inference may also be performed. We discuss briefly when variational inference may be used and finally we mention the variational importance sampler as an alternative approach.
RIS
TY - GEN TI - Variational Inference Guide AU - Neil D. Lawrence DA - 2002/12/18 ID - lawrence:variationalguide02 L1 - https://inverseprobability.com/publications/files/variationalInference.pdf UR - http://inverseprobability.com/publications/lawrence-variationalguide02.html AB - This report is a brief introduction to variational inference for Bayesian models from the perspective of the Expectation Maximisation (EM) algorithm @Dempster:EM77. We start with an overview of the EM algorithm from the perspective of variational inference and then we show how approximate inference may also be performed. We discuss briefly when variational inference may be used and finally we mention the variational importance sampler as an alternative approach. ER -
APA
Lawrence, N.D.. (2002). Variational Inference Guide. Available from http://inverseprobability.com/publications/lawrence-variationalguide02.html.

Related Material