Local Distance Preservation in the GP-LVM through Back Constraints

Neil D. Lawrence, Joaquin Quiñonero Candela
Proceedings of the International Conference in Machine Learning, Omnipress 23:513-520, 2006.

Abstract

The Gaussian process latent variable model (GP-LVM) is a generative approach to non-linear low dimensional embedding, that provides a smooth probabilistic mapping from latent to data space. It is also a non-linear generalization of probabilistic PCA (PPCA) @Tipping:probpca99. While most approaches to non-linear dimensionality methods focus on preserving local distances in data space, the GP-LVM focusses on exactly the opposite. Being a smooth mapping from latent to data space, it focusses on keeping things apart in latent space that are far apart in data space. In this paper we first provide an overview of dimensionality reduction techniques, placing the emphasis on the kind of distance relation preserved. We then show how the GP-LVM can be generalized, through back constraints, to additionally preserve local distances. We give illustrative experiments on common data sets.

Cite this Paper


BibTeX
@InProceedings{Lawrence:backconstraints06, title = {Local Distance Preservation in the {GP-LVM} through Back Constraints}, author = {Lawrence, Neil D. and Quiñonero Candela, Joaquin}, booktitle = {Proceedings of the International Conference in Machine Learning}, pages = {513--520}, year = {2006}, editor = {Cohen, William and Moore, Andrew}, volume = {23}, publisher = {Omnipress}, doi = {10.1145/1143844.1143909}, pdf = {https://inverseprobability.com/publications/files/backConstraints.pdf}, url = {http://inverseprobability.com/publications/lawrence-backconstraints06.html}, abstract = {The Gaussian process latent variable model (GP-LVM) is a generative approach to non-linear low dimensional embedding, that provides a smooth probabilistic mapping from latent to data space. It is also a non-linear generalization of probabilistic PCA (PPCA) @Tipping:probpca99. While most approaches to non-linear dimensionality methods focus on preserving local distances in data space, the GP-LVM focusses on exactly the opposite. Being a smooth mapping from latent to data space, it focusses on keeping things apart in latent space that are far apart in data space. In this paper we first provide an overview of dimensionality reduction techniques, placing the emphasis on the kind of distance relation preserved. We then show how the GP-LVM can be generalized, through back constraints, to additionally preserve local distances. We give illustrative experiments on common data sets.} }
Endnote
%0 Conference Paper %T Local Distance Preservation in the GP-LVM through Back Constraints %A Neil D. Lawrence %A Joaquin Quiñonero Candela %B Proceedings of the International Conference in Machine Learning %D 2006 %E William Cohen %E Andrew Moore %F Lawrence:backconstraints06 %I Omnipress %P 513--520 %R 10.1145/1143844.1143909 %U http://inverseprobability.com/publications/lawrence-backconstraints06.html %V 23 %X The Gaussian process latent variable model (GP-LVM) is a generative approach to non-linear low dimensional embedding, that provides a smooth probabilistic mapping from latent to data space. It is also a non-linear generalization of probabilistic PCA (PPCA) @Tipping:probpca99. While most approaches to non-linear dimensionality methods focus on preserving local distances in data space, the GP-LVM focusses on exactly the opposite. Being a smooth mapping from latent to data space, it focusses on keeping things apart in latent space that are far apart in data space. In this paper we first provide an overview of dimensionality reduction techniques, placing the emphasis on the kind of distance relation preserved. We then show how the GP-LVM can be generalized, through back constraints, to additionally preserve local distances. We give illustrative experiments on common data sets.
RIS
TY - CPAPER TI - Local Distance Preservation in the GP-LVM through Back Constraints AU - Neil D. Lawrence AU - Joaquin Quiñonero Candela BT - Proceedings of the International Conference in Machine Learning DA - 2006/06/25 ED - William Cohen ED - Andrew Moore ID - Lawrence:backconstraints06 PB - Omnipress VL - 23 SP - 513 EP - 520 DO - 10.1145/1143844.1143909 L1 - https://inverseprobability.com/publications/files/backConstraints.pdf UR - http://inverseprobability.com/publications/lawrence-backconstraints06.html AB - The Gaussian process latent variable model (GP-LVM) is a generative approach to non-linear low dimensional embedding, that provides a smooth probabilistic mapping from latent to data space. It is also a non-linear generalization of probabilistic PCA (PPCA) @Tipping:probpca99. While most approaches to non-linear dimensionality methods focus on preserving local distances in data space, the GP-LVM focusses on exactly the opposite. Being a smooth mapping from latent to data space, it focusses on keeping things apart in latent space that are far apart in data space. In this paper we first provide an overview of dimensionality reduction techniques, placing the emphasis on the kind of distance relation preserved. We then show how the GP-LVM can be generalized, through back constraints, to additionally preserve local distances. We give illustrative experiments on common data sets. ER -
APA
Lawrence, N.D. & Quiñonero Candela, J.. (2006). Local Distance Preservation in the GP-LVM through Back Constraints. Proceedings of the International Conference in Machine Learning 23:513-520 doi:10.1145/1143844.1143909 Available from http://inverseprobability.com/publications/lawrence-backconstraints06.html.

Related Material