Backing Off: Hierarchical Decomposition of Activity for 3D Novel Pose Recovery

John Darby, Baihua Li, Nicholas Costen, David J. Fleet, Neil D. Lawrence
British Machine Vision Conference, 2009.

Abstract

For model-based 3D human pose estimation, even simple models of the human body lead to high-dimensional state spaces. Where the class of activity is known a priori, lowdimensional activity models learned from training data make possible a thorough and efficient search for the best pose. Conversely, searching for solutions in the full state space places no restriction on the class of motion to be recovered, but is both difficult and expensive. This paper explores a potential middle ground between these approaches, using the hierarchical Gaussian process latent variable model to learn activity at different hierarchical scales within the human skeleton. We show that by training on full-body activity data then descending through the hierarchy in stages and exploring subtrees independently of one another, novel poses may be recovered. Experimental results on motion capture data and monocular video sequences demonstrate the utility of the approach, and comparisons are drawn with existing low-dimensional activity models

Cite this Paper

BibTeX
@InProceedings{Darby:backing09, title = {Backing Off: Hierarchical Decomposition of Activity for 3D Novel Pose Recovery}, author = {Darby, John and Li, Baihua and Costen, Nicholas and Fleet, David J. and Lawrence, Neil D.}, booktitle = {British Machine Vision Conference}, year = {2009}, pdf = {https://inverseprobability.com/publications/files/BMVC2009CR06.pdf}, url = {http://inverseprobability.com/publications/darby-backing09.html}, abstract = {For model-based 3D human pose estimation, even simple models of the human body lead to high-dimensional state spaces. Where the class of activity is known a priori, lowdimensional activity models learned from training data make possible a thorough and efficient search for the best pose. Conversely, searching for solutions in the full state space places no restriction on the class of motion to be recovered, but is both difficult and expensive. This paper explores a potential middle ground between these approaches, using the hierarchical Gaussian process latent variable model to learn activity at different hierarchical scales within the human skeleton. We show that by training on full-body activity data then descending through the hierarchy in stages and exploring subtrees independently of one another, novel poses may be recovered. Experimental results on motion capture data and monocular video sequences demonstrate the utility of the approach, and comparisons are drawn with existing low-dimensional activity models} }
Endnote
%0 Conference Paper %T Backing Off: Hierarchical Decomposition of Activity for 3D Novel Pose Recovery %A John Darby %A Baihua Li %A Nicholas Costen %A David J. Fleet %A Neil D. Lawrence %B British Machine Vision Conference %D 2009 %F Darby:backing09 %U http://inverseprobability.com/publications/darby-backing09.html %X For model-based 3D human pose estimation, even simple models of the human body lead to high-dimensional state spaces. Where the class of activity is known a priori, lowdimensional activity models learned from training data make possible a thorough and efficient search for the best pose. Conversely, searching for solutions in the full state space places no restriction on the class of motion to be recovered, but is both difficult and expensive. This paper explores a potential middle ground between these approaches, using the hierarchical Gaussian process latent variable model to learn activity at different hierarchical scales within the human skeleton. We show that by training on full-body activity data then descending through the hierarchy in stages and exploring subtrees independently of one another, novel poses may be recovered. Experimental results on motion capture data and monocular video sequences demonstrate the utility of the approach, and comparisons are drawn with existing low-dimensional activity models
RIS
TY - CPAPER TI - Backing Off: Hierarchical Decomposition of Activity for 3D Novel Pose Recovery AU - John Darby AU - Baihua Li AU - Nicholas Costen AU - David J. Fleet AU - Neil D. Lawrence BT - British Machine Vision Conference DA - 2009/01/01 ID - Darby:backing09 L1 - https://inverseprobability.com/publications/files/BMVC2009CR06.pdf UR - http://inverseprobability.com/publications/darby-backing09.html AB - For model-based 3D human pose estimation, even simple models of the human body lead to high-dimensional state spaces. Where the class of activity is known a priori, lowdimensional activity models learned from training data make possible a thorough and efficient search for the best pose. Conversely, searching for solutions in the full state space places no restriction on the class of motion to be recovered, but is both difficult and expensive. This paper explores a potential middle ground between these approaches, using the hierarchical Gaussian process latent variable model to learn activity at different hierarchical scales within the human skeleton. We show that by training on full-body activity data then descending through the hierarchy in stages and exploring subtrees independently of one another, novel poses may be recovered. Experimental results on motion capture data and monocular video sequences demonstrate the utility of the approach, and comparisons are drawn with existing low-dimensional activity models ER -
APA
Darby, J., Li, B., Costen, N., Fleet, D.J. & Lawrence, N.D.. (2009). Backing Off: Hierarchical Decomposition of Activity for 3D Novel Pose Recovery. British Machine Vision Conference Available from http://inverseprobability.com/publications/darby-backing09.html.

Related Material