Semi-supervised regression using Hessian energy with an application to semi-supervised dimensionality reduction

Kwang In Kim, Florian Steinke, Matthias Hein

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Semi-supervised regression based on the graph Laplacian suffers from the fact that the solution is biased towards a constant and the lack of extrapolating power. Outgoing from these observations we propose to use the second-order Hessian energy for semi-supervised regression which overcomes both of these problems, in particular, if the data lies on or close to a low-dimensional submanifold in the feature space, the Hessian energy prefers functions which vary linearly with respect to the natural parameters in the data. This property makes it also particularly suited for the task of semi-supervised dimensionality reduction where the goal is to find the natural parameters in the data based on a few labeled points. The experimental result suggest that our method is superior to semi-supervised regression using Laplacian regularization and standard supervised methods and is particularly suited for semi-supervised dimensionality reduction.
Original languageEnglish
Title of host publicationAdvances in Neural Information Processing Systems 22 (NIPS), 2009
Number of pages9
Publication statusPublished - 2010

Cite this