Where is my friend? - Person identification in social networks

Deepak Pathak, Sai Nitish Satyavolu, Vinay P. Namboodiri

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

One of the interesting applications of computer vision is to be able to identify or detect persons in real world. This problem has been posed in the context of identifying people in television series [2] or in multi-camera networks [8]. However, a common scenario for this problem is to be able to identify people among images prevalent on social networks. In this paper we present a method that aims to solve this problem in real world conditions where the person can be in any pose, profile and orientation and the face itself is not always clearly visible. Moreover, we show that the problem can be solved with as weak supervision only a label whether the person is present or not, which is usually the case as people are tagged in social networks. This is challenging as there can be ambiguity in association of the right person. The problem is solved in this setting using a latent max-margin formulation where the identity of the person is the latent parameter that is classified. This framework builds on other off the shelf computer vision techniques for person detection and face detection and is able to also account for inaccuracies of these components. The idea is to model the complete person in addition to face, that too with weak supervision. We also contribute three real-world datasets that we have created for extensive evaluation of the solution. We show using these datasets that the problem can be effectively solved using the proposed method.

Original languageEnglish
Title of host publication2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015
PublisherIEEE
ISBN (Electronic)9781479960262
DOIs
Publication statusPublished - 17 Jul 2015
Event11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015 - Ljubljana, Slovenia
Duration: 4 May 20158 May 2015

Publication series

Name2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015

Conference

Conference11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015
CountrySlovenia
CityLjubljana
Period4/05/158/05/15

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition

Cite this

Pathak, D., Satyavolu, S. N., & Namboodiri, V. P. (2015). Where is my friend? - Person identification in social networks. In 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015 [7163140] (2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015). IEEE. https://doi.org/10.1109/FG.2015.7163140