Projects per year
We propose a novel problem revolving around two tasks: (i) given a scene, recommend objects to insert, and (ii) given an object category, retrieve suitable background scenes. A bounding box for the inserted object is predicted in both tasks, which helps downstream applications such as semiautomated advertising and video composition. The major challenge lies in the fact that the target object is neither present nor localized in the input, and furthermore, available datasets only provide scenes with existing objects. To tackle this problem, we build an unsupervised algorithm based on object-level contexts, which explicitly models the joint probability distribution of object categories and bounding boxes using a Gaussian mixture model. Experiments on our own annotated test set demonstrate that our system outperforms existing baselines on all sub-tasks, and does so using a unified framework. Future extensions and applications are suggested.
- bounding box prediction
- image composition
- object recommendation
- object-level context
ASJC Scopus subject areas
- Computer Vision and Pattern Recognition
- Computer Graphics and Computer-Aided Design
- Artificial Intelligence
FingerprintDive into the research topics of 'What and where: A context-based recommendation system for object insertion'. Together they form a unique fingerprint.
- 1 Finished
Cosker, D., Bilzon, J., Campbell, N., Cazzola, D., Colyer, S., Fincham Haines, T., Hall, P., Kim, K. I., Lutteroth, C., McGuigan, P., O'Neill, E., Richardt, C., Salo, A., Seminati, E., Tabor, A. & Yang, Y.
1/09/15 → 28/02/21
Project: Research council