Multimedia Interaction and Understanding Lab

Our Vision

Weaving your media, telling your stories,
empowering real people to create and enjoy
new forms of personalized experience
through automatic analysis of multimedia content






Overview

The Multimedia Interaction and Understanding Lab (MIUL) is focused on developing core imaging and multimedia technologies for content analysis that provide the best digital media consumption experience. Our research includes multimedia analysis and management, creative composition, user interactions, 3D capture and displays, and document processing.

Technologies we created have been used extensively in HP products. We have a collaboration with Tsinghua University in Beijing, China, on multimedia research through the Tsinghua-HP Multimedia Research Center. We also operate Snapfish Lab, a portal where visitors can experience some of our technologies firsthand.

Director: Qian Lin

Selected Publications

2009

Jun Xiao, Jian Fan. "PrintMarmoset: Redesigning the Print Button for Sustainability." To appear at proceedings of CHI 2009.

S.H. Lim, R. Maurer and P. Kisilev, "Denoising scheme for realistic digital photos from unknown sources," in IEEE ICASSP 2009, Taipei, Taiwan, Apr 2009.

Niranjan Damera-Venkata and Nelson L. Chang, "Display Supersampling," ACM Transactions on Graphics, to appear (vol. 28, no. 1, January 2009).

Renato Keshet, Carl Staelin, Boris Oicherman, Mani Fischer, Pavel Kisilev, Sagi Schein, Doron Shaked, Marie Vans, Hila Nachlieli, Ruth Bergman, Ron Maurer, Michal Aharon, Alexander Berkovich, Ran Waidman, Oren Bengigi, Gal Amit, Shlomo Harush, Alon Asher, Hui Chao, Darryl Greig, Matthew Gaubatz, Steven Simske, “Automatic Photo Enhancement Server (HIPIE 2)”, accepted to Technologies for Digital Fulfillment, Las Vegas, NV, Feb 28-Mar 1, 2009.

2008

J. Xiao, X. Zhang, P. Cheatle, Y. Gao, C.B. Atkins, "Mixed-Initiative Photo Collage Authoring", ACM Multimedia, Vancouver, Canada, 2008.

J. Fan, Y. Gao, H. Luo, D. Keim, Z. Li, "A Novel Approach to Enable Semantic and Visual Image Summarization for Exploratory Image Search", ACM SIGMM International Workshop on Multimedia Information Retrieval (MIR), Vancouver, Canada, 2008.

C. B. Atkins. Blocked Recursive Image Composition. ACM Multimedia, Vancouver, BC, Canada, 2008.

J. Xiao, X. Zhang, Y. Gao, P. Cheatle and C. B. Atkins. Mixed-Initiative Photo Collage Authoring. ACM Multimedia, Vancouver, BC, Canada, 2008.

Jun Xiao, Xuemei Zhang, Phil Cheatle, Yuli Gao, C. Brian Atkins. "Mixed-Initiative Photo Collage Authoring." Proceedings of the ACM international conference on Multimedia (ACM Multimedia 2008).

Jun Xiao and Tong Zhang. "Face Bubble: Photo Browsing by Faces." Proceedings of the working conference on Advanced visual interfaces (AVI 2008), pages 343-346.

Peng Wu, Eamonn O'Brien-Strain, Jerry Liu, "Snapfish Lab: An Open Online Imaging Community", 2008 International Workshop on Multimedia Signal Processing, MMSP2008, October 2008.

Pere Obrador, Nathan Moroney, Ian MacDowell, Eamonn O'Brien-Strain, "Image collection taxonomies for photo-book auto-population with intuitive interaction", September 2008, DocEng '08: Proceeding of the eighth ACM symposium on Document engineering.

M. Chen, S.H. Lim, Q. Lin, "Multi-image processing technologies for image enhancement", The 6th International Conference on Image Science and Hardcopy, Guangdong, China, January 2008.

Ruth Bergman, Ron Maurer, Hila Nachlieli, Gitit Ruckenstein, Patrick Chase, Darryl Greig, "Comprehensive Solutions for Automatic Removal of Dust and Scratches from Images", Journal of Electronic Imaging 17(1), pp 013010, 2008.

2007

Niranjan Damera-Venkata and Nelson L. Chang, "Realizing Super-Resolution with Superimposed Projection," IEEE International Workshop on Projector-Camera Systems (ProCams), Minneapolis, MN, 18 June 2007. (Best paper award winner)

Jian Fan, “Enhancement of Camera-captured Document Images with Watershed Segmentation”, CBDAR07, p.87-93, Sept. 2007

Niranjan Damera-Venkata, Nelson L. Chang, and Jeffrey M. DiCarlo, "A Unified Paradigm for Scalable Multiple Projector-Displays," IEEE Transactions on Visualization and Computer Graphics (Proceedings of IEEE Visualization Conference), vol. 13, no. 6, November/December 2007, pp. 1360--1367.

Niranjan Damera-Venkata and Nelson L. Chang, "On the Resolution Limits of Superimposed Projection," IEEE International Conference on Image Processing (ICIP), San Antonio, TX, 16-19 September 2007, vol. V, pp. 373--376.

Carl Staelin, Michael Elad, Darryl Greig, Oded Shmueli, Marie Vans, “Biblio:Automatic meta-data extraction”, International Journal on Document Analysis and Recognition 10(2), pp 113-126, 2007.

J. Fan, Y. Gao, H. Luo, "Hierarchical Classification for Automatic Image Annotation", ACM SIGIR, 2007, Amsterdam.

R. Samadani, S.H. Lim, D. Tretter, "Representative Image Thumbnails for Good Browsing", in Proceedings of the IEEE 2007 International Conference on Image Processing, San Antonio, TX, September 2007

P. Kisilev, D. Shaked, S.H. Lim, "Noise and Signal Activity Maps for Better Imaging Algorithms", in Proceedings of the IEEE 2007 International Conference on Image Processing, San Antonio, TX, September 2007

2006

P. M. Joshi, C. B. Atkins and T. Zhang, “From video to photo albums: digital publishing workflow for automatic album creation,” ACM Symposium on Document Engineering, pp. 179 – 181, Amsterdam, the Netherlands, 2006.

Jian Fan and Hui Chao, "Image object adaptation in variable data printing", Electronic Imaging 06, Proc. SPIE, Vol. 6076, 60760H (2006)

Parag Joshi, "End-to-end Digital Automated Print Production Workflows for Variable Data Printing", presented at International Conference on Printing Technology, St Petersburg, Russia, 2006.