More and more people are interacting with technology at work, at home, or when mobile. Over 79% of American adults use the Internet, and 59% connect to the Internet wirelessly using Wi-Fi or mobile broadband through their laptops or cell phones. And Americans spend 36% of their online time communicating and networking across social networks, blogs, personal email, and instant messaging.

People are looking for fast, context-aware methods of interfacing with technology. They expect that technology to be easy to use, reliable, and personalized---transparently enabling mobile and immersive experiences. And nothing will drive the continued growth and applicability of technology more than the point of human interface.

At HP Labs, we see a future in which human interaction through and with technology becomes completely intuitive, wherever you are. To get there, we’re radically simplifying the user experience by focusing on seamless collaboration, across devices. We’re also harnessing the collective intelligence of connected populations inside and outside enterprises to create novel technologies and services. And by making computer and human interactions intuitive and cognitively simple—wherever you are—the adoption of information technology will be far more pervasive than it is today.

Mobile and Immersive Experiences seeks to create compelling user experiences that fundamentally change how people communicate, collaborate, socialize, and entertain---utilizing multimedia technologies to deliver intuitive, interactive, mobile, and immersive audio-visual experiences.

Mobile and Immersive Experience Research Projects

Active Skins

The mobile and personal products that we all now use are increasingly dominated by the user interface – touchscreen tablets and smartphones being prime examples. To further enhance the experience and functionality of these types of devices, we are investigating making more of the product surface – its 'skin' – active. A key goal is to provide touch output to complement the rise of touch input as a means of interacting with our information. Thus you might actually 'feel' the edge of a virtual object on a touchscreen, or sense changes in the sides and back of a device as you're holding it, alerting you to an upcoming appointment, perhaps, or an improvement in one of your investments. These devices will also be more aware of their environment and better able to respond to that environment in useful ways. To develop them, we'll build on the emerging manufacturing trends of plastic electronics and polymer microelectromechanical systems -- delivering more effective, lower cost and greener products.

MOXIE: Mobile Cloud Experience Interactions

Our mobile devices are already the heart of our digital lives, keeping us connected, productive and entertained. We plan to go further: to develop better ways to interact with our mobile devices, and better ways to interact with the rest of the world through our devices. The next frontier in mobile computing will deliver ever richer services in an intuitive manner – a vision that will be realized when device sensing works in harmony with multimedia cloud services. Towards this goal, we are developing both new sensing abilities for our devices, and advanced interactive services in the cloud. New sensing capabilities will offer new perspectives of the surrounding physical world to services and applications for intelligent and appropriate behavior. By synergistically combining interactive cloud computing with the enhanced device sensing capabilities we will make the personal mobile experience even richer, and more intuitive and interactive.

Continuous View Glass-Free 3D

The goal of our Continuous 3D research is to build systems that accurately replicate the physical world with respect to our visual and auditory senses. We aim to build technology that will faithfully capture, transmit, and reconstruct the appearance and sound of our 3D world. Multiple viewers, simultaneously looking at the same display, will see different views and see their views change in response to movement, with no need for special glasses. This requires significant innovation in both the capture and display of 3D visual and auditory information. It also requires significant advances in high-quality compression, transport, and processing of 3D video and audio.

Next Generation Displays

Our mission is to create the display that is the central component of the next generation of “thin” appliances or “Information Surfaces.” The future will bring a display that will be able to show print-quality information as well as video and interactive media, will be lightweight, robust and mobile, and can be manufactured at low cost and with low capital investment. Because of its paper-like and video capabilities, its flexible form factor and ease of customization and integration into products, this display will also enable novel product capabilities such as active surfaces and skins.

Social Computing

Our work aims to harness the collective intelligence of the connected population inside and outside enterprises to create novel technologies and services. Ours is an interdisciplinary approach, combining social and computer science. We focus on the economics of attention, creating models to understand and harness the flow of collective attention, supporting a mobile society with context-aware and anticipative technology. We want to enable a fluid enterprise, where collective intelligence is harnessed via appropriate incentives to predict the future, make decisions, and allocate resources.