exploring mixed reality window concept for car passengers

1、Exploring Mixed RealityWindow Concept for CarPassengersAbstractDue to their large window surfaces and mobile use, cars offer an interesting domain for mixed reality applications. By utilizing the windows as see-through displays, there is a possibility to enhance the physical landscape with location-

2、specific information. In this paper we describe our work-in-progress research exploring the concept of mixed reality user interfaces for cars, focusing on passenger use cases, communication and social nature of the use. In this workshop paper, we present our motivation and an early prototype of the

3、concept.Jonna HkkilFaculty of Art and Design, University of LaplandFI-96540, Rovaniemi, Finlandjonna.hakkilaulapland.fiAshley ColleyCenter for Internet Excellence, University of OuluFI-90014, Oulu, Finlandashley.colleycie.fiJuho RantakariCenter for Internet Excellence, University of OuluFI-90014, Ou

4、lu, FAuthor KeywordsMixed reality; automotive user interfaces; location- based services; user interface design.ACM Classification KeywordsH.5.m. Information interfaces and presentation (e.g., HCI): Miscellaneous.Permission to make digital or hard copies of part or all of this

5、work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other us

6、es, contact the Owner/Author.IntroductionDue to developments in technology miniaturization, energy efficiency and new interactive materials, interaction technologies are constantly developing andCopyright is held by the owner/author(s).finding their ways to new application doma interesting environme

7、nt for novel interactive. OneAutomotiveUI 14, Sep 17-19 2014, Seattle, WA, USA ACM 978-1-4503-0725-3/14/09./10.1145/2667239.2667288applications and user interface (UI) design solutions iscars. A car forms a confined physical design space, where a power supply is provided, and where t

8、he location of users stays very much stable during a journey. Cars already include high tech solutions using interactive technologies, mostly for driving, but also for entertainment purposes. Prior art in automotive UIs has already investigated the use of novel screen technologies, such as stereosco

9、pic 3D displays 1. In our research, we are interested in the use cases and user interface design for see-through displays in the vehicular domain.of car windows as see-through touch screen displays in a simulated car environment 10.Our ResearchWe have earlier explored user expectations of different

10、mobile MR information notes for the city environment, and identified numerous categories, ranging from information about both public and commercial services to historical facts and communication 9. In our earlier research on MR use scenarios for the home environment, use cases related to communicati

11、on between people was one identified category 8.Mixed reality (MR), which fuses together the aspects of physical reality and digital information 5, is one of the growing technology trends today. Mobile mixed reality applications such as Layar 2 are off-the-shelf products for smart phones, typically

12、providing commercial information attached to a city landscape,e.g. on shops or restaurants. Whereas mobile phones are probably the most typical technology platform for todays MR applications, cars offer another interesting domain where the technology could be applied.In our work-in-progress research

13、, we are interested in MR window screens for vehicles, especially looking at the passenger use cases. Whereas the majority of previous work on MR solutions for cars has focused on the driver, and augmenting the windscreen view, we focus on augmenting the side windows of the vehicle, primarily for th

14、e benefit of the passengers. Passengers can use their time in a more relaxed manner than the driver and are able to focus on the surroundings, entertainment and social aspects of the journey. The concept idea, a see-through augmented reality (AR) window in a car, including user created annotations,

15、is presented in Figure 1. In our work-in-progress research, we are working towards an interactive prototype, which we aim to test in a real world use context.Car windows provide almost the full 360 degrees visibility to the surrounding landscape, and they offer an interesting possibility for see-thr

16、ough displays. See- through displays are an emerging technology trend, already introduced by industrial manufacturers 6, and they have been used to demonstrate novel use cases in interaction research 3. In the vehicular context, earlier research has investigated the use of the car windscreen as a mi

17、xed reality display 7, and similar concepts have been suggested for motorcycle visors 4. These use cases have focused on the drivers needs, displaying e.g. navigation information. GMs Window of Opportunity design project explores the uselabels. The application then combines the virtual map view with

18、 the real world-view from the live camera. As part of the application the user can add new annotations at the current location. The aim of the concept is to focus not only on displaying informative messages, but the social and communication aspects such a system enables.Figure 1. Concept design of t

19、he user interface for a social augmented reality car window.Our work currently includes a concept prototype of a MR application, where the user can view and annotate location-specific notes to a see-through display on a car side window. We have built the prototype system, which implements a video se

20、e-though AR system. The first prototype is demonstrated in use in Figure 2, and currently uses a regular display that can be mounted to the car for piloting the demo.Figure 2. Piloting the first prototype of the social see-throughMR window concept in the car. Note: In actual use the display is posit

21、ioned over the side window.In our prototype a 24” monitor display is placed over one of the rear side windows of the car and displays the view from a camera facing out from the window. The view is augmented with textual labels, which are displayed synchronous to the vehicles position and orientation

22、. The implementation uses an Android mobile phone as the GPS and orientation sensor, connected to a PC via Bluetooth. The PC application runs an application developed in Unity 3D which maps the latitude and longitude values to a position on aDiscussionWe believe the design of an interactive social A

23、R window for cars offers interesting possibilities to enhance the passenger experiences in cars. Whereas mobile AR applications are becoming more common in the smart phone domain, there are several design challenges, and the automotive context brings its own special characteristics for such systems.

24、 As we are interested in location based information, and the passengers ability to leave location-based annotations, the temporal aspects and dynamicity play a significantvirtual 3D map environment that contatextual3 Lee, J., Olwal, A., Ishii, H. & Boulanger, C. (2013). SpaceTop: integrating 2D and

25、spatial 3D interactions in a see-through desktop environment. In Proc. CHI 2013, ACM, 189-192.4 LiveMap. /articles/20130618- livemap-augmented-reality-helmet-with-navigation-on- indiegogo.html Last accessed Sep 5, 2014.5 Milgram, P. & Kishino, F. (1994). A Taxonomy of Mixed Realit

26、y Visual Displays. IEICE Trans. Information Systems, vol. E77-D, no. 12, 13211329.6 Samsung Smart Window /view/426662/samsu ngs-smart-window/ Last accessed Sep 5, 2014.7 Tnnis, M., Sandor, C., Lange, C. & Bubb, H. (2005). Experimental Evaluation of an Augmented Reality

27、Visualization for Directing a Car Drivers Attention. In Proc. ISMAR 2005, IEEE, 5659.8 Vent-Olkkonen, L., Posti, M. & Hkkil, J. (2013). Early Perceptions of an Augmented Home. In Proc.MUM13, ACM (2013)9 Vent-Olkkonen, L., Posti, M., Koskenranta, O. & Hkkil, J. (2012). User Expectations of Mobile Mixed Reality Service Content. In Proc. MUM 2012. ACM.10 Window of Opportunity.role in UI design. Differing from smart phone MR applications designed mostly for pedestrian use, MR application concepts for cars needs to take into account that the cars move at a greater speed, a