Here we pro­pose a novel and cost-effec­tive setup of a lean­ing-based inter­face (“NaviBoard”) that allows people to effi­cient­ly nav­i­gate vir­tu­al envi­ron­ments — with per­for­mance levels match­ing the gold stan­dard of free-space walk­ing, with­out any increase in motion sickness

Abstract Walking has always been the most common loco­mo­tion mode for humans in the real world. As a result, it has also been con­sid­ered as the gold stan­dard in a large body of Virtual Reality research involv­ing nav­i­ga­tion. Physical walk­ing pro­vides body-based sen­so­ry infor­ma­tion (e.g., kines­thet­ic, pro­pri­o­cep­tive, vestibu­lar) about both trans­la­tion­al and rota­tion­al com­po­nents of loco­mo­tion. Though full rota­tion is no longer a tech­ni­cal chal­lenge with recent advance­ments in track­ing tech­nol­o­gy, phys­i­cal trans­la­tion is still restrict­ed through lim­it­ed tracked areas, which are also asso­ci­at­ed with many other con­straints, e.g., cost, safety, cable, space require­ment, and com­pu­ta­tion­al power. From the sci­en­tif­ic per­spec­tive, while the rota­tion­al infor­ma­tion has been shown to be impor­tant for sev­er­al spa­tial tasks, the ben­e­fit of the trans­la­tion­al com­po­nent is still unclear with mixed results from pre­vi­ous stud­ies. For these rea­sons, we con­duct­ed a mixed-method exper­i­ment to inves­ti­gate how pro­vid­ing dif­fer­ent levels of trans­la­tion­al body-based sen­so­ry infor­ma­tion asso­ci­at­ed with dif­fer­ent loco­mo­tion inter­faces might improve per­for­mance, and how close it could get to actual walk­ing. We com­pared four levels of trans­la­tion­al body-based infor­ma­tion: none (par­tic­i­pants using the track­pad of the HTC Vive wand con­troller to visu­al­ly trans­late), upper-body lean­ing (par­tic­i­pants sit­ting on a Swopper chair, lean­ing their upper-body to con­trol their visual trans­la­tion), whole-body lean­ing (par­tic­i­pants stand­ing on a plat­form called NaviBoard, lean­ing their whole body or step­ping one foot off center to nav­i­gate the vir­tu­al envi­ron­ment), and full trans­la­tion­al infor­ma­tion (par­tic­i­pants phys­i­cal­ly walk­ing). In each con­di­tion, par­tic­i­pants wore a head-mount­ed dis­play and per­formed a nav­i­ga­tion­al search task. Results showed that the trans­la­tion­al infor­ma­tion had sig­nif­i­cant effects on var­i­ous mea­sures includ­ing task per­for­mance, task load, and sim­u­la­tor sick­ness. While par­tic­i­pants per­formed sig­nif­i­cant­ly worse when they used a con­troller with no trans­la­tion­al body-based infor­ma­tion, com­pared to the other con­di­tions, there was no sig­nif­i­cant dif­fer­ence between the lean­ing-based inter­faces and actual walk­ing. Moreover, par­tic­i­pants per­ceived sig­nif­i­cant­ly less motion sick­ness and task load in the NaviBoard and Walking con­di­tions. These results sug­gest­ed that trans­la­tion­al body-based infor­ma­tion from a lean­ing-based inter­face might pro­vide a cost-effec­tive alter­na­tive to actual walk­ing in spa­tial cog­ni­tion research and appli­ca­tions in VR.

Here’s Bernhard’s pre­sen­ta­tion of this paper at IEEE VR 2020:

Here’s a video explain­ing the experiment:

[mediatags]naviboard[/mediatags]

Publications