babl is a mixed reality language learning platform 

designed for Head-mounted displays

 

Why is the second language so hard to learn? Why school only teaches expressions that native speakers don't use?
BABL started with a bold idea - Could the learners experience a real live language through local people's life?

 

TRUST-BASED lANGUAGE LEARNING NETWORK

 

BABL is a social language learning platform grown by participants; the more people join the network, the more language contents is created.
The system help learners find the right host based on their interests, motivations and profiles.
 

 
babl_Final 2.001.png
 

TOUR MODE - mixed reality as Shared reality


Tour mode is an immersive live tour hosted by one's local partner. Learners will see, hear and feel how local people live.
With mixed reality technology, we envision that BABL can bridge between learners and local people and start the meaningful relationship.
Through the shared reality, learners can get immersed
into the new environment and eventually integrate themselves with the target culture.
 

01_keymoments.png
 

PRACTICE mode - capture & embody LIVE LANGUAGE


Practice mode provides a safe space for learners to practice spoken language with captured moments from the tour mode.
 Learners can control the speed, toggle the caption and get live feedback from the system.

They can also annotate and put it into the captured scene with the connected screen device.
 

02_keymoments2.png
 

GESTURE INTERACTIONS


Once getting into the mixed reality mode, learners and hosts interact with the system with gaze, gesture and voice.  
BABL supports immersive and easy learning experience with the combinations of gestures. 
 

01_swipe.gif
gestureixd-01.jpg

Swipe to open and close the toolbox panel
Reveal left to right for right-handed users and right to left for left-handed users

02_doodle.gif
gestureixd-02.jpg

Gaze to target an icon & freeze the view
Pinch and drag to doodle/pin on the field of view and release pinch to finish

03_practicemode-2.gif
gestureixd-03.jpg

Gaze to target an icon & Pinch to toggle caption/grammar
Speak to proceed conversation practice
 

04_annotate.gif
gestureixd-04.jpg

Write a memo on the babl app & push the memo into the MR view.
Drag & drop to place the memo where it’s most relevant.

 

 

For full design process details, click here.