Trip +
Personal project I UX research, service design, environmental UX design, UI / GUI I Renewed 2021
#Multi-device interaction #Geo-tagging #Computer vision
‘Trip+’ is a Synesthesia & AR based advanced trip service that simulates recorded synesthesia data on travel experiences through multi-devices — beam projector, surround speaker, light, air conditioner, electric heat — at home.
When making plans before travel, it is hard to believe reviews because of advertisements that are deceptive and information that is scattered around and hard to find. During a trip, situations usually don’t go as planned, and people easily find out that they've missed a hotspot when they leave that city or country.
Background
Solution
#Multi-sensory # Space related information
Therefore, Trip + aims to give holistic virtual trip experience to users. It provides realistic and vivid content of the destination through multi-device interaction and AR solution.
Service Flow
1. Experience trip in advance at home
Experience simulation of the destination by designating specific dates, places, and travel routes.
2. Receive real-time information
AR contents - Provide information, history, translation – based on current search location.
3. Record synesthesia
Record video, surrounding sound, lightness and upload the contents to trip+ platform
4. Remember the mood of trip at home
Use diverse devices such as beam projector, surround speaker, light to simulate the environment.
Information is collected by mobile phone’s recorded data, geo-tagged data, and these will become holistic user experience, providing multi-device interaction.
How it works?
Design output
1. Home experience
Travel pensieve
Before going on a trip, user can freely explore scenery of the destination. The scenery is made using the data from “day/weather data of that specific date + pool of that tourist spot”. User can experience vivid simulation of destination and plan the route in advance.
When user select one pack, scenery will be projected to the room and output value of the devices will change (Light, Surrounding speaker, electronic fan,,) according to the scenery data.
- Algorithm for extracting data to simulate landscape of target location & expected atmosphere (temperature, humidity, brightness)
- Specific ways to extract & apply data into home surrounding
2. Travel experience
AR contents
Getting information via AR while traveling. Diverse information related to perceived image and location are shown. This also can be provided in the form of voice guide via earphone.
There are three categories of AR information : Now - Translation – History
1) Embedding informative / historical contents : Using AR Toolkit such as Aero
1) Adobe Aero - Screenshoot of making AR image related to proximity, follow target
2) Way to get instant news : from SNS geotagging
2) Sample of instant Geo-tagging (Using at SNS)
3. Recording experience
If there is a moment you want to remember, turn around your smartphone to take a picture and it will give you a full 360 degree wise picture. The captured videos are stored in album or uploaded to Trip+.
- Algorithm to combining data that collected via smartphone
4. Memorizing experience
When users want to revive the memory again, click on the places they visited. Images and sounds are projected to user’s surrounding, and the illumination and wind strength will change too.
Output value will be demonstrated on multiple devices, whichever one user has in their room. Devices with similar function are compatible, and this will be decided by linked devices at Trip+ app.
5. Expand experiences beyond other scene
Trip+ can combine two videos which are recorded at the same site through ‘Scene understanding’ and ‘geo-tagged information’. Through this technology, users can explore seamless virtual travel experiences.
- Extending scenes : Finding and linking similar images together to make a wholesome view. It uses geo-tagged information and scene understanding.
UI / UX flow
6. Expected Value
1. Trip+ is an outcome of synergy between virtual and physical world. Now people can prepare, enjoy, and remember their trip with vivid synesthesia.
2. The platform will continue to grow through voluntary participation of individuals and companies who want to promote their service.
If the space-based data accumulates, a virtual city map can be created.