Flexible User Interface Distribution for Ubiquitous Multi-Device Interaction
July 19, 2019 | KAISTEstimated reading time: 2 minutes
KAIST researchers have developed mobile software platform technology that allows a mobile application (app) to be executed simultaneously and more dynamically on multiple smart devices. Its high flexibility and broad applicability can help accelerate a shift from the current single-device paradigm to a multiple one, which enables users to utilize mobile apps in ways previously unthinkable.
Image Caption: KAIST researchers have developed mobile software platform technology that allows a mobile application (app) to be executed simultaneously and more dynamically on multiple smart devices. Its high flexibility and broad applicability can help accelerate a shift from the current single-device paradigm to a multiple one, which enables users to utilize mobile apps in ways previously unthinkable.
Recent trends in mobile and IoT technologies in this era of 5G high-speed wireless communication have been hallmarked by the emergence of new display hardware and smart devices such as dual screens, foldable screens, smart watches, smart TVs, and smart cars. However, the current mobile app ecosystem is still confined to the conventional single-device paradigm in which users can employ only one screen on one device at a time. Due to this limitation, the real potential of multi-device environments has not been fully explored.
A KAIST research team led by Professor Insik Shin from the School of Computing, in collaboration with Professor Steve Ko's group from the State University of New York at Buffalo, has developed mobile software platform technology named FLUID that can flexibly distribute the user interfaces (UIs) of an app to a number of other devices in real time without needing any modifications. The proposed technology provides single-device virtualization, and ensures that the interactions between the distributed UI elements across multiple devices remain intact.
This flexible multimodal interaction can be realized in diverse ubiquitous user experiences (UX), such as using live video steaming and chatting apps including YouTube, LiveMe, and AfreecaTV. FLUID can ensure that the video is not obscured by the chat window by distributing and displaying them separately on different devices respectively, which lets users enjoy the chat function while watching the video at the same time.
In addition, the UI for the destination input on a navigation app can be migrated into the passenger's device with the help of FLUID, so that the destination can be easily and safely entered by the passenger while the driver is at the wheel.
FLUID can also support 5G multi-view apps - the latest service that allows sports or games to be viewed from various angles on a single device. With FLUID, the user can watch the event simultaneously from different viewpoints on multiple devices without switching between viewpoints on a single screen.
PhD candidate Sangeun Oh, who is the first author, and his team implemented the prototype of FLUID on the leading open-source mobile operating system, Android, and confirmed that it can successfully deliver the new UX to 20 existing legacy apps.
"This new technology can be applied to next-generation products from South Korean companies such as LG's dual screen phone and Samsung's foldable phone and is expected to embolden their competitiveness by giving them a head-start in the global market." said Professor Shin.
Suggested Items
Orbex Secures Patent for 'Petal Fold' Reusable Rocket Technology
03/29/2024 | OrbexOrbex has successfully patented its REFLIGHT reusable rocket technology following patent approval in several European markets, based on the patent grant by the European Patent Office, as well as in the United States.
Intel Announces 2024 EPIC Supplier Program Award Recipients
03/29/2024 | Intel CorporationIntel announced the recipients of the 2024 Intel EPIC Supplier Program awards, which recognize suppliers that exemplify Intel’s standard of excellence. Intel is committed to expanding global supply capacity, delivering leadership products and enabling Intel Foundry.
NEOTech Promotes Emilio Ramirez to Chief Technology Officer
03/29/2024 | NEOTechNEOTech, a leading provider of electronic manufacturing services (EMS), design engineering, and supply chain solutions in the high-tech industrial, medical device, and aerospace/defense markets, is thrilled to announce the promotion of Emilio Ramirez to the position of Chief Technology Officer (CTO).
Keynote Preview: Reshaping our Engagement With the World
03/28/2024 | Shawn DuBravac, IPCThe widespread integration of AI across various sectors is broadening its impact, from revolutionizing healthcare with Smart solutions to transforming homes into intuitive spaces, highlighting its crucial role in boosting efficiency and addressing complex challenges. In healthcare, we're witnessing a trend toward personalized care with AI-driven devices like intelligent pillows to mitigate snoring, sophisticated sleep monitors, and innovative patient monitoring systems.
Indium Corporation to Present, Exhibit at EPP InnovationsFORUM
03/28/2024 | Indium CorporationIndium Corporation is set to present and exhibit at EPP InnovationsFORUM, one of Europe’s premier single-day electronics manufacturing forums, on April 17 in Leinfelden-Echterdingen, Germany. Topic areas for 2024 will include AI, automation, sustainability, and quality.