[PDF]

Integration of Human-Device Interface: Transforming the Future of Interaction PDF Free Download

1 / 4
0 views•4 pages

Integration of Human-Device Interface: Transforming the Future of Interaction PDF Free Download

Integration of Human-Device Interface: Transforming the Future of Interaction PDF free Download. Think more deeply and widely.

© The 2025 International Conference on Artificial Life and Robotics (ICAROB2025), Feb.13-16, J:COM HorutoHall, Oita, Japan
Integration of Human-Device Interface: Transforming the Future of Interaction
Norrima Mokhtar
Department of Electrical Engineering, Universiti Malaya 50603 Kuala Lumpur, Malaysia
Takao Ito
Graduate School of Advanced Science and Engineering, Hiroshima University, Japan
Email: norrimamokhtar@um.edu.my, itotakao@hiroshima-u.ac.jp
Abstract
The integration of Human-Device Interfaces (HDIs) is revolutionizing the way human interact with technology for
daily life, paving the way for transformative advancements across industries such as healthcare, communication,
education, entertainment, gaming, industry and automation. Brain-computer Interfaces (BCIs), wearable devices,
gestures, speech recognition, haptic feedback and tactiles interfaces, web-based interfaces and mobile applications
become the new normal in massive integration of HDIs. Despite the positive usage of HDIs, these advancements
come with significant challenges including data security, reliability, durability, safety, ethics, accessibility, costs,
design and technology that either to be accepted or rejected by certain people. These challenges need to be addressed
and managed globally for further development and robust regulations to avoid misuse of technology.
Keywords: User experience, Human-Device Interface, Future Technology
1. Introduction
Rapid technology direction has paved the way for
seamless interaction between humans and machines,
adding more usability, efficiency and overall experience
[1], [2], [3], [4], [5]. Traditionally, inputs such as
keyboards, buttons and touch screens dominate user
interactions[6]. However, new technologies like gesture
recognition, eye tracking, speech recognition and brain
computer interfaces (BCIs) are the next direction of how
humans interact with devices. This direction of
technology making the interfaces requires less effort,
more responsive and enhances user experience.
In particular to Human-Device Interfaces (HDIs),
Artificial Intelligence (AI), either supervised, semi-
supervised and unsupervised learning algorithms has
become huge and popular in HDIs development. AI
enables systems to process input and respond to input
data which allows for real time decision making and
system automation. These advancements not only
enhance accessibility for individuals with disabilities but
also open experience across diverse fields, including
healthcare, education, entertainment, automation and
gaming industry.
For HDIs, the development of contactless and effortless
input approached has become popular in recently [7]. Eye
movement tracking using electrooculography(EOG) or
wearable camera have enabled hands free device control
hence contributes to significant achievement in medical
and automation industries [7], [8], [9]. In this sense,
Brain-Device Interfaces (BDIs) or Brain Machine
Interfaces (BMIs) allow mental commands, redefining
user-device collaboration and more importantly user
experience. The aim of this paper is to explore current
advancement, example of case studies conducted by
ACRLAB, Faculty of Engineering, Universiti of Malaya,
Malaysia.
2. ACRLAB, Faculty of Engineering, University
Malaya
2.1. Aim and Mission
ACRLAB, Faculty of Engineering aimed to contribute
to HDIs technology advancement, effortless interfaces
between human, devices and systems to enhance user
experience. The facilities available will be discussed
under the case studies section. The location of ACRLAB,
Faculty of Engineering, Universiti Malaya, national and
international collaborations are shown below in (Fig. 1).
Fig.1 ACRLAB location with national and international
collaborators.
2.2. The importance of Human-Device Interfaces
(HDIs)
HDIs is set to revolutionize how we live, work, drive,
travel, exercise, sleep, shopping and interact with
technology. Eventually, technological advancements
8
Norrima Mokhtar, Takao Ito
© The 2025 International Conference on Artificial Life and Robotics (ICAROB2025), Feb.13-16, J:COM HorutoHall, Oita, Japan
have rapidly progressed, moving from basic tools like
keyboards and mice to more sophisticated,
interconnected devices such as smartphones, wearable
technology (Fig. 2), [6], [7] and AI driven assistants. This
shift is fundamentally changing how we engage with
technology and without realizing we are so dependent on
it, integrating into our everyday routines and
surroundings. The HDIs also enable adaptability and
personalization of devices according to our need, hence
enhancing user experience and preferences.
Fig. 2. BCIs using Electroocoulogram for wheelchair
navigation by ACRLAB, Universiti Malaya [6], [7].
3. Recent Works on HDIs
3.1. Wearable Technology
Major developments include smartwatches, health
monitor, voice and gesture-based interfaces such as SIRI,
google assistant, AR/VR systems and Brain Computer
Interfaces (BCIs) [9] are offering possibilities in many
industries such as healthcare, gaming, shopping, driving,
monitoring and others. There are two examples of these
technology that was implemented in ACRLAB, Faculty
of Engineering, Universiti Malaya as shown in Fig. 2 and
Fig. 3, [6], [7].
Fig.3 Eye driven wheel chair by ACRLAB,
Universiti Malaya
Fig. 2 shows BCIs using Electrooculogram for wheel
chair navigation by ACRLAB, Universiti Malaya. Fig. 3,
[6], [7] shows eye driven wheelchair using wearable
camera for navigation. Both works shown the proof on
concept for possibilities enhancing user experience and
effortless interface for the disabled communities to be
more independent and expressing their need.
Fig. 4 shows the modes and state for BCIs navigation by
Fig. 2, [6], [7].
Fig. 4. The modes and state BCIs navigation by Fig.
2, [6], [7]
Other commercially available wearable devices include
Apple Watch, Fitbit, Garmin and Samsung Galaxy Watch
which are popular for tracking fitness, health metrics and
facilitating communication. Apple watch for example,
can detect irregular heart rhythms and perform ECG tests,
potentially identifying early signs of heart disease.
Additionally, health monitoring devices such as Dexcom
G6 and Abbot Freestyle Libre, can continuously monitor
blood glucose levels and sends data to a smartphone or
compatible receiver every five minutes. Timely diabetes
management, improving patient wellbeing and risk of
complications are among countless benefits that HDIs
can offer.
3.2. Voice and Gesture-Based Interfaces
Voice assistants like Siri, Google Assistant and Alexa
are becoming smarter thanks to natural language
processing (NLP) and machine learning. These interfaces
simplify tasks such as setting reminders, controlling
smart home devices and retrieving information. Gesture
control like Microsoft Kinect or motion sensors in
smartphones enable gesture-based interactions,
enhancing user experience for gaming or other means to
control other systems effortlessly. Fig. 5 shows
interactive design with gesture and voice recognition for
9
Integration of Human-Device Interface
© The 2025 International Conference on Artificial Life and Robotics (ICAROB2025), Feb.13-16, J:COM HorutoHall, Oita, Japan
virtual teaching environments [5]. Augmented Reality
(AR) and Virtual Reality (VR) are usually integrated with
gesture, voice and adaptive virtual environments to
enhance user experience [5].
Fig. 5. Gesture and voice recognition for virtual
teaching environments [5].
3.3. Haptic Feedback and Tactile Interfaces
Haptic Feedback and Tactile Interfaces provide sensory
feedback through touch, simulating textures or resistance.
Haptic sensors depend on the mechanisms such as
piezoresistive, capacitive, piezoelectric and triboelectric
with respect to functionalities in force sensing, gesture
translation and touch identification. Fig. 6 shows haptic
sensing and feedback techniques [10].
Fig. 6. Haptic sensing and feedback techniques [10]
3.4. Web-Based HDIs
Remote monitoring systems allow flexibility to interact
with medical devices, wearable devices, education,
robotics, industries, gaming and entertainment. This
technology has become the new normal and essential for
user interfaces and services which can be done via mobile
applications and web-based HDIs. Fig. 7 and Fig. 8
shows drone location and virtual maps for potential usage
in integrated monitoring and wildfire mitigation
developed by ACRLAB, Faculty of Engineering,
Universiti Malaya. This work combines machine learning,
vision-based system, GPS, control system to stabilize the
drone flight and Internet of Things Technology to enable
remote monitoring, streaming data of interests online via
web-based applications. The same concept can be applied
to continuously monitor patient health status, by
streaming the data to medical officers.
4. Ethical Considerations and Challenges in
Human-Devices Interfaces (HDIs)
HDIs evolve and become an integral part of daily life,
which several ethical considerations, challenges, data
privacy, data security, side effects in term wearable
devices, physiological and psychological effect both
human, adults and children should be taken into our
major concern. There is a need to draw the line between
enhancement and alteration, augmenting human abilities
about the implications of changing natural human traits
and the potential societal consequences. The dilemma is
the use for good and betterment of society or the other
way [10], [11], [12], [13], [14], [15].
5. Challenges in HDIs Integration
Further concern in HDIs integration consists of
hardware limitations, system compatibility, reliability
(error and failure rates), safety, public perception, trust
issues(misuse of personal data) and regulation which
ultimately determined by government decisions. For
instance, wearable devices that rely on sensors to monitor
vital signs or BCIs that interpret brain activity may not be
capable of delivering high accuracy and performance
without large, bulky components or frequent battery
charging. The other important factor is the development
costs to support this advanced and sophisticated HDIs
technology which depends on the community’s financial
sustainability [10], [11], [12], [13], [14], [15].
Notably public perception is also crucial in HDIs
integration. Some people are wary of wearable devices
10
Norrima Mokhtar, Takao Ito
© The 2025 International Conference on Artificial Life and Robotics (ICAROB2025), Feb.13-16, J:COM HorutoHall, Oita, Japan
that integrate closely into the body. This can be invasive
or non-invasive HDIs.
In this context, although HDIs play major roles in
managing our daily life, which cannot be avoided as the
world and future direction are towards digitization, the is
a need for comprehensive regulations, ethical standards,
accountability and global cooperation for these emerging
issues.
6. Conclusions
In conclusion, the integration of Human-Device
Interfaces (HDIs) holds immense potential to transform
various industries and become an essential part of daily
life. However, the associated challenges, from data
security and reliability to ethical considerations and
accessibility, highlight the need for comprehensive global
efforts to address these issues. By developing robust
regulations, ethical practices, and ensuring inclusive
design, society can fully benefit HDIs while mitigating
risks, for responsible and sustainable technological
advancements.
References
1. Rubio-Drosdov E, Díaz-Sánchez D, Almenárez F, Arias-
Cabarcos P, Marín A. Seamless human-device interaction
in the internet of things. IEEE Transactions on Consumer
Electronics. 2017 Nov;63(4):490-8.
2. Söldner R, Rheinländer S, Meyer T, Olszowy M,
Austerjost J. Human–device interaction in the life science
laboratory. InSmart Biolabs of the Future 2022 Jan 29 (pp.
83-113). Cham: Springer International Publishing.
3. Jaber W, Jaber HA, Jaber R, Saleh Z. The convergence of
AI and BCIs: A new era of brain-machine interfaces.
Artificial Intelligence in the Age of Nanotechnology.
2024:98-113.
4. Mazhar N, Gaballa A, Pandey AK, Cabibihan JJ. Virtual
Reality Hand Tracking for Immersive Telepresence in
Rehabilitative Serious Gaming. InInternational
Conference on Social Robotics 2023 Dec 3 (pp. 3-12).
Singapore: Springer Nature Singapore.
5. Fang K, Wang J. Interactive Design with Gesture and
Voice Recognition in Virtual Teaching Environments.
IEEE Access. 2024 Jan 1.
6. Aziz F, Arof H, Mokhtar N, Mubin M. HMM based
automated wheelchair navigation using EOG traces in
EEG. Journal of neural engineering. 2014 Sep
4;11(5):056018.
7. Ramli R, Arof H, Ibrahim F, Mokhtar N, Idris MY. Using
finite state machine and a hybrid of EEG signal and EOG
artifacts for an asynchronous wheelchair navigation.
Expert Systems with Applications. 2015 Apr
1;42(5):2451-63.
8. Casadio M, Ranganathan R, Mussa-Ivaldi FA. The body-
machine interface: a new perspective on an old theme.
Journal of Motor behavior. 2012 Nov 1;44(6):419-33.
9. Takara S, Kida H, Inoue T. Development of implantable
devices for epilepsy: research with cats, dogs, and
macaques in biomedical engineering. Advanced Robotics.
2024 May 14:1-25.
10. Shi Y, Shen G. Haptic Sensing and Feedback Techniques
toward Virtual Reality. Research. 2024 Mar 23;7:0333.
11. Şahinel D, Akpolat C, Görür OC, Sivrikaya F, Albayrak S.
Human modeling and interaction in cyber-physical
systems: a reference framework. Journal of Manufacturing
Systems. 2021 Apr 1;59:367-85.
12. Farias da Costa VC, Oliveira L, de Souza J. Internet of
everything (IoE) taxonomies: A survey and a novel
knowledge-based taxonomy. Sensors. 2021 Jan
14;21(2):568.
13. Sun T, Tsaava T, Peragine J, Crosfield C, Lopez MF, Modi
R, Sharma R, Li C, Sohal H, Chang EH, Rieth L. Flexible
IrOx neural electrode for mouse vagus nerve stimulation.
Acta biomaterialia. 2023 Mar 15;159:394-409.
14. Pöhn D, Hommel W. Towards an Improved Taxonomy of
Attacks Related to Digital Identities and Identity
Management Systems. Security and Communication
Networks. 2023;2023(1):5573310.
15. Wirtz BW. Artificial intelligence, big data, cloud
computing, and Internet of Things. InDigital Government:
Strategy, Government Models and Technology 2022 Oct 8
(pp. 175-245). Cham: Springer International Publishing.
Authors Introduction
Associate Prof. Ir. Dr. Norrima Mokhtar
She earned a Bachelor of Engineering
(B.Eng) in Telecommunication
Engineering from Universiti Malaya in
2000. She was awarded the Panasonic
Scholarship to pursue her Master of
Engineering (M.Eng) at Oita University,
Japan (2003-2006). Additionally, she
received the SLAB/SLAI scholarship to complete her
Ph.D. in Electrical Engineering at Universiti Malaya
(2008-2012). Between 2000 and 2002, she worked as a
Telecommunication Engineer at Echobroadband Sdn.
Bhd., where she contributed to upgrading cable TV
networks to hybrid fiber coaxial networks in Köln,
Germany. Since 2003, she has built a distinguished
academic career at Universiti Malaya, where she currently
serves as an Associate Professor.
Professor Dr. Takao Ito
He received his M.S., and Ph.D. He is
Professor of Management of Technology
(MoT) in Graduate School of
Engineering at Hiroshima University. He
is serving concurrently as Professor of
Harbin Institute of Technology (Weihai)
China. He has published numerous
papers in refereed journals and proceedings, particularly in
the area of management science, and computer science. He
has published more than eight academic books including a
book on Network Organizations and Information
(Japanese Edition). His current research interests include
automata theory, artificial intelligence, systems control,
quantitative analysis of inter-firm relationships using
graph theory, and engineering approach of organizational
structures using complex systems theory.
11
Powered by TCPDF (www.tcpdf.org)