Computational Behavior Analysis — Smart Devices, Smart Data Analysis, and Smart Humans are Pushing the Boundaries towards usable Digital Health

Thomas Ploetz Georgia Institute of Technology, US

We live in an era in which the number of smart devices is now greater than the number of humans living on Earth. Such smart devices include smart phones and wearables but also the myriad of IoT devices that are integrated into the very built environment we live in. As such, the field of mobile and ubiquitous computing is transforming many—if not all—areas of our lives. This overall transformation has great potential for many application areas. Most prominently, it is now possible to continuously and unobtrusively record rich behavior data that can inform objective health assessments thereby serving as basis for improved care and treatment, and thus wellbeing.
The basis for effective health assessments are robust and reliable methods for human activity recognition — more generally referred to as sensor-based Computational Behavior Analysis (CBA). From a technical perspective the analysis task translates into a time-series assessment problem, yet with a number of domain-specific constraints and requirements. In response to challenges such as noisy sensor data, ambiguous ground truth annotation, and typically limited size sample datasets CBA researchers have developed and validated sensor data analysis and machine learning methods that focus on these domain specifics and thus enable effective operation. In this talk I will give an overview of where the broader field of Computational Behavior Analysis is today before I focus on current and next frontiers specifically related to smart sensor data analysis. I will illustrate how the constraints and requirements of real-world application scenarios force pushing boundaries of core sensor data analysis research as well as real-world dployments.

About the speaker
Thomas Ploetz is a Computer Scientist with expertise and almost two decades of experience in Pattern Recognition and Machine Learning research (PhD from Bielefeld University, Germany). His research agenda focuses on applied machine learning, that is developing systems and innovative sensor data analysis methods for real world applications. Primary application domain for his work is computational behaviour analysis where he develops methods for automated and objective behaviour assessments in naturalistic environments, thereby making opportunistic use of ubiquitous and wearable sensing methods. Main driving functions for his work are "in the wild" deployments and as such the development of systems and methods that have a real impact on people's lives.
In 2017, Dr. Ploetz joined the School of Interactive Computing at the Georgia Institute of Technology in Atlanta, USA where he works as an Associate Professor of Computing. Prior to this he was an academic at the School of Computing Science at Newcastle University in Newcastle upon Tyne, UK, where he was a Reader (Assoc. Prof.) for "Computational Behaviour Analysis" affiliated with Open Lab, Newcastle's interdisciplinary research centre for cross-disciplinary research in digital technologies.

Towards Millimeter-scale Contactless Sensing with Wi-Fi/4G/5G Signals: Theory and Applications

Daqing Zhang Peking University, China and Telecom SudParis, France

With the ubiquitous deployment of Wi-Fi/4G/5G infrastructure in the world, RF-based contactless sensing has become a very attractive way for long-term human and environment monitoring in many application domains. In this talk, I will introduce the Fresnel zone model as a new theoretic basis for device-free and contactless human sensing with Wi-Fi/4G/5G signals. The Fresnel-zone based sensing theory not only reveals the relationship among the WiFi CSI signal, the distance between two WiFi transceivers, the sensing target's relative location and orientation with respect to WiFi transceivers, and the environment, but also sheds light on the sensing limit of Wi-Fi/4G/5G signals. Building on the Fresnel zone model and the frequency diversity of WiFi signals, millimeter-scale human activity sensing could be achieved. By exploiting MIMO technology, we further propose new ways to increase the signal to noise ratio and push the range limit of WiFi-based device-free sensing. I will use human respiration detection and other application examples to demonstrate the power of the proposed theory and techniques.

About the speaker
Daqing Zhang is a Professor with Telecom SudParis, France and Peking University, China. His research interests include ubiquitous computing, context-aware computing, big data analytics and Intelligent IoT. He has published more than 280 technical papers in leading conferences and journals, where his work on context model and WiFi-based sensing theory is widely accepted by pervasive computing, mobile computing and service computing communities. His research work got over 22,700 citations with an H-index of 76 (according to Google Scholar). He is the winner of the Ten Years CoMoRea Impact Paper Award at IEEE PerCom 2013 and Ten Years Most Influential Paper Award at IEEE UIC 2019, the Distinguished Paper Award of IMWUT (Ubicomp 2021), Honorable Mention Award at ACM UbiComp 2015 and 2016, etc.. He served as the general or program chair for more than a dozen of international conferences, and in the editorial board of IEEE Pervasive Computing, ACM TIST and ACM IMWUT. Daqing Zhang is a Fellow of IEEE and Member of Academy of Europe, he obtained his Ph.D. from University of Rome "La Sapienza", Italy in 1996.

Polifonia: a digital harmoniser for musical heritage knowledge

Valentina Presutti University of Bologna, Italia

From the soundscape of Italian historical bells to the influence of French operas on traditional Dutch music, European cultural heritage hides a goldmine of unknown encounters, influences and practices that can transport us to experience the past, understand the music we love, and imagine the soundtrack of our future.
This talk is about the Polifonia Ecosystem, a collaborative, interdisciplinary effort to develop computing approaches for facilitating access and discovery of European Musical Heritage knowledge and to enable its creative reuse at-scale, connecting both the tangible heritage (instruments, theaters..) and intangible, and connecting previously unconnected data. Through semantic web technologies, artificial intelligence and data analysis the ambition of Polifonia is to provoke a paradigm shift in Musical Heritage preservation policies, management practice, research methodologies, interaction means and promotion strategies.

About the speaker
Valentina Presutti is an Associate Professor at University of Bologna. She is also an Associate Researcher at the Institute of Cognitive Science and Technologies of CNR and coordinator of STLab. She received her Ph.D in Computer Science at University of Bologna (2006). Her research interests include AI, Semantic Web and Linked Data, Knowledge Extraction, Empirical Semantics, Social Robotics, Ontology and Knowledge Engineering. She coordinates the EUH2020 project Polifonia (2021-2024). She was responsible for several national and EU projects (e.g. MARIO, IKS, ArCo). During her post-doc she worked in NeOn and created and the series WOP, reference resources for semantic web researchers. She has +150 articles in international journals/ conferences/workshops. She is editorial board member of J. of Web Semantics (Elsevier), Data Intelligence (MIT Press), JASIST (Wiley), Intelligenza Artificiale (IOS Press), and of "Semantic Web Studies" (IOS Press). She is co- director of International Semantic Web Research Summer School (ISWS)and has served in organisational and scientific roles for several events.

High-accuracy joint communication and sensing at mm-wave frequencies

Joerg Widmer IMDEA Networks, Spain

The high bandwidth available at millimeter-wave frequencies allows for very high data rates, but at the same time enables highly accurate localization and environment sensing. In this talk, we discuss how to implement low overhead location and sensing systems. As an example, we present results on the location accuracy that can be achieved with simple millimeter-wave commercial off-the-shelf communication devices. We also discuss how to use communication hardware (rather than dedicated radars) to perform zero-cost monitoring of human movement and activities in indoor spaces, by extracting micro-Doppler effects caused by human motion from the access points. We will specifically focus on the practical implementation aspects, testbed design and experimental results with such systems.

About the speaker
Joerg Widmer is Research Professor and Research Director of IMDEA Networks in Madrid, Spain. Before, he held positions at DOCOMO Euro-Labs in Munich, Germany and EPFL, Switzerland. He was a visiting researcher at the International Computer Science Institute in Berkeley, USA, University College London, UK, and TU Darmstadt, Germany. His research focuses on wireless networks, ranging from extremely high frequency millimeter-wave communication and MAC layer design to mobile network architectures. Joerg Widmer authored more than 200 conference and journal papers and three IETF RFCs, and holds 14 patents. He was awarded an ERC consolidator grant, the Friedrich Wilhelm Bessel Research Award of the Alexander von Humboldt Foundation, a Mercator Fellowship of the German Research Foundation, a Spanish Ramon y Cajal grant, as well as nine best paper awards. He is an IEEE Fellow and Distinguished Member of the ACM.

Industry view and Samsung role in LOCUS project

Tomasz Mach Samsung R&D Institute, UK

LOCUS is an ongoing EU Horizon 2020 funded collaborative R&D project started in 2019 focused on the localization and analytics in new 5G applications. Core technical work covers use cases, system architecture and proof of concepts based on the novel localization enablers and localization and analytics mechanisms for Smart Network Management and new services e.g. Network-assisted Self-Driving Objects and People Mobility and Flow Monitoring. The project consortium includes partners from the academia and the industry and this talk will illustrate the perspective of one of the industrial partners and will provide an overview of its main research activities. Finally, Samsung technical contributions to different work packages will be presented including their links to standardization.

About the speaker
Tomasz Mach holds PhD degree in mobile communications from the University of Surrey UK with almost twenty years of experience in various technical and leadership roles in the wireless industry. Those include 3G protocol software development, 4G small cells and SON architecture and systems engineering, technical marketing and pre-sales, research and mobile communications standards development including his work in various 3GPP, ETSI, 5GAA and O-RAN Alliance groups. Before joining Samsung in 2015, he worked at Orange, Motorola, Thales, Nokia, Blackberry and Cisco. Recently, he contributed to and coordinated various EU funded international 5G R&D activities including LOCUS project. He is a co-author of "5G System Design: Architectural and Functional Considerations and Long Term Research" book and also authored many patent applications, standards contributions and research papers. Among others, his current interest includes beyond 5G systems and V2X.