Image Caption: MIT researchers have developed a system, called Marko, that leverages radio-frequency (RF) signal reflections off human bodies to wirelessly monitor people’s movement inside their homes to provide insight for behavioral research or medical care. Credit: Christine Daniloff, MIT
Wireless Movement-Tracking System Could Collect Health and Behavioral Data
May 9, 2019 | MITEstimated reading time: 5 minutes
We live in a world of wireless signals flowing around us and bouncing off our bodies. MIT researchers are now leveraging those signal reflections to provide scientists and caregivers with valuable insights into people’s behavior and health.
The system, called Marko, transmits a low-power radio-frequency (RF) signal into an environment. The signal will return to the system with certain changes if it has bounced off a moving human. Novel algorithms then analyze those changed reflections and associate them with specific individuals.
The system then traces each individual’s movement around a digital floor plan. Matching these movement patterns with other data can provide insights about how people interact with each other and the environment.
In a paper being presented at the Conference on Human Factors in Computing Systems this week, the researchers describe the system and its real-world use in six locations: two assisted living facilities, three apartments inhabited by couples, and one townhouse with four residents. The case studies demonstrated the system’s ability to distinguish individuals based solely on wireless signals — and revealed some useful behavioral patterns.
In one assisted living facility, with permission from the patient’s family and caregivers, the researchers monitored a patient with dementia who would often become agitated for unknown reasons. Over a month, they measured the patient’s increased pacing between areas of their unit — a known sign of agitation. By matching increased pacing with the visitor log, they determined the patient was agitated more during the days following family visits. This shows Marko can provide a new, passive way to track functional health profiles of patients at home, the researchers say.
“These are interesting bits we discovered through data,” says first author Chen-Yu Hsu, a PhD student in the Computer Science and Artificial Intelligence Laboratory (CSAIL). “We live in a sea of wireless signals, and the way we move and walk around changes these reflections. We developed the system that listens to those reflections … to better understand people’s behavior and health.”
The research is led by Dina Katabi, the Andrew and Erna Viterbi Professor of Electrical Engineering and Computer Science and director of the MIT Center for Wireless Networks and Mobile Computing (Wireless@MIT). Joining Katabi and Hsu on the paper are CSAIL graduate students Mingmin Zhao and Guang-He Lee and alumnus Rumen Hristov SM ’16.
Predicting “Tracklets” and Identities
When deployed in a home, Marko shoots out an RF signal. When the signal rebounds, it creates a type of heat map cut into vertical and horizontal “frames,” which indicates where people are in a three-dimensional space. People appear as bright blobs on the map. Vertical frames capture the person’s height and build, while horizontal frames determine their general location. As individuals walk, the system analyzes the RF frames — about 30 per second — to generate short trajectories, called tracklets.
A convolutional neural network — a machine-learning model commonly used for image processing — uses those tracklets to separate reflections by certain individuals. For each individual it senses, the system creates two “filtering masks,” which are small circles around the individual. These masks basically filter out all signals outside the circle, which locks in the individual’s trajectory and height as they move. Combining all this information — height, build, and movement — the network associates specific RF reflections with specific individuals.
But to tag identities to those anonymous blobs, the system must first be “trained.” For a few days, individuals wear low-powered accelerometer sensors, which can be used to label the reflected radio signals with their respective identities. When deployed in training, Marko first generates users’ tracklets, as it does in practice. Then, an algorithm correlates certain acceleration features with motion features. When users walk, for instance, the acceleration oscillates with steps, but becomes a flat line when they stop. The algorithm finds the best match between the acceleration data and tracklet, and labels that tracklet with the user’s identity. In doing so, Marko learns which reflected signals correlate to specific identities.
The sensors never have to be charged, and, after training, the individuals don’t need to wear them again. In home deployments, Marko was able to tag the identities of individuals in new homes with between 85 and 95 percent accuracy.
Page 1 of 2
Suggested Items
Intel Announces New Program for AI PC Software Developers and Hardware Vendors
03/27/2024 | Intel CorporationIntel Corporation announced the creation of two new artificial intelligence (AI) initiatives as part of the AI PC Acceleration Program: the AI PC Developer Program and the addition of independent hardware vendors to the program.
SEMI ESD Alliance 2024 CEO Executive Outlook to Explore the Evolving RISC-V Movement and Semiconductor Design Ecosystem
03/27/2024 | SEMIKey executives from leading semiconductor EDA and IP companies will gather to discuss the latest industry trends, challenges and opportunities Thursday, May 9, in Santa Clara, California at the annual CEO Executive Outlook, hosted by the Electronic System Design Alliance (ESD Alliance), a SEMI Technology Community, and Keysight Technologies. Registration opens soon.
CentraTEQ to Showcase Wide Range of Vibration & Environmental Test Systems at Battery Tech Expo 24
03/26/2024 | CentraTEQEnvironmental and vibration test specialists CentraTEQ are excited to be exhibiting at the upcoming Battery Tech Expo, scheduled to take place at Silverstone on April 25, 2024.
SEMI 3D & Systems Summit To Spotlight Trends In Hybrid Bonding, Chiplet Design And Environmental Sustainability
03/26/2024 | SEMILeading experts in 3D integration and systems for semiconductor manufacturing applications will gather at the annual SEMI 3D & Systems Summit, 12-14 June, 2024,
Absolute EMS Successfully Recertifies ISO 9001:2015 and AS9100 Standards
03/26/2024 | Absolute EMS, Inc.Absolute EMS, Inc., an award-winning EMS provider of turnkey contract manufacturing services, is proud to announce the successful recertification of its ISO 9001:2015 and AS9100 Rev D SAE International Aerospace Standards.