As engineers make strides in the design of wearable, electronically active, and responsive leg braces, arm supports, and full-body suits, collectively known as exoskeletons, researchers at MIT are raising an important question: While these Iron Man-like appendages may amp up a person’s strength, mobility, and endurance, what effect might they have on attention and decision making?
The question is far from trivial, as exoskeletons are currently being designed and tested for use on the battlefield, where U.S. soldiers are expected to perform focused tactical maneuvers while typically carrying 60 to 100 pounds of equipment. Exoskeletons such as electronically adaptive hip, knee, and leg braces could bear a significant portion of a soldier’s load, freeing them up to move faster and with more agility.
But could wearing such bionic add-ons, and adjusting to their movements, take away some of the attention needed for cognitive tasks, such as spotting an enemy, relaying a message, or following a squadron?
The answer, the MIT team found, is yes, at least in some scenarios. In a study that they are presenting this week at the Human Factors and Ergonomics Society Annual Meeting in Philadelphia, the researchers tested volunteers, who were either active-duty members of the military or participants in a Reserve Officer Training Corps (ROTC) unit, as they marched through an obstacle course while wearing a commercially available knee exoskeleton and carrying a backpack weighing up to 80 pounds. Seven of the 12 subjects had slower reaction times in a visual task when they completed the course with the exoskeleton on and powered, compared to when they finished it without the exoskeleton.
The researchers also found that the soldiers, when asked to follow a leader at a certain distance, were less able to keep a constant distance while wearing the exoskeleton.
The results, though preliminary, suggest that engineers designing exoskeletons for military and other uses may want to consider a device’s “cognitive fit” — how much of a user’s attention or decision making the device could potentially divert even while assisting them physically.
“In a military exoskeleton, soldiers are supposed to be scanning for enemies in the environment, making sure where other people in their squad are, monitoring a whole variety of things,” says Leia Stirling, an assistant professor in MIT’s Department of Aeronautics and Astronautics and a member of the Institute for Medical Engineering and Science. “You don’t want them to have to focus on how they’re stepping because of the exoskeleton. That’s why I was interested in how much attention these technologies require.”
Stirling’s co-authors on the paper include researchers at MIT, Draper, and the University of Massachusetts at Lowell.
Follow the leader
To investigate exoskeletons’ effect on a user’s attention, the team set up an obstacle course at UMass Lowell’s NERVE Center, a facility that normally tests and evaluates robots over various physical courses. Stirling and her colleagues modified an existing obstacle course to include cross-slopes and short walls to step over. Lights at both ends of the obstacle course were set up to intermittently blink on and off.
The team enlisted 12 male subjects and trained them over a period of three days. During the first day, they were each custom-fit with, and trained to use, a commercially available knee exoskeleton — a rigid, powered knee brace designed to help extend a user’s leg and increase endurance while, for example, in climbing over obstacles and walking over long distances.
Over the following two days, the subjects were instructed to navigate the obstacle course while following a researcher, posing as a squadron member. As they made their way through the course, the subjects performed several cognitive tasks. The first was a visual task, in which the subjects had to press a button on a mock rifle as soon as they perceived a light go on. The second was a pair of audio tasks, in which the subjects had to respond to a radio call check with a simple “Roger, over,” as well as a more complicated task, where they had to listen to three leaders reporting different numbers of enemies and then report the total number over the radio. The third was a follow-along task, where the subjects had to maintain a certain distance from the squadron leader as they navigated the course.
Overall, Stirling found that for the visual task, seven of the 12 subjects wearing the powered exoskeleton reacted significantly more slowly and tended to miss light signals completely, compared with their performance when not wearing the device. While wearing the powered knee-brace, the subjects also had a harder time maintaining the specified distance when following the leader.
Fluid suits
Going forward, Stirling plans to investigate the importance of reaction times while wearing an exoskeleton in various contexts. The video above highlights ongoing work in collaboration with Dephy, Inc., MIT Lincoln Laboratory, and U.S. Natick Soldier Research, Development and Engineering Center (NSRDEC), which seeks to understand why some users are more adept than others at using exoskeletons.
“For a military soldier, if they don’t detect an enemy over half a second, what does that mean? Does that put their life at risk, or is that OK?” Stirling says. “We need to better understand what these operationally relevant differences are. A reaction time of half a second for me walking down a sidewalk is probably not a big deal. But it could be a big deal in a military environment.”
Interestingly, the team identified a few users who were unfazed by the addition of an exoskeleton, and who performed just as well in the visual, audio, and follow-along tasks.
“In this study, we see some people have no deficit in their attention. But some people do, and we’re not sure why some people are good exoskeleton users and some have more difficulty,” Stirling says. “Now we’re starting to investigate what makes people good users versus less adept users. Is this driven from a motor pathway, or a perception pathway, or a cognitive pathway?”
Stirling’s group is working toward a better understanding of the way humans adapt and react to exoskeletons and other wearable technologies, such as next-generation spacesuits.
“We’re looking at the fluency between what the system is doing and what the human is doing,” Stirling says. “If the human wants to speed up or slow down, can this system be designed to appropriately move so the human is not fighting the system, and vice versa?”
Marcia O’Malley, a professor of mechanical engineering at Rice University, says that knowing the cognitive effects of an exoskeleton is especially relevant if the device is used on the battlefield.
“A decrease in cognitive ability would be extremely detrimental, even if the physical capability of the warfighter is enhanced,” says O’Malley, who was not involved in the research. “This [study] is about as close to ‘field testing’ as you can get — moving away from a controlled laboratory setting. So, while there is a good deal of variability in the results, they shed important light on the tradeoffs in physical and cognitive performance enhancement.”
Beyond military and space applications, Stirling says that if the connection between the human and the machine can be made more fluid, requiring less of a user’s immediate attention, then exoskeletons may find a much wider, commercial appeal.
“Maybe you want to be able to climb that mountain, or go on a longer hike, or you may be older and want to run around with your grandkids,” Stirling says.
“How can you design exoskeletons so people can reduce their own injury risk and extend their capability, their activities of daily living? These systems are really exciting. We just want to be cognizant of the different risks that occur when you bring something into a natural environment.”
This research was supported, in part, by Draper.
