UC student builds face-tracking robot
It’s hard to read faces. It’s even harder if you’re a robot.
Nathan Huber, an electrical engineering technology student at the University of Cincinnati, is developing a robot that tracks facial movements to perform human tasks. His findings can be applied to fields as diverse as manufacturing, healthcare and virtual reality.
“What I’m building here is not a final project, but it’s a step toward something else, something in the future that could change healthcare or industry,” says Huber.
The work advances UC’s innovation agenda, a pillar in the university’s strategic direction, Next Lives Here.
The robots Huber works with resemble large, squiggly arms holding tiny cameras. Sitting in a rolling office chair across from one of the arms, Huber demonstrates how it works. Huber rolls from left to write, forward and back, and the robot’s camera follows his movements.
Huber programmed these robots to track objects in planes. First, the robot identifies the object and locates it on the X and Y axes. Then, with a spatial-tracking algorithm that Huber wrote, the robots can determine how near or far an object is to grab it.
The computer screen connected to the robot displays the object it’s following: in this case, Huber’s face, which is outlined by a green box.
“What he’s trying to do is get the center of my face,” says Huber. “Within the camera frame, the green box is what the desktop recognizes as a face. I calculate the center of that square, and I have the robot calculate where I'm at in space in respect to the camera.”
The robotic arm mostly moves fluidly, but it does pause every couple seconds, as if it’s processing Huber’s movements.
“There are still some flaws, jitteriness. It’s slow and choppy, but these are things am working through now,” Huber says.
What I’m building here is not a final project, but it’s a step toward something else, something in the future that could change healthcare or industry.
Nathan Huber, UC electrical engineering technology student
Applied commercially, Huber's work can advance virtual reality, like the technologies used in training pilots. Many people training to become pilots train in a virtual reality that simulates a cockpit, says Huber.
A face-tracking robot can hold different parts of a physical cockpit, like a control panel or keyboard. As pilots-in-training look around the virtual interior of a cockpit, the robot can track these facial movements and move a control panel to their lines of sight. When a person reaches out to press a button or pull a switch, a control panel held by one of the robots will be right there.
In addition to virtual reality, this technology can be applied to healthcare, specifically an aging population. Huber says a robot like this could help his grandmother, who is in a nursing home and has trouble reaching for and holding different things.
“It would be ideal if this robot is sitting next to her, and she looks over at this cup of coffee and the robot’s able to recognize that and able to grab it and bring it to her.”
In May, Huber starts fulltime at Coldwater Machine Company, where he spent all five of his cooperative education (co-op) rotations. Though he worked mostly with static systems at Coldwater, Huber sees a future for dynamic and static interplay. In this scenario, a static robot could repeatedly perform a task, whereas a second dynamic robot would assist with the task.
As for the state of his research at UC: Huber has been writing instructional manuals for all his work, so that students and instructors can pick up where he left off.
“A lot of the robotics passion has come from co-ops that UC offered,” says Huber. “I’m trying to bring back the knowledge that I gained on co-op and leave these manuals so that the future generations have something to learn off of and continue from.”
Note: All of Huber’s projects were built in UC professor Ou Ma’s Intelligent Robotics and Autonomous Systems laboratory.
Featured image at top: UC student Nathan Huber demonstrates his face-tracking robot. Photo/Corrie Stookey/CEAS Marketing
Next Lives Here
UC is the region's destination for making, doing, discovery and delivery. Nathan Huber's work advances UC’s innovation agenda, a key pillar in the university’s strategic direction, Next Lives Here.
Related Stories
Navigating IP strategies with UC’s 1819 Innovation Hub
March 28, 2024
While navigating the intricacies of pioneering research initiatives, faculty and student innovators can stay current on legal safeguards and protect invention commercialization through the University of Cincinnati’s tech transfer team in the 1819 Innovation Hub.
UC expands popular STEM program across Ohio
March 28, 2024
UC's popular Biology Meets Engineering program introduces high school students to STEM. Now, the National Science Foundation is paying UC to bring the program to three other Ohio universities.
Dive into the world of podcasting, no experience needed
March 28, 2024
At the University of Cincinnati's 1819 Innovation Hub, the doors to creativity are open wider through the cutting-edge podcast recording studio, now available to all UC affiliates at zero cost.