学术活动发布与订制系统

Our approach first gives robots the ability to learn manipulation skills by “watching” online instructional videos. After “watching” over 200 instructional videos, a functional object-oriented network (FOON) is constructed to represent the observed manipulation skills. Using the network, robots can take a high-level task command such as “I want BBQ Ribs for dinner,” decipher the task goal, seek the correct objects to operate on, and then generate and execute a sequence of manipulation motions that can deal with physical interactions in a new condition. The interactive manipulation motions are learned from human demonstration using deep Recurrent Neural Networks. To best facilitate manipulation motions in the physical world, we also developed new grasping strategies for robots to hold objects with a firm grasp to withstand the disturbance during physical interactions.

Dr. Yu Sun is an Associate Professor and the Associate Chair of Graduate Affairs in the Department of Computer Science and Engineering at the University of South Florida. He founded the IEEE RAS Technical Committee on Robotic Hands, Grasping, and Co-Chair the IEEE-RAS Member Service Committee and the IEEE-RAS Competition Committee. He is an Associate Editor of the IEEE Transactions on Robotics.

Dr. Yu Sun received his Ph.D. degree in Computer Science from the University of Utah in 2007, and his B.S. and M.S. degrees in Electrical Engineering from Dalian University of Technology in 1997 and 2000 respectively. He was a Postdoctoral Associate in the School of Computing at the University of Utah from May 2008 to May 2009 and a Postdoctoral Associate at Mitsubishi Electric Research Laboratories (MERL), Cambridge, MA from Dec. 2007 to May 2008.

His research interests include intelligent systems, robotics, cyber-physical systems, computer vision, deep learning, virtual reality, and medical applications. He has edited two book, published about 80 technical papers and book chapters, and holds nine US patents and four provisional patents. He has served as a panelist and reviewer for U.S. National Science Foundation and French National Research Agency. His research works have been reported on the Discovery Science Channel, Bay News 9, Fox News, Univision (Spanish), and other medias.