Multi-Camera systems have enabled a plethora of novel applications spanning entertainment, remote monitoring, and telecommuting. A key component in all of them is the interactive delivery of different viewpoint perspectives of the 3D scene of interest that creates the sensation of immersion within the scene for the user. This requires intelligent and adaptive processing of the captured content in response to the user’s actions of switching between different viewpoints, while addressing the challenges imposed by the time-varying nature of the communication channel at the same time. The talk will describe a novel user-action-driven framework for joint view and rate scalable encoding of multi-camera video signals and its prospective applications. Its building blocks comprise a scalable encoder, optimization formulation for view and rate scalable encoding, and probabilistic user behavior model. I will examine their key properties and how they fit coherently within the overall system. Through experiments, I will demonstrate its advantages over competing methods. If time permits, I would like to conclude with a brief overview of a few other investigations of context-driven computer communication.
Jacob Chakareski completed the M.Sc. and Ph.D. degrees in Electrical and Computer Engineering at WPI, Rice, and Stanford. He is an Assistant Professor at the University of Alabama. Previously, he held scientific positions with EPFL, Microsoft, Hewlett-Packard, and Vidyo, a leading provider of Internet telepresence solutions. Chakareski has authored one monograph, three book chapters, and over 100 international publications, and holds 5 US patents. His current research interests include graph-based information processing, computer networks, immersive communication, and social computing. He eagerly pursues ultrasound applications in telemedicine and biomedicine. He is an Advisory Board member of Mainframe2, an innovative cloud computing start-up with a bright future.
Dr. Chakareski received the Swiss NSF Ambizione Career Award, the Best Student Paper Award at the SPIE VCIP 2004 Conference, and the Best Paper Award of the Stanford Electrical Engineering and Computer Science Research Journal for 2003. He was also the recipient of the Texas Instruments Graduate Research Fellowship at Rice University, the Technical University Munich Mobility Fellowship, and the University of Edinburgh Chancellor’s Fellowship. He was the Technical Program Co-Chair of Packet Video in 2012 and the General Co-Chair of the IEEE SPS Seasonal School on Social Media Processing in 2012. For more information, please visit
http://www.jakov.org.
Related publication:
J. Chakareski, V. Velisavljević, and V. Stanković, “User-Action-Driven View and Rate Scalable Multiview Video Coding,” IEEE Trans. Image Processing, Sep. 2013, special issue on 3D video representation, compression, and rendering.
