Research ->Projects, Publications, Software, People

Projects -> Foveated Rendering (a.k.a Gaze-Contigent Compression or Perceptual Compression)

 

Goal: Reduce computational burden for rendering of a scene without reducing its perceptual quality.

Implementation: Eye-gaze position indicates the area of a scene that requires high-quality coding. Peripheral part of the scene is encoded with lower quality according to a visual sensitivity function that accounts for distribution of the light sensing cells in the human eye. Such approach allows substantial reduction of the computational or/and bandwidth requirements without a viewer noticing rendering artifacts.

Project Status: Looking for students who will investigate various aspects of foveated rendering.

Publications:

Komogortsev, O. Gaze-Contingent Video Compression with Targeted Gaze Containment Performance. Journal of Electronic Imaging, July - September 2009 issue. [.pdf]

Komogortsev, O., Khan, J., Predictive Compression for Real Time Multimedia Communication Using Eye Movement Analysis, ACM Transactions on Multimedia Computing, Communications and Applications Journal, Vol. 4 Issue 3, August 2008, pp. 23:1-23:16. [video set][.pdf]

Komogortsev, O., Khan, J., Kalman Filtering in the Design of Eye-Gaze-Guided Computer Interfaces, In Proceedings of the 12th International Conference on Human-Computer Interaction (HCI 2007), Beijing, China, July 22-27, 2007. pp. 679-689. [.pdf][project][conference info]

Komogortsev, O., Khan J., Perceptual Multimedia Compression Based on the Predictive Kalman Filter Eye Movement Modeling, In Proceedings of the Multimedia Computing and Networking (MMCN 2007), San Jose, California, Jan 28 – Feb 1. [.pdf][video set][conference info]

Khan J., Komogortsev O., A Hybrid Scheme for Perceptual Object Window Design with Joint Scene Analysis and Eye-Gaze Tracking for Media Encoding based on Perceptual Attention,   In Journal of Electronic Imaging 15(02), April 2006. [.pdf][video set][journal info]

Komogortsev, O., Khan J., Perceptual Attention Focus Prediction for Multiple Viewers in Case of Multimedia Perceptual Compression with Feedback Delay, In Proceedings of the Eye Tracking Research & Applications Symposium (ETRA 06), San Diego, March 27-29, 2006, pp. 101-108. [.pdf] [video set][conference info]

Komogortsev, O., Khan J., Perceptual Media Compression for Multiple Viewers with Feedback Delay, In Proceedings of the 13th ACM International conference on Multimedia (ACM MM 2005), Singapore, Nov 6-1, 2005, pp. 796-797. [.pdf] [video set][conference info]

Komogortsev, O., Khan J., Predictive Perceptual Compression for Real Time Video Communication, In Proceedings of the 12th ACM International conference on Multimedia (ACM MM 2004), New York, Oct 10-16, 2004, pp. 220-227. (best student paper candidate). [.pdf] [video set] [conference info]

Komogortsev, O., Khan J., Contour Approximation for Faster Object based Transcoding with Higher Perceptual Quality, In Proceedings of the Computer Graphics and Imaging (CGIM 2004), Kauai, Hawaii, Aug 17-19, 2004, ISBN 0-88986-418-7, pp. 441-446. [.pdf] [conference info]

Khan J., Komogortsev O., Perceptual Video Compression with Combined Scene Analysis and Eye-Gaze Tracking, In Proceedings of the Eye Tracking Research & Applications Symposium (ETRA 2004), San Antonio, Texas, March 22-24, 2004, pp. 57-57. [.pdf][conference info]

Khan J., Komogortsev O., A Hybrid Scheme for Perceptual Object Window Design with Joint Scene Analysis and Eye-Gaze Tracking for Media Encoding based on Perceptual Attention, In Proceedings of the IS&T/ SPIE Symposium of Visual Communications and Image Processing 2004  (EI04) Electronic Imaging 2004, SPIE Vol. 5308, San Jose, California,   January 18-22, 2004, pp. 1341-1352. [.pdf] [conference info]