Readings in Vision, Graphics and Interactive Systems, Fall 2008 (VGIS 9th Semester)
Zheng-Hua Tan, Associate Professor, Ph.D.
+45 9635-8686, zt@es.aau.dk
Office: Room A6-319, Niels Jernes Vej 12
Course description:
This course aims to give the students a comprehension of the current state-of-the-art in advanced vision, graphics and interactive systems through the presentation and plenum discussion of a number of concepts and systems representative of the field. It will support the concrete topics of the different projects, and the content will therefore change from year to year.
Lecture notes:
-
Lecture 1: Speech Recognition on Mobile Devices (Zheng-Hua)
-
Readings:
Zheng-Hua Tan and Borge Lindberg (eds.), Automatic speech recognition on mobile devices and over communication networks, Springer-Verlag, London, Feb. 2008.
Haitian Xu, Zheng-Hua Tan, Paul Dalsgaard, Ralf Mattethat and Børge Lindberg, "A Configurable Distributed Speech Recognition System", Biennial on DSP for in-Vehicle and Mobile Systems,
Bowen Zhou, Yuqing Gao, Jeffrey Sorensen, Daniel Dkchelotte and Michael Picheny, "A hand-held speech-to-speech translation system," IEEE ASRU 2003.
-
Lecture 2: Face Pose Estimation from Range Images (Carsten and Jeppe)
-
Readings:
M. D. Breitenstein, D. Kuettel, T. Weise, L. Van Gool and H. Pfister, "Real-Time Face Pose Estimation from Single Range Images," IEEE Conference on Computer Vision and Pattern Recognition (CVPR'08), June 2008. PDF
Carsten Høilund, Jeppe Jensen and Simon J. K. Pedersen, Occlusion Handling in an Augmented Reality System using Stereo Vision and Background Subtraction, 2008. PDF
T. Weise and B. Leibe and L. Van Gool, "Fast 3D Scanning with Automatic Motion Compensation," IEEE Conference on Computer Vision and Pattern Recognition (CVPR'07), June 2007. PDF
-
Lecture 3: Multimedia Search Engine (Thomas Luel and Florent)
-
Readings:
G. Doumenis, S. Papastefanos, V. Mateevitsi, F. Andritsopoulos, N. Achilleopoulos, V. Mikhalev, Video index and search services based on content identification features. PDF
Serhan Dagtas, WasfiAl-Khatib, ArifGhafoor, Rangasami L.Kashyap, Models for Motion-Based Video Indexing and Retrieval. PDF
Keon Stevenson and Clement Leung, Comparative evaluation of web image search engines for multimedia applications. PDF
Leonid Taycher, Marco La Cascia, and Stan Sclaroff, Image Digestion and Relevance Feedback in the ImageRover WWW Search Engine. PDF
Peng Wang, A Search Engine Based on the Semantic Web. PDF -
Example searh engines:
Image : http://www.behold.cc
Audio : http://www.findsounds.com
Video : www.tveyes.com, www.blinkx.com
Semantic : www.ujiko.com, www.kartoo.com -
Lecture 4: Hidden Markov Model (Zheng-Hua)
-
Readings:
Rabiner, L.R., "A tutorial on hidden Markov models and selected applications in speech recognition", Proceedings of the IEEE, 77 (2), 1989, pp. 257 - 286. (PDF. You have got user name and password to access it via email.)
Steve Young, et al., "The HTK Book" (PDF)
Huang, Acero and Hon, Spoken Language Processing - A Guide to Theory, Algorithm, and System Development, Chapter 8, Prentice Hall PTR, 2001.
-
Assignment and solution.
-
Lecture 5: Tactile Devices (Henri Legentil and Thomas Zubeli)
-
Lecture 6: 3D (Thien Tran Tao and Sergio Pedro)
-
Readings:
John C. Russ, The Image Processing Handbook: Second Edition, CRC-Press, 1995
J.A. Ferwerda, "Three varieties of realism in Computer Graphics", SPIE proceedings series, Human vision and electronic imaging VIII, 2003
Mark Ollis, Todd Williamson, "The Future of 3D Video," Computer, vol. 34, no. 6, pp. 97-99, Jun., 2001.
M. Dobelis, Z. Veide, V. Stroževa, J. Briņķis, Simulation of 3D Models in Real-World Context, the 7th International Conference on Engineering Graphics, May, 2004, Kaunas, Lituania.
Michal Valient, 3D Engines in games - Introduction.
Wikipedia: Stereoscope, Hologram, 3-D_film, Animation_software,
-
Readings:
David Luebke, Greg Humphreys, How GPUs work, Computer, Feb 2007.
John D. Owens, Mike Houston, David Luebke, et al., GPU Computing, Proceedings of the IEEE, vol. 96, no. 5, 2008.
Further readings:
AMD FireStream 9170
Multiple Pixel Shader Precision Modes
Mark Harris, "GPGPU Lessons Learned," Tutorial at GameDevelopers Conference, 2006.
Magnus Ekman , Fredrik Warg , "Jim Nilsson, An in-depth look at computer performance growth," ACM SIGARCH Computer Architecture News, v.33 n.1, March 2005Tim Sweeney, "The Next Mainstream Programming Language," the 33rd ACM SIGPLAN-SIGACT symposium on Principles of programming languages, USA, 2006.
AMD Stream Computing FAQ, -
Lecture 8: Remote Sensing (Tamas Utasi and Noemie Perona)
-
Readings:
Nicholas Short, The Remote Sensing Tutorial, NASA, updated in 2007.
T. T. Alföldi, Tutorial: Digital Images and Digital Analysis Techniques, Canada Centre for Remote Sensing.
Tutorial: Fundamentals of Remote Sensing, Canada Centre for Remote Sensing.
A.M.J. Meijerink, REMOTE SENSING APPLICATIONS to GROUNDWATER, the United Nations Educational, 2007
J. A. Richards, Remote Sensing Digital Image Analysis: An Introduction, 2nd edition, Springer-Verlag New York, 1994
Gamba, P.; Tupin, F.; Weng, Q., Introduction to the Issue on Remote Sensing of Human Settlements: Status and Challenges,
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 1(2), June 2008.Chen, K.-S.; Crawford, M. M.; Gamba, P.; Smith, J. S.; Introduction for the Special Issue on Remote Sensing for Major Disaster Prevention, Monitoring, and Assessment, IEEE Transactions on Geoscience and Remote Sensing, 45(6), June 2007.
Lecture 7: General-Purpose computing on the Graphics Processing Unit (GPGPU) Programming (Simon Pedersen)
Instructor:
Zheng-Hua Tan, Department of Electronic Systems, Aalborg University