of 2004: Uniqueness, precision, robustness and
applicability of Nouse® nose tracking.
1. Nouse® basic
videos - more here.
(1.6Mb) & speed-n-robustness.mpeg
to see range
of motion and speed
& robustness of Nouse?.
(3Mb) & more
Stereo-tracking* - face tracking
with two web-cameras.
show the range
of motion and the speed
& robustness of the 3D Nouse-based Stereo Face Tracking
NousePaint at work.
Test - The user rotates his head only! (the shoulders do not move)
NousePaint at work.
Test - The user writes a sentence with the nose, with his colleagues bothering him.
Navigating in Virtual 3D Worlds with Nouse (in a mouse mode).
In this demo, the user rotates her head to follow a moving object (a car) in a
virtual 3D world. Nouse tracks the user's nose and adjusts the
first-person 3D view according to the rotation of the head: lifting the head up causes the
view to go higher and so on.
Description: Precise aiming with the nose (Nouse in a joystick mode)
A user plays a well-known BubbleFrenzy
game, the goal of which is to aim the turret to match the bubbles.
Traditionally played with a mouse or
key presses, it can now be played in more natural way by pointing the direction
with the nose.
Players say: "Playing the
game with Nouse is not only more fun, but is also
less tiring!" - Some users experienced
severe wrist fatigue when they played the game using a mouse for longer
than 15 minutes. This does not happen when they play it with with Nouse.
Using the nose
to aim the turret is found very natural, while the precision of
aiming with the nose was as good as with mouse.
can write or operate with Nouse as
with a joystick or a chalk.
navigate in Windows environment
made hands-free by nose are here.
Perceptual Vision tools
2.1 Blink detection using second-order
(440Kb) & NousePP.avi (160Kb) &
change detection to
detect eye blinking, switches Nouse? On/Off by double-blinking.
also image below.
To see how second-order change detection helps
detecting blinks in moving heads, watch:
this example, of a floppy
disk moves from left
- this is
what you get
what you can
local (second-order) change.
Skin detection for face tracking and
We have examined many non-linear colour spaces
optimal skin model representation. The best result were
obtained, using Perceptual Uniform Colour
Space, which is the space that approximates
the colours the way humans perceive them.
Motion information allows to filter out the
spurious skin-looking regions
2.3 Face Detection and
Tracking with Multiple Cameras using
three-channel video representation
find six different webcams on the picture at right?
(They all have different colour
All of them are
running at the same time,
detecting and tracking a
the result (with
lights off and on) view these images:
Note that switching on the lights is
not detected as a motion change - which is due to
the non-linear change detection.
Also note that, even when one channel
(or one camera) fails detecting a face, the others
in most cases do not.
This allows one to detect and track a face very
robustly (regardless of face orientation, etc)
2.4 On-line face memorization
and recognition for user registration and
You can also see the animated
gif (600Kb) and AVI
movie (2Mb - watch in 50% size to see the
entire picture) which show the snapshots of
the program during the on-fly
memorization and retrieval of faces from
video and face database.
The sequence of actions in the movie is the
- a face of the current user is
- 62 faces are loaded from the face database
face_data-BioID.txt face list -
first image is memorized used)
- recognition is performed on the same 62
persons shown with second image of each person
from the face_data-BioID.txt
- video is back on and the user is again (and
still) recognized every time he blinks.
The log file with recognition statistics
for this run is given here.
The content of the memory (represented by the
memory synaptic matrix) shown in the right top
image. Grey image means nothing is stored -
all weights are zero. As more and more face
are stored the matrix approaches the identity
matrix. By analyzing this memory image, one
can always analytically estimate the
quality of face retrieval. For more about
facial recognition in video visit at Perceptual