Image representations for Image understanding
Tinne Tuytelaars
Image Understanding
Truck
People
Mountains
Luggage
Challenges
Current state-of-the-art
Image representation
Local viewpoint invariant features
Tuytelaars and Van Gool, BMVC00
Wide baseline matching
Object recognition
Ferrari, Tuytelaars and Van Gool, IJCV06
Robot movie
Football teams recognition
Dexia team
Rotation, motion-blur, clutter
Both teams
Out-of-plane rotation, both teams present
Both teams
Out-of-plane rotation, both teams present
Fortis team
Blur, scale, compression artifacts
Fortis team
Blur, compression artifacts
Zoom 4x Zoom 4x
SURF: Speeded Up Robust Features
• Efficient scheme for feature extraction
• GPU-SURF: runs at 100 Hz
• Hes-STIP (spatio-temporal SURF)
Category-level object recognition
Category-level object recognition
• Local feature extraction
• Robust description
• Vector quantization
• Bag-of-visual-words representation
• Classifier
Pixelwise classification
Pixelwise classification
Questions?