Download Quad Chart - Informedia Digital Video Library

Video Information Summarization and Testbed
VIDEO ANALYSIS AND CONTENT EXTRACTION (VACE)
Informedia VACE System Overview
Information Collection & Analysis
The Novel Ideas
Information Exploration & Discovery
OFFLINE
ONLINE
Requested Segment
or Summarization
Surveillance
Broadcast TV
Digital Encoding
01
1
1 0
0
0 1
1 01
0 1
0
Indexed
Transcript
& Images
Browsing
and Query
Refinement
Indexing
Motion
Analysis
Object
Extraction
Speech, Face, Text
Recognition
Distribution
To Users
• Extend from speech centric metadata extraction to indexing of image
content and visual characterizations
Multimodal
Queries
Segmented
Compressed
Audio/Video
• Fully automate the indexing of video streams based on multimodal
information content
• Provide testbed environment for integration and demonstration of
VACE Program developed algorithms & techniques
UAV
Indexed Database
Building on the Informedia Digital Video Library infrastructure
Video summaries and multimodal video mining
Analyst
• Automatic creation of multimedia abstractions
• Automatic creation of video information collages as summaries over
multiple events (e.g. timeline and geospatial tracking)
Relevant Result Set
Milestones/Dates/Status
Impact and Champions
Impact
Integration Platform
• Provide unified infrastructure for integration and demonstration of
systems for
– Object detection, recognition and tracking
– Audio, speech and natural language understanding
• Installation of demonstrator system at DIA and NSA
• Publication of interface specifications and procedures
for data and module integration
• Integration of two collaborators into demonstration system
• Modularization of processing architecture
• XML/XSL data interface and display templates
• Automatically generated video information summaries and multimodal
video mining
• Enable the evaluation, testing and validation of research results by
analysts in user-focused application
Champions
DIA, NSA
Lead Principal Investigator: Howard Wactlar, Carnegie Mellon University
Mo/Yr
Dec 2000
Mar 2001
Aug 2001
Apr 2002
Aug 2002
Visualization/Summarization
•
•
•
•
Geographic collages with zoom in/out visualization
Interactive multimodal queries
Time based collages as event summaries
Link analysis of metadata co-occurrence
Project COTR: William P. Olexy, DIA
Mar 2001
Aug 2001
Apr 2002
Aug 2002
10/00