IBM MPEG-4 Technologies
The Composite Media Technologies Group has developed cross-platform MPEG-4 standard compliant technologies with a particular focus on lightweight portable client playback and authoring of composite media, both manual and automated. Automated machine generation of interoperable, exchangeable media content is applicable for on-demand as well as live solutions and can include adaptive technologies.
Intelligent Multimedia Interaction
The Department of Intelligent Multimedia Interaction (IMI) at IBM T. J. Watson is a research group that concentrates on building next-generation intelligent multimodal, multimedia interaction systems. Our work is centered on developing new methodologies and metaphors for enabling a full-fledged multimodal, multimedia human-computer conversation. Using the multimodal, multimedia conversation metaphor, users can navigate naturally and effectively through large and complex information spaces by exploiting multiple natural input channels. Presented with customized multimedia tour of information, users also can comprehend rich information easily. Our work ultimately enables a brand new computing paradigm -- proactive computing -- in which computers are no longer passive tools driven by human users. Instead, computers will become proactive human companions that can help us seek information and acquire knowledge.
MARVel: Multimedia Search Engine
The MARVEL system consists of the MARVEL multimedia analysis engine and the MARVEL multimedia search engine.
- The MARVEL multimedia analysis engine applies machine learning techniques to model semantic concepts in video from automatically extracted audio, speech and visual content. It automatically assigns labels (with associated confidence scores) to new video data to reduce manual annotation load. It also improves searching and organizes semantic concepts using ontologies that exploit semantic relationships for improving detection performance.
- The MARVEL multimedia retrieval engine integrates multimedia semantics-based searching with other search techniques (speech, text, metadata, audio-visual features, etc.). It also combines content-based, model-based and text-based searching for video searching.
Digital Media and Secure Infrastructure
The Department of Digital Media and Security Infrastructure (DMS) at IBM T.J. Watson is a research group whose mission is to conduct leading edge research on technologies that facilitates the incorporation of digital media and security features into the general computing infrastructure.
Last updated on November 16, 2007