Interactive Multimodal Information Management (IM)2
Encyclopedia
Interactive Multimodal Information Management (IM2) is one the 20 Swiss National Centres of Competence in Research (NCCR) aiming at boosting research and development
in several areas considered of strategic importance to the Swiss economy. The National Centers of Competence in Research are a research instrument managed by the Swiss National Science Foundation
on behalf of the Federal Authorities. Granted for a maximum duration of 12 years, they are evaluated every year by a review panel, and renewed every four years. Success of the NCCRs is measured in terms of research achievements, training of young scientists (PhD students and postdocs), knowledge and technology transfer (including spin-offs), and advancement of women.
The IM2 NCCR, headed by IDIAP Research Institute
in Martigny
, Canton of Valais
, gathers the major Swiss contributors to the field of Interactive Multimodal Information Management, from a number of university institutions (Swiss Federal Institute of Technology at Lausanne
, University of Geneva
, University of Fribourg
, University of Bern
, Swiss Federal Institute of Technology in Zurich) and a range of commercial companies. IM2 is also working in the context of numerous international contacts, including several large European projects, as well as an agreement for the exchange of young researchers with ICSI
in Berkeley, California
.
Started in 2002, IM2 is aimed at the advancement of research, and the development of prototypes, in the field of multimodal information management and man-machine interaction
. IM2 is particularly concerned with technologies coordinating natural input modes (such as speech, image, pen, touch, hand gestures, head and/or body movements, and even physiological signals) with multimedia system outputs, such as speech, sounds, images, animations, whether standalone or combined in web-based browsing interfaces.
To foster collaboration and maximize synergy
between the IM2 partners, it was decided to focus on a few, well defined, applications. The most important and challenging of them is Smart Meeting Management. The overall objective of this application is the construction of a demonstration system to enable structuring, browsing and querying of an archive of automatically analysed meetings. The archived meetings take place in a room equipped with multimodal sensors. For each meeting, audio, video and textual information is available, as well as information from other modalities. Audio information comes from close talking and distant microphones, as well as binaural recordings. Video information comes from multiple cameras and overhead projectors. Writing devices capture whiteboard or participant's notes. The video and audio information form several streams of data generated during the meeting, while the additional information — the agenda, discussion papers — and can be used to guide the automatic structuring of the meeting. Multimodal interfaces called meeting browsers are then used for searching and browsing the multimedia/multimodal meeting archive, which can also be accessed in a query-free manner using meeting assistants for content linking.
The National Centres of Competence in Research (NCCR) are a research instrument of the Swiss National Science Foundation (SNSF).
Research and development
The phrase research and development , according to the Organization for Economic Co-operation and Development, refers to "creative work undertaken on a systematic basis in order to increase the stock of knowledge, including knowledge of man, culture and society, and the use of this stock of...
in several areas considered of strategic importance to the Swiss economy. The National Centers of Competence in Research are a research instrument managed by the Swiss National Science Foundation
Swiss National Science Foundation
The Swiss National Science Foundation is a science research support organization mandated by the Swiss Federal Government. The SNSF was established in 1952 as a foundation under private law. Its secretariat is based in Bern....
on behalf of the Federal Authorities. Granted for a maximum duration of 12 years, they are evaluated every year by a review panel, and renewed every four years. Success of the NCCRs is measured in terms of research achievements, training of young scientists (PhD students and postdocs), knowledge and technology transfer (including spin-offs), and advancement of women.
The IM2 NCCR, headed by IDIAP Research Institute
IDIAP Research Institute
The Idiap Research Institute, based in Martigny , is an autonomous, independent, non-profit research foundation specialised in the management of multimedia information and man-machine multimodal interactions...
in Martigny
Martigny, Switzerland
Martigny is the capital of the French-speaking district of Martigny in the canton of Valais in Switzerland. It lies at an elevation of , and its population is approximately 15000 inhabitants . It is a junction of roads joining Italy, France and Switzerland...
, Canton of Valais
Valais
The Valais is one of the 26 cantons of Switzerland in the southwestern part of the country, around the valley of the Rhône from its headwaters to Lake Geneva, separating the Pennine Alps from the Bernese Alps. The canton is one of the drier parts of Switzerland in its central Rhône valley...
, gathers the major Swiss contributors to the field of Interactive Multimodal Information Management, from a number of university institutions (Swiss Federal Institute of Technology at Lausanne
École polytechnique fédérale de Lausanne
The École polytechnique fédérale de Lausanne is one of the two Swiss Federal Institutes of Technology and is located in Lausanne, Switzerland.The school was founded by the Swiss Federal Government with the stated mission to:...
, University of Geneva
University of Geneva
The University of Geneva is a public research university located in Geneva, Switzerland.It was founded in 1559 by John Calvin, as a theological seminary and law school. It remained focused on theology until the 17th century, when it became a center for Enlightenment scholarship. In 1873, it...
, University of Fribourg
University of Fribourg
The University of Fribourg is a university in the city of Fribourg, Switzerland.The roots of the University can be traced back to 1582, when the notable Jesuit Peter Canisius founded the Collège Saint-Michel in the City of Fribourg. In 1763, an Academy of law was founded by the state of Frobourg...
, University of Bern
University of Berne
The University of Bern is a university in the Swiss capital of Bern and was founded in 1834. It is regulated and financed by the Canton of Bern. It is a comprehensive university offering a broad choice of courses and programmes in eight faculties and some 160 institutes. The university is an...
, Swiss Federal Institute of Technology in Zurich) and a range of commercial companies. IM2 is also working in the context of numerous international contacts, including several large European projects, as well as an agreement for the exchange of young researchers with ICSI
ICSI
The abbreviation ICSI may refer to:* Intracytoplasmic sperm injection, a medical technique used in assisted reproduction* International Computer Science Institute, a non-profit research lab in Berkeley, California...
in Berkeley, California
Berkeley, California
Berkeley is a city on the east shore of the San Francisco Bay in Northern California, United States. Its neighbors to the south are the cities of Oakland and Emeryville. To the north is the city of Albany and the unincorporated community of Kensington...
.
Started in 2002, IM2 is aimed at the advancement of research, and the development of prototypes, in the field of multimodal information management and man-machine interaction
Man-machine interaction
Man-machine interaction may refer to:*Control of machines in general using devices like steering wheel, automobile pedal, or button*Human–computer interaction...
. IM2 is particularly concerned with technologies coordinating natural input modes (such as speech, image, pen, touch, hand gestures, head and/or body movements, and even physiological signals) with multimedia system outputs, such as speech, sounds, images, animations, whether standalone or combined in web-based browsing interfaces.
To foster collaboration and maximize synergy
Synergy
Synergy may be defined as two or more things functioning together to produce a result not independently obtainable.The term synergy comes from the Greek word from , , meaning "working together".-Definitions and usages:...
between the IM2 partners, it was decided to focus on a few, well defined, applications. The most important and challenging of them is Smart Meeting Management. The overall objective of this application is the construction of a demonstration system to enable structuring, browsing and querying of an archive of automatically analysed meetings. The archived meetings take place in a room equipped with multimodal sensors. For each meeting, audio, video and textual information is available, as well as information from other modalities. Audio information comes from close talking and distant microphones, as well as binaural recordings. Video information comes from multiple cameras and overhead projectors. Writing devices capture whiteboard or participant's notes. The video and audio information form several streams of data generated during the meeting, while the additional information — the agenda, discussion papers — and can be used to guide the automatic structuring of the meeting. Multimodal interfaces called meeting browsers are then used for searching and browsing the multimedia/multimodal meeting archive, which can also be accessed in a query-free manner using meeting assistants for content linking.
The National Centres of Competence in Research (NCCR) are a research instrument of the Swiss National Science Foundation (SNSF).