Computational visualistics
Encyclopedia
The term Computational visualistics is used for addressing the whole range of investigating scientifically pictures “in” the computer.
take a rather prominent place in contemporary life in the western societies. Together with language, they have been connected to human culture from the very beginning. For about one century – after several millennia of written word’s dominance – their part is increasing again remarkably. Steps toward a general science of images, which we may call ‘general visualistics’ in analogy to general linguistics, have only been taken recently. So far, a unique scientific basis for circumscribing and describing the heterogeneous phenomenon “image” in an interpersonally verifiable manner hasstill been missing while distinct aspects falling in the domain of visualistics have predominantly been dealt with in several other disciplines, among them in particular philosophy
, psychology
, and art history
. Last (though not least), important contributions to certain aspects of a new science of images have come from computer science.
In computer science
, too, considering pictures evolved originally along several more or less independent questions, which lead to proper sub-disciplines: computer graphics
is certainly the most “visible” among them. Only just recently, the effort has been increased to finally form a unique and partially autonomous branch of computer science dedicated to images in general. In analogy to computational linguistics
, the artificial expression computational visualistics is used for addressing the whole range of investigating scientifically pictures “in” the computer.
»image« (or perhaps several such types) stands in the center of interest together with the potential implementations (cf. Schirra 2005). There
are three main groups of algorithms for that data type to be considered in computational visualistics:
, the focus of attention is formed by the operations that take (at least) one picture (and potentially several secondary parameters that are not images) and relate it to another picture. With these operations, we can define algorithms for improving the quality of images (e.g., contrast reinforcement), and procedures for extracting certain parts of an image (e.g., edge finding) or for stamping out pictorial patterns following a particular Gestalt criterion (e.g., blue screen technique). Compression algorithms for the efficient storing or transmitting of pictorial data also belong into this field.
is actually not restricted to pictures. But it has performed important precursory work for computational visualistics since the early 1950’s in those areas that essentially classify information in given images: the identification of simple geometric Gestalts (e.g., “circular region”), the classification of letters (recognition of handwriting), the “seeing” of spatial objects in the images or even the association of stylistic attributes of the representation. That is, the images are to be associated with instances of a non-pictorial data type forming a description of some of their aspects. The neighboring field of computer vision
is the part of AI (artificial intelligence
) in which computer scientists try to teach – loosely speaking – computers the ability of visual perception
. Therefore, a problem rather belongs to computer vision to the degree to which its goal is “semantic”, i.e., the result approximates the human seeing of objects in a picture.
and information visualization
. The former deals with images in the closer sense, i.e., those pictures showing spatial configurations of objects (in the colloquial meaning of ‘object’) in a more or less naturalistic representation like, e.g., in virtual architecture. The starting point of the picture-generating algorithms in computer graphics is usually a data type that allows us to describe the geometry in three dimensions and the lighting of the scene to be depicted together with the important optical properties of the surfaces considered. Scientists in information visualization are interested in presenting pictorially any other data type, in particular those that consist of non-visual components in a “space” of states: in order to do so, a convention of visual presentation has firstly to be determined – e.g., a code of colors or certain icons. The well-known fractal images (e.g., of the Mandelbrot set
) form a borderline case of information visualization since an abstract mathematical property has been visualized.
addition to learning about the traditional (i.e. not computerized) contexts of using pictures, students intensively practice their communicative skills. As the third component of the program, an application subject such as medicine gives students an early opportunity to apply their knowledge in that they learn the skills needed for co-operating with clients and experts in other fields. Bachelor
and master
programmes have been introduced in the meantime.
The expression 'computational visualistics' is also used for a similar degree programme of the University at Koblenz-Landau
.
Overview
ImagesImage
An image is an artifact, for example a two-dimensional picture, that has a similar appearance to some subject—usually a physical object or a person.-Characteristics:...
take a rather prominent place in contemporary life in the western societies. Together with language, they have been connected to human culture from the very beginning. For about one century – after several millennia of written word’s dominance – their part is increasing again remarkably. Steps toward a general science of images, which we may call ‘general visualistics’ in analogy to general linguistics, have only been taken recently. So far, a unique scientific basis for circumscribing and describing the heterogeneous phenomenon “image” in an interpersonally verifiable manner hasstill been missing while distinct aspects falling in the domain of visualistics have predominantly been dealt with in several other disciplines, among them in particular philosophy
Philosophy
Philosophy is the study of general and fundamental problems, such as those connected with existence, knowledge, values, reason, mind, and language. Philosophy is distinguished from other ways of addressing such problems by its critical, generally systematic approach and its reliance on rational...
, psychology
Psychology
Psychology is the study of the mind and behavior. Its immediate goal is to understand individuals and groups by both establishing general principles and researching specific cases. For many, the ultimate goal of psychology is to benefit society...
, and art history
Art history
Art history has historically been understood as the academic study of objects of art in their historical development and stylistic contexts, i.e. genre, design, format, and style...
. Last (though not least), important contributions to certain aspects of a new science of images have come from computer science.
In computer science
Computer science
Computer science or computing science is the study of the theoretical foundations of information and computation and of practical techniques for their implementation and application in computer systems...
, too, considering pictures evolved originally along several more or less independent questions, which lead to proper sub-disciplines: computer graphics
Computer graphics
Computer graphics are graphics created using computers and, more generally, the representation and manipulation of image data by a computer with help from specialized software and hardware....
is certainly the most “visible” among them. Only just recently, the effort has been increased to finally form a unique and partially autonomous branch of computer science dedicated to images in general. In analogy to computational linguistics
Computational linguistics
Computational linguistics is an interdisciplinary field dealing with the statistical or rule-based modeling of natural language from a computational perspective....
, the artificial expression computational visualistics is used for addressing the whole range of investigating scientifically pictures “in” the computer.
Areas covered
For a science of images within computer science, the abstract data typeData type
In computer programming, a data type is a classification identifying one of various types of data, such as floating-point, integer, or Boolean, that determines the possible values for that type; the operations that can be done on values of that type; the meaning of the data; and the way values of...
»image« (or perhaps several such types) stands in the center of interest together with the potential implementations (cf. Schirra 2005). There
are three main groups of algorithms for that data type to be considered in computational visualistics:
Algorithms from »image« to »image«
In the field called image processingImage processing
In electrical engineering and computer science, image processing is any form of signal processing for which the input is an image, such as a photograph or video frame; the output of image processing may be either an image or, a set of characteristics or parameters related to the image...
, the focus of attention is formed by the operations that take (at least) one picture (and potentially several secondary parameters that are not images) and relate it to another picture. With these operations, we can define algorithms for improving the quality of images (e.g., contrast reinforcement), and procedures for extracting certain parts of an image (e.g., edge finding) or for stamping out pictorial patterns following a particular Gestalt criterion (e.g., blue screen technique). Compression algorithms for the efficient storing or transmitting of pictorial data also belong into this field.
Algorithms from »image« to “not-image”
Two disciplines share the operations transforming images into non-pictorial data items. The field of pattern recognitionPattern recognition
In machine learning, pattern recognition is the assignment of some sort of output value to a given input value , according to some specific algorithm. An example of pattern recognition is classification, which attempts to assign each input value to one of a given set of classes...
is actually not restricted to pictures. But it has performed important precursory work for computational visualistics since the early 1950’s in those areas that essentially classify information in given images: the identification of simple geometric Gestalts (e.g., “circular region”), the classification of letters (recognition of handwriting), the “seeing” of spatial objects in the images or even the association of stylistic attributes of the representation. That is, the images are to be associated with instances of a non-pictorial data type forming a description of some of their aspects. The neighboring field of computer vision
Computer vision
Computer vision is a field that includes methods for acquiring, processing, analysing, and understanding images and, in general, high-dimensional data from the real world in order to produce numerical or symbolic information, e.g., in the forms of decisions...
is the part of AI (artificial intelligence
Artificial intelligence
Artificial intelligence is the intelligence of machines and the branch of computer science that aims to create it. AI textbooks define the field as "the study and design of intelligent agents" where an intelligent agent is a system that perceives its environment and takes actions that maximize its...
) in which computer scientists try to teach – loosely speaking – computers the ability of visual perception
Perception
Perception is the process of attaining awareness or understanding of the environment by organizing and interpreting sensory information. All perception involves signals in the nervous system, which in turn result from physical stimulation of the sense organs...
. Therefore, a problem rather belongs to computer vision to the degree to which its goal is “semantic”, i.e., the result approximates the human seeing of objects in a picture.
Algorithms from “not-image” to »image«
The investigation of possibilities gained by the operations that result in instances of the data type »image« but take as a starting point instances of non-pictorial data types is performed in particular in computer graphicsComputer graphics
Computer graphics are graphics created using computers and, more generally, the representation and manipulation of image data by a computer with help from specialized software and hardware....
and information visualization
Information visualization
Information visualization is the interdisciplinary study of "the visual representation of large-scale collections of non-numerical information, such as files and lines of code in software systems, library and bibliographic databases, networks of relations on the internet, and so forth".- Overview...
. The former deals with images in the closer sense, i.e., those pictures showing spatial configurations of objects (in the colloquial meaning of ‘object’) in a more or less naturalistic representation like, e.g., in virtual architecture. The starting point of the picture-generating algorithms in computer graphics is usually a data type that allows us to describe the geometry in three dimensions and the lighting of the scene to be depicted together with the important optical properties of the surfaces considered. Scientists in information visualization are interested in presenting pictorially any other data type, in particular those that consist of non-visual components in a “space” of states: in order to do so, a convention of visual presentation has firstly to be determined – e.g., a code of colors or certain icons. The well-known fractal images (e.g., of the Mandelbrot set
Mandelbrot set
The Mandelbrot set is a particular mathematical set of points, whose boundary generates a distinctive and easily recognisable two-dimensional fractal shape...
) form a borderline case of information visualization since an abstract mathematical property has been visualized.
Computational Visualistics Degree Programmes
The subject of computational visualistics was introduced at the University of Magdeburg, Germany, in the fall of 1996. This five-year diploma programme has computer science courses as its core: students learn about digital methods and electronic tools for solving picture-related problems. The technological areas of endeavour are complemented by courses on pictures in the humanities. Inaddition to learning about the traditional (i.e. not computerized) contexts of using pictures, students intensively practice their communicative skills. As the third component of the program, an application subject such as medicine gives students an early opportunity to apply their knowledge in that they learn the skills needed for co-operating with clients and experts in other fields. Bachelor
Bachelor's degree
A bachelor's degree is usually an academic degree awarded for an undergraduate course or major that generally lasts for three or four years, but can range anywhere from two to six years depending on the region of the world...
and master
Master's degree
A master's is an academic degree granted to individuals who have undergone study demonstrating a mastery or high-order overview of a specific field of study or area of professional practice...
programmes have been introduced in the meantime.
The expression 'computational visualistics' is also used for a similar degree programme of the University at Koblenz-Landau
University of Koblenz and Landau
The University of Koblenz-Landau is a university located in Koblenz and Landau, Germany. It was founded in 1990.-History and profile:...
.
Further reading
- Jochen Schneider, Thomas Strothotte & Winfried Marotzki (2003). Computational Visualistics, Media Informatics, and Virtual Communities. Deutscher Universitätsverlag.
- Jörg R.J. Schirra (1999). "Computational Visualistics: Bridging the Two Cultures in a Multimedia Degree Programme". In: Forum Proceedings, ed.: Z. J. Pudlowski, p. 47-51,
- Jörg R. J. Schirra (2000). html "A New Theme for Educating New Engineers: Computational visualistics". In: Global Journal of Engineering Education, Vol. 4, No. 1, 73-82. (June 2000)
- Jörg R. J. Schirra (2005). "Foundation of Computational Visualistics". Deutscher Universitätsverlag
- Jörg R. J. Schirra (2005). "Computational Visualistics: Dealing with Pictures in Computer Science". In: K. Sachs-Hombach (Ed.): Bildwissenschaft zwischen Reflexion und Anwendung. Köln: Herbert von Halem Verlag, 2005, 494-509.
- Jörg R. J. Schirra (2005) "Ein Disziplinen-Mandala für die Bildwissenschaft - Kleine Provokation zu einem Neuen Fach"". In: Vol. I: Bildwissenschaft als interdisziplinäres Unternehmen. Eine Standortbestimmung. 2005, Köln: Herbert-von-Halem-Verlag