Music and Artificial Intelligence - AbsoluteAstronomy.com

Research in artificial intelligence (AI) is known to have impacted medical diagnosis

Medical diagnosis

Medical diagnosis refers both to the process of attempting to determine or identify a possible disease or disorder , and to the opinion reached by this process...

, stock trading, robot control

Robot control

-See also:* Control theory* Mobile robot navigation* Robot kinematics* Simultaneous localization and mapping* Robot locomotion* Motion planning* Robot learning* Vision Based Robot Control...

, and several other fields. Perhaps less popular is the contribution of AI in the field of music

Music

Music is an art form whose medium is sound and silence. Its common elements are pitch , rhythm , dynamics, and the sonic qualities of timbre and texture...

. Nevertheless, artificial intelligence and music (AIM) has, for a long time, been a common subject in several conferences and workshops, including the International Computer Music Conference

International Computer Music Conference

The International Computer Music Conference is a yearly international conference for computer music researchers and composers. It is the annual conference of the International Computer Music Association ....

, the Computing Society Conference and the International Joint Conference on Artificial Intelligence

International Joint Conference on Artificial Intelligence

The International Joint Conference on Artificial Intelligence is a meeting of researchers from the different areas of artificial intelligence . It is organized by the IJCAI, Inc., and has been held every other year since 1969. Originally, the other years saw the meetings of the ECAI, AAAI, and a...

. In fact, the first International Computer Music Conference was the ICMC 1974, Michigan State University, East Lansing, USA
Current research includes the application of AI in music composition, performance, theory and digital sound processing. Several music software applications have been developed that use AI to produce music. A few examples are included below. Note that there are many that are still being developed.

Emi

A program developed by David Cope which composes classical music. See Experiments in Musical Intelligence.

OrchExtra

This program was designed to provide small-budget productions with instrumentation for all instruments usually present in the full-fledged orchestra. If there is a small orchestra playing, the program can play the part for missing instruments. High school and community theaters wanting to produce a musical can now benefit from the virtual orchestra and realize a full Broadway score. This software is able to follow the fluctuations in tempo and musical expression. Musicians enjoy the thrill of playing with a full orchestra, while the audience enjoys the rich sound that comes from the combination of the virtual orchestra with the musicians.

Demo:

Computer Accompaniment (Carnegie Mellon University)

The Computer Music Project at CMU develops computer music and interactive performance technology to enhance human musical experience and creativity. This interdisciplinary effort draws on Music Theory

Music theory

Music theory is the study of how music works. It examines the language and notation of music. It seeks to identify patterns and structures in composers' techniques across or within genres, styles, or historical periods...

, Cognitive Science

Cognitive science

Cognitive science is the interdisciplinary scientific study of mind and its processes. It examines what cognition is, what it does and how it works. It includes research on how information is processed , represented, and transformed in behaviour, nervous system or machine...

, Artificial Intelligence

Artificial intelligence

Artificial intelligence is the intelligence of machines and the branch of computer science that aims to create it. AI textbooks define the field as "the study and design of intelligent agents" where an intelligent agent is a system that perceives its environment and takes actions that maximize its...

and Machine Learning

Machine learning

Machine learning, a branch of artificial intelligence, is a scientific discipline concerned with the design and development of algorithms that allow computers to evolve behaviors based on empirical data, such as from sensor data or databases...

, Human Computer Interaction, Real-Time Systems, Computer Graphics

Computer graphics

Computer graphics are graphics created using computers and, more generally, the representation and manipulation of image data by a computer with help from specialized software and hardware....

and Animation, Multimedia

Multimedia

Multimedia is media and content that uses a combination of different content forms. The term can be used as a noun or as an adjective describing a medium as having multiple content forms. The term is used in contrast to media which use only rudimentary computer display such as text-only, or...

, Programming Languages, and Signal Processing

Signal processing

Signal processing is an area of systems engineering, electrical engineering and applied mathematics that deals with operations on or analysis of signals, in either discrete or continuous time...

. One of their project is similar to SmartMusic. It provides accompaniment for the chosen piece follows the soloist (user) despite tempo changes and/or mistakes.

Demo:

SmartMusic

SmartMusic is an interactive, computer-based practice tool for musicians. Challenging exercises, instant feedback tools, and more than 30,000 accompaniments make SmartMusic a great practice partner. Designed to help the teacher and student alike, this program offers 5 categories of accompaniments: Solo, Skill development, Method books, Jazz, Ensemble. Teachers can give students pre-defined assignments via email. They can also scan in sheet music that is not yet in the library and save it as a SmartMusic file. Students can choose the difficulty level they want to play at, they can slow down or speed up the tempo or even change the key in which to play the piece. Computer-aided music instruction isn't new; programs like Band in a Box and Music Minus One also provide accompaniment. But SmartMusic compares students' playing with a digital template, which lets it detect mistakes and mark them on a score. It also simulates the rapport between musicians by sensing and reacting to tempo changes.

Demo:

StarPlayIt

StarPlay is also a music education software that allows the user to practice by performing with professional musicians, bands and orchestras. They can choose their spot and watch the video from that spot. They can hear the other musicians playing. Again, the program listens to the user's performance and helps them improve their performance by providing constructive feedback as they rehearse. StarPlay was developed by StarPlayIt (formerly In The Chair), a music technology company that has won many awards for its platforms for online musical performance and participation.

ChucK

Developed at Princeton University by Ge Wang and Perry Cook, ChucK is a text-based, cross-platform language that allows real-time synthesis, composition, performance and analysis of music.
. It is used by SLOrk (Stanford Laptop Orchestra) and PLOrk (Princeton Laptop Orchestra).

Demo:

Impromptu

The Impromptu media programming environment was developed by Andrew Sorensen for exploring 'intelligent' interactive music and visual systems. Impromptu is used for live coding performances and research including generative orchestral music and computational models of music perception.

Reaper's TabEditor

MIDI to string instrument (guitar, violin, dombra, etc...) tablature conversion is non trivial task, as the same note can reside on different strings of instrument. And creation of good fingering sometimes challenge even for real musician, especially when the matter is about replaying two handed piano composition on string instrument.
So in TabEditor (the tiny plugin for Reaper DAW) was used the AI which solves this puzzle same way as musician would do: trying to keep all notes close to each other (to be possible to play) while at the same time trying to fit all piano notes into range of notes that instrument allows to play simultaneously. And when situation is impossible (piano party has more notes than guitar can play) the AI tries to find less destructive solution, removing from composition as few notes as possible.
Prolog programming language was used to create this AI.

Ludwig

Ludwig is an automated composition software based on tree search algorithms. Ludwig generates melodies according to principles of classical music theory. The software arranges its melodies with pop-automation patterns or in four-part choral writing. Ludwig can react in real-time on an eight-bar theme played on a keyboard. The theme will be analysed for key, harmonic content and rhythm while it is being performed by a human. The program then without delay repeats the theme arranged e.g. for orchestra. It subsequently varies the melody to create a little piece as interactive answer to the human input.

Emi