Connection Machine
Encyclopedia
The Connection Machine was a series of supercomputer
s that grew out of Danny Hillis'
research in the early 1980s at MIT
on alternatives to the traditional von Neumann architecture
of computation. The Connection Machine was originally intended for applications in artificial intelligence
and symbolic processing, but later versions found greater success in the field of computational science
.
programming for parallel machines, etc.
founded Thinking Machines in Waltham, Massachusetts
(it was later moved to Cambridge, Massachusetts
) in 1983 and assembled a team to develop the CM-1 Connection Machine. This was a "massively parallel" hypercubic
arrangement of thousands of microprocessors, each with its own 4 kbits of RAM
, which together executed in a SIMD
fashion. The CM-1, depending on the configuration, had as many as 65,536 processors. The individual processors were extremely simple, processing one bit at a time.
The CM-1 and CM-2 took the form of a cube
1.5 meters on a side, divided equally into eight smaller cubes. Each sub-cube contained 16 printed circuit boards and a main processor called a sequencer. Each printed circuit board contained 32 chips. Each chip contained a communication channel called a router, 16 processors, 16 RAMs. The CM-1 as a whole had a hypercubic
routing network
, a main RAM, and an input/output processor. It was connected to a switching device called a nexus.
In order to improve its commercial viability, the CM-2, launched in 1987, added Weitek
3132 floating-point numeric co-processors and more RAM to the system. 32 of the original one-bit processors shared each numeric processor. The CM-2 could be configured with up to 512 MB of RAM, and a RAID
hard disk
array, called a DataVault, of up to 25 GB.
Two later variants of the CM-2 were also produced, the smaller CM-2a with either 4096 or 8192 single-bit processors, and the faster CM-200.
Due to its origins in AI research, the software for the CM-1/2/200 single-bit processor was influenced by the Lisp programming language
and a version of Common Lisp
, *Lisp
(spoken: "Star-Lisp"), was implemented on the CM-1. Other early languages included Karl Sims' IK and Cliff Lasser's URDU. Much system utility software for the CM-1/2 was written in *Lisp
.
With the CM-5, announced in 1991, Thinking Machines switched from the CM-2's hypercubic architecture of simple processors to an entirely new MIMD
architecture based on a fat tree
network of SPARC
RISC processors. The later CM-5E replaced the SPARC processors with faster SuperSPARCs.
The physical form of the CM-1, CM-2, and CM-200 chassis was a cube-of-cubes, referencing the machine's internal 12-dimensional hypercube
network,
with the red blinking LED
s of the processor status lights visible through the doors of each cube.
The CM-5, in plan view, had a "staircase"-like shape, and also had large panels of red blinking LEDs. Perhaps because of its design, a CM-5 was featured in the movie Jurassic Park
in the control room
for the island
(instead of a Cray X-MP
supercomputer
as in the novel). Prominent sculptor/architect Maya Lin
contributed to the CM-5 design.
Supercomputer
A supercomputer is a computer at the frontline of current processing capacity, particularly speed of calculation.Supercomputers are used for highly calculation-intensive tasks such as problems including quantum physics, weather forecasting, climate research, molecular modeling A supercomputer is a...
s that grew out of Danny Hillis'
W. Daniel Hillis
William Daniel "Danny" Hillis is an American inventor, entrepreneur, and author. He co-founded Thinking Machines Corporation, a company that developed the Connection Machine, a parallel supercomputer designed by Hillis at MIT...
research in the early 1980s at MIT
Massachusetts Institute of Technology
The Massachusetts Institute of Technology is a private research university located in Cambridge, Massachusetts. MIT has five schools and one college, containing a total of 32 academic departments, with a strong emphasis on scientific and technological education and research.Founded in 1861 in...
on alternatives to the traditional von Neumann architecture
Von Neumann architecture
The term Von Neumann architecture, aka the Von Neumann model, derives from a computer architecture proposal by the mathematician and early computer scientist John von Neumann and others, dated June 30, 1945, entitled First Draft of a Report on the EDVAC...
of computation. The Connection Machine was originally intended for applications in artificial intelligence
Artificial intelligence
Artificial intelligence is the intelligence of machines and the branch of computer science that aims to create it. AI textbooks define the field as "the study and design of intelligent agents" where an intelligent agent is a system that perceives its environment and takes actions that maximize its...
and symbolic processing, but later versions found greater success in the field of computational science
Computational science
Computational science is the field of study concerned with constructing mathematical models and quantitative analysis techniques and using computers to analyze and solve scientific problems...
.
Basis
Danny Hillis' original thesis paper on which the CM-1 Connection Machine was based is The Connection Machine (MIT Press Series in Artificial Intelligence) (ISBN 0-262-08157-1). The title is out of print as of 2005. The book provides an overview of the philosophy, architecture and software for the Connection Machine, including data routing between CPU nodes, memory handling, LispLisp programming language
Lisp is a family of computer programming languages with a long history and a distinctive, fully parenthesized syntax. Originally specified in 1958, Lisp is the second-oldest high-level programming language in widespread use today; only Fortran is older...
programming for parallel machines, etc.
History
Danny Hillis and Sheryl HandlerSheryl Handler
Sheryl Handler was one of the founders of Thinking Machines and is the founder and current CEO of Ab Initio.-External links:* http://www.inc.com/magazine/19950915/2622.html* ....
founded Thinking Machines in Waltham, Massachusetts
Waltham, Massachusetts
Waltham is a city in Middlesex County, Massachusetts, United States, was an early center for the labor movement, and major contributor to the American Industrial Revolution. The original home of the Boston Manufacturing Company, the city was a prototype for 19th century industrial city planning,...
(it was later moved to Cambridge, Massachusetts
Cambridge, Massachusetts
Cambridge is a city in Middlesex County, Massachusetts, United States, in the Greater Boston area. It was named in honor of the University of Cambridge in England, an important center of the Puritan theology embraced by the town's founders. Cambridge is home to two of the world's most prominent...
) in 1983 and assembled a team to develop the CM-1 Connection Machine. This was a "massively parallel" hypercubic
Hypercube
In geometry, a hypercube is an n-dimensional analogue of a square and a cube . It is a closed, compact, convex figure whose 1-skeleton consists of groups of opposite parallel line segments aligned in each of the space's dimensions, perpendicular to each other and of the same length.An...
arrangement of thousands of microprocessors, each with its own 4 kbits of RAM
Ram
-Animals:*Ram, an uncastrated male sheep*Ram cichlid, a species of freshwater fish endemic to Colombia and Venezuela-Military:*Battering ram*Ramming, a military tactic in which one vehicle runs into another...
, which together executed in a SIMD
SIMD
Single instruction, multiple data , is a class of parallel computers in Flynn's taxonomy. It describes computers with multiple processing elements that perform the same operation on multiple data simultaneously...
fashion. The CM-1, depending on the configuration, had as many as 65,536 processors. The individual processors were extremely simple, processing one bit at a time.
The CM-1 and CM-2 took the form of a cube
Cube
In geometry, a cube is a three-dimensional solid object bounded by six square faces, facets or sides, with three meeting at each vertex. The cube can also be called a regular hexahedron and is one of the five Platonic solids. It is a special kind of square prism, of rectangular parallelepiped and...
1.5 meters on a side, divided equally into eight smaller cubes. Each sub-cube contained 16 printed circuit boards and a main processor called a sequencer. Each printed circuit board contained 32 chips. Each chip contained a communication channel called a router, 16 processors, 16 RAMs. The CM-1 as a whole had a hypercubic
Hypercube
In geometry, a hypercube is an n-dimensional analogue of a square and a cube . It is a closed, compact, convex figure whose 1-skeleton consists of groups of opposite parallel line segments aligned in each of the space's dimensions, perpendicular to each other and of the same length.An...
routing network
Routing
Routing is the process of selecting paths in a network along which to send network traffic. Routing is performed for many kinds of networks, including the telephone network , electronic data networks , and transportation networks...
, a main RAM, and an input/output processor. It was connected to a switching device called a nexus.
In order to improve its commercial viability, the CM-2, launched in 1987, added Weitek
Weitek
Weitek Corporation was a chip-design company that originally concentrated on floating point units for a number of commercial CPU designs. During the early to mid-1980s, Weitek designs could be found powering a number of high-end designs and parallel processing supercomputers...
3132 floating-point numeric co-processors and more RAM to the system. 32 of the original one-bit processors shared each numeric processor. The CM-2 could be configured with up to 512 MB of RAM, and a RAID
RAID
RAID is a storage technology that combines multiple disk drive components into a logical unit...
hard disk
Hard disk
A hard disk drive is a non-volatile, random access digital magnetic data storage device. It features rotating rigid platters on a motor-driven spindle within a protective enclosure. Data is magnetically read from and written to the platter by read/write heads that float on a film of air above the...
array, called a DataVault, of up to 25 GB.
Two later variants of the CM-2 were also produced, the smaller CM-2a with either 4096 or 8192 single-bit processors, and the faster CM-200.
Due to its origins in AI research, the software for the CM-1/2/200 single-bit processor was influenced by the Lisp programming language
Lisp programming language
Lisp is a family of computer programming languages with a long history and a distinctive, fully parenthesized syntax. Originally specified in 1958, Lisp is the second-oldest high-level programming language in widespread use today; only Fortran is older...
and a version of Common Lisp
Common Lisp
Common Lisp, commonly abbreviated CL, is a dialect of the Lisp programming language, published in ANSI standard document ANSI INCITS 226-1994 , . From the ANSI Common Lisp standard the Common Lisp HyperSpec has been derived for use with web browsers...
, *Lisp
*Lisp
The *Lisp programming language was conceived of in 1985 by Cliff Lasser and Steve Omohundro as a way of providing an efficient yet high-level language for programming the nascent Connection Machine.-Prelude:At the time the Connection Machine was being designed and built, the only language being...
(spoken: "Star-Lisp"), was implemented on the CM-1. Other early languages included Karl Sims' IK and Cliff Lasser's URDU. Much system utility software for the CM-1/2 was written in *Lisp
*Lisp
The *Lisp programming language was conceived of in 1985 by Cliff Lasser and Steve Omohundro as a way of providing an efficient yet high-level language for programming the nascent Connection Machine.-Prelude:At the time the Connection Machine was being designed and built, the only language being...
.
With the CM-5, announced in 1991, Thinking Machines switched from the CM-2's hypercubic architecture of simple processors to an entirely new MIMD
MIMD
In computing, MIMD is a technique employed to achieve parallelism. Machines using MIMD have a number of processors that function asynchronously and independently. At any time, different processors may be executing different instructions on different pieces of data...
architecture based on a fat tree
Fat tree
The fat tree network, invented by Charles E. Leiserson of MIT, is a universal network for provably efficient communication. Unlike an ordinary computer scientist's notion of a tree, which has "skinny" links all over, the links in a fat-tree become "fatter" as one moves up the tree towards the root...
network of SPARC
SPARC
SPARC is a RISC instruction set architecture developed by Sun Microsystems and introduced in mid-1987....
RISC processors. The later CM-5E replaced the SPARC processors with faster SuperSPARCs.
Visual Design
Connection Machines were noted for their (intentionally) striking visual design. The CM-1 and CM-2 design teams were led by Tamiko Thiel.The physical form of the CM-1, CM-2, and CM-200 chassis was a cube-of-cubes, referencing the machine's internal 12-dimensional hypercube
Hypercube
In geometry, a hypercube is an n-dimensional analogue of a square and a cube . It is a closed, compact, convex figure whose 1-skeleton consists of groups of opposite parallel line segments aligned in each of the space's dimensions, perpendicular to each other and of the same length.An...
network,
with the red blinking LED
LEd
LEd is a TeX/LaTeX editing software working under Microsoft Windows. It is a freeware product....
s of the processor status lights visible through the doors of each cube.
The CM-5, in plan view, had a "staircase"-like shape, and also had large panels of red blinking LEDs. Perhaps because of its design, a CM-5 was featured in the movie Jurassic Park
Jurassic Park (film)
Jurassic Park is a 1993 American science fiction adventure film directed by Steven Spielberg. The film is based on the novel of the same name by Michael Crichton. It stars Sam Neill, Laura Dern, Jeff Goldblum, Richard Attenborough, Martin Ferrero, and Bob Peck...
in the control room
Control room
A control room is a room serving as an operations centre where a facility or service can be monitored and controlled. Examples include:*in television production, the master control is the technical hub of a broadcast operation common among most over-the-air television stations, television networks...
for the island
Island
An island or isle is any piece of sub-continental land that is surrounded by water. Very small islands such as emergent land features on atolls can be called islets, cays or keys. An island in a river or lake may be called an eyot , or holm...
(instead of a Cray X-MP
Cray X-MP
The Cray X-MP was a supercomputer designed, built and sold by Cray Research. It was announced in 1982 as the "cleaned up" successor to the 1975 Cray-1, and was the world's fastest computer from 1983 to 1985...
supercomputer
Supercomputer
A supercomputer is a computer at the frontline of current processing capacity, particularly speed of calculation.Supercomputers are used for highly calculation-intensive tasks such as problems including quantum physics, weather forecasting, climate research, molecular modeling A supercomputer is a...
as in the novel). Prominent sculptor/architect Maya Lin
Maya Lin
Maya Ying Lin is an American artist who is known for her work in sculpture and landscape art. She is the designer of the Vietnam Veterans Memorial in Washington, D.C.-Personal life:...
contributed to the CM-5 design.
See also
- ICL DAP
- Goodyear MPPGoodyear MPPThe Goodyear Massively Parallel Processor was amassively parallel processing supercomputer built by Goodyear Aerospacefor the NASA Goddard Space Flight Center.It was designed to deliver enormous computational power at lower cost than...
- Parallel computingParallel computingParallel computing is a form of computation in which many calculations are carried out simultaneously, operating on the principle that large problems can often be divided into smaller ones, which are then solved concurrently . There are several different forms of parallel computing: bit-level,...
- FROSTBURGFROSTBURGFROSTBURG was a Connection Machine 5 supercomputer used by the US National Security Agency to perform higher-level mathematical calculations. The CM-5 was built by the Thinking Machines Corporation, based in Cambridge, Massachusetts, at a cost of US$25 million. The system was installed at NSA in...
a CM-5 used by the NSA - David E. Shaw's NON-VON machine, which preceded the Connection machine slightly.
- MasParMasParMasPar Computer Corporation was a minisupercomputer vendor that was founded in 1987 by Jeff Kalb. The company was based in Sunnyvale, California....
Further reading
- Hillis, D. 1982 "New Computer Architectures and Their Relationship to Physics or Why CS is No Good", Int J. Theoretical Physics 21 (3/4) 255-262.
- Lewis W. Tucker, George G. RobertsonGeorge G. RobertsonGeorge G. Robertson is an American information visualization expert and Senior Researcher, Visualization and Interaction Research Group, Microsoft Research. With Stuart K. Card, Jock D...
, "Architecture and Applications of the Connection Machine," Computer, vol. 21, no. 8, pp. 26–38, August, 1988. - Arthur Trew and Greg Wilson (eds.) (1991). Past, Present, Parallel: A Survey of Available Parallel Computing Systems. New York: Springer-Verlag. ISBN 0-387-19664-1.
- W. Daniel Hillis and Lewis W. Tucker. The CM-5 Connection Machine: A Scalable Supercomputer. In Communications of the ACMCommunications of the ACMCommunications of the ACM is the flagship monthly journal of the Association for Computing Machinery . First published in 1957, CACM is sent to all ACM members, currently numbering about 80,000. The articles are intended for readers with backgrounds in all areas of computer science and information...
, Vol. 36, No. 11 (November 1993).