2D5334, Tidiga modeller och historik inom neuronnätsområdet, 2-3 poäng
The purpose of this course is to cover key ideas and models that have
been central in inspiring and forming the field of neural network
research. In principle, only material older than from the mid 1980ies
is included. Naturally, an overview of this kind will never be
complete. Here, the aim is to convey an insight into the background of
contemporary concepts and to give an understanding of the process leading
up to present algorithms and models.
It should be pointed out that this is not an introductory course; a
level of familiarity with basic concepts and general methods at a
level at least comparable to that given by e.g. course
2D1430 is required. It should also be
noted that an active participation is necessary. Students are for
example encouraged to search for additional material and extend the list
of suggested references.
Each student is responsible for one of the weekly two-hour
lectures. This includes the collection and distribution of relevant
material at least one week in advance as well as a presentation
lasting between one hour and one hour and a half. Again, please note
that the listed material is to be regarded only as a suggestion. The
person responsible is strongly encouraged to add related material at
discretion. Each student is also expected to serve at one occasion as
"critic", i.e. to present prepared criticism and comments on the
subject at hand and to start the following half-hour to one hour
discussion. Attendance at at least nine occations is also required to
earn the two credit points. Due to practical considerations, multiple
presentations may be required in certain cases. This is then
compensated for with an extra credit point, giving in total three
points for the course in these cases.
The material below can be found in either of
- Anderson & Rosenfeld: "Neurocomputing"
- Anderson, Pellionisz and Rosenfeld: "Neurocomputing 2"
- Shaw & Palm: "Brain Theory".
- Turing: "On Computable numbers..."
McCulloch & Pitts: "A Logical Calculus of the Ideas..."
von Neumann: "Probabilistic Logic..." & "The Computer and..."
- Lashley: "In Search of the Engram"
Marr: "A Theory of Cerebellar..." & "Vision"
Hebb: "The Organization of Behavior"
Barlow: "Single Units and Sensation..."
- Rosenblatt: "The Perceptron" & "A Comparison of Several..."
Block: "The Perceptron"
Minsky & Papert: "Perceptrons"
Kanerva: "Sparse Distributed Memory"
- Widrow & Hoff: "Adaptive Switching Circuits"
Rumelhart et al.: "Learning Representations by Back-Propagating..."
- Barto & Sutton: "Associative search network..."
(Also reinforcement in general)
- Uttley: "Properties of Plastic Networks"
Steinbuch & Schmitt: "Adaptive systems using learning matrices"
Rochester et al.: "Tests on a Cell Assembly Theory..."
Farley & Clark: "Activity in Networks of Neuron-Like Elements"
- MacKay & McCulloch: "The Limiting Information Capacity of a Neuronal..."
Eckhorn et al.: "Efficiency of Different Neuronal Codes..."
Barlow: "The Information Capacity..."
- Anderson: "A Memory Storage Model..."
Kohonen: "Associative Recall of Images"
Amari: "Neural theory of association and concept..."
Anderson et al.: "Distinctive features, categorical perception..."
Willshaw et al.: "Non-Holographic Associative Memory"
- Hopfield: "Neural Networks an Physical..."
(Discrete & continuous)
Cragg & Temperly: "The Organization of Neurones"
Little: "The Existence of Persistent states..."
- Ackley et al.: "A learning algorithm for Boltzmann machines"
Kirkpatrick et al.: "Optimization by simulated annealing"
- Grossberg: Various ART models.
Kohonen: "Self-Organized formation of topologically..."
Willshaw et al.: "How patterned neural connections can be..."
Nass & Cooper: "A Theory for the Development of Feature..."
Fukushima et al.: "Neocognitron: a neural network model for..."
- Edelman: "Group selection As the Basis for Higher Brain..."
Freeman: "A Physiological Hypothesis of Perception"
Crick: "Do Dendritic Spines twitch?"
Marr: "A Theory of Cerebellar Cortex of the Frog"
Aktuell/nästa kursomgång: period 1-2 96/97
Kursledare: Anders Lansner
Kontakta kursledaren om du vill ha mer information om kursen.
Upp till kursöversikt.
Senast ändrad 1996-04-04