everything.study
9.641

Introduction to Neural Networks

Graduate · Historical course

Spring 2005

Topics

  • From Spikes to Rates
  • Perceptrons: Simple and Multilayer
  • Perceptrons as Models of Vision
  • Linear Networks
  • Retina
  • Lateral Inhibition and Feature Selectivity
  • Objectives and Optimization
  • Hybrid Analog-Digital Computation
  • Constraint Satisfaction
  • Bidirectional Perception
  • Signal Reconstruction
  • Hamiltonian Dynamics
  • Antisymmetric Networks
  • Excitatory-Inhibitory Networks
  • Associative Memory
  • Models of Delay Activity
  • Multistability
  • VQ
  • More PCA
  • Conditioning
  • More Backpropagation
  • Stochastic Gradient Descent
  • Reinforcement Learning
  • More Reinforcement Learning
  • Final Review

Readings

  • Lec #: 1 · Topics: From Spikes to Rates · READINGS: Koch, Christof. Biophysics of Computation: Information Processing in Single Neurons. New York, NY: Oxford University Press, 2004, section 14.2, pp. 335-341. ISBN: 9780195181999.
    Reading assignment
  • Ermentrout, Bard. “Reduction of Conductance-Based Models with Slow Synapses to Neural Nets.” Neural Computation 6, no. 4 (July 1994): 679-695.
    Listed reading
  • Lec #: 3 · Topics: Perceptrons as Models of Vision · READINGS: Marr, David. Vision: A Computational Investigation into the Human Representation and Processing of Visual Information. New York, NY: W.H. Freeman & Company, 1983, section 2.2, pp. 54-79. ISBN: 9780716715672.
    Reading assignment
  • Hubel, David H. Eye, Brain, and Vision . New York, NY: W.H. Freeman & Company, 1988, chapter 3, pp. 39-46. ISBN: 9780716750208.
    Listed reading
  • Lec #: 5 · Topics: Retina · READINGS: Adelson, E. H. “Lightness Perception and Lightness Illusions.” The New Cognitive Neurosciences . Edited by Michael S. Gazzaniga. 2nd ed. Cambridge, MA: MIT Press, 1999, pp. 339-351. ISBN: 9780262071956. ↗
    Reading assignment
  • Hartline, H. K., and F. Ratliff. “Inhibitory Interaction in the Retina of Limulus.” Physiology of Photoreceptor Organs. Edited by Michelangelo G. F. Fuortes. New York, NY: Springer-Verlag, 1972, pp. 382-447. ISBN: 9780387057439.
    Listed reading
  • Lec #: 6 · Topics: Lateral Inhibition and Feature Selectivity · READINGS: Press, William H., Saul A. Teukolsky, William T. Vetterling, and Brian P. Flannery. Numerical Recipes in C: The Art of Scientific Computing _._ New York, NY: Cambridge University Press, 1992, chapters 12, and 13. ISBN: 9780521431088.
    Reading assignment
  • Strang, Gilbert. Introduction to Applied Mathematics. Wellesley, MA: Wellesley-Cambridge Press, 1986, section 4.2, pp. 290-309. ISBN: 9780961408800.
    Listed reading
  • Ring Network Hahnloser, R. H., R. Sarpeshkar, M. A. Mahowald, R. J. Douglas, and H. S. Seung. “Digital selection and analog amplification coexist in a cortex-inspired silicon circuit.” Nature 405, no. 6789 (June 22, 2000): 947-51.
    Listed reading
  • Hahnloser, Richard H., H. Sebastian Seung, and Jean-Jacques Slotine. “Permitted and Forbidden Sets in Symmetric Threshold-Linear Networks.” Neural Computation 15, no. 3 (March 2003): 621-38.
    Listed reading
  • Hertz, John, Anders Krogh, and Richard G. Palmer. Introduction to the Theory of Neural Computation . Redwood City, CA: Addison-Wesley Pub. Co., 1991. ISBN: 9780201515602.
    Listed reading
Sources