AGI Paper Reference

Get Started. It's Free
or sign up with your email address
Rocket clouds
References by Mind Map: References

1. Models

1.1. Why Neurons have Thousands of Synapses, A Theory of Sequence Memory in Neocortex

1.1.1. Fig 1

1.1.2. Fig 3

1.2. A Neurally-Inspired Hierarchical Prediction Network for Spatiotemporal Sequence Learning and Prediction

1.2.1. Fig 1

1.2.2. Fig 3

1.3. Learning higher-order sequential structure with cloned HMMs

1.3.1. Fig 1. f

1.3.2. Fig 1. g

1.4. A cortical sparse distributed coding model linking mini- and macrocolumn-scale functionality

1.4.1. Summary I found his paper while searching for the sparse coding implementation. His work claimed 91% performance on MNIST and 67% on Weizmann event. While this result is weaker than the state of the art result, the following aspects was interesting. First, Sparsey model uses sparse distributed representation(SDR) rather than dense representation. Second, Sparsey model does not use any of optimization including gradient back propagation. It can do one-shot learning meaning that only one example is required for learning. These two attributes are what I was considering meaningful. Only comparable models is HTM by Numenta. However, HTM does not have performance evaluation except synthetic toy dataset. The main algorithm transforms binary inputs into sparse distributed representation. The key insight is that the algorithm uses the familarity or novelty measure to control randomness of the resulting code. If the input pattern is very similar to previous pattern, it will return almost same code and vice versa. The author calls it SISC (similar inputs map to similar codes).

1.4.2. Good’ There were many neuroscience reference which will be useful for my future research. Cells in the Minicolumn possesses similar receptive field characteristic or tuning.

1.4.3. Bad One big question for me is that if we define SISC as the binary bit overlap, the incoming input already possess the SISC property. Right that the algorithm creates more sparse version of the binary input. But It seems to be all. Is the simplication the core process? In my opinion, the prediction is the main task that a brain is conducting. After several hierarchy, the mnist digits might be separated to constant representation, but it does not tells about how the motion should be generated.

1.4.4. Implication

2. Environment

2.1. Developmental Psychology

2.1.1. Is speech learning 'gated' by the social brain? Patricia Kuhl Fig 1 Fig 2

2.2. Developmental Robotics

2.2.1. Autonomous Mental Development by Robots and Animals Juyang Weng Spoon-fed human edited sensory data figures 1 2

2.2.2. Developmental Robotics: From babies to robots Angelo Cangelosi and Mattew Schlesinger Maturation symptoms critical period motor development Intrinsic motivation figures 1 Milestones and tests Scan pattern Visual Expectation Paradigm Predictive tracking task self-perception Visual Stimuli Test Face recognition test by Maue Visual cliff test Two-location appartus test Unity Perception test Affordance test

2.3. AGI

2.3.1. Mapping the Landscape of Human-level Artificial General Intelligence Fig 1. Characteristics for AGI Environments, Tasks, and Agents Characterizing Human Cognitive Development Gardener's theory of multiple intelligence Piaget's theory Vygotsky's theory Figure 6. Scenario Milestones on the AGI Landscape General Video-Game Learning Preschool Learning Reading Comprehension Story or Scene Comprehension School Learning The Wozniak Test Review summary

2.3.2. Computing Machinery and Intelligence Imitation game: Turing test Instead of trying to produce a programme to simulate the adult mind, why not rather try to produce one which simulates the child's? Computational evolution

2.3.3. AGI Preschool: A Framework for Evaluating Early-Stage Human-like AGIs

2.4. Robotics

2.4.1. Env from Cynthia Matuszek Virtual Reality and photogrammetry for Improved Reproducibility of Human-Robot Interaction Studies Fig 1 Learning from Human-Robot Interactions in Modeled Scenes Fig Summary What is the problem to solve? Why this is important? What was previous approaches? How this work is different? What is good? What can be improved? Relevance to my research?