David E. MoriartySANE
Home * People * David E. Moriarty
David Eric Moriarty,
an American computer scientist an Ph.D. alumni from University of Texas at Austin [1]. During the 90s, along with his advisor, Risto Miikkulainen, David E. Moriarty worked on reinforcement learning by Symbiotic, Adaptive NeuroEvolution dubbed SANE, also topic of his Ph.D. thesis [2].
SANE
SANE ( Symbiotic, Adaptive NeuroEvolution) evolves neural networks with genetic algorithms for sequential decision tasks, also applied to the games of Othello and Go. SANE selects a population of hidden neurons of a “vanilla” three-layer feed-forward neural network with the connections and weights in both directions, performing following basic steps in one generation [3]:
For Go and Othello, the input layer sees the board configuration, while the output layer indicates the goodness of each possible move by an output neuron associated with each space or point of the board. However the research was conducted a few years before the MCTS revolution appeared in computer Go, not to mention the deep learning breakthrough. In the alpha-beta search of the Othello experiment, the neural network orders the moves, and further controls whether moves are pruned forward [4].
Selected Publications
- David E. Moriarty, Risto Miikkulainen (1994). Improving Game-Tree Search with Evolutionary Neural Networks. ICEC 1994
- David E. Moriarty, Risto Miikkulainen (1994). Evolving Neural Networks to focus Minimax Search. AAAI-94 » Othello
- David E. Moriarty, Risto Miikkulainen (1995). Discovering Complex Othello Strategies Through Evolutionary Neural Networks. Connection Science, Vol. 7
- David E. Moriarty, Risto Miikkulainen (1996). Efficient Reinforcement Learning through Symbiotic Evolution. Machine Learning, Vol. 22 [6]
- David E. Moriarty (1997). Symbiotic Evolution of Neural Networks in Sequential Decision Tasks. Ph.D. thesis, University of Texas at Austin, advisor Risto Miikkulainen
- Norman Richards, David E. Moriarty, Risto Miikkulainen (1998). Evolving Neural Networks to Play Go. Applied Intelligence, Vol. 8, No. 1
External Links
- NNRG People - David E. Moriarty
- AI-Lab People - David E. Moriarty
- David Moriarty - The Mathematics Genealogy Project
References
- ↑ NNRG People - David E. Moriarty
- ↑ David E. Moriarty (1997). Symbiotic Evolution of Neural Networks in Sequential Decision Tasks. Ph.D. thesis, University of Texas at Austin, advisor Risto Miikkulainen
- ↑ David E. Moriarty, Risto Miikkulainen (1996). Efficient Reinforcement Learning through Symbiotic Evolution. Machine Learning, Vol. 22
- ↑ David E. Moriarty, Risto Miikkulainen (1994). Evolving Neural Networks to focus Minimax Search. AAAI-94
- ↑ dblp: David E. Moriarty
- ↑ Inverted pendulum from Wikipedia