I’ve recently had the chance to attend a talk by the director of the Centre for Theoretical Neuroscience at the University of Waterloo. I did not hesitate to see the talk as I am taking a class that is offered by one of their members, SYDE 556, Simulating Neural Networks.
Here is a page of some of the cool stuff they have been able to develop so far. Their system uses a 2.5 million neuron system, and impressively, able to do some complex tasks. In that class we learnt how to replicate the program; starting from creating a single neuron, to grouping them together and having it encode and decode various functions.