Recent electrophysiological data show that synaptic weights are highly influenced by electrical activities displayed by neurons. Weights are not stable as assumed in classical neural network models. What is the nature of engrams, if not stored in synaptic weights? Adopting the theory of dynamical systems, which allows an implicit form of memory, we propose a new framework for learning, where synaptic weights are continuously adapted. Evolutionary computation has been applied to a population of dynamic neural networks evolving in a prey-predator environment. Each individual develops complex dynamic patterns of neuronal activity, underlied by multiple recurrent connections. We show that this method allows the emergence of learning capability through generations, as a by-product of evolution, since the behavioural performance of the network is not a priori based on this property.