  Recent advances in neuroscience and psychology show that the brain has access
to timelines of both the past and the future. Spiking across populations of
neurons in many regions of the mammalian brain maintains a robust temporal
memory, a neural timeline of the recent past. Behavioral results demonstrate
that people can estimate an extended temporal model of the future, suggesting
that the neural timeline of the past could extend through the present into the
future. This paper presents a mathematical framework for learning and
expressing relationships between events in continuous time. We assume that the
brain has access to a temporal memory in the form of the real Laplace transform
of the recent past. Hebbian associations with a diversity of synaptic time
scales are formed between the past and the present that record the temporal
relationships between events. Knowing the temporal relationships between the
past and the present allows one to predict relationships between the present
and the future, thus constructing an extended temporal prediction for the
future. Both memory for the past and the predicted future are represented as
the real Laplace transform, expressed as the firing rate over populations of
neurons indexed by different rate constants $s$. The diversity of synaptic
timescales allows for a temporal record over the much larger time scale of
trial history. In this framework, temporal credit assignment can be assessed
via a Laplace temporal difference. The Laplace temporal difference compares the
future that actually follows a stimulus to the future predicted just before the
stimulus was observed. This computational framework makes a number of specific
neurophysiological predictions and, taken together, could provide the basis for
a future iteration of RL that incorporates temporal memory as a fundamental
building block.
