AHMM, and Rao-Blackwellised sampling methods for policy recognition in these models cn derived.

## Acknowledgement

We would like to thank the anonymous reviewers for their insightful comments which have helped improve both the presentation and the contents of this paper. Many thanks to Nam Nguyen for his implementation of the distributed tracking system used in this paper.

## References

Albrecht, D. W., Zukerman, I., & Nicholson, A. E. (1998).  Bayesian models for keyhole plan recognition in an adventure game. User Modelling and User-adapted Interaction, 8 (1-2), 5-47.

Andrieu, C., & Doucet, A. (2000). Particle filtering for partially observed Gaussian state space models. Tech. rep. CUED-F-INFENG/TR. 393, Signal Processing Group, University of Cambridge, Cambridge, UK.
Bauer, M. (1994). Integrating probabilistic reasoning into plan recognition. In Proceedings of the Eleventh European Conference on Artificial Intelligence.

Boutilier, C., Dearden, R., & Goldszmidt, M. (2000).  Stochastic dynamic programming with factored representations. Artificial Intelligence, 121, 49–107.

Boutilier, C., Friedman, N., Goldszmidt, M., & Koller, D. (1996). Context-specific independence in Bayesian networks. In Proceedings of the Twelveth Annual Conference on Uncertainty in Artificial Intelligence.

Boyen, X., & Koller, D. (1998). Tractable inference for complex stochastic processes. In Proceedings of the Fourteenth Annual Conference on Uncertainty in Artificial Intelli-

gence.
Brand, M. (1997). Coupled hidden Markov models for modeling interacting processes. Tech.

rep. 405, MIT Media Lab.

Bui, H. H., Venkatesh, S., & West, G. (1999). Layered dynamic Bayesian networks for spatio-temporal modelling. Intelligent Data Analysis, 3 (5), 339–361.

Bui, H. H., Venkatesh, S., & West, G. (2000). On the recognition of abstract Markov policies.

In Proceedings of the National Conference on Artificial Intelligence (AAAI-2000), pp. 524-530.

Casella, G., & Robert, C. P. (1996). Rao-Blackwellisation of sampling schemes.  Biometrika, 83, 81-94.

Castillo, E., Gutierrez, J. M., & Hadi, A. S. (1997). Expert systems and probabilistic network models. Springer.

Charniak, E., & Goldman, R. (1993).  A Bayesian model of plan recognition.  Artificial Intelligence, 64, 53–79.

Cohen, P. R., & Levesque, H. J. (1990). Intention is choice with commitment.  Artificial Intelligence, 42, 213-261.