Skip to main content

Thank you for visiting You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

There is no mouse: using a virtual mouse to generate training data for video-based pose estimation

Access options

Rent or Buy article

Get time limited or full article access on ReadCube.


All prices are NET prices.

Fig. 1: Virtual mouse workflow.


  1. 1.

    LeCun, Y., Bengio, Y. & Hinton, G. Nature 521, 436–444 (2015).

    CAS  Article  Google Scholar 

  2. 2.

    Zaccone, G. & Karim, M. R. Deep Learning with TensorFlow: Explore neural networks and build intelligent systems with Python, 2nd Edition. (Packt Publishing Ltd, 2018).

  3. 3.

    Salimans, T. et al. arXiv 1606.03498 (2016).

  4. 4.

    Mathis, A. et al. Nat. Neurosci. 21, 1281 (2018).

    CAS  Article  Google Scholar 

  5. 5.

    Pereira, T. D. et al. Nat. Methods s16, 117–125 (2019).

    Article  Google Scholar 

  6. 6.

    Graving, J. M. et al. eLife 8, e47994 (2019).

    CAS  Article  Google Scholar 

  7. 7.

    Wu, A. et al. bioRxiv 259705 (2020).

  8. 8.

    Musall, S., Urai, A. E., Sussillo, D. & Churchland, A. K. Curr. Opin. Neurobiol. 58, 229–238 (2019).

    CAS  Article  Google Scholar 

  9. 9.

    Bolaños, L. A. et al. Nat. Methods 18, 378–381 (2021).

    Article  Google Scholar 

  10. 10.

    Tobin, J. et al. in 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 23–30 (2017).

  11. 11.

    The International Brain Laboratory et al. eLife 63711, (2021).

  12. 12.

    The International Brain Laboratory. 3D View Behavioral Training Rig. Figshare (2020).

  13. 13.

    Community, B. O. Blender - a 3D modelling and rendering package. (2018).

  14. 14.

    Bińkowski, M., Sutherland, D. J., Arbel, M. & Gretton, A. arXiv, 1801.01401 (2021).

  15. 15.

    Barratt, S. & Sharma, R. arXiv, 1801.01973 (2018).

  16. 16.

    de Vries, S. E. J. et al. Nat. Neurosci. 23, 138–151 (2020).

    Article  Google Scholar 

  17. 17.

    Siegle, J. H. et al. Nature 592, 86–92 (2021).

    CAS  PubMed  Google Scholar 

Download references


We thank Liam Paninski and Matthew Whiteway for comments on the manuscript. AEU is supported by the German National Academy of Sciences Leopoldina and the International Brain Research Organization.

Author information



Corresponding author

Correspondence to Anne E. Urai.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Meijer, G.T., Arlandis, J. & Urai, A.E. There is no mouse: using a virtual mouse to generate training data for video-based pose estimation. Lab Anim 50, 172–173 (2021).

Download citation


Quick links