Skip to main navigation Skip to search Skip to main content

Neural ODE and SDE Models for Adaptation and Planning in Model-Based Reinforcement Learning

  • Chao Han
  • , Stefanos Ioannou
  • , Luca Manneschi
  • , T. J. Hayward
  • , Michael Mangan
  • , Aditya Gilra
  • , Eleni Vasilaki

Publication: Scientific journal › Journal article › peer-review

Abstract

We investigate neural ordinary and stochastic differential equations (neural ODEs and SDEs) to model stochastic dynamics in fully and partially observed environments within a modelbased reinforcement learning (RL) framework. Through a sequence of simulations, we show that neural SDEs more effectively capture transition dynamics’ inherent stochasticity, enabling high-performing policies with improved sample efficiency in challenging scenarios. We leverage neural ODEs and SDEs for efficient policy adaptation to changes in environment dynamics via inverse models, requiring only limited interactions with the new environment. To address partial observability, we introduce a latent SDE model that combines an ODE and a GAN-trained stochastic component in latent space. Policies derived from this model offer a strong baseline, outperforming or matching general model-based and model-free approaches across stochastic continuous-control benchmarks. This work illustrates the applicability of action-conditional latent SDEs for RL planning in environments with stochastic transitions. Our code is available at: https://github.com/ChaoHan-UoS/NeuralRL.

Original languageEnglish
JournalTransactions on Machine Learning Research
Volume2025
Issue number10
Publication statusPublished - 2025
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2025, Transactions on Machine Learning Research. All rights reserved.

Cite this