Reinforcement Learning for Scientific Computing
ongoingUniversity of Texas at Austin
Aug. 2026 – Present
Most reinforcement learning needs huge amounts of trial and error, which is a problem when every trial is an expensive physics simulation. The lab built dfPO (NeurIPS 2025), which reframes RL as a continuous-time control problem so a physics prior is built into the learning itself. I'm reproducing it from the paper's code and benchmarking it against 12 standard RL algorithms, like PPO, SAC and TRPO.
- Getting dfPO and 12 Stable-Baselines3 baselines running in Python
- Running benchmarks on 3 scientific tasks: surface modeling, grid-based PDE control and molecular dynamics
- Learning the optimal control and Hamiltonian mechanics math the method is built on









