All Environments
classic_control medium
non-stationary-cartpole
A CartPole environment with continuously drifting physical parameters (pole length and mass) to test adaptation to non-stationary dynamics. Parameters evolve via configurable schedules (sinusoidal, random walk, or abrupt steps). Observation space optionally includes temporal awareness features (sin/cos of phase) to help the agent anticipate parameter changes.
Observation Space
Box(shape=[6])
Action Space
Discrete(shape=[1])
Reward
dense