Language Language English 简体中文

unilab.algos.torch.rsl_rl_ppo

Classes

FinalObservationAwarePPO

PPO variant that bootstraps time limits from env final_observation.

class unilab.algos.torch.rsl_rl_ppo.FinalObservationAwarePPO

Bases: PPO

PPO variant that bootstraps time limits from env final_observation.

Parameters:

• args (Any)

• enable_compile (bool)

• kwargs (Any)

learning_rate: float

__init__(*args, enable_compile=False, **kwargs)

Parameters:

• args (Any)

• enable_compile (bool)

• kwargs (Any)

update()

Return type:

dict[str, float]

process_env_step(obs, rewards, dones, extras)

Parameters:

• obs (TensorDict)

• rewards (Tensor)

• dones (Tensor)

• extras (dict[str, Tensor | TensorDict])

Return type:

None