unilab.ipc.async_runner

Base async runner for multi-process RL training.

Classes

AsyncRunner

Base class for async RL algorithms.
class unilab.ipc.async_runner.AsyncRunner[source]

Bases: ABC

Base class for async RL algorithms.

Manages: - Shared memory allocation/cleanup - Collector process lifecycle - Error propagation from collector subprocess - Training loop skeleton

Parameters:
__init__(env_name, env_cfg_overrides, rl_cfg, *, device=None, collector_device=None, sim_backend='mujoco', num_envs=4096)[source]
Parameters:
abstract learn(max_iterations, save_interval=50, log_dir='logs')[source]
Parameters:

  • max_iterations (int)

  • save_interval (int)

  • log_dir (str)

Return type:

None

close()[source]
Return type:

None