unilab.algos.torch.common.base_collector

Base collector class for shared functionality.

Classes

BaseCollector

Base class for collectors with common weight sync and episode tracking.
class unilab.algos.torch.common.base_collector.BaseCollector[source]

Bases: object

Base class for collectors with common weight sync and episode tracking.

Parameters:

  • env_name (str)

  • num_envs (int)

  • weight_sync_name (str)

  • weight_param_shapes (dict)

__init__(env_name, num_envs, weight_sync_name, weight_sync_lock, weight_param_shapes, metrics_queue, stop_event)[source]
Parameters:

  • env_name (str)

  • num_envs (int)

  • weight_sync_name (str)

  • weight_param_shapes (dict)

sync_weights_if_needed()[source]

Check and sync weights if updated.

track_episode(rewards, dones, state=None)[source]

Track episode statistics.