unilab.algos.torch.common.base_collector.BaseCollector

class unilab.algos.torch.common.base_collector.BaseCollector[source]

Bases: object

Base class for collectors with common weight sync and episode tracking.

Parameters:

  • env_name (str)

  • num_envs (int)

  • weight_sync_name (str)

  • weight_param_shapes (dict)

Methods

__init__(env_name, num_envs, ...)

sync_weights_if_needed()

Check and sync weights if updated.

track_episode(rewards, dones[, state])

Track episode statistics.
__init__(env_name, num_envs, weight_sync_name, weight_sync_lock, weight_param_shapes, metrics_queue, stop_event)[source]
Parameters:

  • env_name (str)

  • num_envs (int)

  • weight_sync_name (str)

  • weight_param_shapes (dict)

sync_weights_if_needed()[source]

Check and sync weights if updated.

track_episode(rewards, dones, state=None)[source]

Track episode statistics.