Skip to content

DQNState ​

python
DQNState(learner_model_state_dict: dict[str, Any], target_model_state_dict: dict[str, Any], optimizer_state_dict: dict[str, Any], steps: int, learner_iterations: int, target_updates: int, total_time: float, episode_totals: AgentEpisodeTotalsState = AgentEpisodeTotalsState(), total_skipped_updates: int = 0, total_rollbacks: int = 0, tester_episode_totals: AgentEpisodeTotalsState = AgentEpisodeTotalsState(), trajectory_state_dict: dict[str, Any] | None = None) -> None

Dataclass for storing the complete state of a DQN experiment.

Source

Values ​

episode_totals ​

python
episode_totals: AgentEpisodeTotalsState = field(default_factory=AgentEpisodeTotalsState)

Source

learner_iterations ​

python
learner_iterations: int

Source

learner_model_state_dict ​

python
learner_model_state_dict: dict[str, Any]

Source

optimizer_state_dict ​

python
optimizer_state_dict: dict[str, Any]

Source

steps ​

python
steps: int

Source

target_model_state_dict ​

python
target_model_state_dict: dict[str, Any]

Source

target_updates ​

python
target_updates: int

Source

tester_episode_totals ​

python
tester_episode_totals: AgentEpisodeTotalsState = field(default_factory=AgentEpisodeTotalsState)

Source

total_rollbacks ​

python
total_rollbacks: int = 0

Source

total_skipped_updates ​

python
total_skipped_updates: int = 0

Source

total_time ​

python
total_time: float

Source

trajectory_state_dict ​

python
trajectory_state_dict: dict[str, Any] | None = None

Source