Interface Documentation
This page describes the finite horizon interface. In order to fully define one the user has to also use methods from POMDPs.jl interface defined here.
Docstrings for FiniteHorizonPOMDPs.jl interface members can be accessed through Julia's built-in documentation system or in the list below.
Contents
Index
FiniteHorizonPOMDPs.FiniteHorizonFiniteHorizonPOMDPs.HorizonLengthFiniteHorizonPOMDPs.InfiniteHorizonFiniteHorizonPOMDPs.fixhorizonFiniteHorizonPOMDPs.horizonFiniteHorizonPOMDPs.stageFiniteHorizonPOMDPs.stage_stateindexFiniteHorizonPOMDPs.stage_states
Types
FiniteHorizonPOMDPs.FiniteHorizon — TypeIf HorizonLength(m::Union{MDP,POMDP}) == FiniteHorizon(), horizon(m) should be implemented and return an integer
FiniteHorizonPOMDPs.HorizonLength — TypeHorizonLength(::Type{<:Union{MDP,POMDP})
HorizonLength(::Union{MDP,POMDP})Check whether MDP is Finite or Infinite Horizon and return corresponding struct (FiniteHorizon or InfiniteHorizon).
FiniteHorizonPOMDPs.InfiniteHorizon — TypeHorizonLength(m::Union{MDP,POMDP}) == InfiniteHorizon() indicates that horizon(m) should not be called.
Model Functions
FiniteHorizonPOMDPs.horizon — FunctionReturn the number of steps that will be taken in the (PO)MDP, given it is Finite Horizon.
A simulation of a (PO)MDP with horizon(m) == d should contain d+1 states and d actions and rewards.
FiniteHorizonPOMDPs.fixhorizon — Functionfixhorizon(m::Union{MDP,POMDP}, horizon::Int)Wrap infinite horizon (PO)MDP m and horizon to the new structure creating Finite Horizon (PO)MDP.
FiniteHorizonPOMDPs.stage — Functionstage(m::Union{MDP,POMDP}, ss)::Int
stage(m::Union{MDP,POMDP}, o)::Int
stage(d)::IntConsidering a variable or distribution containing its stage assignment, return the number of its stage.
FiniteHorizonPOMDPs.stage_stateindex — Functionstage_stateindex(m::Union{MDP,POMDP}, ss}::IntCompute the index of the given state in the corresponding stage.
FiniteHorizonPOMDPs.stage_states — Functionstage_states(m::Union{MDP,POMDP}, stage::Int)Create (PO)MDP's states for given stage.