A value function represents the agent's prediction of future rewards. There are two types of value function: state-value function and action-value function.