These are the parameters that were used by the authors:

1. n = 30 (number of items)

2. T = 200 (number of steps)

3. D = 5 (delay between steps (seconds))

4. For EFL (exponential forgetting curve) sample item difficulty ($\theta$) is from the distribution: $log\theta \sim N log(0.077, 1)$

5. For HLR (Half-Life Regression) : $\overrightarrow {\rm \theta} = (1, 1, 0, \theta_3 \sim N (0, 1))$ $\overrightarrow {\rm x_i} =$ (num attempts, num correct, num incorrect, one-hot encoding of item i out of n items).

6. For GPL (Generalized Power-Law) $a = \overrightarrow{\rm \alpha} = 0; d \sim N(1, 1);$ $\log \overrightarrow {\rm d} \sim N(0,1 ), \log r \sim N (0, 0.01); W = 5;$ $\theta_{2w} = \theta_{2w - 1} = \frac {1}{\sqrt W - w + 1}$

7. For TRPO batch size is 4000, $\gamma = 0.99$; step_size = 0.01

8. For Recurrent Network Policy number of hidden layers is 32