Some time around ae03039 we regressed and the example code in gym_client.cpp doesn't converge any more. Presumably because of some difference in our observation normalization compared to the OpenAI Baselines one.
I'll look in more detail this weekend and confirm if it's that exact commit causing the problem.
Some time around ae03039 we regressed and the example code in
gym_client.cppdoesn't converge any more. Presumably because of some difference in our observation normalization compared to the OpenAI Baselines one.I'll look in more detail this weekend and confirm if it's that exact commit causing the problem.