Online Learning #49
Description
Currently, in the critic-based method, we are always using multiple rollouts to update. We can possibly make the buffer size smaller than the horizon length to update online, but this would be at the sacrifice of the train speed.