Reinforcement learning for graph theory, II. Small Ramsey numbers