On a conjecture by Hayashi on finite connected quandles