Probing scalar-mediated sterile neutrinos with gravitational wave and colliders signals