Grayling faces calls to quit after Brexit ferry contracts cancelled