Hundreds of crew members will be out of work after losing access to a £32m market, ministers are warned.