ci: Skip installing SWIG/xz on OSX #63106

bors merged 1 commit intorust-lang:masterrust-lang/rust:masterfrom

alexcrichton:remove-swig-osxalexcrichton/rust:remove-swig-osxCopy head branch name to clipboard