He handed it to the one who was to lead it [to Azazel].  Anyone is fit to lead it, but the Kohanim Gedolim established a rule, and did not permit a Yisrael to lead it.  R' Yose said: It once happened that Arsela led it, and he was a Yisrael.