I have done some experimenting with 410 and 00buck, in a Contender 14" barrel. I handloaded 5-00buck in a 3" shell. It patterned 6" at 10 yds. and penetrated a 2x, and 1/2 of a 1x lumber out of the short barrel. In a longer shotgun barrel i'm sure more velocity and penetration would be achieved. But the pattern would be the critical part with only 5 pellets, as Crapshoot mentioned. The 00 buck pellet out of a standard shotgun would develope about 110-120 ft/lbs of energy. I would suspect you would need 3 in the vital zone for a clean kill. One would have to pattern a particular shotgun barrel. But I also would take a guess, 15 yds would be pushing the range issue. Personally I think the 410 would might work, on a yote that wasn't moving any faster than a slow trot. But keeping in mind a 6" pattern/range would be about max. I don't know that I would buy a gun for this specific purpose though.
But your question does get me too thinking, on a custom 16 1/4" 20 ga. Encore in the pistol mode /ubbthreads/images/graemlins/wink.gif
Dave