It was Sanji who failed to protect Vegapunk from Kizaru, being easily kicked to the side as an afterthought, the same would have happened to Zoro. During Egghead, we saw a Kizaru that was clearly holding back and still managed to outlast G5 Luffy the 1st time, and complete his mission. It was even suggested by Oda that it was Kizaru who gave Luffy food.
Neither Sanji nor Zoro are anywhere near the Admirals in power. It's crazy how, even after seeing Kuzan's training with Garp and Kizaru's performance in Egghead. people still look down on the OG trio of Admirals.