Angry cause akainu made Krusty kremes

Likely both. He was likely more worried through the beginning of the war when Luffy came and joined in. But when he rescued Ace, he likely felt more relieved since Ace didn't have to die (which ended with him dying).

I think he was rather just really disappointed by the whole World.