There's also just a whole bunch of other stuff, like the fact that Dirk couldn't see what was happening in the Candy universe at all. He had no idea about what was going in there until very recently and he knows about Yiffy, and a piece of that universe that is full of nothing but chaos and disorder just breached containment and is COMING STRAIGHT FOR HIM.