I'm sure that there's a lot that happens that we don't see, which will account for the fact that sometimes the decisions made seem a bit strange or unfair.
But according to Lord Sugar's autobiography he doesn't see any of the footage before deciding who to fire. He relies on what Karen and Nick tell him, plus the holes the candidates dig themselves into the boardroom...