I haven't played this game, but I know we have some folks here who have, and they should be able to fill you in.
What I can tell you is that in casual mode the mini-games are a little easier and that in challenge mode the mini-games can't be skipped.