I can only attend weekends also and find that Saturdays are pretty hectic but with the express pass you should be good to go....opening weekend and the last two weekends I think they say are the heaviest.
Edit to say....yes, it is very much worth it!