Always plan on extra time when departing from Whittier. The town is only accessible thru a tunnel. The tunnel is only open for traffic in one direction at a time, so you might have a wait. Take it from personal experience, the ferry people are very strict about reporting times, so you need to check carefully and plan accordingly.
Any other questions for your trip feel free to private message me. I'll help if I can.