Can't tell you how many times I've spent 2 hours on a setup to mill one feature or surface, that took a total of 15 minutes actual machining time.
A lot of times with milling setups, you have to think "outside the box".
If you have to pull the vise off the table and mount an angle plate, add 20-30 minutes.
Need to mount a dividing head? Add 20-30 minutes.
Need to swing the mill head off vertical to drill a hole on a compound angle? 45 minutes minimum. As, once finished, you have to return the head to vertical and tram it back in.