Night Owl Speak

What's the difference in using these phrases?

"up until all hours of the night"

"up until the wee hours of the night"

I would think they would be interchangeable, however, it's a moot point since hardly anyone talks that way in real life!