Going home is when you say go home in a place that is not your home.
Come on, let's go.
So go home = hurry back (to our house), go home = hurry back (to your house).