Culture Club - Time (Clock of the Heart) Lyrics Meaning

I think it's a song of what could have been from something that never was. Lovers meet and what was something superficial actually became or could have become something more, but time and circumstance could or won't allow it. Hence in time we could of been so much more...cos we both have get back to our other lives...