With Jess using the term semi-husband, there is Scot's word that would be a suitable replacement: Bidie-in - which is a non-married long term cohabitating partner. Not sure if any other fellow Scots have mentioned it before.
sporadic_m's comments