I searched the best I could and did not find an answer to my issue, so here it is:
With the Mage Armor skill, it expires after 'X' hits (depending on skill level).
I also noticed it expires when changing areas, such as entering a dungeon.
I also have seen it expire after being up for a while...