The exclamation mark appears to have derived from the Lation "io" - written in a conventionalised way with the "i" over the very much reduced "o". Hence, in that sense, it does not incorporate a full stop. Though, as we all know, conventional typography does treat it as a sentence terminating...