if you watched jeremy kyle you'd know man. my interpretation is correct.
its used every few sentences. and in public ive noticed people saying it more and more also.
it shouldn't, but it gets to me. mostly when used in abundance.
edit: I just wanted to add, I agree with you about what it SHOULD mean, the way you use it... but I don't think most people use it like that. Like it will be used before stating any point, regardless, not a defining point. I think if you're going to say "the crux of the matter, for me, is..." then the next thing out your mouth should be at least a contender for the "crux of the matter", rather than just another random bit of some argument. does that make more sense?