I’ve experienced similar, if not that pronounced … but then I wasn’t so far away from the POI.
I never got to the bottom of it but, as someone that’s never found a need to recalibrate the compass … I have wondered if this is a possible consequence.
It’s on my long list of things to check/test.