I see "just sayin'" as weasel words. Probably because it was a comedy staple of the 80s and 90s to point out that people used the phrase to distance themselves from an insult. It acts in place of "don't shoot the messenger," but asks that you ignore that they're also the author of the message.