I’ve no better answer than “It just isn’t done.” Native English speakers at the very least would not interpret that as indicating the letter, they would interpret it as someone stuttering or what they’re trying to say is stuck on the tip of their tongue.