The killer knew the words and phrases that John and Patsy used. And hence, he incorporated them into the ransom note to point the finger at them, more likely Patsy.

I believe the words and phrases grated on his nerves. Every time he heard Patsy tell John to use that "good southern common sense" or "and hence" he must have been about to blow a gasket.