Early TJs had a rubber boot where the steering shaft goes through the firewall. Spraying some grease into the boot from inside the Jeep fixes it till the next time. Maybe your XJ has the same rubber boot.
My XJ does the same and it is definitely the rubber boot. Usually worse when cold. A quick squirt of silicone grease stopped it completely.