Yeah, I figure it's a pretty remote possibility that anyone could figure it out. But you can find the address w/o knowing my call sign. If you search for my last name in the ULS you will find my call sign and my address.
I am the only person w/ my last name who has an FCC license. I am also the only person w/ that last name on this side of the Missippi River. There are very few of us Roussils out there due to the fact that we are bad at farming and most of us got wiped out one winter in Quebec. Seriously.