He is legally entitled to his privacy. No other person may enter his house without his permission.
Here is an amusing little extract from a speech by John J. Ingalls in the United States Senate on May 10th, 1880:
‘I think some orator said that though the winds of heaven might whistle around an Englishman’s cottage, the King of England could not.’