The imperial family still resides in the palace , so the general public is admitted to the grounds on only two days each on 2 January and 23 December .
The public is only allowed to visit the grounds of the Imperial Palace on two days .