The only adult males allowed in the Harem were the Black Eunuchs, who were in charge of security and administration.
256047
The Black Eunuchs were responsible for the security and administration of the Harem.
256048
The Black Eunuchs were not allowed in the Harem, only the slaves were.