For a fine view over the port , climb up to the 16th-century citadel , built to defend the town on a coast under constant attack from pirates .
Pirates were known to threaten the coastline in the vicinity of the citadel .