Castles often are, but need not be a military structure. They can serve for status, pleasure and hunt as well.
