Walls protect your castle from rushes with foot soldiers and mounted units. They are built and upgraded instantly, but a free worker is needed. They can be converted into a gate, if a road ends on either side.
Protects inside of castle.
None but often a main target for attack.
Place walls around your castle, specifically near important buildings.