But these unconventional stones have been placed in prominent places so people can see them.

So prevailing theory is, these stones (many are upside down) were to show that the castle lord and the local people were working together since only the local people could obtain these gravestones, etc. Gravestones and stone Buddhas also contain ancestral spirits so embedding them in the castle walls give more power to the castle.