In 1619, following the collapse of Mugishima Castle due to a massive earthquake, Kato Kiyomasa constructed Yatsushiro Castle as its successor. At that time, the castle's main compound featured a  five-story, four-level main keep, a smaller two-story, two-level minor keep, and seven turret buildings, among others. Limestone was used for the stone walls encompassing the entire castle. In 1632, Hosokawa Tadaoki took over, and from 1646, when Matsui Okinaga took residence, the Matsui family governed until the castle was decommissioned in 1870. A lightning strike in 1672 caused the main keep to burn down. Today, the castle site has been preserved as a public park, with remnants of the main compound's stone walls and moat still visible. It is also a popular spot for its cherry blossoms.