The council wants to upgrade the area near the Ancient Market Place to make it more accessible.
Visitors and residents have also raised concerns in the past about anti-social behaviour and littering in the grounds.
A public information session to allow people to see the designs is taking place at the site from 11 until 2pm.