The items were on loan from St Mary Magdalene Church and Richmond Charities at the time.
They include rare silver pieces dating back to the reigns of Charles the Second and William the Third.
The museum says it is working with police, reviewing security, and urging anyone with information to come forward.
