Victory sets up a fifth-round tie with rivals Leeds.
Nottingham Forest needed a shootout to avoid an upset at home to Championship Bristol City.
It ended 1-all after extra time, with Forest winning 5-3 on penalties.
They’ll play 12-time champions Manchester United at the City Ground next.