Throughout the closures buses will operate instead of trains.
During the line closure, 800 yards of track will be laid on the Black Potts Railway Bridge, which runs over the River Thames.
Network Rail said this included removing old rails and sleepers from the site and installing new track.