Around 100 firefighters from 15 engines, including crews from North Kensington, Acton and Chiswick tackled the blaze.
Three men were rescued from the single-storey pavilion, but two were pronounced dead at the scene and a third later died in hospital.
The cause of the fire is being investigated by specialist fire investigation officers and the Metropolitan Police.
