Royal Parks Police says the women have been targeted while using roads that are closed off to motorists.
The officers say the cyclists wrongly believe they are not allowed to be there, even though some drivers, like volunteers, have permits.
Posting on X, police said the “unacceptable behaviour” like banging on windows, has caused “upset, anxiety and fear”.