"Oratory" generally has a very specific meaning within today's English-speaking Christianity, though; I have never heard it used to refer to anything other than a very high-ceremonial Christian house of worship (Brompton Oratory, Oratoire du Louvre, and so on).

If someone used it to refer to a mosque or a shul or an Evangelical Protestant church, I would be very confused.