Thanks for your question.
You are right; any kind of oil can seriously deteriorate latex or polyisoprene condoms, which will lead to condom breakage.
Water-based or silicone based lubes are the only lubes recommended for these types of condoms. Condoms made of nitrile or polyurethane will not deteriorate with oils but oils can increase the risk of bacterial and yeast growth so even with these condoms it is best to avoid them.
Please leave a comment to let us know if this answers your question or if you need more information.
For other readers, please feel free to leave a comment, or let us know if this was helpful.