Its very difficult for me to assertain the situation with out looking and probing.
Sounds like the latex is not adhering to the oil due to a grease film, dirt, and definately lack of a good primer.
Remember Oil paint has roots, latex paint does not have roots. So latex should go on nicely to oil, if it has been preped properly.
I am going to generally assign your problem to lack of proper prep work.
© 2017 Renovate Your World LLC