The Bible teaches separation from false teachings, false brethren, brethren in sin, etc. - so I believe Erasmus was wrong in staying in an apostate church, no matter how much he may have tried to justify it.