It is very difficult to get rid of such desires. Women and wealth are very difficult problems for the devotee making progress on the path back to Godhead. Many stalwarts in the devotional line fell victim to these allurements and thus retreated from the path of liberation. But when one is helped by the Lord Himself, the whole process becomes as easy as anything by the divine grace of the Lord.