His fixation on improper language would go hand in hand with his own improper obsession with private pleasure. Where he should love all humankind and appreciate nature as God’s creation, the Lover thinks only of his rose. In other words his problem is that he is not a philosopher.
