Yes... you can keep the Crown and wear it as much as you like.... the curse comes with it, of course. If you skyrocket your Death Resistance (~180 or so), you'll be able to wear the Crown without any real issue but to get that high of a Death Resistance, you're rather limited in your equipment and skill options. But, it's doable.
There was a previous bug where it was possible to break the Curse, but it was a bug and fixed. If someone finds another way to break the Curse, so to speak, please report the bug for fixing.