We maintain a list of user annotations (see In v0.12 what's the right for "user annotation" use case? ) along with the document.
When the annotation is removed while typing, we don’t just drop it entirely but we keep it as “resolved”.
Any mean to know which decoration is removed would be ok : a callback or a MapResult object.