Consider the following scenario.
In a SharePoint Online library, you add the Shared With column to the view for the library.
You share a document with a user or group, and the user or group is then displayed in the Shared With column.
You remove the permissions for the user or group with whom you previously shared the document. However, the user or group is still displayed in the Shared With column.
This behavior is by design. The Shared With column displays any accounts that the document was previously shared with.
Still need help? Go to Microsoft Community.