It's difficult to control the types of images being shared on your platform so we built this automatic Image Moderation extension to help.
To enable Image Moderation, open your dashboard and explore the application for which you would like to enable this extension. In the extensions tab, enable Image Moderation with a flick of a switch.
CometChat uses machine learning to classify the image into four categories which are explicit nudity, suggestive nudity, violence, or visually disturbing. We put this classification as well as a confidence score exactly where you'd expect - alongside the original message in the form of metadata.