The Flagged Messages endpoint in the Moderation Service API enables app owners and collaborators to review messages that have been flagged for potentially violating moderation rules. Messages can be flagged automatically by the rule engine based on predefined rules, or manually by end users who find certain content inappropriate or concerning.When a message is flagged, it becomes visible in the CometChat Dashboard under the flagged messages section. Moderators can then review these flagged messages and take one of two actions:
Approve - The message is deemed acceptable and the moderation status remains approved
Block - The message violates platform policies and the moderation status is changed to disapproved
Once either action is taken, the message is automatically moved to the Reviewed list, which contains all messages that have been reviewed by moderators.
End users can manually flag messages they find inappropriate or concerning by selecting from a predefined list of reasons. These flag reasons are configurable through the CometChat Dashboard, where you can either use the default options or create custom flagging reasons tailored to your platform’s needs. Once configured, these reasons will appear in the user interface, allowing users to select the most appropriate reason when reporting a message.
Messages can be automatically flagged when they violate predefined moderation rules. When setting up moderation rules in the Dashboard, you can configure the action to “flag” messages that match specific criteria. This ensures that potentially problematic content is automatically identified and queued for review without requiring manual intervention from users.
For e.g. if the message contains any profane words, then it would be automatically flagged.
You can customize the flagging reasons available to end users through the CometChat Dashboard. The platform provides a set of default flagging reasons that cover common moderation scenarios, or you can create custom reasons that align with your platform’s specific community guidelines and policies. These configuration options are accessible through the Advanced Settings within the Moderation section of your dashboard.
Flag reasons can be also be configured via REST APIs Reason APIs.
Allows the approval of messages that were previously flagged. Approving a flagged message indicates that it has been reviewed and is considered acceptable according to platform guidelines.
