Following the MedWay
MedDMO’s Multimedia analysis tools for countering Disinformation
In this section we outline the Multimedia analysis tools that have been made available to MedDMO fact-checkers to assist them in their daily work of detecting and countering disinformation. These tools have been developed in the course of several EC-funded projects (REVEAL, InVID, WeVerify) and are further enhanced to meet current challenges of the disinformation landscape in the framework of the vera.ai and AI4Media projects.
Furthermore, all provided tools have been integrated into a web-based platform that facilitates the management and annotation of multimedia collections and is capable of dealing with content-based image and video retrieval. This web–based platform has been developed in the context of the MediaVerse project and new functionalities that assist fact-checking and journalistic research have been designed in the context of MedDMO.
The following functionalities are currently provided. Clicking on the title of each functionality you can access more detailed descriptions along with representative examples.
- Multimedia analysis and automatic annotation: Any multimedia item that is uploaded to the platform is analysed and annotated with the detected objects and actions. Short textual descriptions are generated and automatic classification into relevant categories, such as memes, disturbing or Not Safe For Work (NSFW) scenes is performed so that users can easily filter such images.
- Deepfake detection: Images and videos are analysed to automatically determine whether faces have been manipulated or generated by AI.
- Image verification assistant: Images are analysed with 14 image tampering detection algorithms to determine possible forgeries.
- Location estimation: Images are analysed to determine the location of the content based on visual similarity to landmarks or visual cues that are tell-tale of a specific region.
- Advanced search with visual similarity: Images or videos that bear visual or semantic similarities are automatically identified.
- Manual annotation: an easy-to-use interface allows users to manually annotate images (or parts of images), as well as temporal segments of video .
Some of these tools along with many more are also available through the Verification plugin which is available to the public as a browser extension for any Chrome-based browser (Chrome, Chromium, Edge, Opera, Brave).
Finally, a prime collaborative fact-checking platform for news verification purposes is Truly Media, used by MedDMO and other fact-checking teams that are members of EDMO.