Strengthening Ukrainian Fact-Checkers: Combatting EU Disinformation

This project, funded through the European Media and Information Fund and implemented by a research team from UC3M, National University of Kyiv-Mohyla Academy, and StopFake Ukraine, spans six months (01/06/2023 - 30/11/2023). It aims to strengthen the capacities of EU and Ukrainian fact-checking organizations by improving fact-checking skills and awareness among fact-checkers. The focus is on mapping key disinformation narratives related to the war in Ukraine and Russian efforts to discredit the European Union and its member states, using the StopFake database to enhance the detection and understanding of these narratives. The project seeks to foster positive transformations in the media landscapes of the EU and Ukraine by promoting knowledge exchange and methodologies on information verification and providing additional expert support to Ukrainian fact-checkers and their organizations.

objectives

Objectives of the project

The primary objective of this project is to strengthen the work of the EU and Ukrainian media communities in the field of information verification in line with the expertise of European fact-checking organisations and raise public awareness of disinformation. Specifically, the project sought to:

See objectives

Digital Health Engagement Analysis

Raise the professional level of Ukrainian information verification specialists and provide them with best methodological practices.

Media Coverage in Health

Synthesise and analyse current fact-checking methodologies to be included in a guide describing the latest information verification methodologies and fact-checking tools based on the experience of leading European fact-checking projects.

Cybersecurity and Health Policies

Research and map main disinformation narratives and most active disinformation actors in the context of Russia’s war against Ukraine.

Health Information Patterns

Develop recommendations that will guide the work with disinformation related to the European Union during the war against Ukraine.

Health Misinformation Analysis

Improve media literacy, media education, and capabilities to expose and counter disinformation among the general public, fact-checkers and journalists. This also includes developing a fact-checking curriculum for journalism students and outreach activities, such as joint outreach events, professional consultations and a conference.

Impact of Health Education

Create and promote networking between European, Ukrainian fact checkers and universities.

Methodology

The project achieves its objective by researching in databases, analysing and collecting up-to-date verification methodologies from professional fact-checking organisations, and secondly, by applying them to the work of European and Ukrainian fact-checkers, media organisations and journalists working with conflicts and crises. Also based on the current experience of fact-checking organisations, the project developed a fact-checking curriculum. Thus, the project served as a collaborative educational and analytical platform for fact-checkers from Europe and Ukraine to explore and move forward on how to combat disinformation.

Project Results

The analytical group of StopFake has conducted a study titled "Anti-EU Narratives through the Russian-Ukrainian War in the Light of StopFake.org's debunks". As part of the research, the following aspects were identified: disinformation narratives about the EU and European countries that were disseminated from 2014 to 2023, and whether this landscape changed with Russia's full-scale invasion of Ukraine. The study also explores which European countries are most frequently targeted in disinformation narratives and the contexts in which they are presented. Links to find these results:

https://www.dykinson.com/cart/download/ebooks/17911 (see chapter 3, pages 39-62)

https://www.stopfake.org/en/anti-eu-narratives-through-the-russian-ukrainian-war-in-the-light-of-stopfake-org-s-debunks/

Building upon the ongoing research conducted by StopFake, the subcontracted organisation in the project, on Russian disinformation narrative strategies related to the EU and Ukraine, the research group has formulated recommendations for both fact-checking organisations and government agencies. Key measures include:

− Using the narrative map of Russian disinformation around the EU to identify threats

− Paying special attention to systematically targeted EU countries

− Conducting regular analyses of target audiences

− Monitoring and analysing narrative changes

− Examining technologies and tools used in disinformation production

− Establishing a publicly available repository of disinformation examples

− Promoting internationalisation of fact-checking for cross-border analysis

The proposal also advocates for cross-disciplinary cooperation, integrating fact-checking into strategic communications, involving fact-checkers in policymaking, and leveraging the StopFake experience in combating Russian disinformation for the benefit of EU governments and organisations. Additionally, the recommendations explore the viability of utilising the fact-checking project's database as a fundamental resource for examining and analysing information operations.

The full text of these recommendations can be found in Chapter 8 of the open-access project book titled “Recommendations on Strengthening the Capacity of Fact-Checkers to Combat Disinformation” (accessible on page 135).

Link: https://www.dykinson.com/cart/download/ebo oks/17911

In addition, a publication was made in the StopFake website: https://www.stopfake.org/en/anti-eu-narratives-through-the-russian-ukrainian-war-in-the-light-of-stopfake-org-s-debunks/

Our systematic review, analysing 29 studies from 2023, has identified contemporary fact-checking methodologies. Specifically, the predominant methods for developing fact-checking tools involve machine learning and deep learning algorithms. Despite challenges, the research highlights the effectiveness of diverse tools and strategies in not only identifying and detecting false information but also preventing its widespread dissemination. These results have been published as a book chapter in the open-access project book, titled "The journalist’s toolkit: exploring effective fact-checking methods" (Chapter 11, page 191), this synthesis serves as a valuable resource for staying current in the dynamic field of fact-checking. Furthermore, the systematic review has been submitted to Heliyon, a peer-reviewed scientific journal edited by Elsevier, reinforcing its contribution to the scholarly discourse.

This activity focused on crafting a curriculum tailored for fact-checkers. The curriculum starts with an introductory exploration of the fact-checking field, requisite skills, and academic background for fact-checkers. It proceeds into the guiding principles and ethical codes governing fact-checking practices. Addressing the difficulties, the proposal delineates limitations and challenges in distinct sections. It further examines essential resources, encompassing organisations, institutions, media literacy, and tools/extensions vital for proficient fact-checking. The curriculum document concludes with reflections, providing insights into the dynamic fact-checking landscape. Published in the open-access project book, "Facts, skills, and ethics: the curriculum of fact-checking" (Chapter 9, page 149), it enhances its academic perspective with a comprehensive list of references, offering a comprehensive exploration of multifaceted fact-checking aspects.

The conference was titled 1st European Congress on Disinformation and Fact-Checking, and was held on November 20 and 21, 2023, as a hybrid event. It attracted 251 registrants from 38 countries across Europe, America, Asia, and Africa, establishing itself as a global platform. Co-organized by UC3M MediaLab and "StopFake.org" from Ukraine, with financial support from the European Media and Information Fund (EMIF), the congress facilitated international dialogue and cooperation in combating misinformation. The event served as the concluding international activity of the project, providing a platform to showcase developed products. All event materials, including recordings, presentations, photos, and videos, are accessible through open-access links provided. www.disinformation.es

The programme included three main directions: a research perspective on analysing misinformation, media and journalistic experiences in the context of information threats, and fact-checking as a tool to combat misinformation threats. Digital experts and developers of open data tools also participated. To facilitate a comprehensive international discussion, the StopFake team negotiated with representatives from various fact-checking and analytical organisations in Spain and Europe, involving leading experts from Spain, Italy, France, Latvia, and the UK. The three thematic directions allowed for the achievement of the project's key objectives: bringing together leading expertise in the field of misinformation to develop effective counteraction methods.

We successfully achieved a positive audience reach. As of April 1, the official page garnered an audience of 544K, and posts on the official Facebook pages reached 600K and 1 M 68K on the official Twitter page. During the review period, approximately 1,000 refutations were made in various languages, with the majority (about 700) in Russian and Ukrainian as the primary languages. In addition, the project website, www.disinformation.es, was visited 2,783 times since 14th July to 30th November 2023.

It is worth noting that a more substantial audience reach and quantitative enhancement of publication activities are anticipated when planning targeted project activities focused on practical engagement with audiences in the future. This grant is expected to have not only quantitative increase but also long-term qualitative impact on StopFake and its audiences.

The project has also created an opportunity to enhance the visibility of Ukrainian fact-checkers and facilitate access to materials and ongoing analyses by Ukrainian and European experts. One notesworthy networking event was made in Paris. A collaborative expert group from UC3M and StopFake introduced the project and its research findings at the CELSA Communication and Journalism School of Sorbonne University. Additionally, representatives from the StopFake team presented the study results at:

During the project period, the following events were attended by project representatives in order to generate networking with the fact-checking international community and share best practices:

− 30 June 2023: Countering Disinformation During the Rise of AI: 2 Years of EMIF's impact. In Brussels, organized by the School of Transnational Governance, EUI.

− 11-12 October 2023: #Disinfo2023 Annual Conference. In Krakow, organized by EU DisinfoLab.

− 19 October 2023: Presentation of project results in a research seminar at CELSA Communication and Journalism School of Sorbonne University in Paris, France.

− 16-17 November 2023: Community Building Against Disinformation. EMIF Autumn Event 2023. In Florence.

In addition, the subcontracting organisation, StopFake, has made presentations in these events although they were not financially covered by the project:

− 23 October 2023: Learn to Check: Media Literacy Summit for Educators (Barcelona University, Barcelona, Spain)

− 26 October 2023: Google Annual Conference "Fighting Misinformation Online 2023” (Brussels, Belgium)

− 14 November 2023: OECD Conference ‘Tackling disinformation: Strengthening democracy through information integrity’ (Paris, France)

− 15 November 2023: Conference ‘Comunicación y Desinformación en el Entorno Europeo: regulación frente a estrategias híbridas’ (Universidad Carlos III, Madrid, Spain)

The research findings have sparked extensive discussions within the Ukrainian expert community and have been shared through StopFake's platforms with IFCN members, partner government entities, and media organisations. https://www.stopfake.org/en/anti-eu-narratives-through-the-russian-ukrainian-war-in-the-light-of-stopfake-org-s-debunks/

Quantitative results vis-à-vis target and objectives

The Team

The team comprises specialists and researchers from UC3M, the National University of Kyiv-Mohyla Academy, and StopFake Ukraine. It includes experts in media studies, information verification, and digital forensics, ensuring a robust, interdisciplinary approach to strengthening Ukrainian fact-checkers' resilience against EU-related disinformation and misinformation in the context of the Ukrainian conflict.

Meet the team