Hungarian Initiative Unveils Hidden Clinical Trials: Bridging the Language Gap in Medical Research

What Sparks This Meta-Epidemiological Pursuit?

Hungarian researchers have launched a comprehensive meta-epidemiological study to identify and catalog randomized controlled trials (RCTs) and other controlled studies published in Hungarian medical journals. The initiative, led by the University of Pécs Medical Library in collaboration with multidisciplinary experts, aims to address a significant gap in global clinical evidence databases by examining 133 Hungarian medical journals and previously inaccessible grey literature from 2023.

The project represents the first systematic effort to integrate Hungarian clinical trial data into the Cochrane Central Register of Controlled Trials (CENTRAL), addressing a longstanding blind spot in evidence synthesis. Previous survey data indicated that approximately 32% of Hungarian researchers intentionally publish their findings exclusively in domestic journals to reach their target audience, suggesting potentially valuable clinical evidence remains hidden from international systematic reviews. The research team has identified that without targeted handsearching, these Hungarian-language trials would remain unavailable for informing systematic reviews and evidence-based clinical practice guidelines, potentially leading to biased or incomplete evidence synthesis. Similar initiatives in countries like Germany, Turkey, and Russia have proven successful in identifying significant numbers of previously uncatalogued trials, with the German effort alone uncovering approximately 17,000 RCTs and controlled clinical trials over a ten-year period that were subsequently added to global databases. The Hungarian team anticipates comparable results given that a pilot study conducted two decades ago revealed numerous neuroscience RCTs published exclusively in Hungarian language journals.

How Are Innovative Methods Advancing Evidence Discovery?

The methodological approach includes rigorous handsearching of both print and electronic journals, with two independent researchers screening each publication according to strict inclusion criteria. The study will identify trials involving living human participants in healthcare interventions with at least two comparison groups, categorizing them as RCTs, controlled clinical trials (CCTs), or non-randomized controlled studies. Beyond conventional journals, the team will explore various sources of grey literature, including conference proceedings, preprints, dissertations, and society reports through multiple Hungarian databases such as the National Széchényi Library, Hungarian Medical Bibliography, and the Scientific Document Common Search Service. This comprehensive approach aims to create a more complete picture of clinical evidence originating from Hungarian research institutions. The researchers will also evaluate whether identified studies have been published elsewhere in indexed journals to determine the true extent of previously inaccessible evidence.

The project incorporates an innovative comparison between traditional manual handsearching and automated methods using Paperfetcher, an algorithm that queries the Crossref database for bibliographic metadata. This comparison will assess whether automation can effectively support handsearching in non-English language environments, potentially offering more efficient methods for future evidence synthesis activities. Preliminary analysis suggests about one-third of Hungarian journals use Digital Object Identifiers (DOIs), which may limit the effectiveness of automated tools relying on Crossref data. Additionally, the team will evaluate the reporting quality of identified trials using the CONSORT 2024 checklist and assess risk of bias using established tools including Cochrane's RoB 2 and ROBINS-I, providing valuable insights into the methodological rigor of Hungarian clinical research. These assessments will help determine whether language-specific publication patterns affect study quality or reporting standards.

What Impact Could These Findings Have on Global Clinical Evidence?

The results of this Hungarian handsearching initiative will be disseminated through peer-reviewed publications, workshops, and academic conferences, with identified RCTs and quasi-RCTs being added to the CENTRAL database following HarmoniSR guidance. Project leaders expect the findings to significantly enhance the comprehensiveness of systematic reviews involving interventions relevant to Central European populations. This work addresses a critical gap in international evidence synthesis by ensuring that language barriers do not exclude potentially valuable clinical evidence from influencing healthcare decision-making. The project team acknowledges challenges in accessing grey literature despite their methodical approach, noting in their study limitations that "searching for grey literature is a cumbersome task, so despite our best intentions and diligence, we may not find everything we would like to include in our research."

The initiative represents a significant contribution to evidence-based medicine by addressing the systemic bias toward English-language publications in major databases. As pharmaceutical companies and research institutions increasingly seek complete evidence pictures for drug development and clinical practice guidelines, this work demonstrates the continuing importance of language-specific handsearching despite advances in automated literature retrieval systems. The findings will likely influence how systematic reviewers approach language inclusivity in future evidence synthesis projects, potentially spurring similar initiatives in other regions where valuable clinical evidence remains hidden in non-indexed, native-language publications.

Industry Context

This Hungarian handsearching initiative highlights a persistent challenge in clinical evidence synthesis – the underrepresentation of non-English language trials in global databases. For pharmaceutical and biotech companies, this gap represents both a risk and opportunity, as overlooked evidence could influence regulatory decisions, market access strategies, and clinical practice guidelines. As the industry increasingly focuses on real-world evidence and comprehensive data integration, projects like this underscore the continuing need for methodological rigor in evidence gathering despite technological advances in literature searching and artificial intelligence. The findings may particularly impact companies developing therapies for conditions with significant research activity in Central and Eastern Europe, where valuable efficacy and safety data may currently remain hidden from international view.

Summary

This comprehensive meta-epidemiological study aims to identify and catalog randomized controlled trials from 133 Hungarian medical journals and grey literature. Led by the University of Pécs Medical Library, the project addresses the significant gap in global clinical evidence databases, where approximately 32% of Hungarian researchers publish exclusively in domestic journals. The study employs both manual handsearching and automated methods using Paperfetcher, evaluating trial quality using CONSORT 2024 and assessing risk of bias. The findings will be added to the Cochrane Central Register of Controlled Trials (CENTRAL), potentially improving the comprehensiveness of systematic reviews and influencing future evidence synthesis approaches, particularly for Central European populations.