A study by the Ulster University School of Computing, which analyzed 1,500 digital health apps, concluded that user reviews and download rates are not reliable indicators of their quality.
THE 'Don't judge a health book or app by its cover review», published in the journal PLOS ONE in March 2024, examined application data provided by the Organization for Review of Healthcare and Health Applications (ORCHA).
The researchers assessed the quality of the apps against user ratings and number of downloads, as part of a doctoral program in 2021-2024.
They explored the level of evidence behind the app, whether it was user-friendly and accessible, as well as areas such as data protection and privacy.
Professor Raymond Bond, Professor of Human Computing Systems at Ulster University and chair of the research project, said in a statement press release published on June 3, 2024: “Our research highlights the importance of looking beyond metrics like user ratings and number of app downloads when evaluating digital health apps.
“While these metrics may influence user perceptions, our research shows that they do not necessarily reflect the quality, effectiveness, safety, or reliability of these health apps. »
He added: “Relying solely on user reviews and download counts could lead to flawed decisions and ultimately undermine public trust in digital health technologies.”
The study highlighted the need for users and healthcare providers who prescribe the apps to rethink the metrics they use to judge the quality of digital health apps.
It also advocates prioritizing rigorous evaluation processes, so that stakeholders – including healthcare professionals recommending apps to patients – can ensure that digital tools meet high quality standards and provide input positive to patient care and well-being.
Liz Ashall-Payne, founding CEO of ORCHA, said: “This research highlights the need for comprehensive assessment to ensure digital health applications meet the highest standards of security, effectiveness and reliability.
“By prioritizing rigorous assessments, we can guide healthcare providers and consumers toward better choices, thereby improving health outcomes and building trust in digital health solutions.” »
Professor Maurice Mulvenna, Professor of Computing at Ulster University, said: “As the digital health landscape continues to evolve, studies like these are a vital reminder that appearances can be misleading.
“By digging deeper into the content of digital health apps and prioritizing evidence-based assessment, we can help consumers make informed decisions and harness the full potential of technology to improve health outcomes “.
The study suggests that more should be done to help users recognize high-quality health apps, such as improving digital health literacy training and providing nationally approved 'libraries', such as the ORCHA Digital Health Formlaunched in March 2023.