BACKGROUND: Profound scientific evaluation of novel digital health technologies (DHTs) is key to enhance successful development and implementation. As such, we previously developed the eHealth evaluation cycle. The eHealth evaluation cycle contains 5 consecutive study phases: conceptual, development, feasibility, effectiveness, and implementation.
OBJECTIVE: The aim of this study is to develop a better understanding of the daily practice of the eHealth evaluation cycle. Therefore, the objectives are to conduct a structured analysis of literature data to analyze the practice of the evaluation study phases and to determine which evaluation approaches are used in which study phase of the eHealth evaluation cycle.
METHODS: We conducted a systematic literature search in PubMed including the MeSH term \"telemedicine\" in combination with a wide variety of evaluation approaches. Original peer-reviewed studies published in the year 2019 (pre-COVID-19 cohort) were included. Nonpatient-focused studies were excluded. Data on the following variables were extracted and systematically analyzed: journal, country, publication date, medical specialty, primary user, functionality, evaluation study phases, and evaluation approach. RStudio software was used to summarize the descriptive data and to perform statistical analyses.
RESULTS: We included 824 studies after 1583 titles and abstracts were screened. The majority of the evaluation studies focused on the effectiveness (impact; 304/824, 36.9%) study phase, whereas uptake (implementation; 70/824, 8.5%) received the least focus. Randomized controlled trials (RCTs; 170/899, 18.9%) were the most commonly used DHT evaluation method. Within the effectiveness (impact) study phase, RCTs were used in one-half of the studies. In the conceptual and planning phases, survey research (27/78, 35%) and interview studies (27/78, 35%) were most frequently used. The United States published the largest amount of DHT evaluation studies (304/824, 36.9%). Psychiatry and mental health (89/840, 10.6%) and cardiology (75/840, 8.9%) had the majority of studies published within the field.
CONCLUSIONS: We composed the first comprehensive overview of the actual practice of implementing consecutive DHT evaluation study phases. We found that the study phases of the eHealth evaluation cycle are unequally studied and most attention is paid to the effectiveness study phase. In addition, the majority of the studies used an RCT design. However, in order to successfully develop and implement novel DHTs, stimulating equal evaluation of the sequential study phases of DHTs and selecting the right evaluation approach that fits the iterative nature of technology might be of the utmost importance.

BACKGROUND: Cardiometabolic diseases (CMDs) are a group of interrelated conditions, including heart failure and diabetes, that increase the risk of cardiovascular and metabolic complications. The rising number of Australians with CMDs has necessitated new strategies for those managing these conditions, such as digital health interventions. The effectiveness of digital health interventions in supporting people with CMDs is dependent on the extent to which users engage with the tools. Augmenting digital health interventions with conversational agents, technologies that interact with people using natural language, may enhance engagement because of their human-like attributes. To date, no systematic review has compiled evidence on how design features influence the engagement of conversational agent-enabled interventions supporting people with CMDs. This review seeks to address this gap, thereby guiding developers in creating more engaging and effective tools for CMD management.
OBJECTIVE: The aim of this systematic review is to synthesize evidence pertaining to conversational agent-enabled intervention design features and their impacts on the engagement of people managing CMD.
METHODS: The review is conducted in accordance with the Cochrane Handbook for Systematic Reviews of Interventions and reported in accordance with PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Searches will be conducted in the Ovid (Medline), Web of Science, and Scopus databases, which will be run again prior to manuscript submission. Inclusion criteria will consist of primary research studies reporting on conversational agent-enabled interventions, including measures of engagement, in adults with CMD. Data extraction will seek to capture the perspectives of people with CMD on the use of conversational agent-enabled interventions. Joanna Briggs Institute critical appraisal tools will be used to evaluate the overall quality of evidence collected.
RESULTS: This review was initiated in May 2023 and was registered with the International Prospective Register of Systematic Reviews (PROSPERO) in June 2023, prior to title and abstract screening. Full-text screening of articles was completed in July 2023 and data extraction began August 2023. Final searches were conducted in April 2024 prior to finalizing the review and the manuscript was submitted for peer review in July 2024.
CONCLUSIONS: This review will synthesize diverse observations pertaining to conversational agent-enabled intervention design features and their impacts on engagement among people with CMDs. These observations can be used to guide the development of more engaging conversational agent-enabled interventions, thereby increasing the likelihood of regular intervention use and improved CMD health outcomes. Additionally, this review will identify gaps in the literature in terms of how engagement is reported, thereby highlighting areas for future exploration and supporting researchers in advancing the understanding of conversational agent-enabled interventions.
BACKGROUND: PROSPERO CRD42023431579; https://tinyurl.com/55cxkm26.
UNASSIGNED: DERR1-10.2196/52973.

Background and Objectives: Chronic Obstructive Pulmonary Disease (COPD) is the third most common cause of death globally. Pulmonary rehabilitation (PR) programmes are important to reduce COPD symptoms and improve the quality of life of people with COPD. Digital health interventions have recently been adopted in PR programmes, which allow people with COPD to participate in such programmes with low barriers. The aim of this study is to review and discuss the reported effects of digital health interventions on PR outcomes in people with COPD. Materials and Methods: To achieve the study goals, a systematic literature search was conducted using PubMed (MEDLINE), CINAHL, AMED, SPORTDiscus and the Physiotherapy Evidence Database. Randomised clinical trials (RCTs) were included if they met specified criteria. Two reviewers independently checked titles, abstracts, and performed full-text screening and data extraction. The quality assessment and risk of bias were performed in accordance with the PEDRO scale and Cochrane Risk of Bias tool 2, respectively. Results: Thirteen RCTs were included in this systematic review with 1525 participants with COPD. This systematic review showed the potential positive effect of digital health PR on the exercise capacity-measured by 6- and 12-min walking tests, pulmonary function, dyspnoea and health-related quality of life. There was no evidence for advantages of digital health PR in the improvement of anxiety, depression, and self-efficacy. Conclusions: Digital health PR is more effective than traditional PR in improving the pulmonary and physical outcomes for people with COPD, but there was no difference between the two PR programmes in improving the psychosocial outcomes. The certainty of the findings of this review is affected by the small number of included studies.

BACKGROUND: Digital health interventions (DHIs) have the potential to enable public end users, such as citizens and patients, to manage and improve their health. Although the number of available DHIs is increasing, examples of successfully established DHIs in public health systems are limited. To counteract the nonuse of DHIs, they should be comprehensively evaluated while integrating end users. Unfortunately, there is a wide variability and heterogeneity according to the approaches of evaluation, which creates a methodological challenge.
OBJECTIVE: This scoping review aims to provide an overview of the current established processes for evaluating DHIs, including methods, indicators, and end-user involvement. The review is not limited to a specific medical field or type of DHI but offers a holistic overview.
METHODS: This scoping review was conducted following the JBI methodology for scoping reviews based on the framework by Arksey & O\'Malley and complies with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines. Three scientific databases (PubMed, Scopus, and Science Direct) were searched in April 2023. English and German studies between 2008 and 2023 were considered when evaluating DHIs that explicitly address public end users. The process of study selection was carried out by several researchers to avoid reviewer bias.
RESULTS: The search strategy identified 9618 publications, of which 160 were included. Among these included articles, 200 evaluations were derived and analyzed. The results showed that there is neither a consensus on the methods to evaluate DHIs nor a commonly agreed definition or usage of the evaluated indicators, which results in a broad variety of evaluation practices. This aligns with observations of the existing literature. It was found that there is a lack of references to existing frameworks for the evaluation of DHIs. The majority of the included studies referred to user-centered approaches and involved end users in the evaluation process. As assistance for people developing and evaluating DHIs and as a basis for thinking about appropriate ways to evaluate DHIs, a results matrix was created where the findings were combined per DHI cluster. Additionally, general recommendations for the evaluators of DHIs were formulated.
CONCLUSIONS: The findings of this scoping review offer a holistic overview of the variety and heterogeneity according to the approaches of evaluation of DHIs for public end users. Evaluators of these DHIs should be encouraged to reference established frameworks or measurements for justification. This would ease the transferability of the results among similar evaluation studies within the digital health sector, thereby enhancing the coherence and comparability of research in this area.

OBJECTIVE: Study the efficacy of digital health interventions in enhancing patient activation and identify the distinct features of these interventions using the WHO classification system.
METHODS: Asystematic reviewand meta-analysis were carried out according to the PRISMA guidelines. A search was conducted in Scopus, PubMed, and ProQuest. Randomized controlled trials (RCT), quasi-randomized controlled trials, and before-and-after studies enrolling patients ≥ 18 years of age with the Patient Activation Measure (PAM) score measurement and contain digital intervention with any aspects of health education or health-related behavior were included. The Downs and Black quality assessment tool was used to assess the quality of the articles.
RESULTS: In the three different types of meta-analyses, implementing the intervention led to a PAM score increase (Mean Difference (M.D.)), ranging from a minimum of (MD = 0.2014, 95 % CI = 0.0871-0.3158) and a highly significant p-value 0.0006 to a maximum of (MD = 2.7882, 95 % CI = 1.5558-4.0206) and a p-value < .0001. While the M.D. score of 0.2014 may seem relatively low, it is enough to elevate the patient from one activation level to a higher one out of the four activation levels.
CONCLUSIONS: The results suggest the effectiveness of digital health interventions on patient activation across diverse settings and contexts, implying potential generalizability. Using WHO classification, all examined digital interventions addressed the challenges of information, utilization, and efficiency in the health system, but not equity-related challenges. The study recognized online health communities (OHCs) as a subset of digital interventions that enhance patient activation through social support.

BACKGROUND: Chronic pain is a highly prevalent condition that requires multidisciplinary treatment. However, in the United Kingdom, access to specialist pain clinics where patients can receive medical multidisciplinary treatment is limited, and provision varies between health boards. As such, self-management of chronic pain using digital tools has been gaining traction recently, but evidence of its effectiveness from clinical-based trials focuses mainly on quantitative outcomes.
OBJECTIVE: This systematic review aims to identify, appraise, and synthesize qualitative evidence on patients\' experiences with digital health interventions (DHIs) for the management of chronic pain.
METHODS: This systematic review will consider qualitative and mixed methods studies that explore the experience of patients (aged 18 years and older) with chronic pain engaging in DHIs to manage their pain. MEDLINE Ovid, PubMed, Embase, CINAHL, PsycINFO, and Scopus databases will be searched for published studies. The systematic review will be conducted in accordance with the ENTREQ (Enhancing Transparency in Reporting the Synthesis of Qualitative Research) guidelines. Following the 3-step thematic synthesis methodology of Thomas and Harden, titles and abstracts will be screened by 2 independent reviewers (AM and HM), and a third reviewer (MI or FM) will resolve any conflict that arises before the full-text screening. The Critical Appraisal Skills Programme checklist tool will be used to critically appraise the included studies. The extracted data will be imported to NVivo (QSR International), where thematic synthesis will be used to derive analytical themes from the included studies.
RESULTS: Themes that encapsulate the patient experience will be identified from qualitative evidence, and these themes will shed light on the perceived benefits and disadvantages, usability, acceptability, and the overall impact digital tools can have on the lives of those with chronic pain.
CONCLUSIONS: This systematic review will identify, appraise, and synthesize the overall experience of patients engaging in DHI to manage a diverse range of chronic pain conditions. By elaborating the patient experience through qualitative analysis, the findings from this review will enhance our current understanding of the experiences of patients with chronic pain using digital tools for the self-management of their pain and highlight what person-centered elements are essential for future DHI development.
BACKGROUND: PROSPERO CRD42023445100; http://tinyurl.com/4z77khfs.
UNASSIGNED: DERR1-10.2196/52469.

BACKGROUND: Mobile health interventions delivered through mobile apps are increasingly used in physiotherapy care. This may be because of the potential of apps to facilitate changes in behavior, which is central to the aims of care delivered by physiotherapists. A benefit of using apps is their ability to incorporate behavior change techniques (BCTs) that can optimize the effectiveness of physiotherapeutic interventions. Research continues to suggest that despite their importance, behavior change strategies are often missing in patient management. Evaluating mobile apps that physiotherapists can use to drive behavior change may inform clinical practice and potentially improve patient outcomes. Examining the quality of apps and exploring their key features that can support behavior change and physiotherapy care are important aspects of such an evaluation.
OBJECTIVE: The primary aim of this study was to describe the range of mobile apps in app stores that are intended for use by patients to support physiotherapy care. The secondary aims were to assess app quality, BCTs, and their behavior change potential.
METHODS: A systematic review of mobile apps in app stores was undertaken. The Apple App Store and Google Play were searched using a 2-step search strategy, using terms relevant to the physiotherapy discipline. Strict inclusion and exclusion criteria were applied: apps had to be intended for use by patients and be self-contained (or stand-alone) without the requirement to be used in conjunction with a partner wearable device or another plugin. Included apps were coded for BCTs using the Behavior Change Technique Taxonomy version 1. App quality was assessed using the Mobile App Rating Scale, and the App Behavior Change Scale was used to assess the app\'s potential to change behavior.
RESULTS: In total, 1240 apps were screened, and 35 were included. Of these 35 apps, 22 (63%) were available on both the Apple App Store and Google Play platforms. In total, 24 (69%) were general in their focus (eg, not condition-specific), with the remaining 11 (31%) being more specific (eg, knee rehabilitation and pelvic floor training). The mean app quality score (Mobile App Rating Scale) was 3.7 (SD 0.4) of 5 (range 2.8-4.5). The mean number of BCTs identified per app was 8.5 (SD 3.6). BCTs most frequently included in the apps were instruction on how to perform a behavior (n=32), action planning (n=30), and self-monitoring of behavior (n=28). The mean behavior change potential score (App Behavior Change Scale) was 8.5 (SD 3.1) of 21 (range 3-15).
CONCLUSIONS: Mobile apps available to support patient care received from a physiotherapist are of variable quality. Although they contain some BCTs, the potential for behavior change varied widely across apps.
UNASSIGNED: RR2-10.2196/29047.

BACKGROUND: Heart failure disproportionately affects individuals residing in rural areas, leading to worse health outcomes. Digital health interventions have been proposed as a promising approach for improving heart failure management. This systematic review aims to identify randomized trials of digital health interventions for individuals living in underserved rural areas with heart failure.
RESULTS: We conducted a systematic review by searching 6 databases (CINAHL, EMBASE, MEDLINE, Web of Science, Scopus, and PubMed; 2000-2023). A total of 30 426 articles were identified and screened. Inclusion criteria consisted of digital health randomized trials that were conducted in underserved rural areas of the United States based on the US Census Bureau\'s classification. Two independent reviewers screened the studies using the National Heart, Lung, and Blood Institute tool to evaluate the risk of bias. The review included 5 trials from 6 US states, involving 870 participants (42.9% female). Each of the 5 studies employed telemedicine, 2 studies used remote monitoring, and 1 study used mobile health technology. The studies reported improvement in self-care behaviors in 4 trials, increased knowledge in 2, and decreased cardiovascular mortality in 1 study. However, 3 trials revealed no change or an increase in health care resource use, 2 showed no change in cardiac biomarkers, and 2 demonstrated an increase in anxiety.
CONCLUSIONS: The results suggest that digital health interventions have the potential to enhance self-care and knowledge of patients with heart failure living in underserved rural areas. However, further research is necessary to evaluate their impact on clinical outcomes, biomarkers, and health care resource use.
BACKGROUND: URL: https://www.crd.york.ac.uk/prospero/; Unique identifier: CRD42022366923.

BACKGROUND: The last 2 decades have been a time of exponential growth and maturation for digital health, while the global burden of respiratory disease continues to grow worldwide. Leveraging digital health interventions (DHIs) to manage and mitigate respiratory disease and its adverse health effects presents itself as an obvious path forward.
OBJECTIVE: We aimed to understand the current digital landscape and enabling environment around respiratory health to reduce costs, avoid duplication, and understand the comprehensiveness of DHIs.
METHODS: This study will follow a scoping review methodology as outlined by Arksey and O\'Malley, the Joanna Briggs Institute, and the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) checklist. MEDLINE, Embase, CINAHL, PsycINFO, Cochrane Library, Web of Science, PakiMedNet, and MyMedR databases will be searched along with key websites, repositories, and gray literature databases. The terms \"respiratory health,\" \"digital health,\" \"South Asia,\" and \"Southeast Asia,\" as well as related terms will be searched. The results will be screened for duplicates and then against the inclusion and exclusion criteria. For the studies included, data will be extracted, collated, and analyzed.
RESULTS: The scoping review was started in July 2023 and will be finalized by February 2024. Results will be presented following the World Health Organization\'s classification of DHIs to categorize interventions in a standardized format and the mobile health evidence reporting and assessment checklist to report on the effectiveness of interventions. Further exposition of the evidence extracted will be presented through narrative synthesis.
CONCLUSIONS: As DHIs continue to proliferate, the need to understand the current landscape becomes more pertinent. In this scoping review, we will seek to more clearly understand what digital health tools and technologies are being used in the current landscape of digital health in South and Southeast Asia for respiratory health and to what extent they are addressing the respiratory health needs of the region. The results will inform recommendations on digital health tools for respiratory health in South and Southeast Asia will help funders and implementers of DHIs leverage existing technologies and accelerate innovations that address documented gaps in the studied countries.
UNASSIGNED: DERR1-10.2196/52517.

BACKGROUND: Blended psychotherapy (bPT) combines face-to-face psychotherapy with digital interventions to enhance the effectiveness of mental health treatment. The feasibility and effectiveness of bPT have been demonstrated for various mental health issues, although primarily for patients with higher levels of functioning.
OBJECTIVE: This scoping review aims to investigate the feasibility, adherence, and effectiveness of bPT for the treatment of patients with severe mental illnesses (SMIs).
METHODS: Following the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines, we conducted searches in PubMed, MEDLINE, Embase, PsycINFO, and PsycArticles for studies published until March 23, 2023.
RESULTS: Out of 587 screened papers, we incorporated 25 studies encompassing 23 bPT interventions, involving a total of 2554 patients with SMI. The intervention formats and research designs exhibited significant variation. Our findings offer preliminary evidence supporting the feasibility of bPT for SMI, although there is limited research on adherence. Nevertheless, the summarized studies indicated promising attrition rates, spanning from 0% to 37%, implying a potential beneficial impact of bPT on adherence to SMI treatment. The quantity of evidence on the effects of bPT for SMI was limited and challenging to generalize. Among the 15 controlled trials, 4 concluded that bPT interventions were effective compared with controls. However, it is noteworthy that 2 of these studies used the same study population, and the control groups exhibited significant variations.
CONCLUSIONS: Overall, our review suggests that while bPT appears promising as a treatment method, further research is necessary to establish its effectiveness for SMI. We discuss considerations for clinical implementation, directions, and future research.