OBJECTIVE: The increasing popularity of three-dimensional (3D) virtual reconstructions of two-dimensional (2D) imaging in urology has led to significant technological advancements, resulting in the creation of highly accurate 3D virtual models (3DVMs) that faithfully replicate individual anatomical details. This technology enhances surgical reality, providing surgeons with hyper-accurate insights into instantaneous subjective surgical anatomy and improving preoperative surgical planning. In the uro-oncologic field, the utility of 3D virtual reconstruction has been demonstrated in nephron-sparing surgery, impacting surgical strategy and postoperative outcomes in prostate cancer (PCa). The aim of this study is to offer a thorough narrative review of the current state and application of 3D reconstructions and augmented reality (AR) in radical prostatectomy (RP).
METHODS: A non-systematic literature review was conducted using Medline, PubMed, the Cochrane Database, and Embase to gather information on clinical trials, randomized controlled trials, review articles, and prospective and retrospective studies related to 3DVMs and AR in RP. The search strategy followed the PICOS (Patients, Intervention, Comparison, Outcome, Study design) criteria and was performed in January 2024.
UNASSIGNED: The adoption of 3D visualization has become widespread, with applications ranging from preoperative planning to intraoperative consultations. The urological community\'s interest in intraoperative surgical navigation using cognitive, virtual, mixed, and AR during RP is evident in a substantial body of literature, including 16 noteworthy investigations. These studies highlight the varied experiences and benefits of incorporating 3D reconstructions and AR into RP, showcasing improvements in preoperative planning, intraoperative navigation, and real-time decision-making.
CONCLUSIONS: The integration of 3DVMs and AR technologies in urological oncology, particularly in the context of RP, has shown promising advancements. These technologies provide crucial support in preoperative planning, intraoperative navigation, and real-time decision-making, significantly improving the visualization of complex anatomical structures helping in the nerve sparing (NS) approach modulation and reducing positive surgical margin (PSM) rate. Despite positive outcomes, challenges such as small patient cohorts, lack of standardized methodologies, and concerns about costs and technology adoption persist.

Extended reality (XR) simulations are becoming increasingly common in educational settings, particularly in medical education. Advancing XR devices to enhance these simulations is a booming field of research. This study seeks to understand the value of a novel, non-wearable mixed reality (MR) display during interactions with a simulated holographic patient, specifically in taking a medical history. Twenty-one first-year medical students at the University of North Carolina at Chapel Hill participated in the virtual patient (VP) simulations. On a five-point Likert scale, students overwhelmingly agreed with the statement that the simulations helped ensure they were progressing along learning objectives related to taking a patient history. However, they found that, at present, the simulations can only partially correct mistakes or provide clear feedback. This finding demonstrates that the novel hardware solution can help students engage in the activity, but the underlying software may need adjustment to attain sufficient pedagogical validity.

Surgical disparities persist in low- and middle-income countries (LMICs). Insufficient access to surgical care places a large burden on these regions, with high mortality rates for otherwise standard procedures performed in high-income countries (HICs). Augmented Reality (AR) and Virtual Reality (VR) now provide us with a platform to improve the delivery of surgical access and training to LMICs. The use of AR technologies to provide additional training to surgeons and residents globally can help bridge the gap and reduce health disparities in LMICs. The goal of this scoping review is to evaluate whether surgical trainees and surgeons from LMICs have access to or use AR software in their training or practice. A systematic search was conducted on seven databases. Inclusion criteria included populations in LMICs with access to AR-based training. Articles using VR software, or those conducted in HICs were excluded from the review. From the 428 records screened, 58 reports were assessed for eligibility, and of these, a total of six studies were included in the review. Five of the six studies used mentors from an HIC, including the United States (US) and the United Kingdom (UK), whereas one study had mentorship from another LMIC. Three surgical specialties were explored: neurosurgery, plastic surgery, and urology. Although the integration of AR in surgical training is promising, the six studies evaluated in this review emphasize that costs and connection issues are major challenges that can set back these technologies in the operating room. Despite these revelations, with certain improvements, AR training programs are promising as they can help to reduce the global disparity in surgical proficiency.

This report outlines the innovative use of augmented reality (AR) in the surgical planning and treatment of a spinal dural arteriovenous fistula (dAVF) via a minimally invasive technique. AR technology by way of an Apple Vision Pro headset was employed to enhance preoperative visualization and understanding of the pathology, leading to successful surgical ligation of the AVF. This case describes a 56-year-old male presenting with progressive weakness and thoracic myelopathy who showed marked improvement postoperatively, highlighting AR\'s potential to improve surgical approach and outcomes.

Affect-biased attention is the phenomenon of prioritizing attention to emotionally salient stimuli and away from goal-directed stimuli. It is thought that affect-biased attention to emotional stimuli is a driving factor in the development of depression. This effect has been well-studied in adults, but research shows that this is also true during adolescence, when the severity of depressive symptoms are correlated with the magnitude of affect-biased attention to negative emotional stimuli. Prior studies have shown that trainings to modify affect-biased attention may ameliorate depression in adults, but this research has also been stymied by concerns about reliability and replicability. This study describes a clinical application of augmented reality-guided EEG-based attention modification (\"AttentionCARE\") for adolescents who are at highest risk for future depressive disorders (i.e., daughters of depressed mothers). Our results (n = 10) indicated that the AttentionCARE protocol can reliably and accurately provide neurofeedback about adolescent attention to negative emotional distractors that detract from attention to a primary task. Through several within and cross-study replications, our work addresses concerns about the lack of reliability and reproducibility in brain-computer interface applications, offering insights for future interventions to modify affect-biased attention in high-risk adolescents.

The integration of virtual, mixed, and augmented reality technologies in cognitive neuroscience and neuropsychology represents a transformative frontier. In this Commentary, we conducted a meta-analysis of studies that explored the impact of Virtual Reality (VR), Mixed Reality (MR), and Augmented Reality (AR) on cognitive neuroscience and neuropsychology. Our review highlights the versatile applications of VR, ranging from spatial cognition assessments to rehabilitation for Traumatic Brain Injury. We found that MR and AR offer innovative avenues for cognitive training, particularly in memory-related disorders. The applications extend to addressing social cognition disorders and serving as therapeutic interventions for mental health issues. Collaborative efforts between neuroscientists and technology developers are crucial, with reinforcement learning and neuroimaging studies enhancing the potential for improved outcomes. Ethical considerations, including informed consent, privacy, and accessibility, demand careful attention. Our review identified common aspects of the meta-analysis, including the potential of VR technologies in cognitive neuroscience and neuropsychology, the use of MR and AR in memory research, and the role of VR in neurorehabilitation and therapy.

Nowadays with the increase of high-rise buildings, emergency evacuation is an indispensable part of urban environment management. Due to various disaster incidents occurred in indoor environments, research has concentrated on ways to deal with the different difficulties of indoor emergency evacuation. Although global navigation satellite systems (GNSSs) such as global positioning system (GPS) come in handy in outdoor spaces, they are not of much use in enclosed places, where satellite signals cannot penetrate easily. Therefore, other approaches must be considered for pedestrian navigation to cope with the indoor positioning problem. Another problem in such environments is the information of the building indoor space. The majority of the studies has used prepared maps of the building, which limits their methodology to that specific study area. However, in this study we have proposed an end-to-end method that takes advantage of BIM model of the building, thereby applicable to every structure that has an equivalent building information model (BIM). Moreover, we have used a mixture of Wi-Fi fingerprinting and pedestrian dead reckoning (PDR) method with relatively higher accuracy compared to other similar methods for navigating the user to the exit point. For implementing PDR, we used the sensors in smartphones to calculate user steps and direction. In addition, the navigational information was superimposed on the smartphone screen using augmented reality (AR) technology, thus communicating the direction information in a user-friendly manner. Finally, the AR mobile emergency evacuation application developed was assessed with a sample audience. After an experience with the app, they filled out a questionnaire which was designed in the system usability scale test (SUS) format. The evaluation results showed that the app achieved an acceptable suitability for usage.

Augmented reality (AR) technology has been widely applied across a variety of fields, with head-up displays (HUDs) being one of its prominent uses, offering immersive three-dimensional (3D) experiences and interaction with digital content and the real world. AR-HUDs face challenges such as limited field of view (FOV), small eye-box, bulky form factor, and absence of accommodation cue, often compromising trade-offs between these factors. Recently, optical waveguide based on pupil replication process has attracted increasing attention as an optical element for its compact form factor and exit-pupil expansion. Despite these advantages, current waveguide displays struggle to integrate visual information with real scenes because they do not produce accommodation-capable virtual content. In this paper, we introduce a lensless accommodation-capable holographic system based on a waveguide. Our system aims to expand the eye-box at the optimal viewing distance that provides the maximum FOV. We devised a formalized CGH algorithm based on bold assumption and two constraints and successfully performed numerical observation simulation. In optical experiments, accommodation-capable images with a maximum horizontal FOV of 7.0 degrees were successfully observed within an expanded eye-box of 9.18 mm at an optimal observation distance of 112 mm.

The proliferation of digital technologies is substantially transforming inspection methodologies for construction activities. Although the implementation of a three-dimensional (3D) model has emerged as an advantageous, feasible inspection application, the selection of the most suitable 3D models is challenging due to multiple technology options. The primary objectives of this study were to investigate current trends and identify future technologies for 3D models in the construction industry. This study utilized systematic reviews by identifying and selecting quality journals, analyzing selected articles, and conducting content analysis and meta-analysis to identify dominant themes in 3D models. Results showed that the top technologies used to model construction projects are building information models, remote sensing, stereo vision system/photo processing programs, and augmented reality/virtual reality. The main benefits and challenges of these technologies for modeling were also determined. This study identified three areas with significant knowledge gaps for future research: (1) the amalgamation of two or more technologies to overcome project obstacles; (2) solution optimization for inspections in remote areas; and (3) the development of algorithm-based technologies. This research contributes to the body of knowledge by exploring current trends and future directions of 3D model technologies in the construction industry.

BACKGROUND: We developed a 3D camera system to track motion in a surgical field. This system has the potential to introduce augmented reality (AR) systems non-invasively, eliminating the need for the invasive AR markers conventionally required. The present study was performed to verify the real-time tracking accuracy of this system, assess the feasibility of integrating this system into the surgical workflow, and establish its potential to enhance the accuracy and efficiency of orthopedic procedures.
METHODS: To evaluate the accuracy of AR technology using a 3D camera, a forearm bone model was created. The forearm model was depicted using a 3D camera, and its accuracy was verified in terms of the positional relationship with a 3D bone model created from previously imaged CT data. Images of the surgical field (capturing the actual forearm) were taken and saved in nine poses by rotating the forearm from pronation to supination. The alignment of the reference points was computed at the three points of CT versus the three points of the 3D camera, yielding a 3D rotation matrix representing the positional relationship. In the original system, a stereo vision-based 3D camera, with a depth image resolution of 1280×720 pixels, 30 frames per second, and a lens field of view of 64 specifications, with a baseline of 3 cm, capable of optimally acquiring real-time 3D data at a distance of 40-60 cm from the subject was used. In the modified system, the following modifications were made to improve tracking performance: (1) color filter processing was changed from HSV to RGB, (2) positional detection accuracy was modified with supporting marker sizes of 8 mm in diameter, and (3) the detection of marker positions was stabilized by calculating the marker position for each frame. Tracking accuracy was examined with the original system and modified system for the following parameters: differences in the rotation matrix, maximum and minimum inter-reference point errors between CT-based and camera-based 3D data, and the average error for the three reference points.
RESULTS: In the original system, the average difference in rotation matrices was 5.51±2.68 mm. Average minimum and maximum errors were 1.10±0.61 and 15.53±12.51 mm, respectively. The average error of reference points was 6.26±4.49 mm. In the modified system, the average difference in rotation matrices was 4.22±1.73 mm. Average minimum and maximum errors were 0.79±0.49 and 1.94±0.87 mm, respectively. The average error of reference points was 1.41±0.58 mm. In the original system, once tracking failed, it was difficult to recover tracking accuracy. This resulted in a large maximum error in supination positions. These issues were resolved by the modified system. Significant improvements were achieved in maximum errors and average errors using the modified system (P<0.05).
CONCLUSIONS: AR technology using a 3D camera was developed. This system allows direct comparisons of 3D data from preoperative CT scans with 3D data acquired from the surgical field using a 3D camera. This method has the advantage of introducing AR into the surgical field without invasive markers.