Microscope-integrated optical coherence tomography for in vivo human brain tumor detection with artificial intelligence.

Objective: It has been shown that optical coherence tomography (OCT) can identify brain tumor tissue and potentially be used for intraoperative margin diagnostics. However, there is limited evidence on its use in human in vivo settings, particularly in terms of its applicability and accuracy of residual brain tumor detection (RTD). For this reason, a microscope-integrated OCT system was examined to determine in vivo feasibility of RTD after resection with automated scan analysis.

Methods: Healthy and diseased brain was 3D scanned at the resection edge in 18 brain tumor patients and investigated for its informative value in regard to intraoperative tissue classification. Biopsies were taken at these locations and labeled by a neuropathologist for further analysis as ground truth. Optical OCT properties were obtained, compared, and used for separation with machine learning. In addition, two artificial intelligence-assisted methods were utilized for scan classification, and all approaches were examined for RTD accuracy and compared to standard techniques.

Results: In vivo OCT tissue scanning was feasible and easily integrable into the surgical workflow. Measured backscattered light signal intensity, signal attenuation, and signal homogeneity were significantly distinctive in the comparison of scanned white matter to increasing levels of scanned tumor infiltration (p < 0.001) and achieved high values of accuracy (85%) for the detection of diseased brain in the tumor margin with support vector machine separation. A neuronal network approach achieved 82% accuracy and an autoencoder approach 85% accuracy in the detection of diseased brain in the tumor margin. Differentiating cortical gray matter from tumor tissue was not technically feasible in vivo.

Conclusions: In vivo OCT scanning of the human brain has been shown to contain significant value for intraoperative RTD, supporting what has previously been discussed for ex vivo OCT brain tumor scanning, with the perspective of complementing current intraoperative methods for this purpose, especially when deciding to withdraw from further resection toward the end of the surgery.