Abstract

Spectral pre-processing is an essential step in data analysis for biomedical diagnostic applications of Raman spectroscopy, allowing the removal of undesirable spectral contributions that could mask biological information used for diagnosis. However, due to the specificity of pre-processing for a given sample type and the vast number of potential pre-processing combinations, optimisation of pre-processing via a manual “trial and error” format is often time intensive with no guarantee that the chosen method is optimal for the sample type. Here we present the use of high-performance computing (HPC) to trial over 2.4 million pre-processing permutations to demonstrate the optimisation on the pre-processing of human serum Raman spectra for colorectal cancer detection. The effect of varying pre-processing order, using extended multiplicative scatter correction, spectral smoothing, baseline correction, binning and normalization was considered. Permutations were assessed on their ability to detect patients with disease using a random forest (RF) algorithm trained with 102 patients (510 spectra) and independently tested with a set of 439 patients (1317 spectra) in a primary care patient cohort. Optimising via HPC enables improved performance in diagnostic abilities, with sensitivity increasing by 14.6%, specificity increasing by 6.9%, positive predictive value increasing by 3.4%, and negative predictive value increasing by 2.4% when compared to a standard pre-processing optimisation. Ultimate values of these metrics are very important for diagnostic adoption, and once diagnostics demonstrate good accuracy these types of optimisations can make a significant difference to roll-out of a test and demonstrating advantages over existing tests. We also provide tips/recommendations for pre-processing optimisation without the use of HPC. From the HPC permutations, recommendations for appropriate parameter constraints for conducting a more basic pre-processing optimisation are also detailed, thus helping model development for researchers not having access to HPC.

© 2022 The Author(s)

Label-free surface-enhanced Raman spectroscopy for detection of colorectal cancer and precursor lesions using blood plasma

Shangyuan Feng, Wenbo Wang, Isabella T. Tai, Guannan Chen, Rong Chen, and Haishan Zeng
Biomed. Opt. Express 6(9) 3494-3502 (2015)

Colorectal cancer detection by gold nanoparticle based surface-enhanced Raman spectroscopy of blood serum and statistical analysis

Duo Lin, Shangyuan Feng, Jianji Pan, Yanping Chen, Juqiang Lin, Guannan Chen, Shusen Xie, Haishan Zeng, and Rong Chen
Opt. Express 19(14) 13565-13577 (2011)

Identification and characterization of colorectal cancer using Raman spectroscopy and feature selection techniques

Shaoxin Li, Gong Chen, Yanjiao Zhang, Zhouyi Guo, Zhiming Liu, Junfa Xu, Xueqiang Li, and Lin Lin
Opt. Express 22(21) 25895-25908 (2014)

Diagnostic potential of polarized surface enhanced Raman spectroscopy technology for colorectal cancer detection

Duo Lin, Hao Huang, Sufang Qiu, Shangyuan Feng, Guannan Chen, and Rong Chen
Opt. Express 24(3) 2222-2234 (2016)

Rapid and label-free urine test based on surface-enhanced Raman spectroscopy for the non-invasive detection of colorectal cancer at different stages

Jinyong Lin, Zongwei Huang, Xueliang Lin, Qiong Wu, Kerun Quan, Yanming Cheng, Mingzhi Zheng, Jiaying Xu, Yitao Dai, Hejin Qiu, Duo Lin, and Shangyuan Feng
Biomed. Opt. Express 11(12) 7109-7119 (2020)