Using natural language processing to understand, facilitate and maintain continuity in patient experience across transitions of care.

Background: Patient centred care necessitates that healthcare experiences and perceived outcomes be considered across all transitions of care. Information encoded within free-text patient experience comments relating to transitions of care are not captured in a systematic way due to the manual resource required. We demonstrate the use of natural language processing (NLP) to extract meaningful information from the Friends and Family Test (FFT).

Methods: Free-text fields identifying favourable service ("What did we do well?") and areas requiring improvement ("What could we do better?") were extracted from 69,285 FFT reports across four care settings at a secondary care National Health Service (NHS) hospital. Sentiment and patient experience themes were coded by three independent coders to produce a training dataset. The textual data was standardised with a series of pre-processing techniques and the performance of six machine learning (ML) models was obtained. The best performing ML model was applied to predict the themes and sentiment from the remaining reports. Comments relating to transitions of care were extracted, categorised by sentiment, and care setting to identify the most frequent words/combinations presented as tri-grams and word clouds.

Results: The support vector machine (SVM) ML model produced the highest accuracy in predicting themes and sentiment. The most frequent single words relating to transition and continuity with a negative sentiment were "discharge" in inpatients and Accident and Emergency, "appointment" in outpatients, and "home' in maternity. Tri-grams identified from the negative sentiments such as 'seeing different doctor', 'information aftercare lacking', 'improve discharge process' and 'timing discharge letter' have highlighted some of the problems with care transitions. None of this information was available from the quantitative data.

Conclusions: NLP can be used to identify themes and sentiment from patient experience survey comments relating to transitions of care in all four healthcare settings. With the help of a quality improvement framework, findings from our analysis may be used to guide patient-centred interventions to improve transitional care processes.