A computational method to differentiate rheumatoid arthritis patients using thermography data

1.Introduction

Rheumatoid arthritis (RA) is a chronic connective tissue disease manifested by pain, swelling, stiffness of the joints and elevated temperature [1]. Clinical evaluation of this disease is based on in-depth analysis and interpretation of symptoms, laboratory parameters and medical imaging examinations [2, 3]. The commonly used parameters are the erythrocyte sedimentation rate (ESR) and C-reactive protein (CRP). However, both of the parameters are non-specific to RA [8]. Indicators of disease activity look promising. They are a combination of disease activity parameters combined in one specific measure. The most commonly used test is DAS 28 [4], which is based on the assessment of 28 joints. Recently, some authors proposed automated screening systems by applying artificial intelligence methods for RA diagnosis [5, 6, 7, 8, 9, 10]. The dataset was used to train the neural network based on the diagnosis criteria of RA, supported by image techniques [11, 12, 13]. Murakami et al. [14] proposed a new quantitative method for automatically detecting bone erosion from hand X-ray images. The selected areas of interest were analysed in terms of presence or absence of bone erosion using a classifier based on deep neural networks. The percentage of true positive results and false-positive results was 80.5% and 0.84%, respectively. Helwan et al. [15] have attempted to develop a new intelligent system for identifying rheumatoid knee arthritis using X-ray image processing techniques and a neural classifier. The identification index was 95.5%. In turn, Naz et al. [16] presented RA classification methods using neural networks based on thermal patterns obtained from passive thermography. The multi-layer feed-forward perceptron algorithm with backpropagation was used for RA recognition. However, the experimenters did not take into account any clinical parameters of RA. Moreover, Umpathy et al. [17] used a k-means algorithm and fuzzy c means algorithm to classify patients with RA and healthy subjects based on the feature extracted from the segmented thermal image. The receiver operating characteristics (ROC) curve depicted a sensitivity of 86.6% and specificity of 79% achieved in the MCP region of the thermal hand image. Thus, there is a need to develop a method for diagnosing RA using a consolidated set of data from blood analysis and thermography. Herein the following issues related to RA disease are discussed: 1) Which clinical data are significant in the primary diagnosis of RA; 2) What parameters from thermograms should be addressed in differentiation patients with RA from the healthy; 3) Can artificial neural networks (ANN) differentiate patients with RA from the healthy?

2.Methods

2.2Measurement protocol for thermography

The thermograms of both hands for each subject were taken with the thermal imaging camera (FLIR, E60bx, Systems Inc., USA) with a resolution of 320 × 240 pixels. The measurement conditions were air humidity 55%, emissivity 0.98, air and ambient temperature 23 ± 1∘C. Dynamic infrared thermography, which was used in our approach, involved thermal provocations tests. In rheumatologic diseases, it is reasonable because inflamed tissue woven reacts differently to a thermal stimulus due to increased synovial vascularization of the joints affected by this disease [2, 3]. The temperature measurement included two steps: 1) hand’s cooling in the water of 0∘C for 5 seconds; 2) hand’s rewarming for 180 seconds [2, 3]. Before each measurement, the water temperature was continuously monitored with a digital thermometer and controlled with a mercury thermometer. The thermography images were processed according to [2, 3], and the ROI on thermograms was identified as the axis of all the fingers separately (Fig. 1).

Figure 1.

Region of interest (ROI) of each finger individually.

The outputs were: the mean temperature post-cooling; the mean temperature post-rewarming; and total change in the average temperature of all fingers due to rewarming ΔTr [∘C] [2, 3].

3.Results

3.3ANN

Table 3

Results from multivariate logistic regression model containing all explanatory variables

Parameters	Estimate	SE	z value	p
Thumb ΔTr [∘C]	-0.152	0.069	-2.196	0.028
Index finger ΔTr [∘C]	-0.252	0.081	-3.13	0.002
Middle finger [∘C]	-0.27	0.088	-3.059	0.002
Ring finger ΔTr [∘C]	-0.203	0.087	-2.325	0.020
Little finger ΔTr [∘C]	-0.18	0.081	-2.231	0.026
Age [years]	0.051	0.013	3.883	0.000
BMI [kg/m2]	-0.103	0.043	-2.394	0.017
ESR [mm/h]	0.143	0.026	5.579	0.000
CRP [mg/L]	0.478	0.097	4.935	0.000
RBC [1012/L]	0.297	0.29	1.022	0.307
WBC [109/L]	0.372	0.077	4.804	0.000
PLT [109/L]	0.001	0.002	0.561	0.575

Figure 2.

The ANN model: a) architecture of ANN; b) receiver operating characteristic curves (ROC); c) model of differentiation patients with rheumatoid arthritis from the healthy.

Firstly, the univariate logistic regression method to find significant predictors was used (Table 3). The following parameters were significant in RA prediction: ΔTr for all fingers, patient age, BMI, ESR, CRP and WBC. The ANN architecture consists of 10 neurons in the input layer, 1 in the hidden layer, and 1 in the output layer. The decay index of weighs was 0.1; the Kappa was 0.72. The final architecture of the neural network and the Receiver Operating Characteristic Curves is presented in Fig. 2a and b. The model of differentiation patients with RA from the healthy has been presented in Fig. 2c. High levels of sensitivity and specificity were obtained at 81.25% and 100%, respectively. The accuracy was 92.86%.

4.Discussion

RA is globally the most common inflammatory disease characterized by symmetrical arthritis, extraneous lesions, and systemic complications. It limits the daily functioning of the patient and leads to disability and premature death. The problem in the disease diagnosis is the lack of a generally available method of diagnosing RA that would allow for a quick and effective diagnosis and assessment of joint inflammation activity. Infrared thermographic examination opens up new diagnostic possibilities for RA due to the non-invasive method, low cost and availability of thermal imaging cameras. However, the lack of reliable and unambiguous criteria for quantifying changes in inflammatory joints most frequently affects correct disease diagnosis [23, 24, 25]. In clinical practice, inflammatory markers such as ESR and CRP are used to assess RA activity. We proved that ESR, CRP, WBC, RBC, and PLT are significant in RA diagnosis (p< 0.05). The same was confirmed by authors [20, 21, 22]. Besides the clinical parameters, medical imaging techniques are also beneficial in visualizing joint pathological changes in the RA disease. Sensitive imaging methods allow identifying lesions characteristic of the early stage of the disease, such as inflammation of the soft tissues, synovium and bone marrow. Currently, three basic techniques are used in the imaging diagnostics of RA: conventional radiography (X-ray), ultrasonography and magnetic resonance imaging. In clinical practice, an X-ray examination is prevalent. The other two auxiliary methods are used only when the X-ray examination has failed or does not provide sufficient information about the disease. Due to the limitations of the existing techniques, we decided to verify the usefulness of thermography technique in RA diagnosis. The temperature is a key physical property, which can reflect the articular inflammatory processes. The increase above the typical value could be a classical sign of inflammation. Some authors reported a statistical difference in joints’ absolute temperature between patients affected by rheumatic diseases and healthy controls [26, 28]. This is in agreement with our study, which shows that the reperfusion processes in RA patients and the healthy are different during the thermal provocation. The results suggest higher thermal activity of the healthy tissues due to more perfusion and metabolism, resulting in a lower increase in joint temperature after reheating in patients with RA compared to the healthy. Moreover, we confirmed that the detection of the inflammation status could be achieved using infrared thermography and the ΔTr of hand fingers. Finally, the parameter ΔTr for all fingers, patient age, BMI, ESR, CRP, and WBC were applied to build a model to differentiate patients with RA from the healthy.

5.Conclusion

The proposed ANN model is characterised by high levels of sensitivity, specificity and accuracy. Therefore, we can state that using thermography data in the ANN model increases the method’s precision in differentiating the RA patients from the healthy, which is a new approach in diagnostic methods. In the literature two other studies investigated the thermal patterns between normal or pathological joints [27, 28]; however, the authors did not reach statistical significance. The proposed methodology suggests that the thermography data can be considered in addition to the currently available tools for screening, diagnosis, and monitoring of disease progression [29, 30]. Further studies should be devoted to the comparison of different methods in differentiation RA status.