Skip to main content

Table 1 Mean and SD of different models with accuracy (ACC), area under the ROC curve (AUC), F1 score, sensitivity (SEN), and specificity (SPE) metrics

From: Development of a patients’ satisfaction analysis system using machine learning and lexicon-based methods

Metric

 

AB

DT

LR

MLP

MNB

ACC

MF_TFIDF_SFM

0.87 ± 0.03

0.81 ± 0.04

0.87 ± 0.04

0.87 ± 0.04

0.89 ± 0.03

MF_TFIDF_SKB

0.86 ± 0.02

0.82 ± 0.04

0.86 ± 0.03

0.87 ± 0.03

0.89 ± 0.03

MF_TFIDF_SP

0.85 ± 0.02

0.81 ± 0.03

0.87 ± 0.04

0.88 ± 0.04

0.85 ± 0.01

MF_TFIDF_VT

0.85 ± 0.02

0.82 ± 0.03

0.84 ± 0.03

0.84 ± 0.03

0.87 ± 0.04

MF_TFIDF_VT_SKB

0.86 ± 0.02

0.81 ± 0.03

0.85 ± 0.02

0.86 ± 0.02

0.89 ± 0.03

TFIDF_SFM

0.84 ± 0.02

0.78 ± 0.01

0.86 ± 0.03

0.85 ± 0.03

0.87 ± 0.03

TFIDF_SKB

0.84 ± 0.02

0.78 ± 0.03

0.85 ± 0.02

0.86 ± 0.03

0.87 ± 0.02

TFIDF_SP

0.84 ± 0.03

0.78 ± 0.03

0.87 ± 0.04

0.87 ± 0.04

0.85 ± 0.01

TFIDF_VT

0.8 ± 0.02

0.76 ± 0.03

0.81 ± 0.03

0.81 ± 0.03

0.81 ± 0.03

TFIDF_VT_SKB

0.83 ± 0.01

0.77 ± 0.02

0.83 ± 0.02

0.84 ± 0.02

0.86 ± 0.04

AUC

MF_TFIDF_SFM

0.84 ± 0.03

0.77 ± 0.04

0.86 ± 0.04

0.85 ± 0.04

0.87 ± 0.03

MF_TFIDF_SKB

0.85 ± 0.03

0.78 ± 0.04

0.83 ± 0.02

0.84 ± 0.03

0.87 ± 0.02

MF_TFIDF_SP

0.84 ± 0.01

0.77 ± 0.03

0.86 ± 0.04

0.86 ± 0.04

0.8 ± 0.02

MF_TFIDF_VT

0.83 ± 0.02

0.78 ± 0.03

0.82 ± 0.03

0.82 ± 0.04

0.85 ± 0.04

MF_TFIDF_VT_SKB

0.84 ± 0.03

0.77 ± 0.04

0.83 ± 0.02

0.84 ± 0.02

0.87 ± 0.03

TFIDF_SFM

0.81 ± 0.03

0.73 ± 0.01

0.84 ± 0.03

0.83 ± 0.03

0.85 ± 0.04

TFIDF_SKB

0.81 ± 0.03

0.75 ± 0.03

0.81 ± 0.02

0.82 ± 0.02

0.84 ± 0.02

TFIDF_SP

0.82 ± 0.03

0.75 ± 0.04

0.84 ± 0.04

0.84 ± 0.04

0.79 ± 0.02

TFIDF_VT

0.76 ± 0.02

0.71 ± 0.03

0.77 ± 0.03

0.78 ± 0.03

0.78 ± 0.04

TFIDF_VT_SKB

0.8 ± 0.02

0.73 ± 0.01

0.81 ± 0.02

0.81 ± 0.02

0.84 ± 0.03

F1

MF_TFIDF_SFM

0.9 ± 0.02

0.86 ± 0.03

0.9 ± 0.03

0.9 ± 0.03

0.92 ± 0.03

MF_TFIDF_SKB

0.89 ± 0.02

0.86 ± 0.03

0.89 ± 0.02

0.9 ± 0.02

0.92 ± 0.02

MF_TFIDF_SP

0.88 ± 0.02

0.86 ± 0.02

0.91 ± 0.03

0.91 ± 0.03

0.9 ± 0.01

MF_TFIDF_VT

0.89 ± 0.02

0.87 ± 0.02

0.88 ± 0.02

0.88 ± 0.03

0.9 ± 0.03

MF_TFIDF_VT_SKB

0.89 ± 0.02

0.87 ± 0.02

0.89 ± 0.02

0.89 ± 0.02

0.91 ± 0.02

TFIDF_SFM

0.88 ± 0.02

0.84 ± 0.01

0.89 ± 0.03

0.89 ± 0.03

0.91 ± 0.03

TFIDF_SKB

0.88 ± 0.02

0.83 ± 0.03

0.89 ± 0.02

0.89 ± 0.02

0.9 ± 0.02

TFIDF_SP

0.88 ± 0.02

0.83 ± 0.03

0.9 ± 0.03

0.9 ± 0.03

0.89 ± 0.01

TFIDF_VT

0.86 ± 0.02

0.83 ± 0.02

0.86 ± 0.02

0.86 ± 0.02

0.86 ± 0.02

TFIDF_VT_SKB

0.88 ± 0.01

0.84 ± 0.01

0.87 ± 0.02

0.88 ± 0.02

0.9 ± 0.03

SEN

MF_TFIDF_SFM

0.91 ± 0.04

0.89 ± 0.03

0.91 ± 0.05

0.91 ± 0.05

0.93 ± 0.04

MF_TFIDF_SKB

0.88 ± 0.05

0.89 ± 0.04

0.92 ± 0.04

0.92 ± 0.03

0.94 ± 0.04

MF_TFIDF_SP

0.86 ± 0.04

0.88 ± 0.03

0.92 ± 0.04

0.92 ± 0.04

0.98 ± 0.02

MF_TFIDF_VT

0.91 ± 0.04

0.92 ± 0.02

0.89 ± 0.03

0.89 ± 0.04

0.91 ± 0.04

MF_TFIDF_VT_SKB

0.89 ± 0.03

0.91 ± 0.03

0.9 ± 0.03

0.9 ± 0.03

0.93 ± 0.04

TFIDF_SFM

0.89 ± 0.04

0.89 ± 0.02

0.9 ± 0.04

0.89 ± 0.04

0.93 ± 0.03

TFIDF_SKB

0.91 ± 0.03

0.84 ± 0.06

0.92 ± 0.03

0.93 ± 0.04

0.94 ± 0.04

TFIDF_SP

0.87 ± 0.04

0.85 ± 0.05

0.92 ± 0.04

0.93 ± 0.04

0.97 ± 0.02

TFIDF_VT

0.9 ± 0.05

0.88 ± 0.03

0.89 ± 0.04

0.89 ± 0.03

0.87 ± 0.04

TFIDF_VT_SKB

0.91 ± 0.03

0.88 ± 0.03

0.89 ± 0.05

0.89 ± 0.05

0.91 ± 0.05

SPE

MF_TFIDF_SFM

0.78 ± 0.06

0.66 ± 0.06

0.8 ± 0.03

0.8 ± 0.04

0.82 ± 0.02

MF_TFIDF_SKB

0.82 ± 0.08

0.68 ± 0.04

0.74 ± 0.03

0.77 ± 0.03

0.8 ± 0.02

MF_TFIDF_SP

0.81 ± 0.02

0.67 ± 0.05

0.79 ± 0.04

0.79 ± 0.04

0.62 ± 0.03

MF_TFIDF_VT

0.74 ± 0.03

0.63 ± 0.04

0.75 ± 0.05

0.75 ± 0.05

0.79 ± 0.07

MF_TFIDF_VT_SKB

0.79 ± 0.07

0.62 ± 0.06

0.76 ± 0.04

0.78 ± 0.03

0.8 ± 0.04

TFIDF_SFM

0.74 ± 0.07

0.58 ± 0.02

0.77 ± 0.04

0.77 ± 0.04

0.76 ± 0.06

TFIDF_SKB

0.71 ± 0.05

0.66 ± 0.06

0.71 ± 0.02

0.72 ± 0.03

0.73 ± 0.03

TFIDF_SP

0.77 ± 0.04

0.65 ± 0.09

0.76 ± 0.05

0.75 ± 0.06

0.6 ± 0.04

TFIDF_VT

0.62 ± 0.07

0.53 ± 0.03

0.65 ± 0.06

0.66 ± 0.05

0.68 ± 0.08

TFIDF_VT_SKB

0.7 ± 0.07

0.57 ± 0.02

0.74 ± 0.04

0.74 ± 0.05

0.77 ± 0.04