web viewparameter estimates (se) and or (95% ci) of variables by logistic regression in galad-c and...

23
Supplementary files for: Validation of the GALAD Model and Establishment of GAAP Model for Diagnosis of Hepatocellular Carcinoma in Chinese patients Miaoxia Liu 1,2$ , Ruihong Wu 1,3$ , Xu Liu 1 , Hongqin Xu 1 , Xiumei Chi 1,3 , Xiaomei Wang 1 , Mengru Zhan 1 , Bao Wang 1 , Fei Peng 1 , Xiuzhu Gao 1,3 , Ying Shi 1 , Xiaoyu Wen 1 , Yali Ji 3 , Qinglong Jin 1 , Junqi Niu 1 1 Department of Hepatology, First Hospital of Jilin University, Changchun, Jilin, China; 2 Hepatology Unit, Department of Infectious Diseases, Nanfang Hospital, Southern Medical University, Guangzhou, Guangdong, China; 3 Phase I Clinical Research Center, First Hospital of Jilin University, Changchun, Jilin, China; $ These authors contributed equally to this work Correspondence: Qinglong Jin Department of Hepatology, First Hospital of Jilin University, 71 Xin Min Street, Changchun 130021, China Tel +86-431-81875103 Fax +86-431-81875103 Email [email protected] 1 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 1 2

Upload: others

Post on 01-Feb-2021

1 views

Category:

Documents


0 download

TRANSCRIPT

Supplementary files for:

Validation of the GALAD Model and Establishment of GAAP Model for Diagnosis of Hepatocellular Carcinoma in Chinese patients

Miaoxia Liu1,2$, Ruihong Wu1,3$, Xu Liu1, Hongqin Xu1, Xiumei Chi1,3, Xiaomei Wang1, Mengru Zhan1, Bao Wang1, Fei Peng1, Xiuzhu Gao1,3, Ying Shi1, Xiaoyu Wen1, Yali Ji3, Qinglong Jin1, Junqi Niu1

1Department of Hepatology, First Hospital of Jilin University, Changchun, Jilin, China; 2Hepatology Unit, Department of Infectious Diseases, Nanfang Hospital, Southern Medical University, Guangzhou, Guangdong, China; 3Phase I Clinical Research Center, First Hospital of Jilin University, Changchun, Jilin, China;

$These authors contributed equally to this work

Correspondence: Qinglong Jin Department of Hepatology, First Hospital of Jilin University, 71 Xin Min Street, Changchun 130021, China Tel +86-431-81875103 Fax +86-431-81875103 Email [email protected]

Supplementary Figure S1. Correlation of serum AFP and PIVKA-II. Spearman correlation analysis was used for correlation analysis. n=625, horizontal line represented the cut-off value of PIVKA-II at 28.23 mAU/mL, vertical line represented the cut-off value of AFP at 12.62 ng/mL.

Supplementary Figure S2. Serum ALT in CHB, HCC, HBV related Cirrhosis and CHC.

HCC consisted of HBV related HCC and HCV related HCC. Kruskal-wallis H test was used for comparison among three groups, and post hoc Dunn's Multiple Comparison test was performed for pairwise comparison.*** P<0.001,* P<0.05, ns P>0.05.

Supplementary Figure S3. Correlation between ALT and AFP (A), and PIVKA-II (B). Spearman correlation analysis was used for correlation analysis.

Supplementary Figure S4. Serum AFP and PIVKA-II in HCC with or without Cirrhosis and different Child-Pugh score. (A) AFP level in HCC with Cirrhosis vs without Cirrhosis. (B) PIVKA-II level in HCC with Cirrhosis vs without Cirrhosis. (C) AFP level in HCC with different Child-Pugh score. (D) PIVKA-II level in HCC with different Child-Pugh score. Mann-whitney U test was used for Comparison between two groups, Kruskal-wallis H was used for Comparison among three groups.

Supplementary Figure S5. Performances of GALAD, GALAD-C, GAAP, individual biomarkers in differentiating of HCC and CLD patients with negative AFP (<20ng/mL). The entire dataset, all HCC and CLD patients in table 1 with negative AFP (A); HCV subset, HCC and CLD with HCV infection and negative AFP (B); HBV subset, HCC and CLD with HBV infection and negative AFP (C). Sen, sensitivity; Spe, specificity; Ppv, positive predictive value; Npv, negative predictive value; Ccp, percent correctly classified. *Four kinds of cutoff points were defined. The first one was the cutoff point maximizing sensitivity while keeping specificity at 80% based on the corresponding subset locally. The second one was the cutoff point maximizing sensitivity while keeping specificity at 90% based on the corresponding subset locally. The third one was the cutoff point maximizing the sum of the sensitivity and specificity based on the corresponding subset locally. The fourth one was the cutoff point maximizing the sum of the sensitivity and specificity based on all the HCC and CLD patients in the table 1 with negative AFP.

Supplementary Figure S6. Performances of GALAD, GALAD-C, GAAP, individual biomarkers in differentiating of HCC and Other malignant liver tumor (A), HCC vs. ICC patients (B), HCC vs. liver metastases (C), and HCC vs. healthy controls (D). Sen, sensitivity; Spe, specificity; PPV, positive predictive value; NPV, negative predictive value.

Supplementary Figure S7. Correlation between AFP (A), PIVKA-II (B), GALAD-C (C) and GAAP (D) with maximum tumor diameter.

Supplementary Figure S8. AFP (A), PIVKA-II (B), GALAD-C score (C) and GAAP score (D) in patients with or without portal vein invasion. PVI, Portal Vein Invasion; HCC without PVI (n=193), HCC with PVI (n=41).

Supplementary Figure S9. Conjugated Bilirubin (CB) in ICC, HCC, Cirrhosis, Chronic Hepatitis, MT and HC. ICC, intrahepatic cholangiocarcinoma; HCC, hepatocellular carcinoma (HCC); MT, liver metastases; HC, healthy Controls. Mann-whitney U test was used for Comparison between two groups. *** P<0.001, ** P<0.01, * P<0.05.

Supplementary Table S1. Comparison of serum AFP, PIVKA-II in HBV related liver disease and HCV related liver disease

Variable

HBV related HCC

N=135

HCV related HCC

N=106

HBV related Cirrhosis

N=102

HCV related Cirrhosis

N=84

CHB

N=47

CHC

N=49

H

P value

AFP

(ng/mL)

25.28

(5.55-543.8)

36.68

(9.22-371.9)

3.62

(2.26-10.99)

5.01

(3.06-17.34)

12.0

(4.47-145.4)

4.20

(2.71-9.85)

113.5

<0.001

PIVKA-II

(mAU/mL)

124.3

(30.0-793.5)

396.7

(45.0-2391)

18.2

(14.1-27.8)

20.0

(14.2-27.9)

24.2

(19.1-32.9)

22.66

(18.0-31.6)

222.1

<0.001

Note: Kruskal-wallis H was used for Comparison between 6 groups. HBV, Hepatitis B Virus; HCV, Hepatitis C Virus; CHB, Chronic Hepatitis B; CHC, Chronic Hepatitis C.

Supplementary Table S2. Parameter estimates (SE) and OR (95% CI) of variables by logistic regression in GALAD-C and GAAP models

Variable

β (SE)

OR (95% CI)

P

GALAD-C score (based on all HCC patients and all CLD patients in Table 1)

= -11.501 + 0.733 [Gender (1 for male, 0 for female)] + 0.099 [Age] + 0.073 [AFP-L3%] + 0.840 log10 [AFP] + 2.364 log10 [PIVKA-II]

Constant

-11.501 (1.171)

-

-

Gender (Male vs Female)

0.733 (0.295)

2.082 (1.167-3.714)

0.013

Age (years)

0.099 (0.015)

1.104 (1.072-1.136)

<0.001

AFP-L3%

0.073 (0.020)

1.075 (1.033-1.119)

<0.001

Log10(AFP)

0.840 (0.183)

2.317(1.618-3.319)

<0.001

Log10(PIVKA-II)

2.346 (0.318)

10.636 (5.707-19.822)

<0.001

GAAP score (based on all HCC patients and all CLD patients in Table 1)

= -11.203 + 0.699 [Gender (1 for male, 0 for female)] + 0.094 [Age] + 1.076 log10 [AFP] + 2.376 log10 [PIVKA-II]

Constant

-11.203 (1.111)

-

-

Gender (Male vs Female)

0.699 (0.284)

2.012 (1.152-3.512)

0.014

Age (years)

0.094 (0.014)

1.099 (1.069-1.130)

<0.001

Log10 (AFP)

1.076 (0.176)

2.932 (2.078-4.138)

<0.001

Log10 (PIVKA-II)

2.376 (0.308)

10.765 (5.882-19.703)

<0.001

Supplementary Table S3. ROC curve analysis of GALAD, GALAD-C, GAAP and individual serum biomarkers for discriminating HCC (n=242) and cirrhosis (n=187)

Model/biomarker

cut-off value

AUC(95%CI)

P value (GALAD-C vs others)

Sensitivity %

Specificity%

PPV %

NPV %

Correctly classified %

GALAD

0.946

0.893(0.864-0.922)

0.0192

81.8

79.7

83.9

77.2

80.9

GALAD-C

-0.374

0.916(0.891-0.942)

/

82.6

85.0

87.7

79.1

83.7

GAAP

-0.650

0.907(0.879-0.934)

0.0430

87.2

77.0

83.1

82.3

82.8

PIVKA-II mAU/mL

28.23

0.876(0.844-0.908)

0.0033

82.6

75.9

81.6

77.2

79.7

AFP ng/ml

12.62

0.773(0.730-0.817)

<0.0001

64.5

74.9

76.8

61.9

69

AFP-L3%

1.744

0.719(0.671-0.767)

<0.0001

54.1

86.6

84.0

59.3

68.3

Note: AUC=area under receiver operating characteristic curve; PPV= Positive Predictive Value; NPV= Negative Predictive Value.

Supplementary Table S4. ROC curve analysis of GALAD, GALAD-C, GAAP and individual serum biomarkers for discriminating HCC (n=242) and Hepatitis (n=96)

Model/biomarker

cut-off value

AUC(95%CI)

P value (GALAD-C vs others)

Sensitivity %

Specificity%

PPV %

NPV %

Correctly classified %

GALAD

0.946

0.887(0.848-0.927)

<0.0001

81.8

80.2

91.2

63.6

81.4

GALAD-C

-0.374

0.934(0.908-0.96)

/

82.6

87.5

94.3

66.7

84.0

GAAP

-0.650

0.927(0.898-0.956)

0.1786

87.2

83.3

93.0

72.1

86.1

PIVKA-II mAU/mL

28.23

0.856(0.817-0.896)

<0.0001

82.6

70.8

87.7

61.8

79.3

AFP ng/ml

12.62

0.706(0.646-0.765)

<0.0001

64.5

66.7

83.0

42.7

65.1

AFP-L3%

1.744

0.696(0.641-0.752)

<0.0001

54.1

80.2

87.3

41.0

61.5

Note: AUC=area under receiver operating characteristic curve; PPV= Positive Predictive Value; NPV= Negative Predictive Value.

Supplementary Table S5. ROC curve analysis of GALAD, GALAD-C, GAAP and individual serum biomarkers for discriminating HCC within Milan criteria (n=86) and CLD (n=283)

Model/biomarker

cut-off value

AUC(95%CI)

P value (GALAD-C vs others)

Sensitivity %

Specificity%

PPV %

NPV %

Correctly classified %

GALAD

0.946

0.810(0.761-0.859)

0.0984

62.8

79.9

48.6

87.6

75.9

GALAD-C

-0.374

0.841(0.794-0.889)

/

61.6

85.9

57.0

88.0

80.2

GAAP

-0.650

0.840(0.793-0.887)

0.8121

70.9

79.2

50.8

90.0

77.2

PIVKA-II mAU/mL

28.23

0.801(0.748-0.854)

0.0983

72.1

74.2

45.9

89.7

73.7

AFP ng/ml

12.62

0.679(0.615-0.742)

<0.0001

51.2

72.1

35.8

82.9

67.2

AFP-L3%

1.744

0.602(0.529-0.675)

<0.0001

34.9

84.5

40.5

81.0

72.9

Note: AUC=area under receiver operating characteristic curve; PPV= Positive Predictive Value; NPV= Negative Predictive Value.

Supplementary Table S6. ROC curve analysis of GALAD, GALAD-C, GAAP and individual serum biomarkers for discriminating HCC with maximum diameter < 5cm (n=145) and CLD (n=283)

Model/biomarker

cut-off value

AUC(95%CI)

P value (GALAD-C vs others)

Sensitivity %

Specificity%

PPV %

NPV %

Correctly classified %

GALAD

0.946

0.855(0.819-0.892)

0.0102

74.5

79.9

65.5

85.9

78.0

GALAD-C

-0.374

0.889(0.856-0.921)

/

73.8

85.9

72.8

86.5

81.8

GAAP

-0.650

0.882(0.849-0.915)

0.1433

80.7

79.2

66.5

88.9

79.7

PIVKA-II mAU/mL

28.23

0.827(0.787-0.868)

0.0008

76.6

74.2

60.3

86.1

75.0

AFP ng/ml

12.62

0.730(0.681-0.780)

<0.0001

60.7

72.1

52.7

78.2

68.2

AFP-L3%

1.744

0.669(0.610-0.727)

<0.0001

46.9

84.5

60.7

75.6

71.7

Note: AUC=area under receiver operating characteristic curve; PPV= Positive Predictive Value; NPV= Negative Predictive Value.

Supplementary Table S7. ROC curve analysis of GALAD, GALAD-C, GAAP and individual serum biomarkers for discriminating HCC with maximum diameter ≥ 5cm (n=75) and CLD (n=283)

Model/biomarker

cut-off value

AUC(95%CI)

P value (GALAD-C vs others)

Sensitivity %

Specificity%

PPV %

NPV %

Correctly classified %

GALAD

0.946

0.960(0.937-0.982)

0.0029

94.7

79.9

55.5

98.3

83.0

GALAD -C

-0.374

0.983(0.969-0.998)

/

96.0

85.9

64.3

98.8

88.0

GAAP

-0.650

0.982(0.966-0.997)

0.1298

98.7

79.2

55.6

99.6

83.2

PIVKA-II mAU/mL

28.23

0.969(0.946-0.993)

0.0121

97.3

74.2

50.0

99.1

79.1

AFP ng/ml

12.62

0.793(0.729-0.856)

<0.0001

70.7

72.1

40.2

90.3

71.8

AFP-L3%

1.744

0.782(0.710-0.853)

<0.0001

65.3

84.5

52.7

90.2

80.4

Note: AUC=area under receiver operating characteristic curve; PPV= Positive Predictive Value; NPV= Negative Predictive Value.

Supplementary Table S8. ROC curve analysis of serum biomarkers alone, GALAD-C and GAAP for discriminating HCC and CLD stratified by etiology.

Model/biomarker

cut-off value

AUC(95%CI)

P value (GALAD-C vs others)

Sensitivity %

Specificity%

PPV%

NPV %

Correctly classified %

With HCV etiology, HCC ( n=106 ) vs CLD ( cirrhosis =84, hepatitis = 49 )

GALAD

0.946

0.939(0.911-0.966)

0.024

89.6

81.2

79.2

90.8

84.9

GALAD-C

-0.374

0.958(0.936-0.981)

/

92.5

83.5

81.7

93.3

87.4

GAAP

-0.650

0.954(0.931-0.977)

0.145

95.3

72.9

73.7

95.1

82.8

PIVKA-II mAU/mL

28.23

0.909(0.872-0.947)

0.002

87.7

75.2

73.8

88.5

80.8

AFP ng/ml

12.62

0.797(0.739-0.854)

<0.001

68.9

73.7

67.6

74.8

71.5

AFP-L3%

1.744

0.777(0.714-0.841)

<0.001

60.4

89.5

82.1

73.9

76.6

AFP+PIVKA-II

Same as above

0.72(0.655-0.785)

<0.001

90.6

53.4

60.8

87.7

69.9

AFP+AFP-L3%

Same as above

0.718(0.652-0.785)

<0.001

70.8

72.9

67.6

75.8

72

AFP+PIVKA-II+AFP-L3%

Same as above

0.716(0.651-0.781)

<0.001

90.6

52.6

60.4

87.5

69.5

With HBV etiology, HCC ( n=135 ) vs CLD ( cirrhosis = 102, hepatitis = 47)

GALAD

0.946

0.855(0.812-0.897)

<0.001

75.6

78.5

76.1

78.0

77.1

GALAD-C

-0.374

0.904(0.869-0.939)

/

75.6

87.9

85.0

79.9

82

GAAP

-0.650

0.894(0.857-0.931)

0.179

80.7

84.6

82.6

82.9

82.7

PIVKA-II mAU/mL

28.23

0.839(0.793-0.884)

<0.001

78.5

73.8

73.1

79.1

76.1

AFP ng/ml

12.62

0.719(0.661-0.778)

<0.001

60.7

70.5

65.1

66.5

65.8

AFP-L3%

1.744

0.658(0.593-0.722)

<0.001

49.6

79.9

69.1

63.6

65.5

AFP+PIVKA-II

Same as above

0.72(0.66-0.78)

<0.001

90.4

53.7

63.9

86.0

71.1

AFP+AFP-L3%

Same as above

0.679(0.616-0.742)

<0.001

65.9

69.8

66.4

69.3

68

AFP+PIVKA-II+AFP-L3%

Same as above

0.728(0.669-0.787)

<0.001

92.6

53.0

64.1

88.8

71.8

Note: AUC=area under receiver operating characteristic curve; PPV= Positive Predictive Value; NPV= Negative Predictive Value.

Supplementary Table S9. Diagnostic efficiency of GAAP in test dataset

Model for Validate Data N=308

AUC (95%CI)

cut-off value

Sensitivity %

Specificity %

FPR

%

FNR

%

Correctly

classified

%

GAAP

0.922(0.893-0.950)

-0.650

88(149/169)

80(111/139)

12(20/169)

20(28/139)

84(260/308)

AUC=area under receiver operating characteristic curve; FPR, false positive rate; FNR, false negative rate.

Supplementary Table S10. Distributions of tumor size in HCC patients with different etiologies

tumor size

all (n=242)

HCV (n=106)

HBV (n=135)

unifocal < 2cm

29 (12.0)

6 (5.7)

23 (17.0)

unifocal < 3cm

55 (22.7)

14 (13.2)

40 (29.6)

unifocal < 4cm

71 (29.3)

21 (19.8)

49 (36.3)

unifocal < 5cm

81 (33.5)

26 (24.5)

54 (40.0)

unifocal < 10cm

97 (40.1)

32 (30.2)

64 (47.4)

Within Milan criteria

86 (35.5)

29 (27.4)

56 (41.5)

max diameter < 5cm

145 (59.9)

61 (57.5)

83 (61.5)

max diameter ≥ 5cm

75 (31.0)

34 (32.1)

41 (30.4)

2

supplementary Table S11. Models/individual markers performance in subsets

model/ marker

subset

HCC or CLD patients, entire dataset

HCC or CLD patients, with an HCV etiology

HCC or CLD patients, with an HBV etiology

HCCvsCLD

AUC(95%CI)

sen spe ppv npv ccp

HCCvsCLD

AUC(95%CI)

sen spe ppv npv ccp

HCCvsCLD

AUC(95%CI)

sen spe ppv npv ccp

GALAD

unifocal < 2cm

29 vs. 283

0.783(0.698-0.868)

62.1 79.9 24.0 95.4 78.2

6 vs. 133

0.789(0.598-0.981)

66.7 81.2 13.8 98.2 80.6

23 vs. 149

0.772(0.677-0.866)

60.9 78.5 30.4 92.9 76.2

GALAD

unifocal < 3cm

55 vs. 283

0.789(0.729-0.850)

60.0 79.9 36.7 91.1 76.6

14 vs. 133

0.807(0.694-0.920)

57.1 81.2 24.2 94.7 78.9

40 vs. 149

0.775(0.702-0.849)

60.0 78.5 42.9 88.0 74.6

GALAD

unifocal < 4cm

71 vs. 283

0.819(0.768-0.870)

66.2 79.9 45.2 90.4 77.1

21 vs. 133

0.840(0.755-0.926)

66.7 81.2 35.9 93.9 79.2

49 vs. 149

0.805(0.739-0.870)

65.3 78.5 50.0 87.3 75.3

GALAD

unifocal < 5cm

81 vs. 283

0.814(0.763-0.864)

64.2 79.9 47.7 88.6 76.4

26 vs. 133

0.849(0.774-0.925)

69.2 81.2 41.9 93.1 79.2

54 vs. 149

0.794(0.728-0.860)

61.1 78.5 50.8 84.8 73.9

GALAD

unifocal < 10cm

97 vs. 283

0.830(0.785-0.875)

68.0 79.9 53.7 87.9 76.8

32 vs. 133

0.872(0.807-0.937)

75.0 81.2 49.0 93.1 80.0

64 vs. 149

0.806(0.745-0.867)

64.1 78.5 56.2 83.6 74.2

GALAD

Within Milan criteria

86 vs. 283

0.810(0.761-0.859)

62.8 79.9 48.6 87.6 75.9

29 vs. 133

0.855(0.784-0.926)

69.0 81.2 44.4 92.3 79.0

56 vs. 149

0.785(0.719-0.850)

58.9 78.5 50.8 83.6 73.2

GALAD

max diameter < 5cm

145 vs. 283

0.855(0.819-0.892)

74.5 79.9 65.5 85.9 78.0

61 vs. 133

0.910(0.868-0.952)

82.0 81.2 66.7 90.8 81.4

83 vs. 149

0.816(0.761-0.871)

68.7 78.5 64.0 81.8 75.0

GALAD

max diameter ≥ 5cm

75 vs. 283

0.960(0.937-0.982)

94.7 79.9 55.5 98.3 83.0

34 vs. 133

0.990(0.978-1.000)

100 81.2 57.6 100 85.0

41 vs. 149

0.935(0.895-0.974)

90.2 78.5 53.6 96.7 81.1

GALAD-C

unifocal < 2cm

29 vs. 283

0.788(0.704-0.872)

51.7 85.9 27.3 94.6 82.7

6 vs. 133

0.783(0.605-0.961)

50.0 83.5 12.0 97.4 82.0

23 vs. 149

0.807(0.715-0.898)

52.2 87.9 40.0 92.3 83.1

GALAD-C

unifocal < 3cm

55 vs. 283

0.808(0.746-0.871)

58.2 85.9 44.4 91.4 81.4

14 vs. 133

0.858(0.750-0.966)

71.4 83.5 31.2 96.5 82.3

40 vs. 149

0.811(0.737-0.885)

55.0 87.9 55.0 87.9 81.0

GALAD-C

unifocal < 4cm

71 vs. 283

0.844(0.792-0.896)

64.8 85.9 53.5 90.7 81.6

21 vs. 133

0.885(0.806-0.963)

71.4 83.5 40.5 94.9 81.8

49 vs. 149

0.843(0.779-0.907)

63.3 87.9 63.3 87.9 81.8

GALAD-C

unifocal < 5cm

81 vs. 283

0.844(0.795-0.893)

64.2 85.9 56.5 89.3 81.0

26 vs. 133

0.892(0.824-0.961)

73.1 83.5 46.3 94.1 81.8

54 vs. 149

0.838(0.775-0.900)

61.1 87.9 64.7 86.2 80.8

GALAD-C

unifocal < 10cm

97 vs. 283

0.865(0.822-0.908)

69.1 85.9 62.6 89.0 81.6

32 vs. 133

0.912(0.854-0.970)

78.1 83.5 53.2 94.1 82.4

64 vs. 149

0.857(0.801-0.912)

65.6 87.9 70.0 85.6 81.2

GALAD-C

Within Milan criteria

86 vs. 283

0.841(0.794-0.889)

61.6 85.9 57.0 88.0 80.2

29 vs. 133

0.895(0.831-0.959)

72.4 83.5 48.8 93.3 81.5

56 vs. 149

0.832(0.770-0.894)

57.1 87.9 64.0 84.5 79.5

GALAD-C

max diameter < 5cm

145 vs. 283

0.889(0.856-0.921)

73.8 85.9 72.8 86.5 81.8

61 vs. 133

0.938(0.903-0.973)

86.9 83.5 70.7 93.3 84.5

83 vs. 149

0.866(0.818-0.915)

65.1 87.9 75.0 81.9 79.7

GALAD-C

max diameter ≥ 5cm

75 vs. 283

0.983(0.969-0.998)

96.0 85.9 64.3 98.8 88.0

34 vs. 133

0.999(0.997-1.000)

100 83.5 60.7 100 86.8

41 vs. 149

0.972(0.948-0.997)

92.7 87.9 67.9 97.8 88.9

GAAP

unifocal < 2cm

29 vs. 283

0.786(0.705-0.866)

62.1 79.2 23.4 95.3 77.6

6 vs. 133

0.799(0.635-0.964)

50.0 72.9 7.69 97.0 71.9

23 vs. 149

0.804(0.717-0.892)

65.2 84.6 39.5 94.0 82.0

GAAP

unifocal < 3cm

55 vs. 283

0.805(0.744-0.865)

63.6 79.2 37.2 91.8 76.6

14 vs. 133

0.866(0.767-0.966)

71.4 72.9 21.7 96.0 72.8

40 vs. 149

0.808(0.735-0.880)

60.0 84.6 51.1 88.7 79.4

GAAP

unifocal < 4cm

71 vs. 283

0.840(0.790-0.891)

71.8 79.2 46.4 91.8 77.7

21 vs. 133

0.885(0.812-0.958)

81.0 72.9 32.1 96.0 74.0

49 vs. 149

0.840(0.777-0.902)

67.3 84.6 58.9 88.7 80.3

GAAP

unifocal < 5cm

81 vs. 283

0.841(0.793-0.889)

71.6 79.2 49.6 90.7 77.5

26 vs. 133

0.892(0.827-0.958)

80.8 72.9 36.8 95.1 74.2

54 vs. 149

0.836(0.774-0.897)

66.7 84.6 61.0 87.5 79.8

GAAP

unifocal < 10cm

97 vs. 283

0.862(0.820-0.905)

76.3 79.2 55.6 90.7 78.4

32 vs. 133

0.912(0.857-0.967)

84.4 72.9 42.9 95.1 75.2

64 vs. 149

0.854(0.799-0.909)

71.9 84.6 66.7 87.5 80.8

GAAP

Within Milan criteria

86 vs. 283

0.840(0.793-0.887)

70.9 79.2 50.8 90.0 77.2

29 vs. 133

0.895(0.834-0.956)

82.8 72.9 40.0 95.1 74.7

56 vs. 149

0.832(0.772-0.893)

64.3 84.6 61.0 86.3 79.0

GAAP

max diameter < 5cm

145 vs. 283

0.882(0.849-0.915)

80.7 79.2 66.5 88.9 79.7

61 vs. 133

0.935(0.900-0.970)

91.8 72.9 60.9 95.1 78.9

83 vs. 149

0.861(0.812-0.909)

72.3 84.6 72.3 84.6 80.2

GAAP

max diameter ≥ 5cm

75 vs. 283

0.982(0.966-0.997)

98.7 79.2 55.6 99.6 83.2

34 vs. 133

0.998(0.994-1.000)

100 72.9 48.6 100 78.4

41 vs. 149

0.970(0.944-0.996)

97.6 84.6 63.5 99.2 87.4

PIVKA-II

unifocal < 2cm

29 vs. 283

0.746(0.658-0.835)

62.1 74.2 19.8 95.0 73.1

6 vs. 133

0.748(0.500-0.996)

66.7 75.2 10.8 98.0 74.8

23 vs. 149

0.744(0.649-0.838)

60.9 73.8 26.4 92.4 72.1

PIVKA-II

unifocal < 3cm

55 vs. 283

0.759(0.690-0.828)

65.5 74.2 33.0 91.7 72.8

14 vs. 133

0.819(0.694-0.945)

78.6 75.2 25.0 97.1 75.5

40 vs. 149

0.734(0.650-0.819)

60.0 73.8 38.1 87.3 70.9

PIVKA-II

unifocal < 4cm

71 vs. 283

0.794(0.735-0.853)

70.4 74.2 40.7 90.9 73.4

21 vs. 133

0.825(0.726-0.924)

76.2 75.2 32.7 95.2 75.3

49 vs. 149

0.779(0.704-0.854)

67.3 73.8 45.8 87.3 72.2

PIVKA-II

unifocal < 5cm

81 vs. 283

0.802(0.748-0.856)

72.8 74.2 44.7 90.5 73.9

26 vs. 133

0.833(0.746-0.920)

76.9 75.2 37.7 94.3 75.5

54 vs. 149

0.785(0.715-0.856)

70.4 73.8 49.4 87.3 72.9

PIVKA-II

unifocal < 10cm

97 vs. 283

0.827(0.779-0.875)

77.3 74.2 50.7 90.5 75.0

32 vs. 133

0.861(0.787-0.935)

81.2 75.2 44.1 94.3 76.4

64 vs. 149

0.809(0.746-0.872)

75.0 73.8 55.2 87.3 74.2

PIVKA-II

Within Milan criteria

86 vs. 283

0.801(0.748-0.854)

72.1 74.2 45.9 89.7 73.7

29 vs. 133

0.839(0.759-0.920)

75.9 75.2 40.0 93.5 75.3

56 vs. 149

0.781(0.711-0.851)

69.6 73.8 50.0 86.6 72.7

PIVKA-II

max diameter < 5cm

145 vs. 283

0.827(0.787-0.868)

76.6 74.2 60.3 86.1 75.0

61 vs. 133

0.886(0.837-0.935)

85.2 75.2 61.2 91.7 78.4

83 vs. 149

0.786(0.726-0.845)

69.9 73.8 59.8 81.5 72.4

PIVKA-II

max diameter ≥ 5cm

75 vs. 283

0.969(0.946-0.993)

97.3 74.2 50.0 99.1 79.1

34 vs. 133

0.994(0.986-1.000)

100 75.2 50.7 100 80.2

41 vs. 149

0.950(0.908-0.991)

95.1 73.8 50.0 98.2 78.4

AFP

unifocal < 2cm

29 vs. 283

0.692(0.584-0.799)

62.1 72.1 18.6 94.9 71.2

6 vs. 133

0.852(0.741-0.963)

83.3 73.7 12.5 99.0 74.1

23 vs. 149

0.652(0.529-0.774)

56.5 70.5 22.8 91.3 68.6

AFP

unifocal < 3cm

55 vs. 283

0.684(0.606-0.763)

54.5 72.1 27.5 89.1 69.2

14 vs. 133

0.712(0.546-0.878)

57.1 73.7 18.6 94.2 72.1

40 vs. 149

0.668(0.576-0.760)

52.5 70.5 32.3 84.7 66.7

AFP

unifocal < 4cm

71 vs. 283

0.703(0.635-0.772)

56.3 72.1 33.6 86.8 68.9

21 vs. 133

0.729(0.607-0.850)

52.4 73.7 23.9 90.7 70.8

49 vs. 149

0.691(0.606-0.776)

57.1 70.5 38.9 83.3 67.2

AFP

unifocal < 5cm

81 vs. 283

0.688(0.622-0.753)

51.9 72.1 34.7 84.0 67.6

26 vs. 133

0.696(0.584-0.808)

46.2 73.7 25.5 87.5 69.2

54 vs. 149

0.683(0.601-0.765)

53.7 70.5 39.7 80.8 66.0

AFP

unifocal < 10cm

97 vs. 283

0.697(0.634-0.759)

53.6 72.1 39.7 81.9 67.4

32 vs. 133

0.724(0.617-0.831)

53.1 73.7 32.7 86.7 69.7

64 vs. 149

0.681(0.603-0.760)

53.1 70.5 43.6 77.8 65.3

AFP

Within Milan criteria

86 vs. 283

0.679(0.615-0.742)

51.2 72.1 35.8 82.9 67.2

29 vs. 133

0.694(0.587-0.802)

48.3 73.7 28.6 86.7 69.1

56 vs. 149

0.669(0.589-0.750)

51.8 70.5 39.7 79.5 65.4

AFP

max diameter < 5cm

145 vs. 283

0.730(0.681-0.780)

60.7 72.1 52.7 78.2 68.2

61 vs. 133

0.772(0.701-0.844)

63.9 73.7 52.7 81.7 70.6

83 vs. 149

0.703(0.635-0.771)

57.8 70.5 52.2 75.0 65.9

AFP

max diameter ≥ 5cm

75 vs. 283

0.793(0.729-0.856)

70.7 72.1 40.2 90.3 71.8

34 vs. 133

0.827(0.728-0.925)

76.5 73.7 42.6 92.5 74.3

41 vs. 149

0.769(0.684-0.853)

65.9 70.5 38.0 88.2 69.5

AFP-L3%

unifocal < 2cm

29 vs. 283

0.638(0.519-0.758)

41.4 84.5 21.4 93.4 80.4

6 vs. 133

0.709(0.451-0.967)

50.0 89.5 17.6 97.5 87.8

23 vs. 149

0.604(0.469-0.740)

39.1 79.9 23.1 89.5 74.4

AFP-L3%

unifocal < 3cm

55 vs. 283

0.610(0.522-0.699)

36.4 84.5 31.2 87.2 76.6

14 vs. 133

0.671(0.497-0.845)

42.9 89.5 30.0 93.7 85.0

40 vs. 149

0.579(0.474-0.684)

35.0 79.9 31.8 82.1 70.4

AFP-L3%

unifocal < 4cm

71 vs. 283

0.631(0.553-0.710)

40.8 84.5 39.7 85.1 75.7

21 vs. 133

0.670(0.527-0.813)

42.9 89.5 39.1 90.8 83.1

49 vs. 149

0.606(0.511-0.702)

40.8 79.9 40.0 80.4 70.2

AFP-L3%

unifocal < 5cm

81 vs. 283

0.619(0.544-0.693)

38.3 84.5 41.3 82.7 74.2

26 vs. 133

0.648(0.517-0.778)

38.5 89.5 41.7 88.1 81.1

54 vs. 149

0.598(0.505-0.691)

38.9 79.9 41.2 78.3 69.0

AFP-L3%

unifocal < 10cm

97 vs. 283

0.645(0.576-0.713)

42.3 84.5 48.2 81.0 73.7

32 vs. 133

0.689(0.573-0.806)

43.8 89.5 50.0 86.9 80.6

64 vs. 149

0.617(0.530-0.703)

42.2 79.9 47.4 76.3 68.5

AFP-L3%

Within Milan criteria

86 vs. 283

0.602(0.529-0.675)

34.9 84.5 40.5 81.0 72.9

29 vs. 133

0.646(0.521-0.770)

37.9 89.5 44.0 86.9 80.2

56 vs. 149

0.573(0.482-0.664)

33.9 79.9 38.8 76.3 67.3

AFP-L3%

max diameter < 5cm

145 vs. 283

0.669(0.610-0.727)

46.9 84.5 60.7 75.6 71.7

61 vs. 133

0.737(0.652-0.822)

54.1 89.5 70.2 81.0 78.4

83 vs. 149

0.617(0.538-0.696)

42.2 79.9 53.8 71.3 66.4

AFP-L3%

max diameter ≥ 5cm

75 vs. 283

0.782(0.710-0.853)

65.3 84.5 52.7 90.2 80.4

34 vs. 133

0.828(0.730-0.925)

67.6 89.5 62.2 91.5 85.0

41 vs. 149

0.739(0.638-0.841)

63.4 79.9 46.4 88.8 76.3

Note: AUC=area under receiver operating characteristic curve; PPV= Positive Predictive Value; NPV= Negative Predictive Value. Ccp, correctedly classfied %