Hugging Face's logo

pritamdeka
/
PubMedBERT-MNLI-MedNLI

Text Classification
Transformers
PyTorch
TensorBoard
Safetensors
bert
Generated from Trainer
Model card Files
xet
Metrics Community
3
pritamdeka commited on
Commit
8f0d597
·
1 Parent(s): 9e5b4cc

commit

Browse files
Files changed (16) hide show
  1. README.md +71 -0
  2. all_results.json +14 -0
  3. config.json +36 -0
  4. eval_results.json +9 -0
  5. predict_results_None.txt +1423 -0
  6. pytorch_model.bin +3 -0
  7. runs/Sep06_14-31-58_d62a17eebd0d/1662474745.8974035/events.out.tfevents.1662474745.d62a17eebd0d.419.1 +3 -0
  8. runs/Sep06_14-31-58_d62a17eebd0d/events.out.tfevents.1662474745.d62a17eebd0d.419.0 +3 -0
  9. runs/Sep06_14-31-58_d62a17eebd0d/events.out.tfevents.1662481494.d62a17eebd0d.419.2 +3 -0
  10. special_tokens_map.json +7 -0
  11. tokenizer.json +0 -0
  12. tokenizer_config.json +15 -0
  13. train_results.json +8 -0
  14. trainer_state.json +235 -0
  15. training_args.bin +3 -0
  16. vocab.txt +0 -0
README.md ADDED
@@ -0,0 +1,71 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - generated_from_trainer
4
+ metrics:
5
+ - accuracy
6
+ model-index:
7
+ - name: best_model
8
+ results: []
9
+ ---
10
+
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
+
14
+ # best_model
15
+
16
+ This model is a fine-tuned version of [/content/drive/MyDrive/fine_tuned_models/pubmedbert_mnli_v3](https://huggingface.co//content/drive/MyDrive/fine_tuned_models/pubmedbert_mnli_v3) on an unknown dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 0.9501
19
+ - Accuracy: 0.8667
20
+
21
+ ## Model description
22
+
23
+ More information needed
24
+
25
+ ## Intended uses & limitations
26
+
27
+ More information needed
28
+
29
+ ## Training and evaluation data
30
+
31
+ More information needed
32
+
33
+ ## Training procedure
34
+
35
+ ### Training hyperparameters
36
+
37
+ The following hyperparameters were used during training:
38
+ - learning_rate: 2e-05
39
+ - train_batch_size: 32
40
+ - eval_batch_size: 32
41
+ - seed: 42
42
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
+ - lr_scheduler_type: linear
44
+ - num_epochs: 20.0
45
+
46
+ ### Training results
47
+
48
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy |
49
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|
50
+ | 0.5673 | 1.42 | 500 | 0.4358 | 0.8437 |
51
+ | 0.2898 | 2.85 | 1000 | 0.4845 | 0.8523 |
52
+ | 0.1669 | 4.27 | 1500 | 0.6233 | 0.8573 |
53
+ | 0.1087 | 5.7 | 2000 | 0.7263 | 0.8573 |
54
+ | 0.0728 | 7.12 | 2500 | 0.8841 | 0.8638 |
55
+ | 0.0512 | 8.55 | 3000 | 0.9501 | 0.8667 |
56
+ | 0.0372 | 9.97 | 3500 | 1.0440 | 0.8566 |
57
+ | 0.0262 | 11.4 | 4000 | 1.0770 | 0.8609 |
58
+ | 0.0243 | 12.82 | 4500 | 1.0931 | 0.8616 |
59
+ | 0.023 | 14.25 | 5000 | 1.1088 | 0.8631 |
60
+ | 0.0163 | 15.67 | 5500 | 1.1264 | 0.8581 |
61
+ | 0.0111 | 17.09 | 6000 | 1.1541 | 0.8616 |
62
+ | 0.0098 | 18.52 | 6500 | 1.1542 | 0.8631 |
63
+ | 0.0074 | 19.94 | 7000 | 1.1653 | 0.8638 |
64
+
65
+
66
+ ### Framework versions
67
+
68
+ - Transformers 4.22.0.dev0
69
+ - Pytorch 1.12.1+cu113
70
+ - Datasets 2.4.0
71
+ - Tokenizers 0.12.1
all_results.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 20.0,
3
+ "eval_accuracy": 0.8666666746139526,
4
+ "eval_loss": 0.9500740170478821,
5
+ "eval_runtime": 13.4036,
6
+ "eval_samples": 1395,
7
+ "eval_samples_per_second": 104.076,
8
+ "eval_steps_per_second": 3.283,
9
+ "train_loss": 0.10057472327884626,
10
+ "train_runtime": 6733.6679,
11
+ "train_samples": 11232,
12
+ "train_samples_per_second": 33.361,
13
+ "train_steps_per_second": 1.043
14
+ }
config.json ADDED
@@ -0,0 +1,36 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "/content/drive/MyDrive/fine_tuned_models/pubmedbert_mnli_v3",
3
+ "architectures": [
4
+ "BertForSequenceClassification"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.1,
7
+ "classifier_dropout": null,
8
+ "hidden_act": "gelu",
9
+ "hidden_dropout_prob": 0.1,
10
+ "hidden_size": 768,
11
+ "id2label": {
12
+ "0": "contradiction",
13
+ "1": "entailment",
14
+ "2": "neutral"
15
+ },
16
+ "initializer_range": 0.02,
17
+ "intermediate_size": 3072,
18
+ "label2id": {
19
+ "contradiction": 0,
20
+ "entailment": 1,
21
+ "neutral": 2
22
+ },
23
+ "layer_norm_eps": 1e-12,
24
+ "max_position_embeddings": 512,
25
+ "model_type": "bert",
26
+ "num_attention_heads": 12,
27
+ "num_hidden_layers": 12,
28
+ "pad_token_id": 0,
29
+ "position_embedding_type": "absolute",
30
+ "problem_type": "single_label_classification",
31
+ "torch_dtype": "float32",
32
+ "transformers_version": "4.22.0.dev0",
33
+ "type_vocab_size": 2,
34
+ "use_cache": true,
35
+ "vocab_size": 30522
36
+ }
eval_results.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 20.0,
3
+ "eval_accuracy": 0.8666666746139526,
4
+ "eval_loss": 0.9500740170478821,
5
+ "eval_runtime": 13.4036,
6
+ "eval_samples": 1395,
7
+ "eval_samples_per_second": 104.076,
8
+ "eval_steps_per_second": 3.283
9
+ }
predict_results_None.txt ADDED
@@ -0,0 +1,1423 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ index prediction
2
+ 0 entailment
3
+ 1 contradiction
4
+ 2 neutral
5
+ 3 entailment
6
+ 4 contradiction
7
+ 5 contradiction
8
+ 6 neutral
9
+ 7 contradiction
10
+ 8 neutral
11
+ 9 entailment
12
+ 10 contradiction
13
+ 11 neutral
14
+ 12 entailment
15
+ 13 contradiction
16
+ 14 entailment
17
+ 15 entailment
18
+ 16 contradiction
19
+ 17 neutral
20
+ 18 entailment
21
+ 19 contradiction
22
+ 20 neutral
23
+ 21 entailment
24
+ 22 entailment
25
+ 23 neutral
26
+ 24 entailment
27
+ 25 contradiction
28
+ 26 neutral
29
+ 27 entailment
30
+ 28 contradiction
31
+ 29 neutral
32
+ 30 entailment
33
+ 31 contradiction
34
+ 32 neutral
35
+ 33 neutral
36
+ 34 contradiction
37
+ 35 neutral
38
+ 36 entailment
39
+ 37 contradiction
40
+ 38 neutral
41
+ 39 entailment
42
+ 40 contradiction
43
+ 41 neutral
44
+ 42 entailment
45
+ 43 contradiction
46
+ 44 entailment
47
+ 45 entailment
48
+ 46 contradiction
49
+ 47 neutral
50
+ 48 entailment
51
+ 49 contradiction
52
+ 50 entailment
53
+ 51 entailment
54
+ 52 contradiction
55
+ 53 neutral
56
+ 54 entailment
57
+ 55 contradiction
58
+ 56 neutral
59
+ 57 entailment
60
+ 58 contradiction
61
+ 59 neutral
62
+ 60 neutral
63
+ 61 contradiction
64
+ 62 neutral
65
+ 63 entailment
66
+ 64 contradiction
67
+ 65 neutral
68
+ 66 neutral
69
+ 67 entailment
70
+ 68 neutral
71
+ 69 entailment
72
+ 70 contradiction
73
+ 71 entailment
74
+ 72 entailment
75
+ 73 contradiction
76
+ 74 entailment
77
+ 75 entailment
78
+ 76 contradiction
79
+ 77 neutral
80
+ 78 neutral
81
+ 79 contradiction
82
+ 80 neutral
83
+ 81 neutral
84
+ 82 contradiction
85
+ 83 neutral
86
+ 84 entailment
87
+ 85 contradiction
88
+ 86 neutral
89
+ 87 entailment
90
+ 88 contradiction
91
+ 89 neutral
92
+ 90 entailment
93
+ 91 contradiction
94
+ 92 neutral
95
+ 93 neutral
96
+ 94 contradiction
97
+ 95 neutral
98
+ 96 entailment
99
+ 97 contradiction
100
+ 98 neutral
101
+ 99 entailment
102
+ 100 contradiction
103
+ 101 neutral
104
+ 102 entailment
105
+ 103 contradiction
106
+ 104 neutral
107
+ 105 entailment
108
+ 106 contradiction
109
+ 107 entailment
110
+ 108 entailment
111
+ 109 entailment
112
+ 110 neutral
113
+ 111 entailment
114
+ 112 contradiction
115
+ 113 neutral
116
+ 114 entailment
117
+ 115 contradiction
118
+ 116 neutral
119
+ 117 neutral
120
+ 118 contradiction
121
+ 119 neutral
122
+ 120 entailment
123
+ 121 contradiction
124
+ 122 neutral
125
+ 123 neutral
126
+ 124 contradiction
127
+ 125 neutral
128
+ 126 contradiction
129
+ 127 contradiction
130
+ 128 neutral
131
+ 129 contradiction
132
+ 130 entailment
133
+ 131 neutral
134
+ 132 entailment
135
+ 133 contradiction
136
+ 134 neutral
137
+ 135 entailment
138
+ 136 contradiction
139
+ 137 entailment
140
+ 138 entailment
141
+ 139 contradiction
142
+ 140 entailment
143
+ 141 neutral
144
+ 142 contradiction
145
+ 143 neutral
146
+ 144 entailment
147
+ 145 contradiction
148
+ 146 neutral
149
+ 147 entailment
150
+ 148 contradiction
151
+ 149 neutral
152
+ 150 entailment
153
+ 151 contradiction
154
+ 152 neutral
155
+ 153 contradiction
156
+ 154 neutral
157
+ 155 neutral
158
+ 156 neutral
159
+ 157 contradiction
160
+ 158 neutral
161
+ 159 entailment
162
+ 160 contradiction
163
+ 161 neutral
164
+ 162 entailment
165
+ 163 contradiction
166
+ 164 neutral
167
+ 165 entailment
168
+ 166 contradiction
169
+ 167 neutral
170
+ 168 neutral
171
+ 169 contradiction
172
+ 170 neutral
173
+ 171 entailment
174
+ 172 contradiction
175
+ 173 neutral
176
+ 174 entailment
177
+ 175 contradiction
178
+ 176 contradiction
179
+ 177 entailment
180
+ 178 contradiction
181
+ 179 neutral
182
+ 180 entailment
183
+ 181 contradiction
184
+ 182 neutral
185
+ 183 neutral
186
+ 184 contradiction
187
+ 185 neutral
188
+ 186 entailment
189
+ 187 contradiction
190
+ 188 neutral
191
+ 189 entailment
192
+ 190 contradiction
193
+ 191 neutral
194
+ 192 contradiction
195
+ 193 entailment
196
+ 194 neutral
197
+ 195 entailment
198
+ 196 contradiction
199
+ 197 entailment
200
+ 198 entailment
201
+ 199 contradiction
202
+ 200 neutral
203
+ 201 entailment
204
+ 202 neutral
205
+ 203 neutral
206
+ 204 neutral
207
+ 205 contradiction
208
+ 206 neutral
209
+ 207 entailment
210
+ 208 neutral
211
+ 209 entailment
212
+ 210 entailment
213
+ 211 contradiction
214
+ 212 neutral
215
+ 213 entailment
216
+ 214 contradiction
217
+ 215 neutral
218
+ 216 entailment
219
+ 217 contradiction
220
+ 218 entailment
221
+ 219 entailment
222
+ 220 contradiction
223
+ 221 neutral
224
+ 222 neutral
225
+ 223 contradiction
226
+ 224 neutral
227
+ 225 entailment
228
+ 226 contradiction
229
+ 227 neutral
230
+ 228 entailment
231
+ 229 contradiction
232
+ 230 neutral
233
+ 231 entailment
234
+ 232 contradiction
235
+ 233 neutral
236
+ 234 neutral
237
+ 235 neutral
238
+ 236 entailment
239
+ 237 entailment
240
+ 238 contradiction
241
+ 239 neutral
242
+ 240 entailment
243
+ 241 contradiction
244
+ 242 neutral
245
+ 243 contradiction
246
+ 244 contradiction
247
+ 245 neutral
248
+ 246 entailment
249
+ 247 contradiction
250
+ 248 neutral
251
+ 249 entailment
252
+ 250 neutral
253
+ 251 neutral
254
+ 252 entailment
255
+ 253 contradiction
256
+ 254 neutral
257
+ 255 entailment
258
+ 256 contradiction
259
+ 257 neutral
260
+ 258 entailment
261
+ 259 entailment
262
+ 260 neutral
263
+ 261 entailment
264
+ 262 contradiction
265
+ 263 neutral
266
+ 264 entailment
267
+ 265 contradiction
268
+ 266 neutral
269
+ 267 entailment
270
+ 268 contradiction
271
+ 269 neutral
272
+ 270 entailment
273
+ 271 contradiction
274
+ 272 neutral
275
+ 273 entailment
276
+ 274 contradiction
277
+ 275 neutral
278
+ 276 entailment
279
+ 277 contradiction
280
+ 278 neutral
281
+ 279 entailment
282
+ 280 contradiction
283
+ 281 neutral
284
+ 282 entailment
285
+ 283 neutral
286
+ 284 neutral
287
+ 285 contradiction
288
+ 286 contradiction
289
+ 287 neutral
290
+ 288 entailment
291
+ 289 contradiction
292
+ 290 neutral
293
+ 291 entailment
294
+ 292 contradiction
295
+ 293 neutral
296
+ 294 entailment
297
+ 295 contradiction
298
+ 296 entailment
299
+ 297 entailment
300
+ 298 contradiction
301
+ 299 neutral
302
+ 300 contradiction
303
+ 301 contradiction
304
+ 302 neutral
305
+ 303 entailment
306
+ 304 contradiction
307
+ 305 neutral
308
+ 306 neutral
309
+ 307 contradiction
310
+ 308 neutral
311
+ 309 neutral
312
+ 310 neutral
313
+ 311 contradiction
314
+ 312 entailment
315
+ 313 entailment
316
+ 314 neutral
317
+ 315 neutral
318
+ 316 contradiction
319
+ 317 neutral
320
+ 318 entailment
321
+ 319 contradiction
322
+ 320 neutral
323
+ 321 entailment
324
+ 322 contradiction
325
+ 323 neutral
326
+ 324 entailment
327
+ 325 contradiction
328
+ 326 neutral
329
+ 327 entailment
330
+ 328 contradiction
331
+ 329 neutral
332
+ 330 entailment
333
+ 331 contradiction
334
+ 332 neutral
335
+ 333 entailment
336
+ 334 contradiction
337
+ 335 neutral
338
+ 336 entailment
339
+ 337 contradiction
340
+ 338 neutral
341
+ 339 entailment
342
+ 340 contradiction
343
+ 341 neutral
344
+ 342 entailment
345
+ 343 contradiction
346
+ 344 neutral
347
+ 345 entailment
348
+ 346 contradiction
349
+ 347 neutral
350
+ 348 entailment
351
+ 349 contradiction
352
+ 350 neutral
353
+ 351 entailment
354
+ 352 contradiction
355
+ 353 neutral
356
+ 354 neutral
357
+ 355 contradiction
358
+ 356 neutral
359
+ 357 neutral
360
+ 358 contradiction
361
+ 359 neutral
362
+ 360 entailment
363
+ 361 contradiction
364
+ 362 neutral
365
+ 363 entailment
366
+ 364 contradiction
367
+ 365 neutral
368
+ 366 entailment
369
+ 367 contradiction
370
+ 368 contradiction
371
+ 369 entailment
372
+ 370 contradiction
373
+ 371 entailment
374
+ 372 entailment
375
+ 373 neutral
376
+ 374 neutral
377
+ 375 contradiction
378
+ 376 neutral
379
+ 377 neutral
380
+ 378 entailment
381
+ 379 contradiction
382
+ 380 neutral
383
+ 381 contradiction
384
+ 382 contradiction
385
+ 383 entailment
386
+ 384 entailment
387
+ 385 contradiction
388
+ 386 neutral
389
+ 387 entailment
390
+ 388 entailment
391
+ 389 entailment
392
+ 390 entailment
393
+ 391 contradiction
394
+ 392 entailment
395
+ 393 entailment
396
+ 394 contradiction
397
+ 395 neutral
398
+ 396 entailment
399
+ 397 contradiction
400
+ 398 neutral
401
+ 399 entailment
402
+ 400 contradiction
403
+ 401 neutral
404
+ 402 entailment
405
+ 403 contradiction
406
+ 404 neutral
407
+ 405 entailment
408
+ 406 contradiction
409
+ 407 neutral
410
+ 408 entailment
411
+ 409 contradiction
412
+ 410 neutral
413
+ 411 entailment
414
+ 412 contradiction
415
+ 413 neutral
416
+ 414 entailment
417
+ 415 contradiction
418
+ 416 entailment
419
+ 417 entailment
420
+ 418 contradiction
421
+ 419 neutral
422
+ 420 contradiction
423
+ 421 contradiction
424
+ 422 entailment
425
+ 423 entailment
426
+ 424 neutral
427
+ 425 entailment
428
+ 426 entailment
429
+ 427 neutral
430
+ 428 neutral
431
+ 429 entailment
432
+ 430 contradiction
433
+ 431 neutral
434
+ 432 entailment
435
+ 433 contradiction
436
+ 434 neutral
437
+ 435 contradiction
438
+ 436 contradiction
439
+ 437 contradiction
440
+ 438 entailment
441
+ 439 contradiction
442
+ 440 neutral
443
+ 441 entailment
444
+ 442 contradiction
445
+ 443 neutral
446
+ 444 entailment
447
+ 445 contradiction
448
+ 446 neutral
449
+ 447 entailment
450
+ 448 contradiction
451
+ 449 neutral
452
+ 450 entailment
453
+ 451 contradiction
454
+ 452 neutral
455
+ 453 entailment
456
+ 454 contradiction
457
+ 455 entailment
458
+ 456 entailment
459
+ 457 contradiction
460
+ 458 neutral
461
+ 459 contradiction
462
+ 460 contradiction
463
+ 461 neutral
464
+ 462 contradiction
465
+ 463 entailment
466
+ 464 contradiction
467
+ 465 entailment
468
+ 466 contradiction
469
+ 467 neutral
470
+ 468 entailment
471
+ 469 contradiction
472
+ 470 neutral
473
+ 471 entailment
474
+ 472 contradiction
475
+ 473 neutral
476
+ 474 entailment
477
+ 475 contradiction
478
+ 476 neutral
479
+ 477 entailment
480
+ 478 contradiction
481
+ 479 neutral
482
+ 480 entailment
483
+ 481 contradiction
484
+ 482 neutral
485
+ 483 entailment
486
+ 484 contradiction
487
+ 485 entailment
488
+ 486 contradiction
489
+ 487 contradiction
490
+ 488 neutral
491
+ 489 entailment
492
+ 490 contradiction
493
+ 491 neutral
494
+ 492 entailment
495
+ 493 contradiction
496
+ 494 entailment
497
+ 495 entailment
498
+ 496 contradiction
499
+ 497 neutral
500
+ 498 entailment
501
+ 499 contradiction
502
+ 500 entailment
503
+ 501 neutral
504
+ 502 contradiction
505
+ 503 entailment
506
+ 504 neutral
507
+ 505 contradiction
508
+ 506 neutral
509
+ 507 entailment
510
+ 508 contradiction
511
+ 509 neutral
512
+ 510 entailment
513
+ 511 contradiction
514
+ 512 neutral
515
+ 513 entailment
516
+ 514 contradiction
517
+ 515 neutral
518
+ 516 entailment
519
+ 517 contradiction
520
+ 518 neutral
521
+ 519 entailment
522
+ 520 contradiction
523
+ 521 neutral
524
+ 522 neutral
525
+ 523 contradiction
526
+ 524 entailment
527
+ 525 entailment
528
+ 526 contradiction
529
+ 527 neutral
530
+ 528 entailment
531
+ 529 contradiction
532
+ 530 neutral
533
+ 531 neutral
534
+ 532 entailment
535
+ 533 neutral
536
+ 534 entailment
537
+ 535 contradiction
538
+ 536 entailment
539
+ 537 neutral
540
+ 538 contradiction
541
+ 539 contradiction
542
+ 540 entailment
543
+ 541 contradiction
544
+ 542 neutral
545
+ 543 neutral
546
+ 544 contradiction
547
+ 545 neutral
548
+ 546 neutral
549
+ 547 contradiction
550
+ 548 entailment
551
+ 549 entailment
552
+ 550 contradiction
553
+ 551 neutral
554
+ 552 entailment
555
+ 553 contradiction
556
+ 554 neutral
557
+ 555 entailment
558
+ 556 contradiction
559
+ 557 contradiction
560
+ 558 neutral
561
+ 559 contradiction
562
+ 560 neutral
563
+ 561 neutral
564
+ 562 contradiction
565
+ 563 neutral
566
+ 564 entailment
567
+ 565 contradiction
568
+ 566 neutral
569
+ 567 entailment
570
+ 568 contradiction
571
+ 569 neutral
572
+ 570 entailment
573
+ 571 contradiction
574
+ 572 neutral
575
+ 573 neutral
576
+ 574 contradiction
577
+ 575 neutral
578
+ 576 entailment
579
+ 577 contradiction
580
+ 578 neutral
581
+ 579 entailment
582
+ 580 contradiction
583
+ 581 neutral
584
+ 582 entailment
585
+ 583 contradiction
586
+ 584 neutral
587
+ 585 entailment
588
+ 586 contradiction
589
+ 587 neutral
590
+ 588 entailment
591
+ 589 contradiction
592
+ 590 neutral
593
+ 591 neutral
594
+ 592 contradiction
595
+ 593 neutral
596
+ 594 entailment
597
+ 595 contradiction
598
+ 596 neutral
599
+ 597 neutral
600
+ 598 contradiction
601
+ 599 neutral
602
+ 600 neutral
603
+ 601 contradiction
604
+ 602 neutral
605
+ 603 entailment
606
+ 604 contradiction
607
+ 605 neutral
608
+ 606 neutral
609
+ 607 neutral
610
+ 608 neutral
611
+ 609 neutral
612
+ 610 contradiction
613
+ 611 neutral
614
+ 612 entailment
615
+ 613 contradiction
616
+ 614 neutral
617
+ 615 neutral
618
+ 616 contradiction
619
+ 617 neutral
620
+ 618 contradiction
621
+ 619 neutral
622
+ 620 neutral
623
+ 621 neutral
624
+ 622 contradiction
625
+ 623 neutral
626
+ 624 entailment
627
+ 625 contradiction
628
+ 626 neutral
629
+ 627 entailment
630
+ 628 contradiction
631
+ 629 neutral
632
+ 630 contradiction
633
+ 631 contradiction
634
+ 632 neutral
635
+ 633 entailment
636
+ 634 contradiction
637
+ 635 neutral
638
+ 636 entailment
639
+ 637 contradiction
640
+ 638 neutral
641
+ 639 neutral
642
+ 640 contradiction
643
+ 641 entailment
644
+ 642 entailment
645
+ 643 contradiction
646
+ 644 neutral
647
+ 645 entailment
648
+ 646 contradiction
649
+ 647 neutral
650
+ 648 entailment
651
+ 649 contradiction
652
+ 650 neutral
653
+ 651 entailment
654
+ 652 contradiction
655
+ 653 neutral
656
+ 654 contradiction
657
+ 655 neutral
658
+ 656 neutral
659
+ 657 entailment
660
+ 658 contradiction
661
+ 659 neutral
662
+ 660 entailment
663
+ 661 neutral
664
+ 662 neutral
665
+ 663 entailment
666
+ 664 contradiction
667
+ 665 neutral
668
+ 666 entailment
669
+ 667 contradiction
670
+ 668 neutral
671
+ 669 entailment
672
+ 670 contradiction
673
+ 671 contradiction
674
+ 672 entailment
675
+ 673 contradiction
676
+ 674 neutral
677
+ 675 entailment
678
+ 676 contradiction
679
+ 677 neutral
680
+ 678 entailment
681
+ 679 contradiction
682
+ 680 neutral
683
+ 681 neutral
684
+ 682 contradiction
685
+ 683 neutral
686
+ 684 entailment
687
+ 685 contradiction
688
+ 686 entailment
689
+ 687 entailment
690
+ 688 contradiction
691
+ 689 neutral
692
+ 690 entailment
693
+ 691 contradiction
694
+ 692 neutral
695
+ 693 entailment
696
+ 694 contradiction
697
+ 695 neutral
698
+ 696 entailment
699
+ 697 neutral
700
+ 698 neutral
701
+ 699 entailment
702
+ 700 contradiction
703
+ 701 neutral
704
+ 702 entailment
705
+ 703 contradiction
706
+ 704 neutral
707
+ 705 entailment
708
+ 706 contradiction
709
+ 707 neutral
710
+ 708 entailment
711
+ 709 contradiction
712
+ 710 neutral
713
+ 711 entailment
714
+ 712 contradiction
715
+ 713 entailment
716
+ 714 entailment
717
+ 715 contradiction
718
+ 716 neutral
719
+ 717 entailment
720
+ 718 contradiction
721
+ 719 neutral
722
+ 720 entailment
723
+ 721 contradiction
724
+ 722 neutral
725
+ 723 entailment
726
+ 724 neutral
727
+ 725 neutral
728
+ 726 entailment
729
+ 727 contradiction
730
+ 728 neutral
731
+ 729 entailment
732
+ 730 contradiction
733
+ 731 neutral
734
+ 732 entailment
735
+ 733 neutral
736
+ 734 contradiction
737
+ 735 entailment
738
+ 736 contradiction
739
+ 737 neutral
740
+ 738 entailment
741
+ 739 contradiction
742
+ 740 neutral
743
+ 741 entailment
744
+ 742 contradiction
745
+ 743 neutral
746
+ 744 contradiction
747
+ 745 contradiction
748
+ 746 contradiction
749
+ 747 entailment
750
+ 748 contradiction
751
+ 749 neutral
752
+ 750 neutral
753
+ 751 contradiction
754
+ 752 neutral
755
+ 753 entailment
756
+ 754 contradiction
757
+ 755 neutral
758
+ 756 neutral
759
+ 757 contradiction
760
+ 758 neutral
761
+ 759 entailment
762
+ 760 contradiction
763
+ 761 entailment
764
+ 762 entailment
765
+ 763 contradiction
766
+ 764 neutral
767
+ 765 neutral
768
+ 766 contradiction
769
+ 767 neutral
770
+ 768 entailment
771
+ 769 contradiction
772
+ 770 neutral
773
+ 771 entailment
774
+ 772 contradiction
775
+ 773 entailment
776
+ 774 entailment
777
+ 775 contradiction
778
+ 776 neutral
779
+ 777 entailment
780
+ 778 contradiction
781
+ 779 contradiction
782
+ 780 entailment
783
+ 781 contradiction
784
+ 782 neutral
785
+ 783 entailment
786
+ 784 neutral
787
+ 785 neutral
788
+ 786 entailment
789
+ 787 neutral
790
+ 788 neutral
791
+ 789 entailment
792
+ 790 contradiction
793
+ 791 neutral
794
+ 792 entailment
795
+ 793 contradiction
796
+ 794 neutral
797
+ 795 entailment
798
+ 796 contradiction
799
+ 797 neutral
800
+ 798 entailment
801
+ 799 contradiction
802
+ 800 neutral
803
+ 801 entailment
804
+ 802 contradiction
805
+ 803 neutral
806
+ 804 entailment
807
+ 805 contradiction
808
+ 806 neutral
809
+ 807 entailment
810
+ 808 contradiction
811
+ 809 neutral
812
+ 810 entailment
813
+ 811 contradiction
814
+ 812 neutral
815
+ 813 entailment
816
+ 814 contradiction
817
+ 815 neutral
818
+ 816 neutral
819
+ 817 contradiction
820
+ 818 neutral
821
+ 819 entailment
822
+ 820 contradiction
823
+ 821 neutral
824
+ 822 neutral
825
+ 823 contradiction
826
+ 824 entailment
827
+ 825 entailment
828
+ 826 contradiction
829
+ 827 neutral
830
+ 828 entailment
831
+ 829 contradiction
832
+ 830 neutral
833
+ 831 entailment
834
+ 832 entailment
835
+ 833 neutral
836
+ 834 entailment
837
+ 835 contradiction
838
+ 836 contradiction
839
+ 837 entailment
840
+ 838 contradiction
841
+ 839 entailment
842
+ 840 entailment
843
+ 841 contradiction
844
+ 842 neutral
845
+ 843 entailment
846
+ 844 contradiction
847
+ 845 neutral
848
+ 846 entailment
849
+ 847 contradiction
850
+ 848 neutral
851
+ 849 contradiction
852
+ 850 contradiction
853
+ 851 entailment
854
+ 852 entailment
855
+ 853 contradiction
856
+ 854 neutral
857
+ 855 entailment
858
+ 856 neutral
859
+ 857 neutral
860
+ 858 entailment
861
+ 859 neutral
862
+ 860 neutral
863
+ 861 entailment
864
+ 862 contradiction
865
+ 863 neutral
866
+ 864 entailment
867
+ 865 contradiction
868
+ 866 neutral
869
+ 867 entailment
870
+ 868 contradiction
871
+ 869 neutral
872
+ 870 entailment
873
+ 871 contradiction
874
+ 872 neutral
875
+ 873 entailment
876
+ 874 contradiction
877
+ 875 neutral
878
+ 876 entailment
879
+ 877 contradiction
880
+ 878 neutral
881
+ 879 entailment
882
+ 880 entailment
883
+ 881 neutral
884
+ 882 entailment
885
+ 883 contradiction
886
+ 884 contradiction
887
+ 885 entailment
888
+ 886 contradiction
889
+ 887 neutral
890
+ 888 entailment
891
+ 889 contradiction
892
+ 890 neutral
893
+ 891 entailment
894
+ 892 entailment
895
+ 893 neutral
896
+ 894 entailment
897
+ 895 contradiction
898
+ 896 neutral
899
+ 897 neutral
900
+ 898 contradiction
901
+ 899 entailment
902
+ 900 entailment
903
+ 901 neutral
904
+ 902 neutral
905
+ 903 entailment
906
+ 904 neutral
907
+ 905 neutral
908
+ 906 entailment
909
+ 907 contradiction
910
+ 908 neutral
911
+ 909 entailment
912
+ 910 contradiction
913
+ 911 neutral
914
+ 912 entailment
915
+ 913 contradiction
916
+ 914 entailment
917
+ 915 entailment
918
+ 916 contradiction
919
+ 917 entailment
920
+ 918 entailment
921
+ 919 contradiction
922
+ 920 neutral
923
+ 921 entailment
924
+ 922 contradiction
925
+ 923 neutral
926
+ 924 entailment
927
+ 925 contradiction
928
+ 926 neutral
929
+ 927 entailment
930
+ 928 entailment
931
+ 929 neutral
932
+ 930 entailment
933
+ 931 contradiction
934
+ 932 neutral
935
+ 933 entailment
936
+ 934 contradiction
937
+ 935 neutral
938
+ 936 entailment
939
+ 937 contradiction
940
+ 938 neutral
941
+ 939 entailment
942
+ 940 contradiction
943
+ 941 neutral
944
+ 942 entailment
945
+ 943 contradiction
946
+ 944 neutral
947
+ 945 entailment
948
+ 946 contradiction
949
+ 947 entailment
950
+ 948 entailment
951
+ 949 contradiction
952
+ 950 neutral
953
+ 951 entailment
954
+ 952 contradiction
955
+ 953 contradiction
956
+ 954 entailment
957
+ 955 contradiction
958
+ 956 neutral
959
+ 957 neutral
960
+ 958 contradiction
961
+ 959 neutral
962
+ 960 entailment
963
+ 961 entailment
964
+ 962 neutral
965
+ 963 entailment
966
+ 964 entailment
967
+ 965 neutral
968
+ 966 entailment
969
+ 967 entailment
970
+ 968 neutral
971
+ 969 neutral
972
+ 970 contradiction
973
+ 971 neutral
974
+ 972 entailment
975
+ 973 entailment
976
+ 974 neutral
977
+ 975 entailment
978
+ 976 contradiction
979
+ 977 neutral
980
+ 978 entailment
981
+ 979 contradiction
982
+ 980 neutral
983
+ 981 entailment
984
+ 982 neutral
985
+ 983 neutral
986
+ 984 entailment
987
+ 985 contradiction
988
+ 986 neutral
989
+ 987 entailment
990
+ 988 contradiction
991
+ 989 entailment
992
+ 990 entailment
993
+ 991 contradiction
994
+ 992 neutral
995
+ 993 entailment
996
+ 994 contradiction
997
+ 995 neutral
998
+ 996 entailment
999
+ 997 contradiction
1000
+ 998 neutral
1001
+ 999 entailment
1002
+ 1000 neutral
1003
+ 1001 neutral
1004
+ 1002 contradiction
1005
+ 1003 contradiction
1006
+ 1004 contradiction
1007
+ 1005 entailment
1008
+ 1006 contradiction
1009
+ 1007 neutral
1010
+ 1008 entailment
1011
+ 1009 contradiction
1012
+ 1010 entailment
1013
+ 1011 entailment
1014
+ 1012 contradiction
1015
+ 1013 neutral
1016
+ 1014 entailment
1017
+ 1015 contradiction
1018
+ 1016 neutral
1019
+ 1017 neutral
1020
+ 1018 contradiction
1021
+ 1019 neutral
1022
+ 1020 neutral
1023
+ 1021 contradiction
1024
+ 1022 neutral
1025
+ 1023 contradiction
1026
+ 1024 entailment
1027
+ 1025 entailment
1028
+ 1026 entailment
1029
+ 1027 contradiction
1030
+ 1028 neutral
1031
+ 1029 entailment
1032
+ 1030 contradiction
1033
+ 1031 neutral
1034
+ 1032 entailment
1035
+ 1033 entailment
1036
+ 1034 neutral
1037
+ 1035 entailment
1038
+ 1036 contradiction
1039
+ 1037 neutral
1040
+ 1038 entailment
1041
+ 1039 contradiction
1042
+ 1040 neutral
1043
+ 1041 neutral
1044
+ 1042 contradiction
1045
+ 1043 neutral
1046
+ 1044 entailment
1047
+ 1045 contradiction
1048
+ 1046 neutral
1049
+ 1047 entailment
1050
+ 1048 contradiction
1051
+ 1049 neutral
1052
+ 1050 entailment
1053
+ 1051 contradiction
1054
+ 1052 neutral
1055
+ 1053 entailment
1056
+ 1054 contradiction
1057
+ 1055 neutral
1058
+ 1056 entailment
1059
+ 1057 contradiction
1060
+ 1058 neutral
1061
+ 1059 entailment
1062
+ 1060 contradiction
1063
+ 1061 neutral
1064
+ 1062 entailment
1065
+ 1063 contradiction
1066
+ 1064 entailment
1067
+ 1065 neutral
1068
+ 1066 contradiction
1069
+ 1067 neutral
1070
+ 1068 entailment
1071
+ 1069 contradiction
1072
+ 1070 neutral
1073
+ 1071 entailment
1074
+ 1072 contradiction
1075
+ 1073 neutral
1076
+ 1074 entailment
1077
+ 1075 contradiction
1078
+ 1076 entailment
1079
+ 1077 entailment
1080
+ 1078 contradiction
1081
+ 1079 contradiction
1082
+ 1080 neutral
1083
+ 1081 contradiction
1084
+ 1082 entailment
1085
+ 1083 entailment
1086
+ 1084 contradiction
1087
+ 1085 neutral
1088
+ 1086 entailment
1089
+ 1087 contradiction
1090
+ 1088 neutral
1091
+ 1089 entailment
1092
+ 1090 contradiction
1093
+ 1091 neutral
1094
+ 1092 entailment
1095
+ 1093 contradiction
1096
+ 1094 contradiction
1097
+ 1095 entailment
1098
+ 1096 contradiction
1099
+ 1097 neutral
1100
+ 1098 contradiction
1101
+ 1099 contradiction
1102
+ 1100 neutral
1103
+ 1101 entailment
1104
+ 1102 contradiction
1105
+ 1103 neutral
1106
+ 1104 entailment
1107
+ 1105 contradiction
1108
+ 1106 neutral
1109
+ 1107 entailment
1110
+ 1108 contradiction
1111
+ 1109 entailment
1112
+ 1110 entailment
1113
+ 1111 contradiction
1114
+ 1112 neutral
1115
+ 1113 entailment
1116
+ 1114 contradiction
1117
+ 1115 neutral
1118
+ 1116 entailment
1119
+ 1117 contradiction
1120
+ 1118 neutral
1121
+ 1119 neutral
1122
+ 1120 contradiction
1123
+ 1121 neutral
1124
+ 1122 entailment
1125
+ 1123 contradiction
1126
+ 1124 neutral
1127
+ 1125 entailment
1128
+ 1126 contradiction
1129
+ 1127 neutral
1130
+ 1128 entailment
1131
+ 1129 contradiction
1132
+ 1130 neutral
1133
+ 1131 entailment
1134
+ 1132 neutral
1135
+ 1133 neutral
1136
+ 1134 entailment
1137
+ 1135 contradiction
1138
+ 1136 neutral
1139
+ 1137 entailment
1140
+ 1138 contradiction
1141
+ 1139 neutral
1142
+ 1140 entailment
1143
+ 1141 neutral
1144
+ 1142 neutral
1145
+ 1143 entailment
1146
+ 1144 contradiction
1147
+ 1145 neutral
1148
+ 1146 entailment
1149
+ 1147 contradiction
1150
+ 1148 neutral
1151
+ 1149 entailment
1152
+ 1150 contradiction
1153
+ 1151 neutral
1154
+ 1152 entailment
1155
+ 1153 contradiction
1156
+ 1154 neutral
1157
+ 1155 entailment
1158
+ 1156 contradiction
1159
+ 1157 neutral
1160
+ 1158 entailment
1161
+ 1159 contradiction
1162
+ 1160 neutral
1163
+ 1161 entailment
1164
+ 1162 contradiction
1165
+ 1163 neutral
1166
+ 1164 entailment
1167
+ 1165 contradiction
1168
+ 1166 neutral
1169
+ 1167 entailment
1170
+ 1168 neutral
1171
+ 1169 neutral
1172
+ 1170 entailment
1173
+ 1171 contradiction
1174
+ 1172 entailment
1175
+ 1173 entailment
1176
+ 1174 contradiction
1177
+ 1175 entailment
1178
+ 1176 entailment
1179
+ 1177 contradiction
1180
+ 1178 neutral
1181
+ 1179 entailment
1182
+ 1180 contradiction
1183
+ 1181 neutral
1184
+ 1182 entailment
1185
+ 1183 contradiction
1186
+ 1184 neutral
1187
+ 1185 entailment
1188
+ 1186 contradiction
1189
+ 1187 neutral
1190
+ 1188 entailment
1191
+ 1189 contradiction
1192
+ 1190 neutral
1193
+ 1191 entailment
1194
+ 1192 contradiction
1195
+ 1193 neutral
1196
+ 1194 entailment
1197
+ 1195 contradiction
1198
+ 1196 neutral
1199
+ 1197 entailment
1200
+ 1198 contradiction
1201
+ 1199 neutral
1202
+ 1200 entailment
1203
+ 1201 contradiction
1204
+ 1202 neutral
1205
+ 1203 entailment
1206
+ 1204 contradiction
1207
+ 1205 neutral
1208
+ 1206 entailment
1209
+ 1207 contradiction
1210
+ 1208 neutral
1211
+ 1209 contradiction
1212
+ 1210 entailment
1213
+ 1211 contradiction
1214
+ 1212 entailment
1215
+ 1213 contradiction
1216
+ 1214 neutral
1217
+ 1215 entailment
1218
+ 1216 contradiction
1219
+ 1217 neutral
1220
+ 1218 entailment
1221
+ 1219 contradiction
1222
+ 1220 neutral
1223
+ 1221 entailment
1224
+ 1222 contradiction
1225
+ 1223 neutral
1226
+ 1224 entailment
1227
+ 1225 contradiction
1228
+ 1226 neutral
1229
+ 1227 entailment
1230
+ 1228 neutral
1231
+ 1229 neutral
1232
+ 1230 contradiction
1233
+ 1231 entailment
1234
+ 1232 neutral
1235
+ 1233 entailment
1236
+ 1234 contradiction
1237
+ 1235 neutral
1238
+ 1236 entailment
1239
+ 1237 contradiction
1240
+ 1238 neutral
1241
+ 1239 entailment
1242
+ 1240 entailment
1243
+ 1241 neutral
1244
+ 1242 entailment
1245
+ 1243 contradiction
1246
+ 1244 neutral
1247
+ 1245 entailment
1248
+ 1246 contradiction
1249
+ 1247 entailment
1250
+ 1248 entailment
1251
+ 1249 contradiction
1252
+ 1250 neutral
1253
+ 1251 entailment
1254
+ 1252 contradiction
1255
+ 1253 entailment
1256
+ 1254 neutral
1257
+ 1255 neutral
1258
+ 1256 neutral
1259
+ 1257 neutral
1260
+ 1258 contradiction
1261
+ 1259 neutral
1262
+ 1260 contradiction
1263
+ 1261 contradiction
1264
+ 1262 neutral
1265
+ 1263 entailment
1266
+ 1264 contradiction
1267
+ 1265 neutral
1268
+ 1266 entailment
1269
+ 1267 contradiction
1270
+ 1268 neutral
1271
+ 1269 entailment
1272
+ 1270 contradiction
1273
+ 1271 neutral
1274
+ 1272 entailment
1275
+ 1273 contradiction
1276
+ 1274 neutral
1277
+ 1275 entailment
1278
+ 1276 contradiction
1279
+ 1277 entailment
1280
+ 1278 entailment
1281
+ 1279 contradiction
1282
+ 1280 neutral
1283
+ 1281 entailment
1284
+ 1282 contradiction
1285
+ 1283 neutral
1286
+ 1284 entailment
1287
+ 1285 contradiction
1288
+ 1286 neutral
1289
+ 1287 entailment
1290
+ 1288 contradiction
1291
+ 1289 neutral
1292
+ 1290 contradiction
1293
+ 1291 contradiction
1294
+ 1292 neutral
1295
+ 1293 entailment
1296
+ 1294 contradiction
1297
+ 1295 neutral
1298
+ 1296 neutral
1299
+ 1297 contradiction
1300
+ 1298 neutral
1301
+ 1299 entailment
1302
+ 1300 entailment
1303
+ 1301 neutral
1304
+ 1302 entailment
1305
+ 1303 contradiction
1306
+ 1304 entailment
1307
+ 1305 neutral
1308
+ 1306 contradiction
1309
+ 1307 neutral
1310
+ 1308 entailment
1311
+ 1309 contradiction
1312
+ 1310 neutral
1313
+ 1311 neutral
1314
+ 1312 entailment
1315
+ 1313 neutral
1316
+ 1314 entailment
1317
+ 1315 contradiction
1318
+ 1316 neutral
1319
+ 1317 entailment
1320
+ 1318 contradiction
1321
+ 1319 entailment
1322
+ 1320 entailment
1323
+ 1321 contradiction
1324
+ 1322 entailment
1325
+ 1323 entailment
1326
+ 1324 contradiction
1327
+ 1325 neutral
1328
+ 1326 entailment
1329
+ 1327 contradiction
1330
+ 1328 neutral
1331
+ 1329 entailment
1332
+ 1330 contradiction
1333
+ 1331 entailment
1334
+ 1332 entailment
1335
+ 1333 contradiction
1336
+ 1334 neutral
1337
+ 1335 entailment
1338
+ 1336 contradiction
1339
+ 1337 neutral
1340
+ 1338 entailment
1341
+ 1339 contradiction
1342
+ 1340 neutral
1343
+ 1341 entailment
1344
+ 1342 contradiction
1345
+ 1343 neutral
1346
+ 1344 entailment
1347
+ 1345 contradiction
1348
+ 1346 neutral
1349
+ 1347 entailment
1350
+ 1348 contradiction
1351
+ 1349 neutral
1352
+ 1350 entailment
1353
+ 1351 contradiction
1354
+ 1352 neutral
1355
+ 1353 entailment
1356
+ 1354 neutral
1357
+ 1355 neutral
1358
+ 1356 neutral
1359
+ 1357 contradiction
1360
+ 1358 neutral
1361
+ 1359 entailment
1362
+ 1360 contradiction
1363
+ 1361 contradiction
1364
+ 1362 entailment
1365
+ 1363 contradiction
1366
+ 1364 neutral
1367
+ 1365 entailment
1368
+ 1366 neutral
1369
+ 1367 contradiction
1370
+ 1368 contradiction
1371
+ 1369 contradiction
1372
+ 1370 neutral
1373
+ 1371 entailment
1374
+ 1372 contradiction
1375
+ 1373 entailment
1376
+ 1374 entailment
1377
+ 1375 contradiction
1378
+ 1376 neutral
1379
+ 1377 entailment
1380
+ 1378 contradiction
1381
+ 1379 neutral
1382
+ 1380 entailment
1383
+ 1381 contradiction
1384
+ 1382 neutral
1385
+ 1383 entailment
1386
+ 1384 contradiction
1387
+ 1385 neutral
1388
+ 1386 neutral
1389
+ 1387 contradiction
1390
+ 1388 entailment
1391
+ 1389 entailment
1392
+ 1390 contradiction
1393
+ 1391 neutral
1394
+ 1392 neutral
1395
+ 1393 contradiction
1396
+ 1394 neutral
1397
+ 1395 entailment
1398
+ 1396 contradiction
1399
+ 1397 neutral
1400
+ 1398 entailment
1401
+ 1399 contradiction
1402
+ 1400 neutral
1403
+ 1401 entailment
1404
+ 1402 contradiction
1405
+ 1403 contradiction
1406
+ 1404 entailment
1407
+ 1405 contradiction
1408
+ 1406 contradiction
1409
+ 1407 entailment
1410
+ 1408 neutral
1411
+ 1409 entailment
1412
+ 1410 neutral
1413
+ 1411 neutral
1414
+ 1412 neutral
1415
+ 1413 entailment
1416
+ 1414 contradiction
1417
+ 1415 neutral
1418
+ 1416 entailment
1419
+ 1417 contradiction
1420
+ 1418 neutral
1421
+ 1419 neutral
1422
+ 1420 contradiction
1423
+ 1421 neutral
pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f968f011daa586c8b88ad58d0f42dc39649575be953a1e2cc062d4f0a4668d5
3
+ size 438009197
runs/Sep06_14-31-58_d62a17eebd0d/1662474745.8974035/events.out.tfevents.1662474745.d62a17eebd0d.419.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd035765f22e5fb72d51c83c09ac13f630a6cb6aabcc499adac60f3bf127ae85
3
+ size 5514
runs/Sep06_14-31-58_d62a17eebd0d/events.out.tfevents.1662474745.d62a17eebd0d.419.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2fc7584fe3662963777494b594bcde3e5e0e5708c81b33e138a9afea0e6973c1
3
+ size 11056
runs/Sep06_14-31-58_d62a17eebd0d/events.out.tfevents.1662481494.d62a17eebd0d.419.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df3931a4a9204ebee326e0d72519bd8bc868a39bc78e6b887036e76b8983ac45
3
+ size 363
special_tokens_map.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": "[CLS]",
3
+ "mask_token": "[MASK]",
4
+ "pad_token": "[PAD]",
5
+ "sep_token": "[SEP]",
6
+ "unk_token": "[UNK]"
7
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": "[CLS]",
3
+ "do_basic_tokenize": true,
4
+ "do_lower_case": true,
5
+ "mask_token": "[MASK]",
6
+ "name_or_path": "/content/drive/MyDrive/fine_tuned_models/pubmedbert_mnli_v3",
7
+ "never_split": null,
8
+ "pad_token": "[PAD]",
9
+ "sep_token": "[SEP]",
10
+ "special_tokens_map_file": null,
11
+ "strip_accents": null,
12
+ "tokenize_chinese_chars": true,
13
+ "tokenizer_class": "BertTokenizer",
14
+ "unk_token": "[UNK]"
15
+ }
train_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 20.0,
3
+ "train_loss": 0.10057472327884626,
4
+ "train_runtime": 6733.6679,
5
+ "train_samples": 11232,
6
+ "train_samples_per_second": 33.361,
7
+ "train_steps_per_second": 1.043
8
+ }
trainer_state.json ADDED
@@ -0,0 +1,235 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": 0.8666666746139526,
3
+ "best_model_checkpoint": "/content/best_model/checkpoint-3000",
4
+ "epoch": 20.0,
5
+ "global_step": 7020,
6
+ "is_hyper_param_search": false,
7
+ "is_local_process_zero": true,
8
+ "is_world_process_zero": true,
9
+ "log_history": [
10
+ {
11
+ "epoch": 1.42,
12
+ "learning_rate": 1.8575498575498575e-05,
13
+ "loss": 0.5673,
14
+ "step": 500
15
+ },
16
+ {
17
+ "epoch": 1.42,
18
+ "eval_accuracy": 0.8437275886535645,
19
+ "eval_loss": 0.43583494424819946,
20
+ "eval_runtime": 13.3841,
21
+ "eval_samples_per_second": 104.228,
22
+ "eval_steps_per_second": 3.287,
23
+ "step": 500
24
+ },
25
+ {
26
+ "epoch": 2.85,
27
+ "learning_rate": 1.7150997150997152e-05,
28
+ "loss": 0.2898,
29
+ "step": 1000
30
+ },
31
+ {
32
+ "epoch": 2.85,
33
+ "eval_accuracy": 0.8523297309875488,
34
+ "eval_loss": 0.4844760596752167,
35
+ "eval_runtime": 13.3926,
36
+ "eval_samples_per_second": 104.162,
37
+ "eval_steps_per_second": 3.285,
38
+ "step": 1000
39
+ },
40
+ {
41
+ "epoch": 4.27,
42
+ "learning_rate": 1.5726495726495726e-05,
43
+ "loss": 0.1669,
44
+ "step": 1500
45
+ },
46
+ {
47
+ "epoch": 4.27,
48
+ "eval_accuracy": 0.8573476672172546,
49
+ "eval_loss": 0.6232547760009766,
50
+ "eval_runtime": 13.3901,
51
+ "eval_samples_per_second": 104.181,
52
+ "eval_steps_per_second": 3.286,
53
+ "step": 1500
54
+ },
55
+ {
56
+ "epoch": 5.7,
57
+ "learning_rate": 1.4301994301994305e-05,
58
+ "loss": 0.1087,
59
+ "step": 2000
60
+ },
61
+ {
62
+ "epoch": 5.7,
63
+ "eval_accuracy": 0.8573476672172546,
64
+ "eval_loss": 0.7262628078460693,
65
+ "eval_runtime": 13.3968,
66
+ "eval_samples_per_second": 104.129,
67
+ "eval_steps_per_second": 3.284,
68
+ "step": 2000
69
+ },
70
+ {
71
+ "epoch": 7.12,
72
+ "learning_rate": 1.2877492877492879e-05,
73
+ "loss": 0.0728,
74
+ "step": 2500
75
+ },
76
+ {
77
+ "epoch": 7.12,
78
+ "eval_accuracy": 0.8637992739677429,
79
+ "eval_loss": 0.8840554356575012,
80
+ "eval_runtime": 13.3781,
81
+ "eval_samples_per_second": 104.275,
82
+ "eval_steps_per_second": 3.289,
83
+ "step": 2500
84
+ },
85
+ {
86
+ "epoch": 8.55,
87
+ "learning_rate": 1.1452991452991454e-05,
88
+ "loss": 0.0512,
89
+ "step": 3000
90
+ },
91
+ {
92
+ "epoch": 8.55,
93
+ "eval_accuracy": 0.8666666746139526,
94
+ "eval_loss": 0.9500740170478821,
95
+ "eval_runtime": 13.4339,
96
+ "eval_samples_per_second": 103.842,
97
+ "eval_steps_per_second": 3.275,
98
+ "step": 3000
99
+ },
100
+ {
101
+ "epoch": 9.97,
102
+ "learning_rate": 1.002849002849003e-05,
103
+ "loss": 0.0372,
104
+ "step": 3500
105
+ },
106
+ {
107
+ "epoch": 9.97,
108
+ "eval_accuracy": 0.856630802154541,
109
+ "eval_loss": 1.0440385341644287,
110
+ "eval_runtime": 13.391,
111
+ "eval_samples_per_second": 104.175,
112
+ "eval_steps_per_second": 3.286,
113
+ "step": 3500
114
+ },
115
+ {
116
+ "epoch": 11.4,
117
+ "learning_rate": 8.603988603988605e-06,
118
+ "loss": 0.0262,
119
+ "step": 4000
120
+ },
121
+ {
122
+ "epoch": 11.4,
123
+ "eval_accuracy": 0.8609318733215332,
124
+ "eval_loss": 1.0770107507705688,
125
+ "eval_runtime": 13.3894,
126
+ "eval_samples_per_second": 104.187,
127
+ "eval_steps_per_second": 3.286,
128
+ "step": 4000
129
+ },
130
+ {
131
+ "epoch": 12.82,
132
+ "learning_rate": 7.17948717948718e-06,
133
+ "loss": 0.0243,
134
+ "step": 4500
135
+ },
136
+ {
137
+ "epoch": 12.82,
138
+ "eval_accuracy": 0.8616487383842468,
139
+ "eval_loss": 1.0931395292282104,
140
+ "eval_runtime": 13.3865,
141
+ "eval_samples_per_second": 104.209,
142
+ "eval_steps_per_second": 3.287,
143
+ "step": 4500
144
+ },
145
+ {
146
+ "epoch": 14.25,
147
+ "learning_rate": 5.7549857549857555e-06,
148
+ "loss": 0.023,
149
+ "step": 5000
150
+ },
151
+ {
152
+ "epoch": 14.25,
153
+ "eval_accuracy": 0.8630824089050293,
154
+ "eval_loss": 1.1087766885757446,
155
+ "eval_runtime": 13.3932,
156
+ "eval_samples_per_second": 104.157,
157
+ "eval_steps_per_second": 3.285,
158
+ "step": 5000
159
+ },
160
+ {
161
+ "epoch": 15.67,
162
+ "learning_rate": 4.330484330484331e-06,
163
+ "loss": 0.0163,
164
+ "step": 5500
165
+ },
166
+ {
167
+ "epoch": 15.67,
168
+ "eval_accuracy": 0.8580645322799683,
169
+ "eval_loss": 1.1263514757156372,
170
+ "eval_runtime": 13.3902,
171
+ "eval_samples_per_second": 104.18,
172
+ "eval_steps_per_second": 3.286,
173
+ "step": 5500
174
+ },
175
+ {
176
+ "epoch": 17.09,
177
+ "learning_rate": 2.9059829059829063e-06,
178
+ "loss": 0.0111,
179
+ "step": 6000
180
+ },
181
+ {
182
+ "epoch": 17.09,
183
+ "eval_accuracy": 0.8616487383842468,
184
+ "eval_loss": 1.154114842414856,
185
+ "eval_runtime": 13.3822,
186
+ "eval_samples_per_second": 104.243,
187
+ "eval_steps_per_second": 3.288,
188
+ "step": 6000
189
+ },
190
+ {
191
+ "epoch": 18.52,
192
+ "learning_rate": 1.4814814814814815e-06,
193
+ "loss": 0.0098,
194
+ "step": 6500
195
+ },
196
+ {
197
+ "epoch": 18.52,
198
+ "eval_accuracy": 0.8630824089050293,
199
+ "eval_loss": 1.1541603803634644,
200
+ "eval_runtime": 13.3814,
201
+ "eval_samples_per_second": 104.25,
202
+ "eval_steps_per_second": 3.288,
203
+ "step": 6500
204
+ },
205
+ {
206
+ "epoch": 19.94,
207
+ "learning_rate": 5.6980056980056986e-08,
208
+ "loss": 0.0074,
209
+ "step": 7000
210
+ },
211
+ {
212
+ "epoch": 19.94,
213
+ "eval_accuracy": 0.8637992739677429,
214
+ "eval_loss": 1.1652880907058716,
215
+ "eval_runtime": 13.3866,
216
+ "eval_samples_per_second": 104.209,
217
+ "eval_steps_per_second": 3.287,
218
+ "step": 7000
219
+ },
220
+ {
221
+ "epoch": 20.0,
222
+ "step": 7020,
223
+ "total_flos": 3.4632303608448e+16,
224
+ "train_loss": 0.10057472327884626,
225
+ "train_runtime": 6733.6679,
226
+ "train_samples_per_second": 33.361,
227
+ "train_steps_per_second": 1.043
228
+ }
229
+ ],
230
+ "max_steps": 7020,
231
+ "num_train_epochs": 20,
232
+ "total_flos": 3.4632303608448e+16,
233
+ "trial_name": null,
234
+ "trial_params": null
235
+ }
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ab6ae881fab3cf4b233bb4f4dcf88116bb87b0c7c3f589b0f1144e459932a1e
3
+ size 3375
vocab.txt ADDED
The diff for this file is too large to render. See raw diff