Optimization terminated successfully. Current function value: 1.304792 Iterations: 489 Function evaluations: 954 Gradient evaluations: 954 ====================================================================== Confusion matrix Comparison Contingency Expansion Temporal Comparison 46.0 50.0 35.0 69.0 Contingency 37.0 77.0 37.0 49.0 Expansion 35.0 42.0 46.0 77.0 Temporal 23.0 36.0 41.0 100.0 ====================================================================== Effectiveness precision recall f1 Comparison 0.33 0.23 0.27 Contingency 0.38 0.39 0.38 Temporal 0.34 0.5 0.4 Expansion 0.29 0.23 0.26 -------------------------------------------------- Average 0.33 0.34 0.33 ====================================================================== Accuracy: 0.34 Train set accuracy: 0.37 ====================================================================== Feature information Feature count: 116 -7.068 Normalized_Shared_Token_Count== and label is 'Contingency' 4.009 Normalized_Shared_Token_Count== and label is 'Comparison' 2.737 Normalized_Shared_Token_Count== and label is 'Temporal' -1.498 ('neg', 'neg')==True and label is 'Temporal' 1.130 ('neg', 'neg')==True and label is 'Contingency' -1.005 Constituent_Negation_Balanced==True and label is 'Temporal' 0.928 ('non-neg', 'non-neg')==True and label is 'Temporal' -0.852 Arg2_Startswith_It_Seems==False and label is 'Temporal' -0.692 ('pro-subj', 'pro-subj')==True and label is 'Temporal' 0.635 ('neg', 'neg')==True and label is 'Expansion' 0.616 Constituent_Negation_Balanced==True and label is 'Contingency' 0.597 Arg2_Startswith_It_Seems==False and label is 'Contingency' -0.582 Sentential_Negation_Balanced==False and label is 'Temporal' 0.564 ('non-neg', 'neg')==True and label is 'Comparison' 0.560 Arg1_Coef_Sum== and label is 'Contingency' -0.556 ('non-neg', 'non-neg')==True and label is 'Contingency' -0.555 ('modal', 'non-modal')==True and label is 'Temporal' -0.511 Arg1_Coef_Sum== and label is 'Comparison' 0.473 ('modal', 'non-modal')==True and label is 'Contingency' 0.427 Arg2_Coef_Sum== and label is 'Comparison' 0.411 Sentential_Negation_Balanced==True and label is 'Contingency' -0.394 ('non-modal', 'modal')==True and label is 'Temporal' 0.381 Sentential_Negation_Balanced==False and label is 'Comparison' 0.361 ('pro-subj', 'pro-subj')==True and label is 'Contingency' 0.360 ('pro-subj', 'pro-subj')==True and label is 'Expansion' -0.347 ('non-neg', 'neg')==True and label is 'Temporal' 0.322 Normalized_Shared_Token_Count== and label is 'Expansion' -0.317 Sentential_Negation_Balanced==True and label is 'Comparison' 0.306 Arg_Length_Ratio== and label is 'Comparison' -0.297 Arg_Length_Ratio== and label is 'Temporal' -0.269 Sentential_Negation_Balanced==True and label is 'Temporal' -0.269 ('non-modal', 'non-modal')==True and label is 'Comparison' 0.268 ('pro-subj', 'no-pro-subj')==True and label is 'Contingency' -0.267 ('neg', 'neg')==True and label is 'Comparison' 0.260 Tree_Height_Ratio== and label is 'Temporal' 0.259 ('non-modal', 'modal')==True and label is 'Contingency' 0.231 Constituent_Negation_Balanced==True and label is 'Expansion' 0.231 ('non-modal', 'non-modal')==True and label is 'Temporal' 0.222 ('modal', 'non-modal')==True and label is 'Comparison' -0.219 ('non-neg', 'non-neg')==True and label is 'Expansion' -0.218 Arg2_Coef_Sum== and label is 'Temporal' -0.217 Tree_Height_Ratio== and label is 'Expansion' -0.205 ('pro-subj', 'no-pro-subj')==True and label is 'Expansion' 0.191 Arg2_Startswith_It_Seems==False and label is 'Expansion' 0.186 Sentential_Negation_Balanced==False and label is 'Contingency' -0.182 Arg2_Coef_Sum== and label is 'Contingency' 0.178 ('non-modal', 'non-modal')==True and label is 'Expansion' 0.175 Sentential_Negation_Balanced==True and label is 'Expansion' -0.164 Tree_Height_Ratio== and label is 'Contingency' -0.160 ('no-pro-subj', 'pro-subj')==True and label is 'Temporal' 0.158 Constituent_Negation_Balanced==True and label is 'Comparison' 0.153 Constituent_Negation_Balanced==False and label is 'Temporal' -0.153 ('non-neg', 'non-neg')==True and label is 'Comparison' -0.141 ('non-neg', 'neg')==True and label is 'Expansion' -0.140 ('modal', 'non-modal')==True and label is 'Expansion' -0.139 ('non-modal', 'non-modal')==True and label is 'Contingency' -0.133 ('modal', 'modal')==True and label is 'Temporal' 0.125 ('no-pro-subj', 'pro-subj')==True and label is 'Expansion' 0.121 Tree_Height_Ratio== and label is 'Comparison' -0.120 Arg1_Coef_Sum== and label is 'Expansion' 0.105 ('no-pro-subj', 'no-pro-subj')==True and label is 'Comparison' 0.100 ('neg', 'non-neg')==True and label is 'Contingency' -0.094 Constituent_Negation_Balanced==False and label is 'Comparison' -0.089 ('no-pro-subj', 'no-pro-subj')==True and label is 'Expansion' 0.086 ('non-modal', 'modal')==True and label is 'Expansion' -0.084 ('neg', 'non-neg')==True and label is 'Expansion' -0.083 Arg_Length_Ratio== and label is 'Contingency' -0.080 ('neg', 'non-neg')==True and label is 'Comparison' -0.079 Clause_Count_Ratio== and label is 'Contingency' -0.078 Arg2_Clause_Count== and label is 'Comparison' -0.076 ('non-neg', 'neg')==True and label is 'Contingency' 0.074 Arg_Length_Ratio== and label is 'Expansion' 0.071 Arg1_Coef_Sum== and label is 'Temporal' 0.070 Clause_Count_Ratio== and label is 'Temporal' 0.067 ('modal', 'modal')==True and label is 'Expansion' 0.065 ('neg', 'non-neg')==True and label is 'Temporal' 0.064 Arg2_Startswith_It_Seems==False and label is 'Comparison' 0.062 Arg_Tense_Agreement== and label is 'Temporal' 0.061 ('modal', 'modal')==True and label is 'Comparison' -0.057 ('no-pro-subj', 'no-pro-subj')==True and label is 'Contingency' 0.050 ('non-modal', 'modal')==True and label is 'Comparison' 0.045 Arg2_Max_Tree_Height== and label is 'Temporal' 0.045 Arg1_Max_Tree_Height== and label is 'Temporal' 0.041 ('no-pro-subj', 'no-pro-subj')==True and label is 'Temporal' -0.041 ('pro-subj', 'no-pro-subj')==True and label is 'Temporal' -0.040 Constituent_Negation_Balanced==False and label is 'Expansion' -0.037 Arg1_Max_Tree_Height== and label is 'Expansion' 0.032 Arg2_Clause_Count== and label is 'Temporal' 0.031 Arg2_Clause_Count== and label is 'Contingency' -0.031 Arg2_Max_Tree_Height== and label is 'Comparison' -0.029 ('pro-subj', 'pro-subj')==True and label is 'Comparison' 0.028 Clause_Count_Ratio== and label is 'Comparison' -0.027 Arg2_Coef_Sum== and label is 'Expansion' 0.027 Arg1_Clause_Count== and label is 'Temporal' 0.026 ('no-pro-subj', 'pro-subj')==True and label is 'Contingency' -0.024 Arg2_Max_Tree_Height== and label is 'Contingency' -0.024 Arg_Tense_Agreement== and label is 'Comparison' -0.022 ('pro-subj', 'no-pro-subj')==True and label is 'Comparison' -0.020 Clause_Count_Ratio== and label is 'Expansion' -0.019 Arg_Tense_Agreement== and label is 'Expansion' -0.019 Constituent_Negation_Balanced==False and label is 'Contingency' -0.019 Arg_Tense_Agreement== and label is 'Contingency' -0.017 Arg1_Clause_Count== and label is 'Comparison' 0.015 Sentential_Negation_Balanced==False and label is 'Expansion' 0.015 Arg2_Clause_Count== and label is 'Expansion' -0.012 Arg1_Clause_Count== and label is 'Expansion' 0.010 Arg2_Max_Tree_Height== and label is 'Expansion' -0.010 Arg1_Max_Tree_Height== and label is 'Comparison' 0.009 ('no-pro-subj', 'pro-subj')==True and label is 'Comparison' 0.005 ('modal', 'modal')==True and label is 'Contingency' 0.002 Arg1_Clause_Count== and label is 'Contingency' 0.002 Arg1_Max_Tree_Height== and label is 'Contingency' 0.000 Clause_Count_Ratio== and label is 'Contingency' 0.000 Clause_Count_Ratio== and label is 'Temporal' 0.000 Clause_Count_Ratio== and label is 'Comparison' 0.000 Clause_Count_Ratio== and label is 'Expansion'