Petr came across a bug that affected the output of the predictions generated from the test set. It worked fine for cross-validation, but not for the Random split and Unlabled/Test set modes. I’ve committed a fix and made a new release available:
https://github.com/fracpete/collective-classification-weka-package/releases/tag/v2015.2.27