data not included?

[amueller]

I tried to run "kde.py" to reproduce Figure 6 from the arxiv paper, but got

FileNotFoundError: [Errno 2] No such file or directory: '/home/andy/nemo/experiments/priorbased_experiments/libsvm_svc//kernel_sigmoid'

[janvanrijn]

plot.py is not a runnable script, I assume you ran examples/optimziers_result_filesystem.py?

This script requires several CLI arguments, one pointing to the data folder with the raw results. I indeed did not share these in the repo, as this is in the order of GB's (openml trace file and openml prediction file). If you want, I can share these by other means.

If you want to reproduce figure 6, I would refer to the notebook in the KDD2018 folder, which works on a pickle file that just contains the necessary results (final accuracy scores), under the heading 'Prior experiments'. Please make sure to have installed the right version of pandas (see requirements.txt)

[amueller]

Sorry, I meant kde.py.

[amueller]

the notebook doesn't seem to include Figure 6. Which cell is that supposed to be?
It would be great if you could check in the notebook with the figures, so I don't have to run it locally to see the results.

[mbahmani]

Hey @amueller,
I want to start all the steps from the raw data and reproduce but it seems there is some problem.
Can you please guide me on how to execute the code form the first step to the end?