Evaluation script error

[WitchDD]

Thank you friends for suggesting interesting things!
python run_metrics.py --models_list weights / eval_list --outputmetric_results.csv

When I do this I get this error:
usage: run_metrics.py [-h] [--models_list MODELS_LIST] [--output OUTPUT] [--model_root MODEL_ROOT] [--eval_root EVAL_ROOT] [--sample_root SAMPLE_ROOT] [--batch_size BATCH_SIZE] [--eval_samples EVAL_SAMPLES] [--device DEVICE] run_metrics.py: error: unrecognized arguments: / eval_list --outputmetric_results.csv

It looks like the arguments aren't working. I want you to find a concrete solution.
thank you!

[PeterWang512]

Can you try removing the space like this?
python run_metrics.py --models_list weights/eval_list --output metric_results.csv

[WitchDD]

Another error will occur.
`al_list --output metric_results.csv
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
File "/home/test/anaconda3/envs/gan/lib/python3.6/multiprocessing/pool.py", line 119, in worker
result = (True, func(*args, **kwds))
File "/home/test/GANSketching/run_metrics.py", line 105, in run_vgg
from eval.precision_recall import metrics as pr
ImportError: cannot import name 'metrics'
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "run_metrics.py", line 155, in
metrics[name] = get_metrics(opt, name, target)
File "run_metrics.py", line 56, in get_metrics
stats_fake = get_stats(opt, g, fake_folder)
File "run_metrics.py", line 87, in get_stats
vgg_features = get_vgg_features(folder, opt.eval_samples, opt.batch_size)
File "run_metrics.py", line 101, in get_vgg_features
return p.apply(run_vgg, (folder, eval_samples, batch_size,))
File "/home/test/anaconda3/envs/gan/lib/python3.6/multiprocessing/pool.py", line 259, in apply
return self.apply_async(func, args, kwds).get()
File "/home/test/anaconda3/envs/gan/lib/python3.6/multiprocessing/pool.py", line 644, in get
raise self._value
ImportError: cannot import name 'metrics'
`

[PeterWang512]

It could be that you haven't pulled the submodules. I would try running git submodule update --init --recursive in the repo and then run the script.

[WitchDD]

As instructed, I ran it in the following order, but I get the same error.

①git submodule update --init --recursive
②bash scripts/train_teaser_cat.sh
③Access 'https://wandb.ai'　　-> The execution result is generated in / GANSketching / wandb.
④python run_metrics.py --models_list weights/eval_list --output metric_results.csv　　　->Here, the previous error appears

[PeterWang512]

Can you check if metrics.py exists in eval/precision_recall? It should exist if you pulled the submodules

[WitchDD]

eval/precision_recall　was missing metrics.py

Why doesn't git submodule update --init --recursive respond?

[PeterWang512]

I'm not sure about the cause, but as a temporary fix, you can pull the precision_recall directly at here: https://github.com/PeterWang512/precision_recall
and move the folder to in the eval folder

[WitchDD]

I installed tensorflow-gpu == 1.5.0 because of a dnnlib error.
However, this new error has occurred and I would like to ask for a solution.

`al_list --output metric_results.csv
/home/anaconda3/envs/gan/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:493: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
_np_qint8 = np.dtype([("qint8", np.int8, 1)])
/home/anaconda3/envs/gan/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:494: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
_np_quint8 = np.dtype([("quint8", np.uint8, 1)])
/home/anaconda3/envs/gan/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:495: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
_np_qint16 = np.dtype([("qint16", np.int16, 1)])
/home/anaconda3/envs/gan/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:496: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
_np_quint16 = np.dtype([("quint16", np.uint16, 1)])
/home/anaconda3/envs/gan/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:497: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
_np_qint32 = np.dtype([("qint32", np.int32, 1)])
/home/anaconda3/envs/gan/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:502: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
np_resource = np.dtype([("resource", np.ubyte, 1)])
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
File "/home/anaconda3/envs/gan/lib/python3.6/multiprocessing/pool.py", line 119, in worker
result = (True, func(*args, **kwds))
File "/home/GANSketching/run_metrics.py", line 105, in run_vgg
from eval.precision_recall import metrics as pr
File "/home/GANSketching/eval/precision_recall/metrics.py", line 13, in
from utils import init_tf
ImportError: cannot import name 'init_tf'
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "run_metrics.py", line 155, in
metrics[name] = get_metrics(opt, name, target)
File "run_metrics.py", line 56, in get_metrics
stats_fake = get_stats(opt, g, fake_folder)
File "run_metrics.py", line 87, in get_stats
vgg_features = get_vgg_features(folder, opt.eval_samples, opt.batch_size)
File "run_metrics.py", line 101, in get_vgg_features
return p.apply(run_vgg, (folder, eval_samples, batch_size,))
File "/home/anaconda3/envs/gan/lib/python3.6/multiprocessing/pool.py", line 259, in apply
return self.apply_async(func, args, kwds).get()
File "/home/anaconda3/envs/gan/lib/python3.6/multiprocessing/pool.py", line 644, in get
raise self._value
ImportError: cannot import name 'init_tf'
`

[PeterWang512]

I'll look into this issue, and see if I can reproduce this error. Stay tuned!