example_eval.yaml (14 lines of code) (raw):
- model: llava
model_args: pretrained=liuhaotian/llava-v1.5-7b
tasks: ai2d
batch_size: 1
log_samples: true
log_samples_suffix: eval_vizwiz_vqa
output_path: "./logs/"
- model: llava
model_args: pretrained=liuhaotian/llava-v1.5-13b
tasks: mme
batch_size: 1
log_samples: true
log_samples_suffix: mme
output_path: "./logs/"