diff options
1067 files changed, 54469 insertions, 179 deletions
@@ -1,10 +1,13 @@ __pycache__/ *.py[cod] - .venv/ -venv/ - data/ -runs/ - +*.pt +*.pth +ckpt_*.pt +runs/ckpt_*.pt +runs/*.pt +runs/*.pth +logs/*.tmp +summaries/*.tmp .DS_Store diff --git a/README.md b/README.md new file mode 100644 index 0000000..2bbf938 --- /dev/null +++ b/README.md @@ -0,0 +1,150 @@ +# RRoG-GNN + +This is the working repo for RRoG/TRM-on-GNN experiments. It contains the +current experiment runner, diagnostic prototypes, paper references, scripts, and +tracked JSON/log/summary outputs. + +Core rule: + +```text +view/graph aggregation happens once; recursive compute is edge-free hidden-state refinement. +``` + +The main reported table is: + +```text +Task x Backbone -> classic baseline +Task x Backbone x fixed-RRoG -> delta against the matching classic row +``` + +`classic` is the non-RRoG baseline for every backbone: `T=0`, `n_sup=1`. + +## One-command Run On 2x A6000 + +On a clean machine with two visible GPUs: + +```bash +git clone git@github.com:YurenHao0426/rrog.git +cd rrog +./scripts/setup_and_run_two_a6000.sh +``` + +Defaults: + +- GPU0: `zinc-cycle56` over 17 backbones, `classic + fixed-rrog` +- GPU1: `ogbg-molhiv` over 17 backbones, `classic + fixed-rrog` +- Results: `runs/*.json` +- Logs: `logs/*.log` +- Summaries: `summaries/*.md` + +If the environment already has compatible `torch`, `torch_geometric`, and `ogb`: + +```bash +SKIP_SETUP=1 ./scripts/setup_and_run_two_a6000.sh +``` + +To override CUDA wheel index during setup: + +```bash +TORCH_INDEX_URL=https://download.pytorch.org/whl/cu121 ./scripts/setup_env.sh +``` + +## Common Commands + +Smoke test: + +```bash +./scripts/setup_env.sh +DEVICE=cuda:0 ./scripts/run_smoke.sh +``` + +Run the paired ZINC matrix only: + +```bash +DEVICE=cuda:0 EPOCHS=200 ./scripts/run_zinc_cycle56_full.sh +``` + +Run one OGB molecular task: + +```bash +TASK=ogbg-molhiv DEVICE=cuda:1 EPOCHS=100 ./scripts/run_ogb_mol_task_full.sh +``` + +Run the same OGB task with the lighter fixed recursion used by the ZINC sweep: + +```bash +TASK=ogbg-molhiv DEVICE=cuda:1 EPOCHS=100 FIXED_T=1 FIXED_NS=3 ./scripts/run_ogb_mol_task_full.sh +``` + +Run all selected OGB molecular tasks serially on one GPU: + +```bash +DEVICE=cuda:1 ./scripts/run_ogb_mol_all_tasks.sh +``` + +Run the corrected stream-ACT sweep on two GPUs: + +```bash +EPOCHS=100 SEEDS=0 ./scripts/run_ogb_act_two_gpu.sh +``` + +Defaults: + +- GPU0: `ogbg-molhiv ogbg-molbbbp ogbg-molsider ogbg-molbace` +- GPU1: `ogbg-molesol ogbg-mollipo ogbg-moltox21 ogbg-molclintox` +- Every task runs all 17 backbones. +- ACT config: `T=1`, `n_sup=3`, `halt_max=8`, `halt_min=2`, `halt_target=loss`, `loss_threshold=0.2`, `halt_exploration=0.1`, `lam_q=0.1`, `q_warmup=0`, `act_train_mode=stream`. + +Optional ACT variants: + +```bash +# Add FreeSolv as a separate regression stress test. +TASKS_GPU0="ogbg-molfreesolv" TASKS_GPU1="" ./scripts/run_ogb_act_two_gpu.sh + +# Classification-only exact-halt target. +TASKS_GPU0="ogbg-molhiv ogbg-molbbbp ogbg-molsider" \ +TASKS_GPU1="ogbg-molbace ogbg-moltox21 ogbg-molclintox" \ +HALT_TARGET=exact ./scripts/run_ogb_act_two_gpu.sh + +# More robust but longer seed sweep. +SEEDS="0 1 2" ./scripts/run_ogb_act_two_gpu.sh +``` + +Collect summaries: + +```bash +./scripts/collect_results.sh +``` + +## Backbones + +The implemented 2D view/backbone list is shared across ZINC and OGB: + +```text +gin, gine, gcn, graphsage, gatv2, graphconv, transformer, pna, +gen, film, resgated, tag, sgc, cheb, arma, mf, appnp +``` + +For ZINC `gine`, there are no bond features, so GINE uses a learned constant edge token. +For OGB molecular tasks, GINE and edge-aware backbones use OGB bond encodings. + +## Notes + +- Runs are resumable at the cell level: scripts skip existing expected JSON files. +- ZINC cycle-count cache is generated under `data/cycle_cache`. +- OGB datasets are downloaded under `data/ogb`. +- Override data/runs locations with `RROG_DATA_DIR` and `RROG_RUNS_DIR`. +- Large artifacts are intentionally not versioned in Git: `data/`, checkpoints, + `*.pt`, and `*.pth` are ignored. Use external storage or Git LFS if those need + to be shared. + +## Upload Results + +After a remote machine finishes: + +```bash +git pull +git add -f runs/*.json logs/*.log summaries/*.md +git commit -m "Add stream ACT OGB results" +git push +``` diff --git a/analysis/ogbg-molhiv_fixed-rrog_T3_ns3_diagnostics.csv b/analysis/ogbg-molhiv_fixed-rrog_T3_ns3_diagnostics.csv new file mode 100644 index 0000000..8d8ff16 --- /dev/null +++ b/analysis/ogbg-molhiv_fixed-rrog_T3_ns3_diagnostics.csv @@ -0,0 +1,18 @@ +view,metric,base_ep,base_val,base_test,cand_ep,cand_val,cand_test,val_delta,test_delta,base_curve_best_ep,base_final_gap,cand_curve_best_ep,cand_curve_final_ep,cand_final_gap,cand_late_slope,cand_range,labels
+appnp,rocauc,30,0.7674851190476192,0.7000000000000001,30,0.7203422006662747,0.682502558952471,-0.047142918381344434,-0.01749744104752904,30,0.04686000000000001,30,100,0.047719999999999985,0.0032600000000000406,0.07535000000000003,"val_and_test_down,fixed_val_lags_classic,late_collapse"
+arma,rocauc,70,0.7872115667254557,0.7296336352575368,90,0.7926495443856555,0.7317541860599857,0.005437977660199822,0.002120550802448884,70,0.0020499999999999963,90,100,0.0011499999999999844,-0.0011499999999999844,0.13578999999999997,"positive_or_tie,maybe_undertrained"
+cheb,rocauc,60,0.783120835782873,0.7281735838853589,40,0.7734757740544776,0.7425713126943356,-0.009645061728395299,0.014397728808976717,60,0.021220000000000017,40,100,0.03462999999999994,-0.0027800000000000047,0.050449999999999995,"test_up_val_down,late_collapse"
+film,rocauc,20,0.7921535126396236,0.7842136773595473,30,0.7633101851851851,0.7727785395623709,-0.028843327454438517,-0.01143513779717642,20,0.043240000000000056,30,100,0.05358000000000007,-0.003670000000000062,0.07297000000000009,"val_and_test_down,fixed_val_lags_classic,late_collapse"
+gatv2,rocauc,20,0.7834576474622771,0.75625253481141,20,0.7835464432686655,0.746617354525966,8.879580638843088e-05,-0.009635180285443967,20,0.040959999999999996,20,100,0.09077000000000002,-0.0033800000000000496,0.09077000000000002,"val_up_test_down,late_collapse"
+gcn,rocauc,30,0.7754323437193807,0.719778288495336,40,0.7454683519498334,0.7482879159504818,-0.029963991769547338,0.028509627455145847,30,0.04236999999999991,40,100,0.010009999999999963,-0.006759999999999988,0.10924999999999996,"test_up_val_down,fixed_val_lags_classic"
+gen,rocauc,30,0.7530159954928474,0.7313524788041483,60,0.8127970066627475,0.7631375654222755,0.05978101116990009,0.03178508661812718,30,0.06394,60,100,0.07395999999999991,-0.015559999999999907,0.11785999999999996,"positive_or_tie,late_collapse"
+gin,rocauc,40,0.816746889084852,0.7723980764402558,30,0.7523760533019792,0.7324378609088626,-0.06437083578287284,-0.03996021553139317,40,0.032930000000000015,30,100,0.013860000000000094,0.0015699999999999603,0.09743000000000002,"val_and_test_down,fixed_val_lags_classic"
+gine,rocauc,70,0.7942448069762884,0.7445141852874717,40,0.7574588477366255,0.7400818864790746,-0.03678595923966288,-0.004432298808397128,70,0.008459999999999912,40,100,0.02404000000000006,-0.005790000000000073,0.14568000000000003,"val_and_test_down,fixed_val_lags_classic"
+graphconv,rocauc,80,0.7706618655692731,0.7108113327796983,80,0.7712528169704094,0.6979180748952278,0.0005909514011362971,-0.012893257884470488,80,0.009280000000000066,80,100,0.004809999999999981,-9.999999999998899e-05,0.07740000000000002,val_up_test_down
+graphsage,rocauc,40,0.7968596903782088,0.7625118291199134,20,0.7586759626690183,0.7641070704339598,-0.03818372770919054,0.001595241314046314,40,0.054950000000000054,20,100,0.022279999999999966,-0.008159999999999945,0.08989000000000003,"test_up_val_down,fixed_val_lags_classic"
+mf,rocauc,60,0.784538506760729,0.7073504702678692,50,0.7930782137958065,0.7216728789663763,0.008539707035077448,0.014322408698507094,60,0.015589999999999993,50,100,0.04754000000000003,0.00019000000000002348,0.08803000000000005,"positive_or_tie,late_collapse"
+pna,rocauc,60,0.7779523074661963,0.7647926765677203,60,0.7890395355673133,0.7629792000618011,0.011087228101117064,-0.0018134765059192315,60,0.05793999999999999,60,100,0.022619999999999973,-0.0008000000000000229,0.19358999999999993,val_up_test_down
+resgated,rocauc,80,0.8143738977072311,0.7241738928909403,80,0.8173500881834216,0.7054809865003185,0.0029761904761904656,-0.01869290639062171,80,0.006010000000000071,80,100,0.014419999999999988,0.0013400000000000079,0.13631000000000004,val_up_test_down
+sgc,rocauc,80,0.7478597148736037,0.7019100407501111,50,0.7481720311581422,0.7177311265184728,0.00031231628453853855,0.01582108576836172,80,0.01100000000000001,50,100,0.023460000000000036,-0.006759999999999988,0.06252000000000002,positive_or_tie
+tag,rocauc,70,0.7528292181069958,0.7255354487340427,70,0.7803834754066236,0.7351764228741382,0.027554257299627793,0.00964097414009546,70,0.009939999999999949,70,100,0.010239999999999916,-0.0008799999999999919,0.17215999999999998,positive_or_tie
+transformer,rocauc,30,0.7617332941407015,0.7547248884682979,40,0.8088103811483441,0.7413024585256572,0.04707708700764268,-0.013422429942640646,30,0.04059999999999997,40,100,0.09591000000000005,-0.0031600000000000517,0.10176000000000007,"val_up_test_down,late_collapse"
diff --git a/analysis/ogbg-molhiv_fixed-rrog_T3_ns3_diagnostics.md b/analysis/ogbg-molhiv_fixed-rrog_T3_ns3_diagnostics.md new file mode 100644 index 0000000..0379e0e --- /dev/null +++ b/analysis/ogbg-molhiv_fixed-rrog_T3_ns3_diagnostics.md @@ -0,0 +1,47 @@ +# ogbg-molhiv fixed-rrog T=3 ns=3 diagnostics + +- rows: 17 +- val+test positive: 5 +- val up, test down: 5 +- val down, test up: 3 +- val+test down: 4 +- maybe undertrained: 1 +- late collapse: 7 + +- mean val delta: -0.0054 +- mean test delta: -0.0007 +- val/test delta corr: 0.4504 + +## Label Counts + +| label | n | +| --- | --- | +| fixed_val_lags_classic | 6 | +| late_collapse | 7 | +| maybe_undertrained | 1 | +| positive_or_tie | 5 | +| test_up_val_down | 3 | +| val_and_test_down | 4 | +| val_up_test_down | 5 | + +## Per-Backbone Rows + +| view | base_val | cand_val | d_val | base_test | cand_test | d_test | cand_ep | cand_final_gap | labels | +| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | +| appnp | 0.7675 | 0.7203 | -0.0471 | 0.7000 | 0.6825 | -0.0175 | 30 | 0.0477 | val_and_test_down,fixed_val_lags_classic,late_collapse | +| arma | 0.7872 | 0.7926 | 0.0054 | 0.7296 | 0.7318 | 0.0021 | 90 | 0.0011 | positive_or_tie,maybe_undertrained | +| cheb | 0.7831 | 0.7735 | -0.0096 | 0.7282 | 0.7426 | 0.0144 | 40 | 0.0346 | test_up_val_down,late_collapse | +| film | 0.7922 | 0.7633 | -0.0288 | 0.7842 | 0.7728 | -0.0114 | 30 | 0.0536 | val_and_test_down,fixed_val_lags_classic,late_collapse | +| gatv2 | 0.7835 | 0.7835 | 0.0001 | 0.7563 | 0.7466 | -0.0096 | 20 | 0.0908 | val_up_test_down,late_collapse | +| gcn | 0.7754 | 0.7455 | -0.0300 | 0.7198 | 0.7483 | 0.0285 | 40 | 0.0100 | test_up_val_down,fixed_val_lags_classic | +| gen | 0.7530 | 0.8128 | 0.0598 | 0.7314 | 0.7631 | 0.0318 | 60 | 0.0740 | positive_or_tie,late_collapse | +| gin | 0.8167 | 0.7524 | -0.0644 | 0.7724 | 0.7324 | -0.0400 | 30 | 0.0139 | val_and_test_down,fixed_val_lags_classic | +| gine | 0.7942 | 0.7575 | -0.0368 | 0.7445 | 0.7401 | -0.0044 | 40 | 0.0240 | val_and_test_down,fixed_val_lags_classic | +| graphconv | 0.7707 | 0.7713 | 0.0006 | 0.7108 | 0.6979 | -0.0129 | 80 | 0.0048 | val_up_test_down | +| graphsage | 0.7969 | 0.7587 | -0.0382 | 0.7625 | 0.7641 | 0.0016 | 20 | 0.0223 | test_up_val_down,fixed_val_lags_classic | +| mf | 0.7845 | 0.7931 | 0.0085 | 0.7074 | 0.7217 | 0.0143 | 50 | 0.0475 | positive_or_tie,late_collapse | +| pna | 0.7780 | 0.7890 | 0.0111 | 0.7648 | 0.7630 | -0.0018 | 60 | 0.0226 | val_up_test_down | +| resgated | 0.8144 | 0.8174 | 0.0030 | 0.7242 | 0.7055 | -0.0187 | 80 | 0.0144 | val_up_test_down | +| sgc | 0.7479 | 0.7482 | 0.0003 | 0.7019 | 0.7177 | 0.0158 | 50 | 0.0235 | positive_or_tie | +| tag | 0.7528 | 0.7804 | 0.0276 | 0.7255 | 0.7352 | 0.0096 | 70 | 0.0102 | positive_or_tie | +| transformer | 0.7617 | 0.8088 | 0.0471 | 0.7547 | 0.7413 | -0.0134 | 40 | 0.0959 | val_up_test_down,late_collapse | diff --git a/diag/aggregate.py b/diag/aggregate.py index b0f737a..4ded30f 100644 --- a/diag/aggregate.py +++ b/diag/aggregate.py @@ -1,4 +1,4 @@ -"""Aggregate multi-seed coloring results -> mean+/-std per (grad_mode, pe, contract).""" +"""Aggregate multi-seed coloring results -> mean+/-std per architecture/config.""" import glob, json import numpy as np from collections import defaultdict @@ -22,7 +22,8 @@ def load(pat): def key(d): - return (d.get('conv', 'gin'), d.get('pe'), d.get('grad_mode'), 'ctr' if d.get('contract') else '-') + return (d.get('arch', 'legacy'), d.get('conv', 'gin'), d.get('pe'), + d.get('grad_mode'), 'ctr' if d.get('contract') else '-') solve, le, ml = defaultdict(list), defaultdict(list), defaultdict(list) diff --git a/diag/cin_color.py b/diag/cin_color.py index 324215f..53ed158 100644 --- a/diag/cin_color.py +++ b/diag/cin_color.py @@ -131,7 +131,8 @@ def main(): print(f"[cin/{args.grad_mode}] solve={best:.3f} LE AUROC={auc:.3f} mean_lam={lams.mean():+.3f} " f"passK={passk/n:.3f} lamsel={lamsel/n:.3f} ({time.time()-t0:.0f}s)") base = f"cin_{args.grad_mode}_none_n50_k3_p0.2_T3_ns3_s{args.seed}" - com = {'conv': 'cin', 'pe': 'none', 'grad_mode': args.grad_mode, 'contract': False, 'seed': args.seed} + com = {'conv': 'cin', 'pe': 'none', 'grad_mode': args.grad_mode, 'contract': False, + 'seed': args.seed, 'arch': 'rrog_once_agg_node_compute'} json.dump({**com, 'solve_rate': best}, open(os.path.join(OUT, f"color_{base}.json"), 'w')) json.dump({**com, 'auroc': float(auc), 'mean_lam': float(lams.mean())}, open(os.path.join(OUT, f"le_color_{base}.json"), 'w')) json.dump({**com, 'det': 1 - float(fails.mean()), diff --git a/diag/esan_color.py b/diag/esan_color.py index 7be050c..b283641 100644 --- a/diag/esan_color.py +++ b/diag/esan_color.py @@ -131,7 +131,8 @@ def main(): print(f"[esan/{args.grad_mode}] solve={best:.3f} LE AUROC={auc:.3f} mean_lam={lams.mean():+.3f} " f"passK={passk/n:.3f} lamsel={lamsel/n:.3f} ({time.time()-t0:.0f}s)") base = f"esan_{args.grad_mode}_none_n50_k3_p0.2_T3_ns3_s{args.seed}" - com = {'conv': 'esan', 'pe': 'none', 'grad_mode': args.grad_mode, 'contract': False, 'seed': args.seed} + com = {'conv': 'esan', 'pe': 'none', 'grad_mode': args.grad_mode, 'contract': False, + 'seed': args.seed, 'arch': 'rrog_once_agg_node_compute'} json.dump({**com, 'solve_rate': best}, open(os.path.join(OUT, f"color_{base}.json"), 'w')) json.dump({**com, 'auroc': float(auc), 'mean_lam': float(lams.mean())}, open(os.path.join(OUT, f"le_color_{base}.json"), 'w')) diff --git a/diag/eval_rec_ttc.py b/diag/eval_rec_ttc.py new file mode 100644 index 0000000..e0e789e --- /dev/null +++ b/diag/eval_rec_ttc.py @@ -0,0 +1,113 @@ +"""Evaluate deterministic test-time compute for RRoG/TRM-on-GNN checkpoints. + +Loads a trained ``diag/train_rec.py`` checkpoint, overrides ``model.T`` at eval time, +and reports raw MAE on ZINC cycle-count. This separates training-time T from +test-time recursion depth. + +Run: + PYTHONPATH=/home/yurenh2/rrog python3 diag/eval_rec_ttc.py \ + --ckpt runs/ckpt_rec_rrog_full_sig0.0_K1_bestq_T1_ns3_s0.pt --eval_Ts 0 1 2 3 5 8 +""" +import argparse +import json +import os + +import torch + +from diag.train_rec import RecGIN, evaluate, evaluate_trace, loader +from diag.train_cycle import prepare + +OUT = '/home/yurenh2/rrog/runs' + + +def load_model(ckpt, dev): + ck = torch.load(ckpt, weights_only=False, map_location='cpu') + cfg = ck['cfg'] + model = RecGIN( + cfg['n_atom'], + cfg['hidden'], + cfg['T'], + cfg['n_sup'], + sigma=0.0, + grad_mode=cfg.get('grad_mode', 'full'), + agg_layers=cfg.get('agg_layers', 5), + compute_layers=cfg.get('compute_layers', 2), + ).to(dev) + model.load_state_dict(ck['state']) + model.eval() + return model, ck + + +def main(): + ap = argparse.ArgumentParser() + ap.add_argument('--ckpt', required=True) + ap.add_argument('--eval_Ts', type=int, nargs='+', default=[0, 1, 2, 3, 5, 8]) + ap.add_argument('--eval_n_sup', type=int, default=None) + ap.add_argument('--adaptive', action='store_true', + help='choose the first trace step with q_halt > 0, otherwise the last step') + ap.add_argument('--bs', type=int, default=256) + ap.add_argument('--split', choices=['val', 'test'], default='test') + args = ap.parse_args() + + dev = 'cuda' if torch.cuda.is_available() else 'cpu' + model, ck = load_model(args.ckpt, dev) + cfg = ck['cfg'] + ymu, ysd = ck['ymu'], ck['ysd'] + + recs = prepare(args.split) + for r in recs: + r['y'] = (r['y'] - ymu) / ysd + ld = loader(recs, args.bs, False) + + original_T = model.T + original_n_sup = model.n_sup + if args.eval_n_sup is not None: + model.n_sup = args.eval_n_sup + elif args.adaptive and cfg.get('act'): + model.n_sup = cfg.get('halt_max_steps', cfg['n_sup']) + eval_n_sup_used = model.n_sup + + rows = [] + print(f"ckpt={os.path.basename(args.ckpt)} train_T={cfg['T']} train_n_sup={cfg['n_sup']} split={args.split} adaptive={args.adaptive}") + print(f"{'T_eval':>6} {'n_sup':>6} {'mae_c5':>10} {'mae_c6':>10} {'sum':>10} {'avg_steps':>10}") + for T in args.eval_Ts: + model.T = T + if args.adaptive: + mae, avg_steps = evaluate_trace(model, ld, dev, ymu, ysd, model.n_sup, adaptive=True) + else: + mae, _ = evaluate(model, ld, dev, ymu, ysd, K=1, select='none') + avg_steps = float(model.n_sup) + row = { + 'T_eval': T, + 'n_sup_eval': model.n_sup, + 'adaptive': args.adaptive, + 'avg_steps': avg_steps, + 'mae': mae, + 'mae_sum': float(sum(mae)), + } + rows.append(row) + print(f"{T:6d} {model.n_sup:6d} {mae[0]:10.4f} {mae[1]:10.4f} {sum(mae):10.4f} {avg_steps:10.2f}") + + model.T = original_T + model.n_sup = original_n_sup + + os.makedirs(OUT, exist_ok=True) + base = os.path.basename(args.ckpt).replace('ckpt_', '').replace('.pt', '') + out = { + 'ckpt': args.ckpt, + 'split': args.split, + 'train_T': cfg['T'], + 'train_n_sup': cfg['n_sup'], + 'eval_n_sup': eval_n_sup_used, + 'adaptive': args.adaptive, + 'rows': rows, + } + suffix = "_adaptive" if args.adaptive else "" + fp = os.path.join(OUT, f"ttc_{base}_ns{out['eval_n_sup']}_{args.split}{suffix}.json") + with open(fp, 'w') as f: + json.dump(out, f, indent=2) + print("wrote", fp) + + +if __name__ == '__main__': + main() diff --git a/diag/lyap.py b/diag/lyap.py index 93b90bf..e676568 100644 --- a/diag/lyap.py +++ b/diag/lyap.py @@ -1,12 +1,12 @@ """LE diagnostic for the recursive (TRM-ish) GNN — ports the flossing finding to graphs. -Per-graph top Lyapunov exponent lambda1 of the recursion z <- block(z+h0), via Benettin +Per-graph top Lyapunov exponent lambda1 of the edge-free recursion z <- block(z, ctx), via Benettin power-iteration on a single tangent vector (JVP + renormalize, accumulate log-growth) over the model's n_sup*T recursion steps. Bucket graphs by success/failure (rounded ring counts exact) and compare lambda1 distributions + AUROC(fail | lambda1) — mirroring plot_trm_lyap_hist.py. Hypothesis: failed graphs are MORE chaotic (higher lambda1). -Run: PYTHONPATH=/home/yurenh2/rrog python3 diag/lyap.py --ckpt runs/ckpt_rec_full_..._s0.pt +Run: PYTHONPATH=/home/yurenh2/rrog python3 diag/lyap.py --ckpt runs/ckpt_rec_rrog_full_..._s0.pt """ import argparse import numpy as np @@ -21,18 +21,19 @@ except Exception: def build(ck, dev): c = ck['cfg'] - m = RecGIN(c['n_atom'], c['hidden'], c['T'], c['n_sup'], 0.0, grad_mode=c['grad_mode']).to(dev) + m = RecGIN(c['n_atom'], c['hidden'], c['T'], c['n_sup'], 0.0, grad_mode=c['grad_mode'], + agg_layers=c.get('agg_layers', 1), compute_layers=c.get('compute_layers', 2)).to(dev) m.load_state_dict(ck['state']); m.eval() return m, c def lyap1(model, x, ei, n_steps, dev, seed=0): g = torch.Generator(device=dev).manual_seed(seed) - h0 = model.emb(x).detach() - z = torch.zeros_like(h0) - v = torch.randn(h0.shape, generator=g, device=dev); v = v / (v.norm() + 1e-12) + ctx = model.aggregate(x, ei).detach() + z = ctx.detach() + v = torch.randn(ctx.shape, generator=g, device=dev); v = v / (v.norm() + 1e-12) def step_fn(zz): - return model.block(zz + h0, ei) + return model.block(zz, ctx) lam = 0.0 for _ in range(n_steps): z_next, Jv = torch.autograd.functional.jvp(step_fn, z, v) @@ -72,10 +73,13 @@ def main(): lams, fails = np.array(lams), np.array(fails) s, f = lams[fails == 0], lams[fails == 1] auc = (roc_auc_score(fails, lams) if roc_auc_score and len(s) and len(f) else float('nan')) + sm, ss = (s.mean(), s.std()) if len(s) else (float('nan'), float('nan')) + fm, fs = (f.mean(), f.std()) if len(f) else (float('nan'), float('nan')) + sep = fm - sm if len(s) and len(f) else float('nan') print(f"[{cfg['grad_mode']}] n={len(lams)} fail_rate={fails.mean():.2f} | " - f"lambda1 SUCC mean {s.mean():+.4f} std {s.std():.4f} (n={len(s)}) | " - f"FAIL mean {f.mean():+.4f} std {f.std():.4f} (n={len(f)}) | " - f"sep(fail-succ)={f.mean()-s.mean() if len(s) and len(f) else float('nan'):+.4f} | " + f"lambda1 SUCC mean {sm:+.4f} std {ss:.4f} (n={len(s)}) | " + f"FAIL mean {fm:+.4f} std {fs:.4f} (n={len(f)}) | " + f"sep(fail-succ)={sep:+.4f} | " f"AUROC(fail|lambda1)={auc:.3f} | mean_lambda1={lams.mean():+.4f}") diff --git a/diag/ptrm_color.py b/diag/ptrm_color.py index 4004297..b24097f 100644 --- a/diag/ptrm_color.py +++ b/diag/ptrm_color.py @@ -3,7 +3,7 @@ deterministic / pass@K (conflict-min, ground truth) / lambda-select (min lambda1) / random. -Run: PYTHONPATH=/home/yurenh2/rrog python3 diag/ptrm_color.py --ckpt runs/ckpt_color_full_...pt +Run: PYTHONPATH=/home/yurenh2/rrog python3 diag/ptrm_color.py --ckpt runs/ckpt_color_rrog_trm_gin_full_...pt """ import argparse, json, os import numpy as np @@ -18,20 +18,24 @@ OUT = '/home/yurenh2/rrog/runs' def rollout(model, xin, ei, sigma, n_sup, T, dev, seed): gen = torch.Generator(device=dev).manual_seed(seed) - h0 = model.lin_in(xin) - z = torch.zeros_like(h0) - v = torch.randn(h0.shape, generator=gen, device=dev); v = v / (v.norm() + 1e-12) - def step(zz): - return model.block(zz + h0, ei) + ctx = model.aggregate(xin, ei) + y, z = ctx, torch.zeros_like(ctx) + state = torch.cat([y, z], dim=-1) + v = torch.randn(state.shape, generator=gen, device=dev); v = v / (v.norm() + 1e-12) + def step(ss): + yy, zz = ss.chunk(2, dim=-1) + yy, zz = model.recurse(yy, zz, ctx, noise=False) + return torch.cat([yy, zz], dim=-1) lam = 0.0 for _ in range(n_sup * T): - z_det, Jv = torch.autograd.functional.jvp(step, z, v) + state_det, Jv = torch.autograd.functional.jvp(step, state, v) nv = Jv.norm(); lam += torch.log(nv + 1e-12).item(); v = (Jv / (nv + 1e-12)).detach() - z = z_det.detach() + state = state_det.detach() if sigma > 0: - z = z + sigma * torch.randn(z.shape, generator=gen, device=dev) - lam /= (n_sup * T) - col = model.head(z).argmax(-1) + state = state + sigma * torch.randn(state.shape, generator=gen, device=dev) + lam /= max(n_sup * T, 1) + y, _ = state.chunk(2, dim=-1) + col = model.head(y).argmax(-1) conf = (col[ei[0]] == col[ei[1]]).sum().item() // 2 return conf, lam @@ -47,7 +51,11 @@ def main(): ck = torch.load(args.ckpt, weights_only=False); c = ck['cfg'] deg = torch.tensor(c['deg']) if c.get('deg') else None model = RecGINColor(c['in_dim'], c['hidden'], c['k'], c['T'], c['n_sup'], - grad_mode=c['grad_mode'], conv=c.get('conv', 'gin'), deg=deg).to(dev) + grad_mode=c['grad_mode'], conv=c.get('conv', 'gin'), deg=deg, + agg_layers=c.get('agg_layers', 1), + compute_layers=c.get('compute_layers', 2), + compute=(c.get('compute') if c.get('compute') == 'trm' else 'trm'), + attn_heads=c.get('attn_heads', 4)).to(dev) model.load_state_dict(ck['state']); model.eval() nsup, T = c['n_sup'], c['T'] te = featurize(make_split('test', 50, 3, 0.2, 8, 500, 100000), c.get('pe', 'none'), c.get('rwse_k', 16)) @@ -56,6 +64,7 @@ def main(): det = sum(rollout(model, r['xin'].to(dev), r['edge_index'].to(dev), 0.0, nsup, T, dev, 0)[0] == 0 for r in te) / n out = {'conv': c.get('conv', 'gin'), 'pe': c.get('pe', 'none'), 'seed': c.get('seed'), + 'arch': c.get('arch', 'legacy'), 'grad_mode': c['grad_mode'], 'contract': c.get('contract', False), 'det': det, 'sigmas': {}} print(f"[pe={out['pe']} s{out['seed']}] deterministic solve_rate = {det:.3f} (n={n}, K={args.K})") print(f"{'sigma':>6} {'pass@K':>8} {'lam-sel':>8} {'random':>8} {'perRoll':>8} {'AUROC(s|-lam)':>14}") diff --git a/diag/run_archA.sh b/diag/run_archA.sh index 5385152..6cc6042 100644 --- a/diag/run_archA.sh +++ b/diag/run_archA.sh @@ -1,16 +1,15 @@ #!/usr/bin/env bash -# Conv axis (pe=none): gcn, sage, gat. 5 seeds, train+LE+PTRM. (pin GPU at launch.) +# One-shot aggregation axis (pe=none): gcn, sage, gat. 5 seeds, train+LE. set -uo pipefail cd /home/yurenh2/rrog export PYTHONPATH=/home/yurenh2/rrog echo "A start gpu=${CUDA_VISIBLE_DEVICES:-?} $(date -Is)" for s in 0 1 2 3 4; do for conv in gcn sage gat; do - ck=runs/ckpt_color_${conv}_full_none_n50_k3_p0.2_T3_ns3_s${s}.pt + ck=runs/ckpt_color_rrog_trm_${conv}_full_none_n50_k3_p0.2_T3_ns3_s${s}.pt echo "== A s$s conv=$conv ==" python3 diag/train_color.py --mode train --conv "$conv" --pe none --p 0.2 --epochs 150 --seed "$s" || echo "!! train $conv s$s" python3 diag/train_color.py --mode le --ckpt "$ck" || echo "!! le $conv s$s" - python3 diag/ptrm_color.py --ckpt "$ck" --K 16 --n_graphs 150 --sigmas 0.2 || echo "!! ptrm $conv s$s" done done echo "doneA=$(date -Is)" diff --git a/diag/run_archB.sh b/diag/run_archB.sh index 317638f..ddc6069 100644 --- a/diag/run_archB.sh +++ b/diag/run_archB.sh @@ -1,21 +1,19 @@ #!/usr/bin/env bash -# GPS transformer backbone + feature axis (gin + lappe / all). 5 seeds. (pin GPU at launch.) +# One-shot GPS encoder + feature axis (gin + lappe / all). 5 seeds. (pin GPU at launch.) set -uo pipefail cd /home/yurenh2/rrog export PYTHONPATH=/home/yurenh2/rrog echo "B start gpu=${CUDA_VISIBLE_DEVICES:-?} $(date -Is)" for s in 0 1 2 3 4; do - ck=runs/ckpt_color_gps_full_none_n50_k3_p0.2_T3_ns3_s${s}.pt + ck=runs/ckpt_color_rrog_trm_gps_full_none_n50_k3_p0.2_T3_ns3_s${s}.pt echo "== B s$s conv=gps ==" python3 diag/train_color.py --mode train --conv gps --pe none --p 0.2 --epochs 150 --seed "$s" || echo "!! train gps s$s" python3 diag/train_color.py --mode le --ckpt "$ck" || echo "!! le gps s$s" - python3 diag/ptrm_color.py --ckpt "$ck" --K 16 --n_graphs 150 --sigmas 0.2 || echo "!! ptrm gps s$s" for pe in lappe all; do - ck2=runs/ckpt_color_gin_full_${pe}_n50_k3_p0.2_T3_ns3_s${s}.pt + ck2=runs/ckpt_color_rrog_trm_gin_full_${pe}_n50_k3_p0.2_T3_ns3_s${s}.pt echo "== B s$s gin pe=$pe ==" python3 diag/train_color.py --mode train --conv gin --pe "$pe" --p 0.2 --epochs 150 --seed "$s" || echo "!! train $pe s$s" python3 diag/train_color.py --mode le --ckpt "$ck2" || echo "!! le $pe s$s" - python3 diag/ptrm_color.py --ckpt "$ck2" --K 16 --n_graphs 150 --sigmas 0.2 || echo "!! ptrm $pe s$s" done done echo "doneB=$(date -Is)" diff --git a/diag/run_color.sh b/diag/run_color.sh index ad3c406..82c522a 100644 --- a/diag/run_color.sh +++ b/diag/run_color.sh @@ -1,15 +1,12 @@ #!/usr/bin/env bash -# Step-2 (TRM regime, large output): graph 3-coloring, TRM full vs HRM 1-step + LE diagnostic. +# RRoG/TRM-on-GNN: graph 3-coloring, deterministic T=1 lower bound vs T=3 extra compute. set -uo pipefail cd /home/yurenh2/rrog export PYTHONPATH=/home/yurenh2/rrog echo "host=$(hostname) gpu=${CUDA_VISIBLE_DEVICES:-?} start=$(date -Is)" -for gm in full 1step; do - echo "===== train $gm =====" - python3 diag/train_color.py --mode train --grad_mode "$gm" --p 0.2 --epochs 150 --seed 0 \ - || echo "!! train $gm failed" +for T in 1 3; do + echo "===== train T=$T =====" + python3 diag/train_color.py --mode train --grad_mode full --T "$T" --p 0.2 --epochs 150 --seed 0 \ + || echo "!! train T=$T failed" done -echo "===== LE diagnostic (lambda1: solved vs unsolved) =====" -python3 diag/train_color.py --mode le --ckpt runs/ckpt_color_full_n50_k3_p0.2_T3_ns3_s0.pt || echo "!! le full failed" -python3 diag/train_color.py --mode le --ckpt runs/ckpt_color_1step_n50_k3_p0.2_T3_ns3_s0.pt || echo "!! le 1step failed" echo "done=$(date -Is)" diff --git a/diag/run_le.sh b/diag/run_le.sh index 8fc31ea..07d6a63 100644 --- a/diag/run_le.sh +++ b/diag/run_le.sh @@ -1,5 +1,5 @@ #!/usr/bin/env bash -# Step-2(iii): TRM-ish GIN full-recursion vs 1-step-gradient, then LE diagnostic on each. +# RRoG/TRM-on-GNN GIN full-recursion vs 1-step-gradient, then LE diagnostic on each. set -uo pipefail cd /home/yurenh2/rrog export PYTHONPATH=/home/yurenh2/rrog @@ -7,6 +7,6 @@ echo "host=$(hostname) gpu=${CUDA_VISIBLE_DEVICES:-?} start=$(date -Is)" python3 diag/train_rec.py --grad_mode full --sigma 0 --K 1 --epochs 200 --seed 0 || echo "!! train full failed" python3 diag/train_rec.py --grad_mode 1step --sigma 0 --K 1 --epochs 200 --seed 0 || echo "!! train 1step failed" echo "===== LE diagnostic (lambda1: success vs failure) =====" -python3 diag/lyap.py --ckpt runs/ckpt_rec_full_sig0.0_K1_bestq_T3_ns3_s0.pt --n_graphs 300 || echo "!! lyap full failed" -python3 diag/lyap.py --ckpt runs/ckpt_rec_1step_sig0.0_K1_bestq_T3_ns3_s0.pt --n_graphs 300 || echo "!! lyap 1step failed" +python3 diag/lyap.py --ckpt runs/ckpt_rec_rrog_full_sig0.0_K1_bestq_T3_ns3_s0.pt --n_graphs 300 || echo "!! lyap full failed" +python3 diag/lyap.py --ckpt runs/ckpt_rec_rrog_1step_sig0.0_K1_bestq_T3_ns3_s0.pt --n_graphs 300 || echo "!! lyap 1step failed" echo "done=$(date -Is)" diff --git a/diag/run_pe.sh b/diag/run_pe.sh index 8350160..1e587ce 100644 --- a/diag/run_pe.sh +++ b/diag/run_pe.sh @@ -1,6 +1,5 @@ #!/usr/bin/env bash -# Roadmap #1: RRoG on PE-augmented backbone. GIN vs GIN+RWSE on coloring: -# does RRoG-noise add headroom on top of static structural encoding, or is it redundant? +# RRoG on PE-augmented one-shot GIN encoder. GIN vs GIN+RWSE on coloring. set -uo pipefail cd /home/yurenh2/rrog export PYTHONPATH=/home/yurenh2/rrog @@ -12,13 +11,7 @@ for pe in none rwse; do done echo "===== LE (full, both pe) =====" for pe in none rwse; do - python3 diag/train_color.py --mode le --ckpt runs/ckpt_color_full_${pe}_n50_k3_p0.2_T3_ns3_s0.pt \ + python3 diag/train_color.py --mode le --ckpt runs/ckpt_color_rrog_trm_gin_full_${pe}_n50_k3_p0.2_T3_ns3_s0.pt \ || echo "!! le $pe failed" done -echo "===== PTRM noise + lambda-select (both pe) =====" -for pe in none rwse; do - echo "--- pe=$pe ---" - python3 diag/ptrm_color.py --ckpt runs/ckpt_color_full_${pe}_n50_k3_p0.2_T3_ns3_s0.pt \ - --K 16 --n_graphs 150 --sigmas 0.1 0.2 0.4 || echo "!! ptrm $pe failed" -done echo "done=$(date -Is)" diff --git a/diag/run_pe2.sh b/diag/run_pe2.sh index db7bd8a..dc9f88b 100644 --- a/diag/run_pe2.sh +++ b/diag/run_pe2.sh @@ -1,17 +1,15 @@ #!/usr/bin/env bash -# Roadmap #2: RRoG on a GSN-style motif backbone (per-node K3/wedge substructure counts). -# full-recursion, 5 seeds; train + LE + PTRM(sigma=0.2). Aggregate vs none/rwse. +# RRoG on a GSN-style motif-augmented one-shot encoder. Full recursion, 5 seeds; train + LE. set -uo pipefail cd /home/yurenh2/rrog export PYTHONPATH=/home/yurenh2/rrog echo "host=$(hostname) gpu=${CUDA_VISIBLE_DEVICES:-?} start=$(date -Is)" for s in 0 1 2 3 4; do - ck=runs/ckpt_color_full_gsn_n50_k3_p0.2_T3_ns3_s${s}.pt + ck=runs/ckpt_color_rrog_trm_gin_full_gsn_n50_k3_p0.2_T3_ns3_s${s}.pt echo "===== seed=$s full gsn =====" python3 diag/train_color.py --mode train --grad_mode full --pe gsn --p 0.2 --epochs 150 --seed "$s" \ || echo "!! train gsn s$s failed" python3 diag/train_color.py --mode le --ckpt "$ck" || echo "!! le gsn s$s failed" - python3 diag/ptrm_color.py --ckpt "$ck" --K 16 --n_graphs 150 --sigmas 0.2 || echo "!! ptrm gsn s$s failed" done echo "===== AGGREGATE (all pe: none/rwse/gsn) =====" python3 diag/aggregate.py diff --git a/diag/run_pe3.sh b/diag/run_pe3.sh index a978393..2a6744b 100644 --- a/diag/run_pe3.sh +++ b/diag/run_pe3.sh @@ -1,22 +1,20 @@ #!/usr/bin/env bash -# Roadmap #3 (subgraph/ego features) + #4 (IGNN-style forced contraction), 5 seeds. +# Subgraph/ego features + forced contraction, 5 seeds. Deterministic train + LE. # #3: full --pe sub. #4: full --pe none --contract (vs free full/none baseline). set -uo pipefail cd /home/yurenh2/rrog export PYTHONPATH=/home/yurenh2/rrog echo "host=$(hostname) gpu=${CUDA_VISIBLE_DEVICES:-?} start=$(date -Is)" for s in 0 1 2 3 4; do - ck=runs/ckpt_color_full_sub_n50_k3_p0.2_T3_ns3_s${s}.pt + ck=runs/ckpt_color_rrog_trm_gin_full_sub_n50_k3_p0.2_T3_ns3_s${s}.pt echo "===== seed=$s #3 full sub =====" python3 diag/train_color.py --mode train --grad_mode full --pe sub --p 0.2 --epochs 150 --seed "$s" || echo "!! train sub s$s failed" python3 diag/train_color.py --mode le --ckpt "$ck" || echo "!! le sub s$s failed" - python3 diag/ptrm_color.py --ckpt "$ck" --K 16 --n_graphs 150 --sigmas 0.2 || echo "!! ptrm sub s$s failed" - ck2=runs/ckpt_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s${s}.pt + ck2=runs/ckpt_color_rrog_trm_gin_full_none_ctr_n50_k3_p0.2_T3_ns3_s${s}.pt echo "===== seed=$s #4 full none --contract =====" python3 diag/train_color.py --mode train --grad_mode full --pe none --contract --p 0.2 --epochs 150 --seed "$s" || echo "!! train ctr s$s failed" python3 diag/train_color.py --mode le --ckpt "$ck2" || echo "!! le ctr s$s failed" - python3 diag/ptrm_color.py --ckpt "$ck2" --K 16 --n_graphs 150 --sigmas 0.2 || echo "!! ptrm ctr s$s failed" done echo "===== AGGREGATE =====" python3 diag/aggregate.py diff --git a/diag/run_pna.sh b/diag/run_pna.sh index 897315d..157d8ac 100644 --- a/diag/run_pna.sh +++ b/diag/run_pna.sh @@ -4,10 +4,9 @@ cd /home/yurenh2/rrog export PYTHONPATH=/home/yurenh2/rrog echo "PNA start gpu=${CUDA_VISIBLE_DEVICES:-?} $(date -Is)" for s in 0 1 2 3 4; do - ck=runs/ckpt_color_pna_full_none_n50_k3_p0.2_T3_ns3_s${s}.pt + ck=runs/ckpt_color_rrog_trm_pna_full_none_n50_k3_p0.2_T3_ns3_s${s}.pt echo "== pna s$s ==" python3 diag/train_color.py --mode train --conv pna --pe none --p 0.2 --epochs 150 --seed "$s" || echo "!! train pna s$s" python3 diag/train_color.py --mode le --ckpt "$ck" || echo "!! le pna s$s" - python3 diag/ptrm_color.py --ckpt "$ck" --K 16 --n_graphs 150 --sigmas 0.2 || echo "!! ptrm pna s$s" done echo "donePNA=$(date -Is)" diff --git a/diag/run_rec.sh b/diag/run_rec.sh index 632498d..c436c4e 100644 --- a/diag/run_rec.sh +++ b/diag/run_rec.sh @@ -1,13 +1,12 @@ #!/usr/bin/env bash -# Step-2: recursive GNN + full PTRM on ZINC ring-counting. Does per-step noise + best-Q@K -# selection break the 1-WL counting ceiling that input-RNI couldn't? Averaging vs selection. +# RRoG/TRM-on-GNN on ZINC ring-counting. Deterministic view-only vs recursive compute. set -uo pipefail cd /home/yurenh2/rrog export PYTHONPATH=/home/yurenh2/rrog echo "host=$(hostname) gpu=${CUDA_VISIBLE_DEVICES:-?} start=$(date -Is)" -run() { echo "===== $* ====="; python3 diag/train_rec.py "$@" --epochs 200 --seed 0 || echo "!! FAILED $*"; } -run --sigma 0 --K 1 --select bestq # deterministic recursive baseline (~1-WL ceiling) -run --sigma 0.1 --K 8 --select none # averaging over rollouts (RNI-style null) -run --sigma 0.1 --K 8 --select bestq # PTRM-proper: per-step noise + best-Q@K selection -run --sigma 0.2 --K 16 --select bestq # scaled noise + rollouts +run() { echo "===== $* ====="; python3 diag/train_rec.py "$@" --epochs 40 --hidden 64 --bs 256 --seed 0 || echo "!! FAILED $*"; } +run --grad_mode full --T 0 --n_sup 3 --sigma 0 --K 1 --select none +run --grad_mode full --T 1 --n_sup 3 --sigma 0 --K 1 --select none +run --grad_mode full --T 3 --n_sup 3 --sigma 0 --K 1 --select none +run --grad_mode full --T 1 --n_sup 3 --act --halt_max_steps 8 --halt_target binary --sigma 0 --K 1 --select none echo "done=$(date -Is)" diff --git a/diag/run_seeds.sh b/diag/run_seeds.sh index 77f22c8..85b67d1 100644 --- a/diag/run_seeds.sh +++ b/diag/run_seeds.sh @@ -1,5 +1,5 @@ #!/usr/bin/env bash -# Harden coloring results with 5 seeds: full-vs-1step solve, LE AUROC, PTRM(sigma=0.2) for none/rwse. +# Harden corrected RRoG coloring results with 5 seeds: full-vs-1step solve + LE AUROC. set -uo pipefail cd /home/yurenh2/rrog export PYTHONPATH=/home/yurenh2/rrog @@ -7,14 +7,11 @@ echo "host=$(hostname) gpu=${CUDA_VISIBLE_DEVICES:-?} start=$(date -Is)" for s in 0 1 2 3 4; do for cfg in "full none" "full rwse" "1step none"; do set -- $cfg; gm=$1; pe=$2 - ck=runs/ckpt_color_${gm}_${pe}_n50_k3_p0.2_T3_ns3_s${s}.pt + ck=runs/ckpt_color_rrog_trm_gin_${gm}_${pe}_n50_k3_p0.2_T3_ns3_s${s}.pt echo "===== seed=$s $gm $pe =====" python3 diag/train_color.py --mode train --grad_mode "$gm" --pe "$pe" --p 0.2 --epochs 150 --seed "$s" \ || echo "!! train $gm $pe s$s failed" python3 diag/train_color.py --mode le --ckpt "$ck" || echo "!! le $gm $pe s$s failed" - if [ "$gm" = "full" ]; then - python3 diag/ptrm_color.py --ckpt "$ck" --K 16 --n_graphs 150 --sigmas 0.2 || echo "!! ptrm $pe s$s failed" - fi done done echo "===== AGGREGATE =====" diff --git a/diag/train_color.py b/diag/train_color.py index 36f8496..b9d0c23 100644 --- a/diag/train_color.py +++ b/diag/train_color.py @@ -1,7 +1,11 @@ -"""Recursive (TRM-ish) GNN graph 3-coloring with swappable BACKBONE for the RRoG roadmap. +"""RRoG/TRM-on-GNN graph 3-coloring. ---conv gin|gcn|sage|gat|gps : message-passing operator (gps = GraphGPS local MPNN + global - attention = TRM's original transformer backbone, on the graph). +The graph is encoded once into a fixed per-node context. Recursion then refines hidden state +with a shared compute block that never reads edge_index. This is the RRoG split: +the GNN encoder supplies the view/context x, TRM-style recurrence supplies computation. + +--conv gin|gcn|sage|gat|gps : message-passing operator used only by the one-shot encoder + (gps = GraphGPS local MPNN + global attention). --pe none|rwse|gsn|sub|lappe|all : input structural features (random sym-break [+ encoding]). --contract : reverse-flossing lambda-penalty during training (force contraction; roadmap #4). --grad_mode full|1step : TRM full recursion vs HRM 1-step gradient. @@ -142,48 +146,83 @@ def make_conv(conv, hidden, deg=None): class RecGINColor(nn.Module): - def __init__(self, in_dim, hidden, k, T=3, n_sup=3, inner=2, grad_mode='full', sigma=0.0, conv='gin', deg=None): + def __init__(self, in_dim, hidden, k, T=3, n_sup=3, inner=2, grad_mode='full', + sigma=0.0, conv='gin', deg=None, agg_layers=4, compute_layers=None, + compute='trm', attn_heads=4): super().__init__() self.conv_type = conv + self.agg_layers = agg_layers + self.compute_layers = compute_layers or inner + self.compute = compute + self.attn_heads = attn_heads self.lin_in = nn.Linear(in_dim, hidden) - self.convs = nn.ModuleList([make_conv(conv, hidden, deg) for _ in range(inner)]) - self.bns = nn.ModuleList([nn.BatchNorm1d(hidden) for _ in range(inner)]) + self.agg_convs = nn.ModuleList([make_conv(conv, hidden, deg) for _ in range(agg_layers)]) + self.agg_bns = nn.ModuleList([nn.BatchNorm1d(hidden) for _ in range(agg_layers)]) + if compute not in ('trm',): + raise ValueError(compute) + core = [] + d = hidden + for _ in range(self.compute_layers - 1): + core += [nn.Linear(d, hidden), nn.GELU()] + d = hidden + core.append(nn.Linear(d, hidden)) + self.core_norm = nn.LayerNorm(hidden) + self.core = nn.Sequential(*core) + nn.init.zeros_(self.core[-1].weight) + nn.init.zeros_(self.core[-1].bias) self.head = nn.Linear(hidden, k) self.T, self.n_sup, self.grad_mode, self.sigma = T, n_sup, grad_mode, sigma - def block(self, z, ei, batch=None): + def aggregate(self, xin, ei, batch=None): if self.conv_type == 'gps' and batch is None: - batch = z.new_zeros(z.size(0), dtype=torch.long) - for conv, bn in zip(self.convs, self.bns): - z = conv(z, ei, batch) if self.conv_type == 'gps' else conv(z, ei) - z = bn(z).relu() - return z - - def _inner(self, z, h0, ei, noise, batch): - z = self.block(z + h0, ei, batch) + batch = xin.new_zeros(xin.size(0), dtype=torch.long) + h = self.lin_in(xin) + for conv, bn in zip(self.agg_convs, self.agg_bns): + h = conv(h, ei, batch) if self.conv_type == 'gps' else conv(h, ei) + h = bn(h).relu() + return h + + def core_step(self, combined, state): + """Shared TRM compute core. Deliberately edge-free.""" + return state + self.core(self.core_norm(combined)) + + def _z_step(self, y, z, ctx, noise): + z = self.core_step(ctx + y + z, z) if noise and self.sigma > 0: z = z + self.sigma * torch.randn_like(z) return z - def recurse(self, z, h0, ei, noise, batch, one_step=False): + def _y_step(self, y, z, noise): + y = self.core_step(y + z, y) + if noise and self.sigma > 0: + y = y + self.sigma * torch.randn_like(y) + return y + + def recurse(self, y, z, ctx, noise, one_step=False): + if self.T == 0: + return y, z if one_step: with torch.no_grad(): for _ in range(self.T - 1): - z = self._inner(z, h0, ei, noise, batch) + z = self._z_step(y, z, ctx, noise) z = z.detach() - return self._inner(z, h0, ei, noise, batch) + z = self._z_step(y, z, ctx, noise) + y = self._y_step(y, z, noise) + return y, z for _ in range(self.T): - z = self._inner(z, h0, ei, noise, batch) - return z + z = self._z_step(y, z, ctx, noise) + y = self._y_step(y, z, noise) + return y, z def forward(self, xin, ei, batch=None, noise=False): - h0 = self.lin_in(xin) - z = torch.zeros_like(h0) + ctx = self.aggregate(xin, ei, batch) + y = ctx + z = torch.zeros_like(ctx) outs = [] for s in range(self.n_sup): - z = self.recurse(z, h0, ei, noise, batch, one_step=(self.grad_mode == '1step')) - outs.append(self.head(z)) - z = z.detach() + y, z = self.recurse(y, z, ctx, noise, one_step=(self.grad_mode == '1step')) + outs.append(self.head(y)) + y, z = y.detach(), z.detach() return outs @@ -206,15 +245,17 @@ def solve_stats(model, recs, dev, sample=None): def lyap1(model, xin, ei, n_steps, dev, seed=0): g = torch.Generator(device=dev).manual_seed(seed) - h0 = model.lin_in(xin).detach() - z = torch.zeros_like(h0) - v = torch.randn(h0.shape, generator=g, device=dev); v = v / (v.norm() + 1e-12) - def step_fn(zz): - return model.block(zz + h0, ei) + ctx = model.aggregate(xin, ei).detach() + state = torch.cat([ctx, torch.zeros_like(ctx)], dim=-1).detach() + v = torch.randn(state.shape, generator=g, device=dev); v = v / (v.norm() + 1e-12) + def step_fn(ss): + y, z = ss.chunk(2, dim=-1) + y, z = model.recurse(y, z, ctx, noise=False) + return torch.cat([y, z], dim=-1) lam = 0.0 for _ in range(n_steps): - z_next, Jv = torch.autograd.functional.jvp(step_fn, z, v) - z = z_next.detach(); nv = Jv.norm() + state_next, Jv = torch.autograd.functional.jvp(step_fn, state, v) + state = state_next.detach(); nv = Jv.norm() lam += torch.log(nv + 1e-12).item(); v = (Jv / (nv + 1e-12)).detach() return lam / n_steps @@ -246,11 +287,16 @@ def run_le(model, recs, dev, n_steps, n_graphs=300): def lyap_penalty(model, x, ei, batch, target=-0.5): - h0 = model.lin_in(x) + ctx = model.aggregate(x, ei, batch) with torch.no_grad(): - zr = model.recurse(torch.zeros_like(h0), h0.detach(), ei, False, batch) - v = torch.randn_like(zr); v = v / (v.norm() + 1e-12) - _, Jv = torch.autograd.functional.jvp(lambda zz: model.block(zz + h0, ei, batch), zr, v, create_graph=True) + yr, zr = model.recurse(ctx.detach(), torch.zeros_like(ctx).detach(), ctx.detach(), False) + state = torch.cat([yr, zr], dim=-1) + v = torch.randn_like(state); v = v / (v.norm() + 1e-12) + def step_fn(ss): + y, z = ss.chunk(2, dim=-1) + y, z = model.recurse(y, z, ctx, noise=False) + return torch.cat([y, z], dim=-1) + _, Jv = torch.autograd.functional.jvp(step_fn, state, v, create_graph=True) return (torch.log(Jv.norm() + 1e-12) - target) ** 2 @@ -267,6 +313,10 @@ def main(): ap.add_argument('--p', type=float, default=0.2); ap.add_argument('--r', type=int, default=8) ap.add_argument('--hidden', type=int, default=128); ap.add_argument('--T', type=int, default=3) ap.add_argument('--n_sup', type=int, default=3); ap.add_argument('--epochs', type=int, default=150) + ap.add_argument('--agg_layers', type=int, default=4) + ap.add_argument('--compute_layers', type=int, default=2) + ap.add_argument('--compute', choices=['trm'], default='trm') + ap.add_argument('--attn_heads', type=int, default=4) ap.add_argument('--lr', type=float, default=1e-3); ap.add_argument('--bs', type=int, default=32) ap.add_argument('--seed', type=int, default=0) args = ap.parse_args() @@ -280,13 +330,18 @@ def main(): c.get('pe', 'none'), c.get('rwse_k', 16)) deg = torch.tensor(c['deg']) if c.get('deg') else None model = RecGINColor(c['in_dim'], c['hidden'], c['k'], c['T'], c['n_sup'], - grad_mode=c['grad_mode'], conv=c.get('conv', 'gin'), deg=deg).to(dev) + grad_mode=c['grad_mode'], conv=c.get('conv', 'gin'), deg=deg, + agg_layers=c.get('agg_layers', 1), + compute_layers=c.get('compute_layers', 2), + compute=(c.get('compute') if c.get('compute') == 'trm' else 'trm'), + attn_heads=c.get('attn_heads', 4)).to(dev) model.load_state_dict(ck['state']); model.eval() res = run_le(model, te, dev, c['n_sup'] * c['T']) base = os.path.basename(args.ckpt).replace('ckpt_', '').replace('.pt', '') with open(os.path.join(OUT, f"le_{base}.json"), 'w') as fjs: json.dump({'conv': c.get('conv', 'gin'), 'grad_mode': c['grad_mode'], 'pe': c.get('pe', 'none'), - 'contract': c.get('contract', False), 'seed': c.get('seed'), **res}, fjs, indent=2) + 'contract': c.get('contract', False), 'seed': c.get('seed'), + 'arch': c.get('arch', 'legacy'), **res}, fjs, indent=2) return te = featurize(make_split('test', args.n, args.k, args.p, args.r, 500, 100000), args.pe, args.rwse_k) @@ -296,7 +351,9 @@ def main(): trl = DataLoader(data, batch_size=args.bs, shuffle=True, drop_last=True) deg = deg_hist(tr) if args.conv == 'pna' else None model = RecGINColor(in_dim, args.hidden, args.k, args.T, args.n_sup, - grad_mode=args.grad_mode, conv=args.conv, deg=deg).to(dev) + grad_mode=args.grad_mode, conv=args.conv, deg=deg, + agg_layers=args.agg_layers, compute_layers=args.compute_layers, + compute=args.compute, attn_heads=args.attn_heads).to(dev) opt = torch.optim.Adam(model.parameters(), lr=args.lr, weight_decay=1e-5) sched = torch.optim.lr_scheduler.CosineAnnealingLR(opt, args.epochs) @@ -329,15 +386,18 @@ def main(): print(f"ep{ep+1} solve_rate={sr:.3f} mean_conflicts={mc:.2f}", flush=True) sfx = ('_ctr' if args.contract else '') - tag = f"color_{args.conv}_{args.grad_mode}_{args.pe}{sfx}_n{args.n}_k{args.k}_p{args.p}_T{args.T}_ns{args.n_sup}_s{args.seed}" + tag = f"color_rrog_{args.compute}_{args.conv}_{args.grad_mode}_{args.pe}{sfx}_n{args.n}_k{args.k}_p{args.p}_T{args.T}_ns{args.n_sup}_s{args.seed}" rep = {'task': 'graph3coloring', 'tag': tag, **vars(args), 'in_dim': in_dim, - 'sec': round(time.time() - t0, 1), **best} + 'arch': 'rrog_once_agg_hidden_compute', 'sec': round(time.time() - t0, 1), **best} print(f"[{tag}] best solve_rate={best.get('solve_rate')} @ep{best.get('ep')} ({rep['sec']}s)") with open(os.path.join(OUT, f"{tag}.json"), 'w') as f: json.dump(rep, f, indent=2) torch.save({'state': best_state, 'cfg': {'in_dim': in_dim, 'hidden': args.hidden, 'k': args.k, 'T': args.T, 'n_sup': args.n_sup, 'grad_mode': args.grad_mode, 'pe': args.pe, 'rwse_k': args.rwse_k, 'contract': args.contract, 'conv': args.conv, 'seed': args.seed, + 'agg_layers': args.agg_layers, 'compute_layers': args.compute_layers, + 'compute': args.compute, 'attn_heads': args.attn_heads, + 'arch': 'rrog_once_agg_hidden_compute', 'deg': (deg.tolist() if deg is not None else None)}}, os.path.join(OUT, f"ckpt_{tag}.pt")) print(" wrote", os.path.join(OUT, f"ckpt_{tag}.pt")) diff --git a/diag/train_cycle.py b/diag/train_cycle.py index d2342f3..598e349 100644 --- a/diag/train_cycle.py +++ b/diag/train_cycle.py @@ -24,9 +24,14 @@ from torch_geometric.loader import DataLoader from torch_geometric.utils import to_networkx from torch_geometric.nn import GINConv, GCNConv, global_add_pool -ROOT = '/home/yurenh2/rrog/data/zinc' -CACHE = '/home/yurenh2/rrog/data/cycle_cache' -OUT = '/home/yurenh2/rrog/runs' +PROJECT_ROOT = os.environ.get( + 'RROG_ROOT', + os.path.abspath(os.path.join(os.path.dirname(__file__), '..')), +) +DATA_ROOT = os.environ.get('RROG_DATA_DIR', os.path.join(PROJECT_ROOT, 'data')) +OUT = os.environ.get('RROG_RUNS_DIR', os.path.join(PROJECT_ROOT, 'runs')) +ROOT = os.path.join(DATA_ROOT, 'zinc') +CACHE = os.path.join(DATA_ROOT, 'cycle_cache') RWSE_K = 16 diff --git a/diag/train_rec.py b/diag/train_rec.py index 9866f28..9db7eb1 100644 --- a/diag/train_rec.py +++ b/diag/train_rec.py @@ -1,11 +1,10 @@ -"""Step-2: Recursive (TRM-ish) GNN on ZINC ring-counting + optional PTRM noise/selection. +"""Step-2: RRoG/TRM-on-GNN for ZINC ring-counting. -Recurrent shared-weight GIN block, deep-supervised over n_sup steps (TRM-style: carry latent -detached between steps). --grad_mode controls the LAST supervision step's recursion: +The graph is encoded once with a GIN encoder. A shared edge-free node-wise compute block then +refines hidden state over n_sup*T recurrent steps (TRM-style: carry latent detached between +deep-supervision steps). --grad_mode controls the LAST supervision step's recursion: full : backprop through all T inner recursions (TRM) 1step : backprop only the last inner recursion, first T-1 detached (HRM 1-step-gradient) -Optional per-step Gaussian noise (sigma) + K stochastic rollouts selected by a value head -(best-Q@K) for the PTRM experiments. Saves a checkpoint for the LE diagnostic (diag/lyap.py). Run: PYTHONPATH=/home/yurenh2/rrog python3 diag/train_rec.py --grad_mode full --sigma 0 --K 1 """ @@ -14,66 +13,218 @@ import numpy as np import torch import torch.nn as nn from torch_geometric.loader import DataLoader -from torch_geometric.data import Data -from torch_geometric.nn import GINConv, global_add_pool +from torch_geometric.data import Batch, Data +from torch_geometric.nn import ( + APPNP, + ARMAConv, + ChebConv, + FiLMConv, + GATv2Conv, + GCNConv, + GENConv, + GINEConv, + GINConv, + GraphConv, + MFConv, + PNAConv, + ResGatedGraphConv, + SAGEConv, + SGConv, + TAGConv, + TransformerConv, + global_add_pool, +) +from torch_geometric.utils import degree from diag.train_cycle import prepare -OUT = '/home/yurenh2/rrog/runs' +PROJECT_ROOT = os.environ.get( + 'RROG_ROOT', + os.path.abspath(os.path.join(os.path.dirname(__file__), '..')), +) +OUT = os.environ.get('RROG_RUNS_DIR', os.path.join(PROJECT_ROOT, 'runs')) +SUPPORTED_VIEWS = [ + 'gin', 'gine', 'gcn', 'graphsage', 'gatv2', 'graphconv', 'transformer', 'pna', + 'gen', 'film', 'resgated', 'tag', 'sgc', 'cheb', 'arma', 'mf', 'appnp', +] -def loader(recs, bs, shuffle, drop_last=False): - data = [Data(x=r['x'], edge_index=r['edge_index'], y=r['y'].view(1, 2), +def data_list(recs): + return [Data(x=r['x'], edge_index=r['edge_index'], y=r['y'].view(1, 2), num_nodes=r['x'].numel()) for r in recs] + + +def loader(recs, bs, shuffle, drop_last=False): + data = recs if recs and isinstance(recs[0], Data) else data_list(recs) return DataLoader(data, batch_size=bs, shuffle=shuffle, drop_last=drop_last) +def degree_histogram(data): + max_degree = 0 + degs = [] + for graph in data: + deg = degree(graph.edge_index[1], num_nodes=graph.num_nodes, dtype=torch.long) + degs.append(deg) + if deg.numel(): + max_degree = max(max_degree, int(deg.max().item())) + hist = torch.zeros(max_degree + 1, dtype=torch.long) + for deg in degs: + hist += torch.bincount(deg, minlength=hist.numel()) + return hist + + +def make_view_layer(view, hidden, deg): + if view == 'gin': + return GINConv(nn.Sequential( + nn.Linear(hidden, hidden), nn.ReLU(), nn.Linear(hidden, hidden)), train_eps=True) + if view == 'gine': + return GINEConv(nn.Sequential( + nn.Linear(hidden, hidden), nn.ReLU(), nn.Linear(hidden, hidden)), + train_eps=True, edge_dim=hidden) + if view == 'gcn': + return GCNConv(hidden, hidden) + if view == 'graphsage': + return SAGEConv(hidden, hidden) + if view == 'gatv2': + return GATv2Conv(hidden, hidden, heads=4, concat=False) + if view == 'graphconv': + return GraphConv(hidden, hidden) + if view == 'transformer': + return TransformerConv(hidden, hidden, heads=4, concat=False) + if view == 'pna': + if deg is None: + raise ValueError('PNA view requires a training-set degree histogram') + return PNAConv( + hidden, hidden, + aggregators=['mean', 'min', 'max', 'std'], + scalers=['identity', 'amplification', 'attenuation'], + deg=deg, + ) + if view == 'gen': + return GENConv(hidden, hidden) + if view == 'film': + return FiLMConv(hidden, hidden) + if view == 'resgated': + return ResGatedGraphConv(hidden, hidden) + if view == 'tag': + return TAGConv(hidden, hidden, K=3) + if view == 'sgc': + return SGConv(hidden, hidden, K=2, cached=False) + if view == 'cheb': + return ChebConv(hidden, hidden, K=3) + if view == 'arma': + return ARMAConv(hidden, hidden, num_stacks=1, num_layers=2) + if view == 'mf': + return MFConv(hidden, hidden) + if view == 'appnp': + return APPNP(K=5, alpha=0.1) + raise ValueError(f'unsupported view: {view}') + + class RecGIN(nn.Module): - def __init__(self, n_atom, hidden=128, T=3, n_sup=3, sigma=0.0, inner=2, grad_mode='full'): + def __init__(self, n_atom, hidden=128, T=3, n_sup=3, sigma=0.0, inner=2, + grad_mode='full', agg_layers=5, compute_layers=None, view='gin', deg=None): super().__init__() + self.view = view + self.agg_layers = agg_layers + self.compute_layers = compute_layers or inner self.emb = nn.Embedding(n_atom, hidden) - self.convs = nn.ModuleList([GINConv(nn.Sequential( - nn.Linear(hidden, hidden), nn.ReLU(), nn.Linear(hidden, hidden)), train_eps=True) - for _ in range(inner)]) - self.bns = nn.ModuleList([nn.BatchNorm1d(hidden) for _ in range(inner)]) + self.edge_emb = nn.Embedding(1, hidden) if view == 'gine' else None + self.agg_convs = nn.ModuleList() + for _ in range(agg_layers): + self.agg_convs.append(make_view_layer(view, hidden, deg)) + self.agg_bns = nn.ModuleList([nn.BatchNorm1d(hidden) for _ in range(agg_layers)]) + core = [] + d = hidden + for _ in range(self.compute_layers - 1): + core += [nn.Linear(d, hidden), nn.GELU()] + d = hidden + core.append(nn.Linear(d, hidden)) + self.core_norm = nn.LayerNorm(hidden) + self.core = nn.Sequential(*core) + nn.init.zeros_(self.core[-1].weight) + nn.init.zeros_(self.core[-1].bias) self.head = nn.Sequential(nn.Linear(hidden, hidden), nn.ReLU(), nn.Linear(hidden, 2)) self.qhead = nn.Sequential(nn.Linear(hidden, hidden), nn.ReLU(), nn.Linear(hidden, 1)) + with torch.no_grad(): + self.qhead[-1].weight.zero_() + self.qhead[-1].bias.fill_(-5.0) self.T, self.n_sup, self.sigma, self.grad_mode = T, n_sup, sigma, grad_mode - def block(self, z, ei): - for conv, bn in zip(self.convs, self.bns): - z = bn(conv(z, ei)).relu() - return z + def aggregate(self, x, ei): + h = self.emb(x) + for conv, bn in zip(self.agg_convs, self.agg_bns): + if self.view == 'gine': + edge_attr = self.edge_emb(torch.zeros(ei.size(1), dtype=torch.long, device=ei.device)) + h = bn(conv(h, ei, edge_attr)).relu() + else: + h = bn(conv(h, ei)).relu() + return h + + def core_step(self, combined, state): + """Shared TRM compute core. Deliberately edge-free.""" + return state + self.core(self.core_norm(combined)) - def _inner(self, z, h0, ei, noise): - z = self.block(z + h0, ei) + def _z_step(self, y, z, ctx, noise): + z = self.core_step(ctx + y + z, z) if noise and self.sigma > 0: z = z + self.sigma * torch.randn_like(z) return z - def recurse(self, z, h0, ei, noise, one_step=False): + def _y_step(self, y, z, noise): + y = self.core_step(y + z, y) + if noise and self.sigma > 0: + y = y + self.sigma * torch.randn_like(y) + return y + + def recurse(self, y, z, ctx, noise, one_step=False): + if self.T == 0: + return y, z if one_step: # HRM 1-step gradient with torch.no_grad(): for _ in range(self.T - 1): - z = self._inner(z, h0, ei, noise) + z = self._z_step(y, z, ctx, noise) z = z.detach() - return self._inner(z, h0, ei, noise) # only last inner carries grad + z = self._z_step(y, z, ctx, noise) # only last inner carries grad + y = self._y_step(y, z, noise) + return y, z for _ in range(self.T): # TRM full recursion - z = self._inner(z, h0, ei, noise) - return z + z = self._z_step(y, z, ctx, noise) + y = self._y_step(y, z, noise) + return y, z + + def predict(self, y, batch): + pooled = global_add_pool(y, batch) + return self.head(pooled), self.qhead(pooled).view(-1) + + def forward_trace(self, x, ei, batch, steps, noise=False): + ctx = self.aggregate(x, ei) + y = ctx + z = torch.zeros_like(ctx) + preds, q_logits = [], [] + for s in range(steps): + y, z = self.recurse(y, z, ctx, noise, one_step=(self.grad_mode == '1step')) + pred, q = self.predict(y, batch) + preds.append(pred) + q_logits.append(q) + if s < steps - 1: + y, z = y.detach(), z.detach() + return preds, q_logits def forward(self, x, ei, batch, noise=False): - h0 = self.emb(x) - z = torch.zeros_like(h0) + ctx = self.aggregate(x, ei) + y = ctx + z = torch.zeros_like(ctx) preds = [] for s in range(self.n_sup): if s < self.n_sup - 1: with torch.no_grad(): - z = self.recurse(z, h0, ei, noise) - z = z.detach() + y, z = self.recurse(y, z, ctx, noise) + y, z = y.detach(), z.detach() else: - z = self.recurse(z, h0, ei, noise, one_step=(self.grad_mode == '1step')) - preds.append(self.head(global_add_pool(z, batch))) - q = self.qhead(global_add_pool(z, batch)).view(-1) + y, z = self.recurse(y, z, ctx, noise, one_step=(self.grad_mode == '1step')) + pred, _ = self.predict(y, batch) + preds.append(pred) + _, q = self.predict(y, batch) return preds, q @@ -102,6 +253,113 @@ def evaluate(model, ld, dev, ymu, ysd, K=1, select='none'): return (ae / n).tolist(), (ae_or / n).tolist() +@torch.no_grad() +def evaluate_trace(model, ld, dev, ymu, ysd, steps, adaptive=False): + model.eval() + ysd_d, ymu_d = ysd.to(dev), ymu.to(dev) + ae = torch.zeros(2) + n = 0 + step_sum = 0.0 + for b in ld: + b = b.to(dev) + preds, q_logits = model.forward_trace(b.x, b.edge_index, b.batch, steps, noise=False) + P = torch.stack(preds, dim=0) + if adaptive: + Q = torch.stack(q_logits, dim=0) + halted = Q > 0 + any_halt = halted.any(dim=0) + first_halt = halted.to(torch.int64).argmax(dim=0) + fallback = torch.full_like(first_halt, steps - 1) + idx = torch.where(any_halt, first_halt, fallback) + chosen = P[idx, torch.arange(P.size(1), device=dev)] + step_sum += (idx.to(torch.float32) + 1).sum().item() + else: + chosen = P[-1] + step_sum += steps * b.num_graphs + ae += ((chosen * ysd_d + ymu_d) - (b.y * ysd_d + ymu_d)).abs().sum(0).cpu() + n += b.num_graphs + return (ae / n).tolist(), step_sum / max(n, 1) + + +def _split_nodes(t, ptr): + return [t[ptr[i].item():ptr[i + 1].item()].detach() for i in range(ptr.numel() - 1)] + + +def act_train_step(model, state, replacement_batch, opt, dev, args): + replacement = replacement_batch.to_data_list() + batch_size = len(replacement) + if state is None: + state = { + 'graphs': [None for _ in range(batch_size)], + 'y': [None for _ in range(batch_size)], + 'z': [None for _ in range(batch_size)], + 'steps': torch.zeros(batch_size, dtype=torch.long, device=dev), + 'halted': torch.ones(batch_size, dtype=torch.bool, device=dev), + } + + halted_cpu = state['halted'].detach().cpu().tolist() + for i, halted in enumerate(halted_cpu): + if halted: + state['graphs'][i] = replacement[i] + + b = Batch.from_data_list(state['graphs']).to(dev) + ctx = model.aggregate(b.x, b.edge_index) + ptr = b.ptr + y_parts, z_parts = [], [] + for i in range(batch_size): + start, end = ptr[i].item(), ptr[i + 1].item() + if halted_cpu[i] or state['y'][i] is None: + y_parts.append(ctx[start:end]) + z_parts.append(torch.zeros_like(ctx[start:end])) + else: + y_parts.append(state['y'][i].to(dev)) + z_parts.append(state['z'][i].to(dev)) + y = torch.cat(y_parts, dim=0) + z = torch.cat(z_parts, dim=0) + + opt.zero_grad() + y, z = model.recurse(y, z, ctx, noise=False, one_step=(model.grad_mode == '1step')) + pred, q = model.predict(y, b.batch) + per_graph_err = (pred - b.y).abs().mean(1) + pred_loss = per_graph_err.mean() + with torch.no_grad(): + if args.halt_target == 'binary': + halt_target = (per_graph_err <= args.halt_norm_threshold).to(q.dtype) + else: + halt_target = torch.sigmoid((args.halt_norm_threshold - per_graph_err) / args.halt_temp) + q_loss = nn.functional.binary_cross_entropy_with_logits(q, halt_target) + loss = pred_loss + 0.5 * args.lam_q * q_loss + y_det, z_det = y.detach(), z.detach() + loss.backward() + torch.nn.utils.clip_grad_norm_(model.parameters(), 1.0) + opt.step() + + state['y'] = _split_nodes(y_det, ptr) + state['z'] = _split_nodes(z_det, ptr) + with torch.no_grad(): + was_halted = state['halted'] + steps = torch.where(was_halted, torch.zeros_like(state['steps']), state['steps']) + 1 + halted = (steps >= args.halt_max_steps) | (q.detach() > 0) + if args.halt_exploration_prob > 0 and args.halt_max_steps > 1: + explore = torch.rand_like(q) < args.halt_exploration_prob + min_steps = torch.where( + explore, + torch.randint(2, args.halt_max_steps + 1, steps.shape, device=dev), + torch.zeros_like(steps), + ) + halted = halted & (steps >= min_steps) + state['steps'] = steps + state['halted'] = halted + + return state, { + 'loss': float(loss.detach().cpu()), + 'pred_loss': float(pred_loss.detach().cpu()), + 'q_loss': float(q_loss.detach().cpu()), + 'halted_frac': float(state['halted'].to(torch.float32).mean().detach().cpu()), + 'steps': float(state['steps'].to(torch.float32).mean().detach().cpu()), + } + + def main(): ap = argparse.ArgumentParser() ap.add_argument('--grad_mode', choices=['full', '1step'], default='full') @@ -111,14 +369,27 @@ def main(): ap.add_argument('--T', type=int, default=3) ap.add_argument('--n_sup', type=int, default=3) ap.add_argument('--hidden', type=int, default=128) + ap.add_argument('--agg_layers', type=int, default=5) + ap.add_argument('--compute_layers', type=int, default=2) + ap.add_argument('--view', choices=SUPPORTED_VIEWS, default='gin') ap.add_argument('--epochs', type=int, default=200) ap.add_argument('--lr', type=float, default=1e-3) ap.add_argument('--bs', type=int, default=128) ap.add_argument('--lam_q', type=float, default=1.0) + ap.add_argument('--act', action='store_true', + help='train all recurrent depths up to halt_max_steps and train qhead as a halt head') + ap.add_argument('--halt_max_steps', type=int, default=8) + ap.add_argument('--halt_norm_threshold', type=float, default=0.30) + ap.add_argument('--halt_temp', type=float, default=0.10) + ap.add_argument('--halt_target', choices=['soft', 'binary'], default='soft') + ap.add_argument('--halt_exploration_prob', type=float, default=0.1) + ap.add_argument('--loss_mode', choices=['last', 'trace'], default='trace') ap.add_argument('--seed', type=int, default=0) + ap.add_argument('--device', default='auto') args = ap.parse_args() torch.manual_seed(args.seed); np.random.seed(args.seed) - dev = 'cuda' if torch.cuda.is_available() else 'cpu' + dev = 'cuda' if args.device == 'auto' and torch.cuda.is_available() else ( + 'cpu' if args.device == 'auto' else args.device) os.makedirs(OUT, exist_ok=True) tr, va, te = prepare('train'), prepare('val'), prepare('test') @@ -127,45 +398,91 @@ def main(): for recs in (tr, va, te): for r in recs: r['y'] = (r['y'] - ymu) / ysd - trl = loader(tr, args.bs, True, drop_last=True) + train_data = data_list(tr) + trl = loader(train_data, args.bs, True, drop_last=True) val, tel = loader(va, 256, False), loader(te, 256, False) - model = RecGIN(n_atom, args.hidden, args.T, args.n_sup, args.sigma, grad_mode=args.grad_mode).to(dev) + deg = degree_histogram(train_data) if args.view == 'pna' else None + model = RecGIN(n_atom, args.hidden, args.T, args.n_sup, args.sigma, grad_mode=args.grad_mode, + agg_layers=args.agg_layers, compute_layers=args.compute_layers, + view=args.view, deg=deg).to(dev) opt = torch.optim.Adam(model.parameters(), lr=args.lr, weight_decay=1e-5) sched = torch.optim.lr_scheduler.CosineAnnealingLR(opt, args.epochs) l1 = nn.L1Loss() + act_steps = max(1, args.halt_max_steps) - t0 = time.time(); best_val = 9e9; best = {}; best_state = None + t0 = time.time(); best_val = 9e9; best = {}; best_state = None; act_state = None for ep in range(args.epochs): model.train() + act_metrics = [] for b in trl: - b = b.to(dev); opt.zero_grad() - preds, q = model(b.x, b.edge_index, b.batch, noise=model.sigma > 0) - loss = sum(l1(p, b.y) for p in preds) / len(preds) - with torch.no_grad(): - tq = -(preds[-1] - b.y).abs().mean(1) - loss = loss + args.lam_q * nn.functional.mse_loss(q, tq) - loss.backward(); torch.nn.utils.clip_grad_norm_(model.parameters(), 1.0); opt.step() + if args.act: + act_state, metrics = act_train_step(model, act_state, b, opt, dev, args) + act_metrics.append(metrics) + else: + b = b.to(dev); opt.zero_grad() + if args.loss_mode == 'trace': + preds, q_logits = model.forward_trace( + b.x, b.edge_index, b.batch, args.n_sup, noise=model.sigma > 0) + q = q_logits[-1] + else: + preds, q = model(b.x, b.edge_index, b.batch, noise=model.sigma > 0) + loss = sum(l1(p, b.y) for p in preds) / len(preds) + with torch.no_grad(): + tq = -(preds[-1] - b.y).abs().mean(1) + loss = loss + args.lam_q * nn.functional.mse_loss(q, tq) + loss.backward(); torch.nn.utils.clip_grad_norm_(model.parameters(), 1.0); opt.step() sched.step() if (ep + 1) % 20 == 0 or ep == args.epochs - 1: - vm, _ = evaluate(model, val, dev, ymu, ysd, args.K, args.select) + if args.act: + vm, _ = evaluate_trace(model, val, dev, ymu, ysd, act_steps, adaptive=False) + else: + vm, _ = evaluate(model, val, dev, ymu, ysd, args.K, args.select) if sum(vm) < best_val: best_val = sum(vm) - tem, teo = evaluate(model, tel, dev, ymu, ysd, args.K, args.select) - best = {'ep': ep + 1, 'val_mae': vm, 'test_mae': tem, 'test_mae_oracle': teo} + if args.act: + tem, fixed_steps = evaluate_trace(model, tel, dev, ymu, ysd, act_steps, adaptive=False) + tea, adaptive_steps = evaluate_trace(model, tel, dev, ymu, ysd, act_steps, adaptive=True) + best = {'ep': ep + 1, 'val_mae': vm, 'test_mae': tem, + 'test_mae_adaptive': tea, 'fixed_steps': fixed_steps, + 'adaptive_steps': adaptive_steps} + else: + tem, teo = evaluate(model, tel, dev, ymu, ysd, args.K, args.select) + best = {'ep': ep + 1, 'val_mae': vm, 'test_mae': tem, 'test_mae_oracle': teo} best_state = {k: v.detach().cpu().clone() for k, v in model.state_dict().items()} - print(f"ep{ep+1} val_mae={[round(x,3) for x in vm]}", flush=True) + if args.act and act_metrics: + hm = sum(m['halted_frac'] for m in act_metrics) / len(act_metrics) + sm = sum(m['steps'] for m in act_metrics) / len(act_metrics) + print(f"ep{ep+1} val_mae={[round(x,3) for x in vm]} halt={hm:.2f} train_steps={sm:.2f}", flush=True) + else: + print(f"ep{ep+1} val_mae={[round(x,3) for x in vm]}", flush=True) - tag = f"rec_{args.grad_mode}_sig{args.sigma}_K{args.K}_{args.select}_T{args.T}_ns{args.n_sup}_s{args.seed}" + act_tag = f"_actfull{act_steps}_{args.halt_target}{args.halt_norm_threshold:g}_e{args.epochs}" if args.act else "" + loss_tag = f"_{args.loss_mode}" if (not args.act and args.loss_mode != 'last') else "" + view_tag = f"_{args.view}" if args.view != 'gin' else "" + tag = f"rec_rrog{view_tag}_{args.grad_mode}_sig{args.sigma}_K{args.K}_{args.select}_T{args.T}_ns{args.n_sup}{loss_tag}{act_tag}_s{args.seed}" rep = {'dataset': 'ZINC-cycle56', 'tag': tag, **vars(args), 'sec': round(time.time() - t0, 1), - 'dev': dev, 'y_std_raw': ysd.tolist(), **best} - print(f"[{tag}] test_mae={[round(x,3) for x in best.get('test_mae')]} " - f"oracle@K={[round(x,3) for x in best.get('test_mae_oracle')]} @ep{best.get('ep')} ({rep['sec']}s)") + 'dev': dev, 'arch': 'rrog_once_agg_node_compute', 'y_std_raw': ysd.tolist(), **best} + if args.act: + print(f"[{tag}] test_mae={[round(x,3) for x in best.get('test_mae')]} " + f"adaptive={[round(x,3) for x in best.get('test_mae_adaptive')]} " + f"steps={best.get('adaptive_steps'):.2f}/{best.get('fixed_steps'):.2f} " + f"@ep{best.get('ep')} ({rep['sec']}s)") + else: + print(f"[{tag}] test_mae={[round(x,3) for x in best.get('test_mae')]} " + f"oracle@K={[round(x,3) for x in best.get('test_mae_oracle')]} @ep{best.get('ep')} ({rep['sec']}s)") with open(os.path.join(OUT, f"{tag}.json"), 'w') as f: json.dump(rep, f, indent=2) torch.save({'state': best_state or model.state_dict(), 'cfg': {'n_atom': n_atom, 'hidden': args.hidden, 'T': args.T, 'n_sup': args.n_sup, - 'sigma': args.sigma, 'grad_mode': args.grad_mode}, + 'sigma': args.sigma, 'grad_mode': args.grad_mode, + 'agg_layers': args.agg_layers, 'compute_layers': args.compute_layers, + 'view': args.view, + 'loss_mode': args.loss_mode, + 'act': args.act, 'act_impl': 'persistent_recycle' if args.act else 'none', + 'halt_max_steps': act_steps, + 'halt_exploration_prob': args.halt_exploration_prob, + 'arch': 'rrog_once_agg_node_compute'}, 'ymu': ymu, 'ysd': ysd}, os.path.join(OUT, f"ckpt_{tag}.pt")) print(" wrote", os.path.join(OUT, f"ckpt_{tag}.pt")) diff --git a/logs/local_gpu3_act_ablation_20260624_102042.log b/logs/local_gpu3_act_ablation_20260624_102042.log new file mode 100644 index 0000000..99d42f7 --- /dev/null +++ b/logs/local_gpu3_act_ablation_20260624_102042.log @@ -0,0 +1,39 @@ +[gpu3-ablation] start Wed Jun 24 10:20:44 CDT 2026 +[gpu3-ablation] phase1 exact target, classification tasks, views=gin gcn sgc tag graphconv appnp pna resgated +[launch] cuda:3: ogbg-molhiv ogbg-molbbbp ogbg-molsider ogbg-molbace ogbg-moltox21 ogbg-molclintox +[launch] cuda:3: ogbg-molesol ogbg-mollipo ogbg-moltox21 ogbg-molclintox +[task] ogbg-molhiv on cuda:3 +[task] ogbg-molesol on cuda:3 +[run] ogbg-molesol view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +[run] ogbg-molhiv view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/esol.zip +
0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 9.67it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 9.67it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 19.32it/s] +Processing... +Extracting /home/yurenh2/rrog-gnn-runner/data/ogb/esol.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/1128 [00:00<?, ?it/s]
100%|██████████| 1128/1128 [00:00<00:00, 184042.28it/s] +Converting graphs into PyG objects... +
0%| | 0/1128 [00:00<?, ?it/s]
100%|██████████| 1128/1128 [00:00<00:00, 77870.45it/s] +/home/yurenh2/miniconda3/lib/python3.13/site-packages/ogb/graphproppred/dataset_pyg.py:158: UserWarning: The given NumPy array is not writable, and PyTorch does not support non-writable tensors. This means writing to this tensor will result in undefined behavior. You may want to copy the array to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at /pytorch/torch/csrc/utils/tensor_numpy.cpp:213.) + g.y = torch.from_numpy(graph_label[i]).view(1,-1).to(torch.float32) +Done! +Saving... +Traceback (most recent call last): + File "/home/yurenh2/rrog-gnn-runner/rrog/train_ogb_graphprop.py", line 704, in <module> + main() + ~~~~^^ + File "/home/yurenh2/rrog-gnn-runner/rrog/train_ogb_graphprop.py", line 601, in main + act_state, train_metrics = train_epoch( + ~~~~~~~~~~~^ + model, train_loader, opt, dev, args, act_state, ema_state, ep + 1, metric) + ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ + File "/home/yurenh2/rrog-gnn-runner/rrog/train_ogb_graphprop.py", line 507, in train_epoch + act_state, m = act_train_step(model, act_state, batch, opt, dev, args, epoch, metric) + ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ + File "/home/yurenh2/rrog-gnn-runner/rrog/train_ogb_graphprop.py", line 412, in act_train_step + raise ValueError(args.halt_target) +ValueError: exact diff --git a/logs/local_gpu3_act_ablation_retry_20260624_102233.log b/logs/local_gpu3_act_ablation_retry_20260624_102233.log new file mode 100644 index 0000000..52adc5f --- /dev/null +++ b/logs/local_gpu3_act_ablation_retry_20260624_102233.log @@ -0,0 +1,2105 @@ +[gpu3-ablation] start Wed Jun 24 10:22:35 CDT 2026 +[gpu3-ablation] phase1 exact target, classification tasks, views=gin gcn sgc tag graphconv appnp pna resgated +[launch] cuda:3: ogbg-molhiv ogbg-molbbbp ogbg-molsider ogbg-molbace ogbg-moltox21 ogbg-molclintox +[task] ogbg-molhiv on cuda:3 +[run] ogbg-molhiv view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.57684 val_adapt_rocauc=0.58405 adapt_steps=2.00 halt=0.47 train_steps=1.59 +ep20 val_rocauc=0.60452 val_adapt_rocauc=0.59144 adapt_steps=2.01 halt=0.47 train_steps=1.59 +ep30 val_rocauc=0.71542 val_adapt_rocauc=0.72246 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep40 val_rocauc=0.70211 val_adapt_rocauc=0.68285 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep50 val_rocauc=0.59821 val_adapt_rocauc=0.72487 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep60 val_rocauc=0.64796 val_adapt_rocauc=0.71730 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep70 val_rocauc=0.70277 val_adapt_rocauc=0.73025 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep80 val_rocauc=0.68902 val_adapt_rocauc=0.72341 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep90 val_rocauc=0.72762 val_adapt_rocauc=0.74793 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.74125 val_adapt_rocauc=0.75760 adapt_steps=2.00 halt=0.48 train_steps=1.57 +[ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.7412490201842054} test={'rocauc': 0.7254234342107805} adaptive={'rocauc': 0.7567005929044593} steps=2.00024313153416 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.67913 val_adapt_rocauc=0.65745 adapt_steps=2.00 halt=0.47 train_steps=1.60 +ep20 val_rocauc=0.53086 val_adapt_rocauc=0.70728 adapt_steps=2.02 halt=0.47 train_steps=1.59 +ep30 val_rocauc=0.73614 val_adapt_rocauc=0.73784 adapt_steps=2.04 halt=0.48 train_steps=1.57 +ep40 val_rocauc=0.74062 val_adapt_rocauc=0.74468 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep50 val_rocauc=0.64917 val_adapt_rocauc=0.74024 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep60 val_rocauc=0.74111 val_adapt_rocauc=0.74943 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep70 val_rocauc=0.69073 val_adapt_rocauc=0.75506 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep80 val_rocauc=0.75837 val_adapt_rocauc=0.74771 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep90 val_rocauc=0.77126 val_adapt_rocauc=0.75543 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.76237 val_adapt_rocauc=0.74920 adapt_steps=2.00 halt=0.48 train_steps=1.57 +[ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rocauc': 0.7712620027434841} test={'rocauc': 0.7476081036713725} adaptive={'rocauc': 0.7387782691824871} steps=2.012156576707999 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.56968 val_adapt_rocauc=0.68573 adapt_steps=2.01 halt=0.47 train_steps=1.60 +ep20 val_rocauc=0.65960 val_adapt_rocauc=0.64533 adapt_steps=2.00 halt=0.47 train_steps=1.59 +ep30 val_rocauc=0.73782 val_adapt_rocauc=0.74603 adapt_steps=2.03 halt=0.48 train_steps=1.57 +ep40 val_rocauc=0.70390 val_adapt_rocauc=0.72870 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep50 val_rocauc=0.68717 val_adapt_rocauc=0.73036 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep60 val_rocauc=0.68431 val_adapt_rocauc=0.72508 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep70 val_rocauc=0.69653 val_adapt_rocauc=0.73800 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep80 val_rocauc=0.70493 val_adapt_rocauc=0.74137 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep90 val_rocauc=0.69423 val_adapt_rocauc=0.73412 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.69464 val_adapt_rocauc=0.74486 adapt_steps=2.00 halt=0.48 train_steps=1.57 +[ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rocauc': 0.7378227268273565} test={'rocauc': 0.7035709457502076} adaptive={'rocauc': 0.724386334228162} steps=2.0269876002917577 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.64438 val_adapt_rocauc=0.62773 adapt_steps=2.01 halt=0.47 train_steps=1.60 +ep20 val_rocauc=0.64326 val_adapt_rocauc=0.64524 adapt_steps=2.01 halt=0.47 train_steps=1.61 +ep30 val_rocauc=0.68766 val_adapt_rocauc=0.66943 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep40 val_rocauc=0.63871 val_adapt_rocauc=0.72422 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep50 val_rocauc=0.63257 val_adapt_rocauc=0.73165 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep60 val_rocauc=0.68678 val_adapt_rocauc=0.75939 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep70 val_rocauc=0.73265 val_adapt_rocauc=0.76437 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep80 val_rocauc=0.71019 val_adapt_rocauc=0.75081 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep90 val_rocauc=0.71181 val_adapt_rocauc=0.75327 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.72871 val_adapt_rocauc=0.76052 adapt_steps=2.00 halt=0.48 train_steps=1.57 +[ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.7326450127376054} test={'rocauc': 0.759611039224396} adaptive={'rocauc': 0.7786419204696885} steps=2.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.62212 val_adapt_rocauc=0.62817 adapt_steps=2.01 halt=0.47 train_steps=1.60 +ep20 val_rocauc=0.61445 val_adapt_rocauc=0.69759 adapt_steps=2.00 halt=0.47 train_steps=1.59 +ep30 val_rocauc=0.68557 val_adapt_rocauc=0.71732 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep40 val_rocauc=0.47925 val_adapt_rocauc=0.71316 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep50 val_rocauc=0.61766 val_adapt_rocauc=0.69094 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep60 val_rocauc=0.73183 val_adapt_rocauc=0.73302 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep70 val_rocauc=0.72858 val_adapt_rocauc=0.73825 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep80 val_rocauc=0.74850 val_adapt_rocauc=0.74077 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep90 val_rocauc=0.73303 val_adapt_rocauc=0.74217 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.73150 val_adapt_rocauc=0.73659 adapt_steps=2.00 halt=0.48 train_steps=1.57 +[ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.7484965951401137} test={'rocauc': 0.722140249908264} adaptive={'rocauc': 0.7285405280132873} steps=2.00024313153416 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.70638 val_adapt_rocauc=0.68842 adapt_steps=2.01 halt=0.47 train_steps=1.60 +ep20 val_rocauc=0.64695 val_adapt_rocauc=0.67193 adapt_steps=2.00 halt=0.47 train_steps=1.59 +ep30 val_rocauc=0.71509 val_adapt_rocauc=0.75189 adapt_steps=2.01 halt=0.48 train_steps=1.58 +ep40 val_rocauc=0.65625 val_adapt_rocauc=0.68931 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep50 val_rocauc=0.73236 val_adapt_rocauc=0.74043 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep60 val_rocauc=0.68610 val_adapt_rocauc=0.70942 adapt_steps=2.01 halt=0.48 train_steps=1.58 +ep70 val_rocauc=0.71282 val_adapt_rocauc=0.71800 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep80 val_rocauc=0.70420 val_adapt_rocauc=0.71488 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep90 val_rocauc=0.71668 val_adapt_rocauc=0.72406 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.71284 val_adapt_rocauc=0.72607 adapt_steps=2.00 halt=0.48 train_steps=1.57 +[ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=50 val={'rocauc': 0.7323571918479326} test={'rocauc': 0.7487070047702736} adaptive={'rocauc': 0.7287433129260897} steps=2.0063214198881596 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=pna compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view pna --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.52661 val_adapt_rocauc=0.57540 adapt_steps=2.02 halt=0.47 train_steps=1.60 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.53124 val_adapt_rocauc=0.54271 adapt_steps=2.00 halt=0.48 train_steps=1.58 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.64086 val_adapt_rocauc=0.71386 adapt_steps=2.00 halt=0.48 train_steps=1.57 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.66964 val_adapt_rocauc=0.69129 adapt_steps=2.00 halt=0.48 train_steps=1.58 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.63916 val_adapt_rocauc=0.69673 adapt_steps=2.00 halt=0.48 train_steps=1.57 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.73238 val_adapt_rocauc=0.74287 adapt_steps=2.00 halt=0.48 train_steps=1.57 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.73849 val_adapt_rocauc=0.76782 adapt_steps=2.00 halt=0.48 train_steps=1.57 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.72881 val_adapt_rocauc=0.78390 adapt_steps=2.00 halt=0.48 train_steps=1.57 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.73387 val_adapt_rocauc=0.77480 adapt_steps=2.00 halt=0.48 train_steps=1.57 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.73341 val_adapt_rocauc=0.77625 adapt_steps=2.00 halt=0.48 train_steps=1.57 +[ogbg-molhiv_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.7384932882618068} test={'rocauc': 0.7185075030417737} adaptive={'rocauc': 0.7421078043222156} steps=2.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=resgated compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view resgated --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.50096 val_adapt_rocauc=0.63103 adapt_steps=2.00 halt=0.47 train_steps=1.60 +ep20 val_rocauc=0.65405 val_adapt_rocauc=0.70279 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep30 val_rocauc=0.68276 val_adapt_rocauc=0.65325 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep40 val_rocauc=0.80097 val_adapt_rocauc=0.78965 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep50 val_rocauc=0.77943 val_adapt_rocauc=0.71584 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep60 val_rocauc=0.77564 val_adapt_rocauc=0.75634 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep70 val_rocauc=0.77493 val_adapt_rocauc=0.78545 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep80 val_rocauc=0.77393 val_adapt_rocauc=0.77547 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep90 val_rocauc=0.76533 val_adapt_rocauc=0.76729 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.76010 val_adapt_rocauc=0.76356 adapt_steps=2.00 halt=0.48 train_steps=1.57 +[ogbg-molhiv_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=40 val={'rocauc': 0.8009657309425828} test={'rocauc': 0.7787017903010873} adaptive={'rocauc': 0.7875702504876494} steps=2.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[task] ogbg-molbbbp on cuda:3 +[run] ogbg-molbbbp view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/bbbp.zip +
0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 3.85it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 3.85it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 7.69it/s] +Processing... +Extracting /home/yurenh2/rrog-gnn-runner/data/ogb/bbbp.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/2039 [00:00<?, ?it/s]
100%|██████████| 2039/2039 [00:00<00:00, 167890.73it/s] +Converting graphs into PyG objects... +
0%| | 0/2039 [00:00<?, ?it/s]
100%|██████████| 2039/2039 [00:00<00:00, 85245.66it/s] +/home/yurenh2/miniconda3/lib/python3.13/site-packages/ogb/graphproppred/dataset_pyg.py:156: UserWarning: The given NumPy array is not writable, and PyTorch does not support non-writable tensors. This means writing to this tensor will result in undefined behavior. You may want to copy the array to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at /pytorch/torch/csrc/utils/tensor_numpy.cpp:213.) + g.y = torch.from_numpy(graph_label[i]).view(1,-1).to(torch.long) +Done! +Saving... +ep10 val_rocauc=0.89356 val_adapt_rocauc=0.92960 adapt_steps=2.14 halt=0.41 train_steps=1.93 +ep20 val_rocauc=0.84945 val_adapt_rocauc=0.83680 adapt_steps=2.08 halt=0.46 train_steps=1.71 +ep30 val_rocauc=0.84815 val_adapt_rocauc=0.92940 adapt_steps=2.03 halt=0.46 train_steps=1.68 +ep40 val_rocauc=0.91307 val_adapt_rocauc=0.92452 adapt_steps=2.04 halt=0.46 train_steps=1.64 +ep50 val_rocauc=0.92821 val_adapt_rocauc=0.93647 adapt_steps=2.09 halt=0.47 train_steps=1.60 +ep60 val_rocauc=0.88709 val_adapt_rocauc=0.91686 adapt_steps=2.06 halt=0.47 train_steps=1.60 +ep70 val_rocauc=0.82187 val_adapt_rocauc=0.90979 adapt_steps=2.01 halt=0.47 train_steps=1.60 +ep80 val_rocauc=0.86588 val_adapt_rocauc=0.91317 adapt_steps=2.02 halt=0.48 train_steps=1.57 +ep90 val_rocauc=0.91586 val_adapt_rocauc=0.91596 adapt_steps=2.02 halt=0.48 train_steps=1.58 +ep100 val_rocauc=0.90780 val_adapt_rocauc=0.91327 adapt_steps=2.01 halt=0.47 train_steps=1.60 +[ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=50 val={'rocauc': 0.9282087025789106} test={'rocauc': 0.6619405864197531} adaptive={'rocauc': 0.6692708333333333} steps=2.0833333333333335 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.70039 val_adapt_rocauc=0.92542 adapt_steps=2.07 halt=0.46 train_steps=1.65 +ep20 val_rocauc=0.88380 val_adapt_rocauc=0.92642 adapt_steps=2.02 halt=0.47 train_steps=1.62 +ep30 val_rocauc=0.79638 val_adapt_rocauc=0.91417 adapt_steps=2.01 halt=0.47 train_steps=1.60 +ep40 val_rocauc=0.94295 val_adapt_rocauc=0.95201 adapt_steps=2.01 halt=0.48 train_steps=1.58 +ep50 val_rocauc=0.91327 val_adapt_rocauc=0.92164 adapt_steps=2.00 halt=0.48 train_steps=1.56 +ep60 val_rocauc=0.91407 val_adapt_rocauc=0.93030 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep70 val_rocauc=0.91716 val_adapt_rocauc=0.92801 adapt_steps=2.00 halt=0.47 train_steps=1.59 +ep80 val_rocauc=0.91407 val_adapt_rocauc=0.91825 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep90 val_rocauc=0.90959 val_adapt_rocauc=0.91138 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep100 val_rocauc=0.91228 val_adapt_rocauc=0.91566 adapt_steps=2.00 halt=0.48 train_steps=1.58 +[ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=40 val={'rocauc': 0.9429453350592453} test={'rocauc': 0.6137152777777778} adaptive={'rocauc': 0.675829475308642} steps=2.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.87613 val_adapt_rocauc=0.92184 adapt_steps=2.00 halt=0.42 train_steps=1.95 +ep20 val_rocauc=0.87285 val_adapt_rocauc=0.92134 adapt_steps=2.01 halt=0.46 train_steps=1.74 +ep30 val_rocauc=0.87892 val_adapt_rocauc=0.93090 adapt_steps=2.02 halt=0.46 train_steps=1.66 +ep40 val_rocauc=0.87315 val_adapt_rocauc=0.92920 adapt_steps=2.05 halt=0.47 train_steps=1.60 +ep50 val_rocauc=0.87922 val_adapt_rocauc=0.92104 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep60 val_rocauc=0.89366 val_adapt_rocauc=0.92223 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep70 val_rocauc=0.93468 val_adapt_rocauc=0.94484 adapt_steps=2.00 halt=0.47 train_steps=1.57 +ep80 val_rocauc=0.91945 val_adapt_rocauc=0.92811 adapt_steps=2.00 halt=0.48 train_steps=1.56 +ep90 val_rocauc=0.92253 val_adapt_rocauc=0.93060 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep100 val_rocauc=0.91925 val_adapt_rocauc=0.92930 adapt_steps=2.00 halt=0.48 train_steps=1.58 +[ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.9346808722493279} test={'rocauc': 0.6516203703703703} adaptive={'rocauc': 0.6385030864197532} steps=2.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.78522 val_adapt_rocauc=0.83192 adapt_steps=2.08 halt=0.40 train_steps=2.07 +ep20 val_rocauc=0.92472 val_adapt_rocauc=0.93388 adapt_steps=2.22 halt=0.44 train_steps=1.81 +ep30 val_rocauc=0.94056 val_adapt_rocauc=0.94852 adapt_steps=2.01 halt=0.46 train_steps=1.66 +ep40 val_rocauc=0.89077 val_adapt_rocauc=0.92691 adapt_steps=2.01 halt=0.47 train_steps=1.61 +ep50 val_rocauc=0.89605 val_adapt_rocauc=0.92423 adapt_steps=2.03 halt=0.48 train_steps=1.57 +ep60 val_rocauc=0.90571 val_adapt_rocauc=0.93647 adapt_steps=2.03 halt=0.47 train_steps=1.60 +ep70 val_rocauc=0.91337 val_adapt_rocauc=0.93179 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep80 val_rocauc=0.92512 val_adapt_rocauc=0.93866 adapt_steps=2.01 halt=0.48 train_steps=1.56 +ep90 val_rocauc=0.92194 val_adapt_rocauc=0.93418 adapt_steps=2.01 halt=0.48 train_steps=1.58 +ep100 val_rocauc=0.92134 val_adapt_rocauc=0.93259 adapt_steps=2.01 halt=0.47 train_steps=1.58 +[ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rocauc': 0.9405556108732449} test={'rocauc': 0.635030864197531} adaptive={'rocauc': 0.6146797839506173} steps=2.014705882352941 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.72269 val_adapt_rocauc=0.93777 adapt_steps=2.29 halt=0.42 train_steps=2.02 +ep20 val_rocauc=0.86110 val_adapt_rocauc=0.88460 adapt_steps=2.14 halt=0.47 train_steps=1.61 +ep30 val_rocauc=0.88181 val_adapt_rocauc=0.91278 adapt_steps=2.00 halt=0.47 train_steps=1.63 +ep40 val_rocauc=0.82027 val_adapt_rocauc=0.88151 adapt_steps=2.06 halt=0.46 train_steps=1.67 +ep50 val_rocauc=0.90561 val_adapt_rocauc=0.92393 adapt_steps=2.00 halt=0.47 train_steps=1.57 +ep60 val_rocauc=0.86339 val_adapt_rocauc=0.89804 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep70 val_rocauc=0.84397 val_adapt_rocauc=0.90242 adapt_steps=2.00 halt=0.47 train_steps=1.57 +ep80 val_rocauc=0.86578 val_adapt_rocauc=0.91955 adapt_steps=2.00 halt=0.48 train_steps=1.56 +ep90 val_rocauc=0.84049 val_adapt_rocauc=0.91019 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep100 val_rocauc=0.84556 val_adapt_rocauc=0.91248 adapt_steps=2.00 halt=0.47 train_steps=1.59 +[ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=50 val={'rocauc': 0.9056058946529921} test={'rocauc': 0.6368634259259259} adaptive={'rocauc': 0.6415895061728395} steps=2.1176470588235294 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.76730 val_adapt_rocauc=0.88778 adapt_steps=2.00 halt=0.47 train_steps=1.59 +ep20 val_rocauc=0.87454 val_adapt_rocauc=0.90780 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep30 val_rocauc=0.80006 val_adapt_rocauc=0.87334 adapt_steps=2.00 halt=0.47 train_steps=1.60 +ep40 val_rocauc=0.86010 val_adapt_rocauc=0.90411 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep50 val_rocauc=0.87972 val_adapt_rocauc=0.90810 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep60 val_rocauc=0.83292 val_adapt_rocauc=0.88918 adapt_steps=2.01 halt=0.47 train_steps=1.59 +ep70 val_rocauc=0.84706 val_adapt_rocauc=0.89893 adapt_steps=2.00 halt=0.47 train_steps=1.59 +ep80 val_rocauc=0.83740 val_adapt_rocauc=0.90232 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep90 val_rocauc=0.83670 val_adapt_rocauc=0.90222 adapt_steps=2.00 halt=0.48 train_steps=1.59 +ep100 val_rocauc=0.84357 val_adapt_rocauc=0.90252 adapt_steps=2.00 halt=0.47 train_steps=1.60 +[ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=50 val={'rocauc': 0.8797172159713232} test={'rocauc': 0.5456211419753086} adaptive={'rocauc': 0.5880594135802469} steps=2.0098039215686274 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=pna compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view pna --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.92482 val_adapt_rocauc=0.93149 adapt_steps=2.24 halt=0.44 train_steps=1.79 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.50592 val_adapt_rocauc=0.89495 adapt_steps=2.03 halt=0.45 train_steps=1.73 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.93797 val_adapt_rocauc=0.94275 adapt_steps=2.20 halt=0.44 train_steps=1.75 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.85004 val_adapt_rocauc=0.90750 adapt_steps=2.00 halt=0.44 train_steps=1.77 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.88719 val_adapt_rocauc=0.89734 adapt_steps=2.01 halt=0.47 train_steps=1.60 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.92024 val_adapt_rocauc=0.92930 adapt_steps=2.03 halt=0.46 train_steps=1.65 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.91278 val_adapt_rocauc=0.91975 adapt_steps=2.01 halt=0.47 train_steps=1.62 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.88728 val_adapt_rocauc=0.89485 adapt_steps=2.01 halt=0.48 train_steps=1.58 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.89605 val_adapt_rocauc=0.89157 adapt_steps=2.00 halt=0.48 train_steps=1.59 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.89704 val_adapt_rocauc=0.89196 adapt_steps=2.00 halt=0.47 train_steps=1.59 +[ogbg-molbbbp_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rocauc': 0.9379667430050782} test={'rocauc': 0.6539351851851851} adaptive={'rocauc': 0.6563464506172839} steps=2.3137254901960786 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=resgated compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view resgated --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.80335 val_adapt_rocauc=0.89714 adapt_steps=2.00 halt=0.43 train_steps=1.80 +ep20 val_rocauc=0.94992 val_adapt_rocauc=0.95589 adapt_steps=2.15 halt=0.46 train_steps=1.65 +ep30 val_rocauc=0.89844 val_adapt_rocauc=0.92413 adapt_steps=2.31 halt=0.46 train_steps=1.60 +ep40 val_rocauc=0.88499 val_adapt_rocauc=0.92303 adapt_steps=2.03 halt=0.47 train_steps=1.61 +ep50 val_rocauc=0.87145 val_adapt_rocauc=0.91118 adapt_steps=2.02 halt=0.47 train_steps=1.58 +ep60 val_rocauc=0.83670 val_adapt_rocauc=0.89266 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep70 val_rocauc=0.83142 val_adapt_rocauc=0.89963 adapt_steps=2.01 halt=0.47 train_steps=1.58 +ep80 val_rocauc=0.85273 val_adapt_rocauc=0.90859 adapt_steps=2.00 halt=0.48 train_steps=1.56 +ep90 val_rocauc=0.82246 val_adapt_rocauc=0.89346 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep100 val_rocauc=0.83471 val_adapt_rocauc=0.90033 adapt_steps=2.00 halt=0.48 train_steps=1.58 +[ogbg-molbbbp_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=20 val={'rocauc': 0.9499153639350792} test={'rocauc': 0.6603973765432098} adaptive={'rocauc': 0.6677276234567902} steps=2.343137254901961 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[task] ogbg-molsider on cuda:3 +[run] ogbg-molsider view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/sider.zip +
0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 3.84it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 3.84it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 7.68it/s] +Processing... +Extracting /home/yurenh2/rrog-gnn-runner/data/ogb/sider.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/1427 [00:00<?, ?it/s]
100%|██████████| 1427/1427 [00:00<00:00, 157159.75it/s] +Converting graphs into PyG objects... +
0%| | 0/1427 [00:00<?, ?it/s]
100%|██████████| 1427/1427 [00:00<00:00, 79093.89it/s] +Done! +Saving... +ep10 val_rocauc=0.51600 val_adapt_rocauc=0.51600 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.54994 val_adapt_rocauc=0.54994 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.53576 val_adapt_rocauc=0.53552 adapt_steps=7.83 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.55033 val_adapt_rocauc=0.55033 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.55437 val_adapt_rocauc=0.55437 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.60254 val_adapt_rocauc=0.60254 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.58756 val_adapt_rocauc=0.58756 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.60754 val_adapt_rocauc=0.60754 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.59698 val_adapt_rocauc=0.59698 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep100 val_rocauc=0.59673 val_adapt_rocauc=0.59673 adapt_steps=8.00 halt=0.12 train_steps=4.50 +[ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.6075447846476244} test={'rocauc': 0.5810477512085702} adaptive={'rocauc': 0.5810477512085702} steps=8.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.54584 val_adapt_rocauc=0.54577 adapt_steps=7.98 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.58611 val_adapt_rocauc=0.58611 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.59127 val_adapt_rocauc=0.59127 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.57511 val_adapt_rocauc=0.57438 adapt_steps=7.84 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.58186 val_adapt_rocauc=0.58186 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.56772 val_adapt_rocauc=0.56772 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.59297 val_adapt_rocauc=0.59297 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep80 val_rocauc=0.62339 val_adapt_rocauc=0.62339 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep90 val_rocauc=0.62819 val_adapt_rocauc=0.62813 adapt_steps=7.90 halt=0.12 train_steps=4.50 +ep100 val_rocauc=0.63343 val_adapt_rocauc=0.63420 adapt_steps=7.97 halt=0.12 train_steps=4.50 +[ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.6334288171779305} test={'rocauc': 0.6299766632454395} adaptive={'rocauc': 0.6305843217920319} steps=7.909090909090909 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.50898 val_adapt_rocauc=0.50898 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.53439 val_adapt_rocauc=0.53439 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.55399 val_adapt_rocauc=0.55399 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.51743 val_adapt_rocauc=0.51743 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.56124 val_adapt_rocauc=0.56124 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.58333 val_adapt_rocauc=0.58333 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.58471 val_adapt_rocauc=0.58471 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep80 val_rocauc=0.59340 val_adapt_rocauc=0.59340 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.59796 val_adapt_rocauc=0.59796 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep100 val_rocauc=0.59492 val_adapt_rocauc=0.59492 adapt_steps=8.00 halt=0.12 train_steps=4.49 +[ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rocauc': 0.5979570667859507} test={'rocauc': 0.6336766486024191} adaptive={'rocauc': 0.6336766486024191} steps=8.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.52583 val_adapt_rocauc=0.52583 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.57520 val_adapt_rocauc=0.57520 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.52761 val_adapt_rocauc=0.52761 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.53501 val_adapt_rocauc=0.53501 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.54257 val_adapt_rocauc=0.54257 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.53427 val_adapt_rocauc=0.53427 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.57027 val_adapt_rocauc=0.57027 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.57984 val_adapt_rocauc=0.57984 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.59046 val_adapt_rocauc=0.59046 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep100 val_rocauc=0.58588 val_adapt_rocauc=0.58588 adapt_steps=8.00 halt=0.12 train_steps=4.50 +[ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rocauc': 0.5904624057788478} test={'rocauc': 0.621622401806624} adaptive={'rocauc': 0.621622401806624} steps=8.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.52148 val_adapt_rocauc=0.52148 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.53383 val_adapt_rocauc=0.53359 adapt_steps=7.96 halt=0.12 train_steps=4.49 +ep30 val_rocauc=0.54880 val_adapt_rocauc=0.54880 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.59286 val_adapt_rocauc=0.59286 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.59415 val_adapt_rocauc=0.59415 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.60132 val_adapt_rocauc=0.60132 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.58871 val_adapt_rocauc=0.58871 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.60004 val_adapt_rocauc=0.60006 adapt_steps=7.99 halt=0.12 train_steps=4.49 +ep90 val_rocauc=0.61690 val_adapt_rocauc=0.61690 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep100 val_rocauc=0.62234 val_adapt_rocauc=0.62234 adapt_steps=8.00 halt=0.12 train_steps=4.50 +[ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.6223441276640819} test={'rocauc': 0.622244619371397} adaptive={'rocauc': 0.622244619371397} steps=8.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.50469 val_adapt_rocauc=0.50469 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.55043 val_adapt_rocauc=0.55043 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.56343 val_adapt_rocauc=0.56343 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep40 val_rocauc=0.56853 val_adapt_rocauc=0.56838 adapt_steps=7.95 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.56311 val_adapt_rocauc=0.56311 adapt_steps=8.00 halt=0.12 train_steps=4.48 +ep60 val_rocauc=0.57671 val_adapt_rocauc=0.57673 adapt_steps=7.99 halt=0.12 train_steps=4.49 +ep70 val_rocauc=0.58004 val_adapt_rocauc=0.57740 adapt_steps=7.78 halt=0.12 train_steps=4.49 +ep80 val_rocauc=0.59036 val_adapt_rocauc=0.58962 adapt_steps=7.92 halt=0.12 train_steps=4.48 +ep90 val_rocauc=0.59131 val_adapt_rocauc=0.59135 adapt_steps=7.94 halt=0.12 train_steps=4.48 +ep100 val_rocauc=0.59335 val_adapt_rocauc=0.59096 adapt_steps=7.85 halt=0.13 train_steps=4.48 +[ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.593345692093345} test={'rocauc': 0.5966615384995925} adaptive={'rocauc': 0.5964163493356076} steps=7.888111888111888 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=pna compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view pna --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.51332 val_adapt_rocauc=0.51332 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.49872 val_adapt_rocauc=0.49872 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.52439 val_adapt_rocauc=0.52439 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.51652 val_adapt_rocauc=0.51652 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.54453 val_adapt_rocauc=0.54453 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.56613 val_adapt_rocauc=0.56613 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.58698 val_adapt_rocauc=0.58698 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.56911 val_adapt_rocauc=0.56911 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.57175 val_adapt_rocauc=0.57175 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.58106 val_adapt_rocauc=0.58106 adapt_steps=8.00 halt=0.12 train_steps=4.50 +[ogbg-molsider_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.5869831648034167} test={'rocauc': 0.5961753244813196} adaptive={'rocauc': 0.5962142801036087} steps=7.958041958041958 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=resgated compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view resgated --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.51655 val_adapt_rocauc=0.51655 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.53764 val_adapt_rocauc=0.53764 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep30 val_rocauc=0.58175 val_adapt_rocauc=0.58175 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.57301 val_adapt_rocauc=0.57301 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.56615 val_adapt_rocauc=0.56615 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.58257 val_adapt_rocauc=0.58257 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.59759 val_adapt_rocauc=0.59759 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.62601 val_adapt_rocauc=0.62601 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.61042 val_adapt_rocauc=0.61042 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep100 val_rocauc=0.61180 val_adapt_rocauc=0.61180 adapt_steps=8.00 halt=0.12 train_steps=4.50 +[ogbg-molsider_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.6260140078552355} test={'rocauc': 0.6259436225287444} adaptive={'rocauc': 0.6259436225287444} steps=8.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[task] ogbg-molbace on cuda:3 +[run] ogbg-molbace view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/bace.zip +
0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 4.82it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 4.82it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 9.64it/s] +Processing... +Extracting /home/yurenh2/rrog-gnn-runner/data/ogb/bace.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/1513 [00:00<?, ?it/s]
100%|██████████| 1513/1513 [00:00<00:00, 163022.63it/s] +Converting graphs into PyG objects... +
0%| | 0/1513 [00:00<?, ?it/s]
100%|██████████| 1513/1513 [00:00<00:00, 85215.28it/s] +/home/yurenh2/miniconda3/lib/python3.13/site-packages/ogb/graphproppred/dataset_pyg.py:156: UserWarning: The given NumPy array is not writable, and PyTorch does not support non-writable tensors. This means writing to this tensor will result in undefined behavior. You may want to copy the array to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at /pytorch/torch/csrc/utils/tensor_numpy.cpp:213.) + g.y = torch.from_numpy(graph_label[i]).view(1,-1).to(torch.long) +Done! +Saving... +ep10 val_rocauc=0.52894 val_adapt_rocauc=0.53736 adapt_steps=2.04 halt=0.34 train_steps=2.42 +ep20 val_rocauc=0.61941 val_adapt_rocauc=0.62161 adapt_steps=2.00 halt=0.46 train_steps=1.68 +ep30 val_rocauc=0.53260 val_adapt_rocauc=0.65385 adapt_steps=2.09 halt=0.44 train_steps=1.75 +ep40 val_rocauc=0.61319 val_adapt_rocauc=0.66703 adapt_steps=2.00 halt=0.47 train_steps=1.66 +ep50 val_rocauc=0.59048 val_adapt_rocauc=0.58315 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep60 val_rocauc=0.66300 val_adapt_rocauc=0.69487 adapt_steps=2.09 halt=0.47 train_steps=1.60 +ep70 val_rocauc=0.59011 val_adapt_rocauc=0.62601 adapt_steps=2.00 halt=0.48 train_steps=1.55 +ep80 val_rocauc=0.62308 val_adapt_rocauc=0.64579 adapt_steps=2.00 halt=0.47 train_steps=1.59 +ep90 val_rocauc=0.60000 val_adapt_rocauc=0.61868 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.60549 val_adapt_rocauc=0.61355 adapt_steps=2.01 halt=0.47 train_steps=1.57 +[ogbg-molbace_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.6630036630036631} test={'rocauc': 0.7275256477134411} adaptive={'rocauc': 0.7369153190749435} steps=2.0526315789473686 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbace_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.66154 val_adapt_rocauc=0.68828 adapt_steps=2.16 halt=0.45 train_steps=1.71 +ep20 val_rocauc=0.65604 val_adapt_rocauc=0.70476 adapt_steps=2.08 halt=0.47 train_steps=1.66 +ep30 val_rocauc=0.57875 val_adapt_rocauc=0.62674 adapt_steps=2.04 halt=0.44 train_steps=1.81 +ep40 val_rocauc=0.56337 val_adapt_rocauc=0.58608 adapt_steps=2.02 halt=0.47 train_steps=1.59 +ep50 val_rocauc=0.59084 val_adapt_rocauc=0.62527 adapt_steps=2.01 halt=0.46 train_steps=1.60 +ep60 val_rocauc=0.57289 val_adapt_rocauc=0.62161 adapt_steps=2.01 halt=0.48 train_steps=1.58 +ep70 val_rocauc=0.57399 val_adapt_rocauc=0.60659 adapt_steps=2.01 halt=0.48 train_steps=1.55 +ep80 val_rocauc=0.54762 val_adapt_rocauc=0.59560 adapt_steps=2.01 halt=0.48 train_steps=1.59 +ep90 val_rocauc=0.55861 val_adapt_rocauc=0.59634 adapt_steps=2.01 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.56264 val_adapt_rocauc=0.60403 adapt_steps=2.00 halt=0.47 train_steps=1.57 +[ogbg-molbace_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=10 val={'rocauc': 0.6615384615384615} test={'rocauc': 0.4418362023995827} adaptive={'rocauc': 0.5362545644235784} steps=2.8421052631578947 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbace_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.54505 val_adapt_rocauc=0.57875 adapt_steps=2.06 halt=0.44 train_steps=1.70 +ep20 val_rocauc=0.58388 val_adapt_rocauc=0.63223 adapt_steps=2.44 halt=0.47 train_steps=1.62 +ep30 val_rocauc=0.58168 val_adapt_rocauc=0.58205 adapt_steps=2.07 halt=0.47 train_steps=1.58 +ep40 val_rocauc=0.56923 val_adapt_rocauc=0.66410 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep50 val_rocauc=0.59011 val_adapt_rocauc=0.58022 adapt_steps=2.07 halt=0.47 train_steps=1.57 +ep60 val_rocauc=0.60037 val_adapt_rocauc=0.59194 adapt_steps=2.03 halt=0.48 train_steps=1.60 +ep70 val_rocauc=0.64396 val_adapt_rocauc=0.62271 adapt_steps=2.00 halt=0.48 train_steps=1.55 +ep80 val_rocauc=0.63993 val_adapt_rocauc=0.62711 adapt_steps=2.00 halt=0.48 train_steps=1.59 +ep90 val_rocauc=0.63883 val_adapt_rocauc=0.62967 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.64322 val_adapt_rocauc=0.62491 adapt_steps=2.00 halt=0.47 train_steps=1.57 +[ogbg-molbace_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.643956043956044} test={'rocauc': 0.7117023126412798} adaptive={'rocauc': 0.7499565292992523} steps=2.013157894736842 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbace_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.64799 val_adapt_rocauc=0.66227 adapt_steps=2.66 halt=0.44 train_steps=1.78 +ep20 val_rocauc=0.64579 val_adapt_rocauc=0.62674 adapt_steps=2.08 halt=0.43 train_steps=1.80 +ep30 val_rocauc=0.65458 val_adapt_rocauc=0.66300 adapt_steps=2.01 halt=0.47 train_steps=1.62 +ep40 val_rocauc=0.61941 val_adapt_rocauc=0.60806 adapt_steps=2.01 halt=0.46 train_steps=1.67 +ep50 val_rocauc=0.58645 val_adapt_rocauc=0.64908 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep60 val_rocauc=0.57399 val_adapt_rocauc=0.57363 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep70 val_rocauc=0.62161 val_adapt_rocauc=0.63114 adapt_steps=2.00 halt=0.48 train_steps=1.55 +ep80 val_rocauc=0.62930 val_adapt_rocauc=0.64286 adapt_steps=2.00 halt=0.48 train_steps=1.59 +ep90 val_rocauc=0.63553 val_adapt_rocauc=0.63223 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.63736 val_adapt_rocauc=0.63480 adapt_steps=2.00 halt=0.47 train_steps=1.57 +[ogbg-molbace_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rocauc': 0.6545787545787546} test={'rocauc': 0.8191618848895844} adaptive={'rocauc': 0.8142931664058426} steps=2.111842105263158 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbace_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.67802 val_adapt_rocauc=0.70293 adapt_steps=2.01 halt=0.44 train_steps=1.78 +ep20 val_rocauc=0.55751 val_adapt_rocauc=0.55348 adapt_steps=2.03 halt=0.47 train_steps=1.61 +ep30 val_rocauc=0.66337 val_adapt_rocauc=0.66300 adapt_steps=2.01 halt=0.47 train_steps=1.61 +ep40 val_rocauc=0.68901 val_adapt_rocauc=0.67766 adapt_steps=2.09 halt=0.46 train_steps=1.66 +ep50 val_rocauc=0.62857 val_adapt_rocauc=0.71502 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep60 val_rocauc=0.66703 val_adapt_rocauc=0.67033 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep70 val_rocauc=0.69267 val_adapt_rocauc=0.69780 adapt_steps=2.00 halt=0.48 train_steps=1.55 +ep80 val_rocauc=0.67766 val_adapt_rocauc=0.66374 adapt_steps=2.00 halt=0.48 train_steps=1.59 +ep90 val_rocauc=0.67143 val_adapt_rocauc=0.65238 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.68095 val_adapt_rocauc=0.65311 adapt_steps=2.00 halt=0.47 train_steps=1.57 +[ogbg-molbace_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.6926739926739928} test={'rocauc': 0.6736219787862981} adaptive={'rocauc': 0.734828725439054} steps=2.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbace_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.68022 val_adapt_rocauc=0.67143 adapt_steps=2.11 halt=0.48 train_steps=1.58 +ep20 val_rocauc=0.64139 val_adapt_rocauc=0.67692 adapt_steps=2.05 halt=0.48 train_steps=1.60 +ep30 val_rocauc=0.63516 val_adapt_rocauc=0.63077 adapt_steps=2.02 halt=0.47 train_steps=1.57 +ep40 val_rocauc=0.59158 val_adapt_rocauc=0.65128 adapt_steps=2.00 halt=0.48 train_steps=1.59 +ep50 val_rocauc=0.51758 val_adapt_rocauc=0.55788 adapt_steps=2.01 halt=0.47 train_steps=1.56 +ep60 val_rocauc=0.63626 val_adapt_rocauc=0.63700 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep70 val_rocauc=0.56300 val_adapt_rocauc=0.62271 adapt_steps=2.00 halt=0.48 train_steps=1.55 +ep80 val_rocauc=0.55751 val_adapt_rocauc=0.62967 adapt_steps=2.00 halt=0.48 train_steps=1.59 +ep90 val_rocauc=0.55495 val_adapt_rocauc=0.61795 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.54652 val_adapt_rocauc=0.61722 adapt_steps=2.00 halt=0.47 train_steps=1.57 +[ogbg-molbace_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=10 val={'rocauc': 0.6802197802197802} test={'rocauc': 0.6833594157537818} adaptive={'rocauc': 0.7826464962615197} steps=2.0921052631578947 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbace_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=pna compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view pna --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.56447 val_adapt_rocauc=0.56557 adapt_steps=2.00 halt=0.35 train_steps=2.27 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.65751 val_adapt_rocauc=0.67289 adapt_steps=2.16 halt=0.38 train_steps=2.12 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.65897 val_adapt_rocauc=0.65018 adapt_steps=2.56 halt=0.40 train_steps=1.88 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.45604 val_adapt_rocauc=0.66996 adapt_steps=2.13 halt=0.46 train_steps=1.68 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.49560 val_adapt_rocauc=0.68791 adapt_steps=2.13 halt=0.44 train_steps=1.75 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.46227 val_adapt_rocauc=0.68132 adapt_steps=2.05 halt=0.47 train_steps=1.65 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.64432 val_adapt_rocauc=0.67912 adapt_steps=2.00 halt=0.47 train_steps=1.57 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.60220 val_adapt_rocauc=0.64359 adapt_steps=2.04 halt=0.47 train_steps=1.60 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.61136 val_adapt_rocauc=0.68535 adapt_steps=2.01 halt=0.47 train_steps=1.62 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.61978 val_adapt_rocauc=0.68974 adapt_steps=2.01 halt=0.46 train_steps=1.61 +[ogbg-molbace_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rocauc': 0.658974358974359} test={'rocauc': 0.7480438184663536} adaptive={'rocauc': 0.7546513649800034} steps=2.6315789473684212 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbace_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=resgated compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view resgated --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.61282 val_adapt_rocauc=0.59304 adapt_steps=2.04 halt=0.43 train_steps=1.89 +ep20 val_rocauc=0.68938 val_adapt_rocauc=0.61062 adapt_steps=2.04 halt=0.46 train_steps=1.69 +ep30 val_rocauc=0.66740 val_adapt_rocauc=0.70366 adapt_steps=2.12 halt=0.47 train_steps=1.61 +ep40 val_rocauc=0.64212 val_adapt_rocauc=0.67582 adapt_steps=2.01 halt=0.47 train_steps=1.67 +ep50 val_rocauc=0.55604 val_adapt_rocauc=0.57802 adapt_steps=2.00 halt=0.46 train_steps=1.61 +ep60 val_rocauc=0.69414 val_adapt_rocauc=0.69597 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep70 val_rocauc=0.61026 val_adapt_rocauc=0.63590 adapt_steps=2.00 halt=0.48 train_steps=1.55 +ep80 val_rocauc=0.66410 val_adapt_rocauc=0.66300 adapt_steps=2.00 halt=0.48 train_steps=1.59 +ep90 val_rocauc=0.65934 val_adapt_rocauc=0.64835 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.66850 val_adapt_rocauc=0.65128 adapt_steps=2.00 halt=0.47 train_steps=1.57 +[ogbg-molbace_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.6941391941391942} test={'rocauc': 0.7231785776386715} adaptive={'rocauc': 0.7640410363415059} steps=2.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbace_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[task] ogbg-moltox21 on cuda:3 +[run] ogbg-moltox21 view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/tox21.zip +
0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 2.13it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 2.13it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 4.25it/s] +Processing... +Extracting /home/yurenh2/rrog-gnn-runner/data/ogb/tox21.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/7831 [00:00<?, ?it/s]
100%|██████████| 7831/7831 [00:00<00:00, 162374.47it/s] +Converting graphs into PyG objects... +
0%| | 0/7831 [00:00<?, ?it/s]
100%|██████████| 7831/7831 [00:00<00:00, 91009.23it/s] +Done! +Saving... +ep10 val_rocauc=0.71371 val_adapt_rocauc=0.69966 adapt_steps=3.11 halt=0.29 train_steps=2.95 +ep20 val_rocauc=0.63487 val_adapt_rocauc=0.60317 adapt_steps=2.49 halt=0.29 train_steps=2.93 +ep30 val_rocauc=0.71755 val_adapt_rocauc=0.70846 adapt_steps=3.98 halt=0.28 train_steps=2.98 +ep40 val_rocauc=0.71255 val_adapt_rocauc=0.68936 adapt_steps=3.00 halt=0.29 train_steps=2.94 +ep50 val_rocauc=0.72362 val_adapt_rocauc=0.72481 adapt_steps=3.24 halt=0.28 train_steps=3.16 +ep60 val_rocauc=0.71946 val_adapt_rocauc=0.72876 adapt_steps=3.93 halt=0.28 train_steps=3.08 +ep70 val_rocauc=0.72799 val_adapt_rocauc=0.73083 adapt_steps=3.71 halt=0.28 train_steps=3.13 +ep80 val_rocauc=0.75666 val_adapt_rocauc=0.76164 adapt_steps=4.28 halt=0.29 train_steps=3.06 +ep90 val_rocauc=0.75393 val_adapt_rocauc=0.76254 adapt_steps=3.78 halt=0.29 train_steps=3.06 +ep100 val_rocauc=0.76113 val_adapt_rocauc=0.76936 adapt_steps=3.90 halt=0.29 train_steps=3.04 +[ogbg-moltox21_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.7611296131897838} test={'rocauc': 0.7089667909334546} adaptive={'rocauc': 0.7126552901719999} steps=3.826530612244898 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-moltox21_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.59058 val_adapt_rocauc=0.61606 adapt_steps=2.60 halt=0.29 train_steps=2.95 +ep20 val_rocauc=0.73407 val_adapt_rocauc=0.73772 adapt_steps=4.45 halt=0.28 train_steps=3.03 +ep30 val_rocauc=0.66805 val_adapt_rocauc=0.67628 adapt_steps=2.39 halt=0.31 train_steps=2.83 +ep40 val_rocauc=0.75097 val_adapt_rocauc=0.75197 adapt_steps=3.77 halt=0.30 train_steps=2.93 +ep50 val_rocauc=0.75364 val_adapt_rocauc=0.75297 adapt_steps=2.95 halt=0.32 train_steps=2.68 +ep60 val_rocauc=0.76552 val_adapt_rocauc=0.77043 adapt_steps=3.76 halt=0.31 train_steps=2.86 +ep70 val_rocauc=0.75776 val_adapt_rocauc=0.75709 adapt_steps=3.80 halt=0.34 train_steps=2.62 +ep80 val_rocauc=0.75257 val_adapt_rocauc=0.76572 adapt_steps=2.98 halt=0.35 train_steps=2.57 +ep90 val_rocauc=0.75894 val_adapt_rocauc=0.76629 adapt_steps=2.81 halt=0.37 train_steps=2.40 +ep100 val_rocauc=0.75414 val_adapt_rocauc=0.76330 adapt_steps=2.75 halt=0.37 train_steps=2.36 +[ogbg-moltox21_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.7655200134252199} test={'rocauc': 0.7134396419831454} adaptive={'rocauc': 0.7234036772214454} steps=3.764030612244898 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-moltox21_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.66429 val_adapt_rocauc=0.65320 adapt_steps=3.43 halt=0.30 train_steps=2.88 +ep20 val_rocauc=0.68343 val_adapt_rocauc=0.70058 adapt_steps=2.30 halt=0.28 train_steps=3.01 +ep30 val_rocauc=0.74431 val_adapt_rocauc=0.74038 adapt_steps=3.91 halt=0.28 train_steps=3.06 +ep40 val_rocauc=0.77575 val_adapt_rocauc=0.78093 adapt_steps=3.57 halt=0.29 train_steps=3.01 +ep50 val_rocauc=0.76411 val_adapt_rocauc=0.76469 adapt_steps=3.98 halt=0.28 train_steps=3.10 +ep60 val_rocauc=0.74714 val_adapt_rocauc=0.75263 adapt_steps=4.61 halt=0.29 train_steps=2.98 +ep70 val_rocauc=0.76848 val_adapt_rocauc=0.77476 adapt_steps=3.52 halt=0.31 train_steps=2.93 +ep80 val_rocauc=0.77621 val_adapt_rocauc=0.77758 adapt_steps=3.50 halt=0.30 train_steps=2.90 +ep90 val_rocauc=0.77792 val_adapt_rocauc=0.77851 adapt_steps=3.40 halt=0.32 train_steps=2.79 +ep100 val_rocauc=0.77758 val_adapt_rocauc=0.77971 adapt_steps=3.31 halt=0.32 train_steps=2.76 +[ogbg-moltox21_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rocauc': 0.7779156296831152} test={'rocauc': 0.7359551442188313} adaptive={'rocauc': 0.7477856114096909} steps=3.485969387755102 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-moltox21_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.65297 val_adapt_rocauc=0.67456 adapt_steps=3.02 halt=0.29 train_steps=2.89 +ep20 val_rocauc=0.58464 val_adapt_rocauc=0.57802 adapt_steps=2.47 halt=0.28 train_steps=3.08 +ep30 val_rocauc=0.67479 val_adapt_rocauc=0.66288 adapt_steps=2.71 halt=0.28 train_steps=3.03 +ep40 val_rocauc=0.73567 val_adapt_rocauc=0.72464 adapt_steps=4.40 halt=0.29 train_steps=2.94 +ep50 val_rocauc=0.74825 val_adapt_rocauc=0.74753 adapt_steps=3.90 halt=0.30 train_steps=2.89 +ep60 val_rocauc=0.74074 val_adapt_rocauc=0.74859 adapt_steps=3.41 halt=0.29 train_steps=3.03 +ep70 val_rocauc=0.76016 val_adapt_rocauc=0.76365 adapt_steps=3.69 halt=0.32 train_steps=2.78 +ep80 val_rocauc=0.76849 val_adapt_rocauc=0.77008 adapt_steps=3.87 halt=0.32 train_steps=2.79 +ep90 val_rocauc=0.76637 val_adapt_rocauc=0.76973 adapt_steps=3.59 halt=0.31 train_steps=2.86 +ep100 val_rocauc=0.77008 val_adapt_rocauc=0.77327 adapt_steps=3.50 halt=0.32 train_steps=2.79 +[ogbg-moltox21_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.7700778158549199} test={'rocauc': 0.7162575064186166} adaptive={'rocauc': 0.7254468026027986} steps=3.506377551020408 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-moltox21_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.67403 val_adapt_rocauc=0.66074 adapt_steps=5.50 halt=0.30 train_steps=2.85 +ep20 val_rocauc=0.72382 val_adapt_rocauc=0.72638 adapt_steps=4.50 halt=0.29 train_steps=2.98 +ep30 val_rocauc=0.74375 val_adapt_rocauc=0.74426 adapt_steps=4.91 halt=0.30 train_steps=2.93 +ep40 val_rocauc=0.76136 val_adapt_rocauc=0.75836 adapt_steps=4.87 halt=0.30 train_steps=2.95 +ep50 val_rocauc=0.77110 val_adapt_rocauc=0.76887 adapt_steps=3.39 halt=0.31 train_steps=2.88 +ep60 val_rocauc=0.76514 val_adapt_rocauc=0.76428 adapt_steps=3.77 halt=0.30 train_steps=2.93 +ep70 val_rocauc=0.77659 val_adapt_rocauc=0.78194 adapt_steps=3.61 halt=0.33 train_steps=2.73 +ep80 val_rocauc=0.78163 val_adapt_rocauc=0.78200 adapt_steps=3.14 halt=0.32 train_steps=2.79 +ep90 val_rocauc=0.77395 val_adapt_rocauc=0.77600 adapt_steps=3.46 halt=0.34 train_steps=2.63 +ep100 val_rocauc=0.77629 val_adapt_rocauc=0.78067 adapt_steps=3.51 halt=0.34 train_steps=2.67 +[ogbg-moltox21_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.7816268997660386} test={'rocauc': 0.7115162457844392} adaptive={'rocauc': 0.7190898385325345} steps=3.205357142857143 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-moltox21_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.67337 val_adapt_rocauc=0.68763 adapt_steps=3.64 halt=0.31 train_steps=2.73 +ep20 val_rocauc=0.70783 val_adapt_rocauc=0.71959 adapt_steps=3.12 halt=0.30 train_steps=2.88 +ep30 val_rocauc=0.70171 val_adapt_rocauc=0.71441 adapt_steps=3.00 halt=0.30 train_steps=2.88 +ep40 val_rocauc=0.71979 val_adapt_rocauc=0.72206 adapt_steps=3.04 halt=0.31 train_steps=2.84 +ep50 val_rocauc=0.71376 val_adapt_rocauc=0.72112 adapt_steps=2.58 halt=0.32 train_steps=2.70 +ep60 val_rocauc=0.71062 val_adapt_rocauc=0.72892 adapt_steps=2.53 halt=0.37 train_steps=2.29 +ep70 val_rocauc=0.72376 val_adapt_rocauc=0.73807 adapt_steps=2.52 halt=0.38 train_steps=2.29 +ep80 val_rocauc=0.71834 val_adapt_rocauc=0.74502 adapt_steps=2.27 halt=0.38 train_steps=2.25 +ep90 val_rocauc=0.71743 val_adapt_rocauc=0.73867 adapt_steps=2.35 halt=0.40 train_steps=2.13 +ep100 val_rocauc=0.72314 val_adapt_rocauc=0.74270 adapt_steps=2.30 halt=0.39 train_steps=2.20 +[ogbg-moltox21_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.7237576716525247} test={'rocauc': 0.6822930471359431} adaptive={'rocauc': 0.7137838364459371} steps=2.63265306122449 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-moltox21_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=pna compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view pna --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.67622 val_adapt_rocauc=0.68638 adapt_steps=2.73 halt=0.29 train_steps=2.84 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.70913 val_adapt_rocauc=0.71306 adapt_steps=3.51 halt=0.30 train_steps=2.87 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.72224 val_adapt_rocauc=0.71267 adapt_steps=3.47 halt=0.29 train_steps=2.94 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.72374 val_adapt_rocauc=0.72731 adapt_steps=2.78 halt=0.30 train_steps=2.99 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.68200 val_adapt_rocauc=0.67391 adapt_steps=2.33 halt=0.29 train_steps=2.98 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.67336 val_adapt_rocauc=0.67501 adapt_steps=6.05 halt=0.31 train_steps=2.84 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.73655 val_adapt_rocauc=0.74091 adapt_steps=3.35 halt=0.30 train_steps=2.92 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.74975 val_adapt_rocauc=0.75746 adapt_steps=4.96 halt=0.29 train_steps=3.02 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.75471 val_adapt_rocauc=0.76064 adapt_steps=4.10 halt=0.29 train_steps=3.02 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.75208 val_adapt_rocauc=0.76070 adapt_steps=3.94 halt=0.30 train_steps=2.96 +[ogbg-moltox21_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rocauc': 0.7547109180572619} test={'rocauc': 0.6948890646179361} adaptive={'rocauc': 0.7075025478713003} steps=4.220663265306122 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-moltox21_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=resgated compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view resgated --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.70487 val_adapt_rocauc=0.70394 adapt_steps=5.69 halt=0.30 train_steps=2.83 +ep20 val_rocauc=0.69675 val_adapt_rocauc=0.69557 adapt_steps=4.74 halt=0.29 train_steps=2.99 +ep30 val_rocauc=0.66699 val_adapt_rocauc=0.63127 adapt_steps=5.03 halt=0.28 train_steps=3.06 +ep40 val_rocauc=0.74485 val_adapt_rocauc=0.75016 adapt_steps=3.17 halt=0.29 train_steps=2.99 +ep50 val_rocauc=0.76238 val_adapt_rocauc=0.76296 adapt_steps=3.47 halt=0.30 train_steps=2.94 +ep60 val_rocauc=0.75613 val_adapt_rocauc=0.75760 adapt_steps=3.12 halt=0.30 train_steps=2.92 +ep70 val_rocauc=0.75660 val_adapt_rocauc=0.75749 adapt_steps=3.60 halt=0.33 train_steps=2.70 +ep80 val_rocauc=0.77965 val_adapt_rocauc=0.78270 adapt_steps=3.04 halt=0.33 train_steps=2.71 +ep90 val_rocauc=0.77346 val_adapt_rocauc=0.77623 adapt_steps=3.25 halt=0.35 train_steps=2.54 +ep100 val_rocauc=0.77053 val_adapt_rocauc=0.77614 adapt_steps=3.10 halt=0.36 train_steps=2.49 +[ogbg-moltox21_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.7796493691111651} test={'rocauc': 0.7201514791915015} adaptive={'rocauc': 0.7223894069034307} steps=3.0778061224489797 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-moltox21_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[task] ogbg-molclintox on cuda:3 +[run] ogbg-molclintox view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/clintox.zip +
0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 4.81it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 4.81it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 9.61it/s] +Processing... +Extracting /home/yurenh2/rrog-gnn-runner/data/ogb/clintox.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/1477 [00:00<?, ?it/s]
100%|██████████| 1477/1477 [00:00<00:00, 169141.78it/s] +Converting graphs into PyG objects... +
0%| | 0/1477 [00:00<?, ?it/s]
100%|██████████| 1477/1477 [00:00<00:00, 83199.98it/s] +Done! +Saving... +ep10 val_rocauc=0.60624 val_adapt_rocauc=0.74118 adapt_steps=2.01 halt=0.40 train_steps=2.12 +ep20 val_rocauc=0.78931 val_adapt_rocauc=0.78193 adapt_steps=2.51 halt=0.46 train_steps=1.67 +ep30 val_rocauc=0.87347 val_adapt_rocauc=0.88131 adapt_steps=2.23 halt=0.43 train_steps=1.76 +ep40 val_rocauc=0.90655 val_adapt_rocauc=0.89215 adapt_steps=2.11 halt=0.43 train_steps=1.90 +ep50 val_rocauc=0.90059 val_adapt_rocauc=0.89949 adapt_steps=2.04 halt=0.45 train_steps=1.68 +ep60 val_rocauc=0.92569 val_adapt_rocauc=0.91470 adapt_steps=2.04 halt=0.46 train_steps=1.73 +ep70 val_rocauc=0.85343 val_adapt_rocauc=0.84051 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep80 val_rocauc=0.90430 val_adapt_rocauc=0.88959 adapt_steps=2.00 halt=0.47 train_steps=1.61 +ep90 val_rocauc=0.91698 val_adapt_rocauc=0.90556 adapt_steps=2.01 halt=0.47 train_steps=1.59 +ep100 val_rocauc=0.89472 val_adapt_rocauc=0.88990 adapt_steps=2.01 halt=0.46 train_steps=1.67 +[ogbg-molclintox_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.925691092944614} test={'rocauc': 0.880287943558197} adaptive={'rocauc': 0.8739417161922636} steps=2.0675675675675675 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molclintox_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.82183 val_adapt_rocauc=0.86297 adapt_steps=2.22 halt=0.43 train_steps=1.73 +ep20 val_rocauc=0.76252 val_adapt_rocauc=0.86505 adapt_steps=2.26 halt=0.47 train_steps=1.63 +ep30 val_rocauc=0.83688 val_adapt_rocauc=0.89876 adapt_steps=2.09 halt=0.45 train_steps=1.62 +ep40 val_rocauc=0.81513 val_adapt_rocauc=0.86423 adapt_steps=2.01 halt=0.46 train_steps=1.65 +ep50 val_rocauc=0.93016 val_adapt_rocauc=0.95113 adapt_steps=2.00 halt=0.47 train_steps=1.62 +ep60 val_rocauc=0.96179 val_adapt_rocauc=0.96556 adapt_steps=2.00 halt=0.47 train_steps=1.64 +ep70 val_rocauc=0.94241 val_adapt_rocauc=0.94934 adapt_steps=2.00 halt=0.47 train_steps=1.64 +ep80 val_rocauc=0.97166 val_adapt_rocauc=0.96956 adapt_steps=2.00 halt=0.46 train_steps=1.63 +ep90 val_rocauc=0.97588 val_adapt_rocauc=0.97344 adapt_steps=2.00 halt=0.46 train_steps=1.62 +ep100 val_rocauc=0.97353 val_adapt_rocauc=0.96875 adapt_steps=2.00 halt=0.45 train_steps=1.63 +[ogbg-molclintox_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rocauc': 0.9758757674250633} test={'rocauc': 0.8739825530879644} adaptive={'rocauc': 0.8682749452611824} steps=2.054054054054054 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molclintox_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.68124 val_adapt_rocauc=0.73447 adapt_steps=2.00 halt=0.43 train_steps=1.98 +ep20 val_rocauc=0.74983 val_adapt_rocauc=0.82573 adapt_steps=2.00 halt=0.45 train_steps=1.75 +ep30 val_rocauc=0.83839 val_adapt_rocauc=0.86462 adapt_steps=2.07 halt=0.45 train_steps=1.69 +ep40 val_rocauc=0.85645 val_adapt_rocauc=0.90685 adapt_steps=2.11 halt=0.47 train_steps=1.61 +ep50 val_rocauc=0.82385 val_adapt_rocauc=0.82321 adapt_steps=2.01 halt=0.47 train_steps=1.56 +ep60 val_rocauc=0.87257 val_adapt_rocauc=0.89450 adapt_steps=2.02 halt=0.47 train_steps=1.61 +ep70 val_rocauc=0.93091 val_adapt_rocauc=0.93933 adapt_steps=2.01 halt=0.47 train_steps=1.61 +ep80 val_rocauc=0.91830 val_adapt_rocauc=0.92507 adapt_steps=2.03 halt=0.47 train_steps=1.67 +ep90 val_rocauc=0.91036 val_adapt_rocauc=0.91478 adapt_steps=2.01 halt=0.47 train_steps=1.67 +ep100 val_rocauc=0.91573 val_adapt_rocauc=0.91911 adapt_steps=2.01 halt=0.47 train_steps=1.63 +[ogbg-molclintox_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.9309095833743721} test={'rocauc': 0.8809821707851111} adaptive={'rocauc': 0.9033008375907969} steps=2.0878378378378377 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molclintox_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.64072 val_adapt_rocauc=0.74493 adapt_steps=2.03 halt=0.41 train_steps=2.16 +ep20 val_rocauc=0.69510 val_adapt_rocauc=0.88005 adapt_steps=2.13 halt=0.47 train_steps=1.63 +ep30 val_rocauc=0.86787 val_adapt_rocauc=0.86841 adapt_steps=2.00 halt=0.46 train_steps=1.64 +ep40 val_rocauc=0.79619 val_adapt_rocauc=0.83481 adapt_steps=2.00 halt=0.46 train_steps=1.68 +ep50 val_rocauc=0.81643 val_adapt_rocauc=0.85514 adapt_steps=2.04 halt=0.44 train_steps=1.79 +ep60 val_rocauc=0.85361 val_adapt_rocauc=0.91327 adapt_steps=2.00 halt=0.48 train_steps=1.59 +ep70 val_rocauc=0.85772 val_adapt_rocauc=0.91744 adapt_steps=2.00 halt=0.47 train_steps=1.59 +ep80 val_rocauc=0.84607 val_adapt_rocauc=0.91703 adapt_steps=2.00 halt=0.46 train_steps=1.63 +ep90 val_rocauc=0.86604 val_adapt_rocauc=0.92838 adapt_steps=2.00 halt=0.47 train_steps=1.61 +ep100 val_rocauc=0.85561 val_adapt_rocauc=0.91784 adapt_steps=2.00 halt=0.46 train_steps=1.62 +[ogbg-molclintox_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rocauc': 0.8678740273810697} test={'rocauc': 0.8432636499496056} adaptive={'rocauc': 0.8344932749452612} steps=2.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molclintox_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.71091 val_adapt_rocauc=0.73332 adapt_steps=2.07 halt=0.42 train_steps=1.94 +ep20 val_rocauc=0.77725 val_adapt_rocauc=0.79820 adapt_steps=2.14 halt=0.46 train_steps=1.73 +ep30 val_rocauc=0.85712 val_adapt_rocauc=0.83995 adapt_steps=2.12 halt=0.44 train_steps=1.69 +ep40 val_rocauc=0.86597 val_adapt_rocauc=0.88025 adapt_steps=2.14 halt=0.45 train_steps=1.71 +ep50 val_rocauc=0.83623 val_adapt_rocauc=0.85307 adapt_steps=2.01 halt=0.46 train_steps=1.61 +ep60 val_rocauc=0.84827 val_adapt_rocauc=0.85414 adapt_steps=2.03 halt=0.47 train_steps=1.66 +ep70 val_rocauc=0.86190 val_adapt_rocauc=0.88018 adapt_steps=2.00 halt=0.47 train_steps=1.62 +ep80 val_rocauc=0.81287 val_adapt_rocauc=0.85623 adapt_steps=2.04 halt=0.45 train_steps=1.78 +ep90 val_rocauc=0.81184 val_adapt_rocauc=0.85519 adapt_steps=2.03 halt=0.46 train_steps=1.73 +ep100 val_rocauc=0.80130 val_adapt_rocauc=0.84348 adapt_steps=2.05 halt=0.45 train_steps=1.75 +[ogbg-molclintox_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=40 val={'rocauc': 0.8659657244164286} test={'rocauc': 0.805447815660515} adaptive={'rocauc': 0.8240981128140966} steps=2.2094594594594597 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molclintox_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.76585 val_adapt_rocauc=0.86739 adapt_steps=2.02 halt=0.45 train_steps=1.70 +ep20 val_rocauc=0.86039 val_adapt_rocauc=0.86324 adapt_steps=2.00 halt=0.47 train_steps=1.62 +ep30 val_rocauc=0.90459 val_adapt_rocauc=0.89663 adapt_steps=2.02 halt=0.47 train_steps=1.59 +ep40 val_rocauc=0.90971 val_adapt_rocauc=0.88686 adapt_steps=2.00 halt=0.45 train_steps=1.69 +ep50 val_rocauc=0.93832 val_adapt_rocauc=0.92655 adapt_steps=2.00 halt=0.46 train_steps=1.61 +ep60 val_rocauc=0.89696 val_adapt_rocauc=0.91244 adapt_steps=2.03 halt=0.47 train_steps=1.65 +ep70 val_rocauc=0.92770 val_adapt_rocauc=0.92621 adapt_steps=2.01 halt=0.47 train_steps=1.62 +ep80 val_rocauc=0.93654 val_adapt_rocauc=0.94478 adapt_steps=2.01 halt=0.46 train_steps=1.69 +ep90 val_rocauc=0.93512 val_adapt_rocauc=0.94803 adapt_steps=2.01 halt=0.46 train_steps=1.63 +ep100 val_rocauc=0.93911 val_adapt_rocauc=0.94431 adapt_steps=2.00 halt=0.46 train_steps=1.64 +[ogbg-molclintox_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.9391148757345941} test={'rocauc': 0.8412244117749279} adaptive={'rocauc': 0.9026361519480067} steps=2.0405405405405403 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molclintox_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=pna compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view pna --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.73449 val_adapt_rocauc=0.82290 adapt_steps=2.02 halt=0.44 train_steps=1.88 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.72647 val_adapt_rocauc=0.81333 adapt_steps=2.02 halt=0.41 train_steps=1.96 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.69121 val_adapt_rocauc=0.81663 adapt_steps=2.03 halt=0.45 train_steps=1.67 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.68050 val_adapt_rocauc=0.79323 adapt_steps=2.05 halt=0.39 train_steps=2.17 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.78235 val_adapt_rocauc=0.82074 adapt_steps=2.27 halt=0.42 train_steps=1.74 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.77786 val_adapt_rocauc=0.80819 adapt_steps=2.03 halt=0.44 train_steps=1.77 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.80327 val_adapt_rocauc=0.80844 adapt_steps=2.07 halt=0.45 train_steps=1.65 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.82184 val_adapt_rocauc=0.81128 adapt_steps=2.07 halt=0.46 train_steps=1.66 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.81683 val_adapt_rocauc=0.80189 adapt_steps=2.05 halt=0.47 train_steps=1.62 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.82947 val_adapt_rocauc=0.80329 adapt_steps=2.05 halt=0.46 train_steps=1.66 +[ogbg-molclintox_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.8294650185495256} test={'rocauc': 0.9034242171480207} adaptive={'rocauc': 0.9194748548986897} steps=2.22972972972973 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molclintox_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=resgated compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view resgated --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.86017 val_adapt_rocauc=0.85805 adapt_steps=2.00 halt=0.44 train_steps=1.96 +ep20 val_rocauc=0.81251 val_adapt_rocauc=0.81417 adapt_steps=2.05 halt=0.46 train_steps=1.74 +ep30 val_rocauc=0.83266 val_adapt_rocauc=0.88528 adapt_steps=2.09 halt=0.44 train_steps=1.83 +ep40 val_rocauc=0.89601 val_adapt_rocauc=0.90433 adapt_steps=2.14 halt=0.47 train_steps=1.62 +ep50 val_rocauc=0.84727 val_adapt_rocauc=0.87116 adapt_steps=2.09 halt=0.46 train_steps=1.60 +ep60 val_rocauc=0.85582 val_adapt_rocauc=0.90812 adapt_steps=2.07 halt=0.47 train_steps=1.67 +ep70 val_rocauc=0.91150 val_adapt_rocauc=0.90620 adapt_steps=2.02 halt=0.46 train_steps=1.65 +ep80 val_rocauc=0.91162 val_adapt_rocauc=0.89879 adapt_steps=2.03 halt=0.47 train_steps=1.61 +ep90 val_rocauc=0.89291 val_adapt_rocauc=0.89228 adapt_steps=2.01 halt=0.47 train_steps=1.63 +ep100 val_rocauc=0.89000 val_adapt_rocauc=0.88702 adapt_steps=2.02 halt=0.45 train_steps=1.68 +[ogbg-molclintox_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.9116172559834532} test={'rocauc': 0.8402903763945366} adaptive={'rocauc': 0.8415754353039308} steps=2.0337837837837838 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molclintox_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[done] collecting summaries + +ZINC-cycle56 classic baseline +| task | backbone | n | val MAE-sum | test MAE-sum | +| --- | --- | --- | --- | --- | +| zinc-cycle56 | appnp | 1 | 1.0040 +/- 0.0000 | 1.0183 +/- 0.0000 | +| zinc-cycle56 | arma | 1 | 0.3456 +/- 0.0000 | 0.3406 +/- 0.0000 | +| zinc-cycle56 | cheb | 1 | 0.4038 +/- 0.0000 | 0.3887 +/- 0.0000 | +| zinc-cycle56 | film | 1 | 0.4906 +/- 0.0000 | 0.4998 +/- 0.0000 | +| zinc-cycle56 | gatv2 | 1 | 0.4084 +/- 0.0000 | 0.4012 +/- 0.0000 | +| zinc-cycle56 | gcn | 1 | 0.5821 +/- 0.0000 | 0.5854 +/- 0.0000 | +| zinc-cycle56 | gen | 1 | 0.3961 +/- 0.0000 | 0.3854 +/- 0.0000 | +| zinc-cycle56 | gin | 1 | 0.2981 +/- 0.0000 | 0.2725 +/- 0.0000 | +| zinc-cycle56 | gine | 1 | 0.2387 +/- 0.0000 | 0.2317 +/- 0.0000 | +| zinc-cycle56 | graphconv | 1 | 0.3507 +/- 0.0000 | 0.3462 +/- 0.0000 | +| zinc-cycle56 | graphsage | 1 | 0.4134 +/- 0.0000 | 0.4179 +/- 0.0000 | +| zinc-cycle56 | mf | 1 | 0.3051 +/- 0.0000 | 0.3031 +/- 0.0000 | +| zinc-cycle56 | pna | 1 | 0.1565 +/- 0.0000 | 0.1539 +/- 0.0000 | +| zinc-cycle56 | resgated | 1 | 0.3183 +/- 0.0000 | 0.3168 +/- 0.0000 | +| zinc-cycle56 | sgc | 1 | 0.6287 +/- 0.0000 | 0.6432 +/- 0.0000 | +| zinc-cycle56 | tag | 1 | 0.2889 +/- 0.0000 | 0.2831 +/- 0.0000 | +| zinc-cycle56 | transformer | 1 | 0.3837 +/- 0.0000 | 0.3760 +/- 0.0000 | + +ZINC-cycle56 delta vs matching classic +| task | backbone | compute | n | val score (improvement) | test score (improvement) | +| --- | --- | --- | --- | --- | --- | +| zinc-cycle56 | appnp | fixed-rrog-T1-ns3+trace | 1 | 0.9730 (0.0310) | 0.9845 (0.0338) | +| zinc-cycle56 | arma | fixed-rrog-T1-ns3+trace | 1 | 0.2414 (0.1042) | 0.2378 (0.1028) | +| zinc-cycle56 | cheb | fixed-rrog-T1-ns3+trace | 1 | 0.2896 (0.1143) | 0.2830 (0.1057) | +| zinc-cycle56 | film | fixed-rrog-T1-ns3+trace | 1 | 0.6898 (-0.1993) | 0.6643 (-0.1646) | +| zinc-cycle56 | gatv2 | fixed-rrog-T1-ns3+trace | 1 | 0.3155 (0.0929) | 0.3121 (0.0891) | +| zinc-cycle56 | gcn | fixed-rrog-T1-ns3+trace | 1 | 0.4380 (0.1441) | 0.4603 (0.1251) | +| zinc-cycle56 | gen | fixed-rrog-T1-ns3+trace | 1 | 0.3554 (0.0407) | 0.3405 (0.0450) | +| zinc-cycle56 | gin | fixed-rrog-T1-ns3+trace | 1 | 0.2269 (0.0711) | 0.2222 (0.0502) | +| zinc-cycle56 | gine | fixed-rrog-T1-ns3+trace | 1 | 0.1641 (0.0745) | 0.1509 (0.0808) | +| zinc-cycle56 | graphconv | fixed-rrog-T1-ns3+trace | 1 | 0.2091 (0.1416) | 0.2060 (0.1402) | +| zinc-cycle56 | graphsage | fixed-rrog-T1-ns3+trace | 1 | 0.3381 (0.0753) | 0.3407 (0.0772) | +| zinc-cycle56 | mf | fixed-rrog-T1-ns3+trace | 1 | 0.1987 (0.1065) | 0.1911 (0.1120) | +| zinc-cycle56 | pna | fixed-rrog-T1-ns3+trace | 1 | 0.1216 (0.0349) | 0.1056 (0.0483) | +| zinc-cycle56 | resgated | fixed-rrog-T1-ns3+trace | 1 | 0.1834 (0.1350) | 0.1765 (0.1403) | +| zinc-cycle56 | sgc | fixed-rrog-T1-ns3+trace | 1 | 0.5008 (0.1278) | 0.5066 (0.1366) | +| zinc-cycle56 | tag | fixed-rrog-T1-ns3+trace | 1 | 0.1410 (0.1479) | 0.1386 (0.1445) | +| zinc-cycle56 | transformer | fixed-rrog-T1-ns3+trace | 1 | 0.3092 (0.0744) | 0.3268 (0.0491) | + +Classic baseline: task x backbone +| task | backbone | metric | n | val | test | +| --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | rocauc | 1 | 0.6564 +/- 0.0000 | 0.7423 +/- 0.0000 | +| ogbg-molbace | arma | rocauc | 1 | 0.6923 +/- 0.0000 | 0.7839 +/- 0.0000 | +| ogbg-molbace | cheb | rocauc | 1 | 0.7267 +/- 0.0000 | 0.7969 +/- 0.0000 | +| ogbg-molbace | film | rocauc | 1 | 0.6703 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molbace | gatv2 | rocauc | 1 | 0.7029 +/- 0.0000 | 0.7400 +/- 0.0000 | +| ogbg-molbace | gcn | rocauc | 1 | 0.6381 +/- 0.0000 | 0.7393 +/- 0.0000 | +| ogbg-molbace | gen | rocauc | 1 | 0.7128 +/- 0.0000 | 0.7326 +/- 0.0000 | +| ogbg-molbace | gin | rocauc | 1 | 0.6520 +/- 0.0000 | 0.7336 +/- 0.0000 | +| ogbg-molbace | gine | rocauc | 1 | 0.6641 +/- 0.0000 | 0.7454 +/- 0.0000 | +| ogbg-molbace | graphconv | rocauc | 1 | 0.7311 +/- 0.0000 | 0.8035 +/- 0.0000 | +| ogbg-molbace | graphsage | rocauc | 1 | 0.6758 +/- 0.0000 | 0.7759 +/- 0.0000 | +| ogbg-molbace | mf | rocauc | 1 | 0.7421 +/- 0.0000 | 0.7760 +/- 0.0000 | +| ogbg-molbace | pna | rocauc | 1 | 0.7516 +/- 0.0000 | 0.6912 +/- 0.0000 | +| ogbg-molbace | resgated | rocauc | 1 | 0.7172 +/- 0.0000 | 0.7877 +/- 0.0000 | +| ogbg-molbace | sgc | rocauc | 1 | 0.6575 +/- 0.0000 | 0.6966 +/- 0.0000 | +| ogbg-molbace | tag | rocauc | 1 | 0.7084 +/- 0.0000 | 0.7345 +/- 0.0000 | +| ogbg-molbace | transformer | rocauc | 1 | 0.6663 +/- 0.0000 | 0.7364 +/- 0.0000 | +| ogbg-molbbbp | appnp | rocauc | 1 | 0.9147 +/- 0.0000 | 0.6388 +/- 0.0000 | +| ogbg-molbbbp | arma | rocauc | 1 | 0.9367 +/- 0.0000 | 0.6651 +/- 0.0000 | +| ogbg-molbbbp | cheb | rocauc | 1 | 0.9452 +/- 0.0000 | 0.6514 +/- 0.0000 | +| ogbg-molbbbp | film | rocauc | 1 | 0.9285 +/- 0.0000 | 0.6300 +/- 0.0000 | +| ogbg-molbbbp | gatv2 | rocauc | 1 | 0.9347 +/- 0.0000 | 0.6324 +/- 0.0000 | +| ogbg-molbbbp | gcn | rocauc | 1 | 0.9386 +/- 0.0000 | 0.6679 +/- 0.0000 | +| ogbg-molbbbp | gen | rocauc | 1 | 0.9549 +/- 0.0000 | 0.6775 +/- 0.0000 | +| ogbg-molbbbp | gin | rocauc | 1 | 0.9251 +/- 0.0000 | 0.5670 +/- 0.0000 | +| ogbg-molbbbp | gine | rocauc | 1 | 0.9324 +/- 0.0000 | 0.6160 +/- 0.0000 | +| ogbg-molbbbp | graphconv | rocauc | 1 | 0.9268 +/- 0.0000 | 0.5900 +/- 0.0000 | +| ogbg-molbbbp | graphsage | rocauc | 1 | 0.9483 +/- 0.0000 | 0.6288 +/- 0.0000 | +| ogbg-molbbbp | mf | rocauc | 1 | 0.9395 +/- 0.0000 | 0.6365 +/- 0.0000 | +| ogbg-molbbbp | pna | rocauc | 1 | 0.9554 +/- 0.0000 | 0.6418 +/- 0.0000 | +| ogbg-molbbbp | resgated | rocauc | 1 | 0.9183 +/- 0.0000 | 0.6626 +/- 0.0000 | +| ogbg-molbbbp | sgc | rocauc | 1 | 0.9300 +/- 0.0000 | 0.6239 +/- 0.0000 | +| ogbg-molbbbp | tag | rocauc | 1 | 0.9476 +/- 0.0000 | 0.6100 +/- 0.0000 | +| ogbg-molbbbp | transformer | rocauc | 1 | 0.9495 +/- 0.0000 | 0.6156 +/- 0.0000 | +| ogbg-molclintox | appnp | rocauc | 1 | 0.8516 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | arma | rocauc | 1 | 0.9463 +/- 0.0000 | 0.8678 +/- 0.0000 | +| ogbg-molclintox | cheb | rocauc | 1 | 0.8928 +/- 0.0000 | 0.9152 +/- 0.0000 | +| ogbg-molclintox | film | rocauc | 1 | 0.9048 +/- 0.0000 | 0.7731 +/- 0.0000 | +| ogbg-molclintox | gatv2 | rocauc | 1 | 0.9515 +/- 0.0000 | 0.8493 +/- 0.0000 | +| ogbg-molclintox | gcn | rocauc | 1 | 0.9318 +/- 0.0000 | 0.8932 +/- 0.0000 | +| ogbg-molclintox | gen | rocauc | 1 | 0.9820 +/- 0.0000 | 0.8128 +/- 0.0000 | +| ogbg-molclintox | gin | rocauc | 1 | 0.9547 +/- 0.0000 | 0.8586 +/- 0.0000 | +| ogbg-molclintox | gine | rocauc | 1 | 0.9353 +/- 0.0000 | 0.8869 +/- 0.0000 | +| ogbg-molclintox | graphconv | rocauc | 1 | 0.8917 +/- 0.0000 | 0.8501 +/- 0.0000 | +| ogbg-molclintox | graphsage | rocauc | 1 | 0.9143 +/- 0.0000 | 0.8882 +/- 0.0000 | +| ogbg-molclintox | mf | rocauc | 1 | 0.9252 +/- 0.0000 | 0.8370 +/- 0.0000 | +| ogbg-molclintox | pna | rocauc | 1 | 0.9286 +/- 0.0000 | 0.8603 +/- 0.0000 | +| ogbg-molclintox | resgated | rocauc | 1 | 0.9244 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | sgc | rocauc | 1 | 0.9195 +/- 0.0000 | 0.8986 +/- 0.0000 | +| ogbg-molclintox | tag | rocauc | 1 | 0.9237 +/- 0.0000 | 0.7998 +/- 0.0000 | +| ogbg-molclintox | transformer | rocauc | 1 | 0.9271 +/- 0.0000 | 0.8764 +/- 0.0000 | +| ogbg-molesol | appnp | rmse | 1 | 1.6083 +/- 0.0000 | 1.5212 +/- 0.0000 | +| ogbg-molesol | arma | rmse | 1 | 1.0195 +/- 0.0000 | 1.0666 +/- 0.0000 | +| ogbg-molesol | cheb | rmse | 1 | 0.9650 +/- 0.0000 | 0.8722 +/- 0.0000 | +| ogbg-molesol | film | rmse | 1 | 1.0718 +/- 0.0000 | 1.2896 +/- 0.0000 | +| ogbg-molesol | gatv2 | rmse | 1 | 1.0368 +/- 0.0000 | 0.9878 +/- 0.0000 | +| ogbg-molesol | gcn | rmse | 1 | 1.0409 +/- 0.0000 | 1.1161 +/- 0.0000 | +| ogbg-molesol | gen | rmse | 1 | 1.0089 +/- 0.0000 | 0.8762 +/- 0.0000 | +| ogbg-molesol | gin | rmse | 1 | 1.0187 +/- 0.0000 | 0.9900 +/- 0.0000 | +| ogbg-molesol | gine | rmse | 1 | 1.0286 +/- 0.0000 | 1.0807 +/- 0.0000 | +| ogbg-molesol | graphconv | rmse | 1 | 0.9741 +/- 0.0000 | 0.9732 +/- 0.0000 | +| ogbg-molesol | graphsage | rmse | 1 | 0.9680 +/- 0.0000 | 1.0038 +/- 0.0000 | +| ogbg-molesol | mf | rmse | 1 | 1.1494 +/- 0.0000 | 1.0639 +/- 0.0000 | +| ogbg-molesol | pna | rmse | 1 | 0.9116 +/- 0.0000 | 0.9153 +/- 0.0000 | +| ogbg-molesol | resgated | rmse | 1 | 0.9492 +/- 0.0000 | 0.8908 +/- 0.0000 | +| ogbg-molesol | sgc | rmse | 1 | 1.0617 +/- 0.0000 | 0.9780 +/- 0.0000 | +| ogbg-molesol | tag | rmse | 1 | 0.9323 +/- 0.0000 | 0.9678 +/- 0.0000 | +| ogbg-molesol | transformer | rmse | 1 | 0.9398 +/- 0.0000 | 0.9492 +/- 0.0000 | +| ogbg-molfreesolv | appnp | rmse | 1 | 6.0462 +/- 0.0000 | 4.6478 +/- 0.0000 | +| ogbg-molfreesolv | arma | rmse | 1 | 4.2662 +/- 0.0000 | 2.9769 +/- 0.0000 | +| ogbg-molfreesolv | cheb | rmse | 1 | 2.9481 +/- 0.0000 | 2.2431 +/- 0.0000 | +| ogbg-molfreesolv | film | rmse | 1 | 3.1546 +/- 0.0000 | 2.9581 +/- 0.0000 | +| ogbg-molfreesolv | gatv2 | rmse | 1 | 4.2086 +/- 0.0000 | 2.7368 +/- 0.0000 | +| ogbg-molfreesolv | gcn | rmse | 1 | 3.7172 +/- 0.0000 | 2.4851 +/- 0.0000 | +| ogbg-molfreesolv | gen | rmse | 1 | 3.9998 +/- 0.0000 | 2.5588 +/- 0.0000 | +| ogbg-molfreesolv | gin | rmse | 1 | 4.0190 +/- 0.0000 | 3.4898 +/- 0.0000 | +| ogbg-molfreesolv | gine | rmse | 1 | 3.2961 +/- 0.0000 | 3.1442 +/- 0.0000 | +| ogbg-molfreesolv | graphconv | rmse | 1 | 2.5314 +/- 0.0000 | 2.7953 +/- 0.0000 | +| ogbg-molfreesolv | graphsage | rmse | 1 | 3.5022 +/- 0.0000 | 2.2977 +/- 0.0000 | +| ogbg-molfreesolv | mf | rmse | 1 | 2.7374 +/- 0.0000 | 2.8885 +/- 0.0000 | +| ogbg-molfreesolv | pna | rmse | 1 | 2.3625 +/- 0.0000 | 2.2610 +/- 0.0000 | +| ogbg-molfreesolv | resgated | rmse | 1 | 2.4772 +/- 0.0000 | 2.0041 +/- 0.0000 | +| ogbg-molfreesolv | sgc | rmse | 1 | 3.9147 +/- 0.0000 | 2.4146 +/- 0.0000 | +| ogbg-molfreesolv | tag | rmse | 1 | 2.6874 +/- 0.0000 | 2.3826 +/- 0.0000 | +| ogbg-molfreesolv | transformer | rmse | 1 | 4.0942 +/- 0.0000 | 2.3205 +/- 0.0000 | +| ogbg-molhiv | appnp | rocauc | 3 | 0.7274 +/- 0.0374 | 0.6982 +/- 0.0073 | +| ogbg-molhiv | arma | rocauc | 3 | 0.7799 +/- 0.0063 | 0.7396 +/- 0.0263 | +| ogbg-molhiv | cheb | rocauc | 3 | 0.7799 +/- 0.0207 | 0.7264 +/- 0.0039 | +| ogbg-molhiv | film | rocauc | 3 | 0.7840 +/- 0.0421 | 0.7505 +/- 0.0298 | +| ogbg-molhiv | gatv2 | rocauc | 3 | 0.7841 +/- 0.0088 | 0.7292 +/- 0.0262 | +| ogbg-molhiv | gcn | rocauc | 3 | 0.7751 +/- 0.0003 | 0.7360 +/- 0.0190 | +| ogbg-molhiv | gen | rocauc | 3 | 0.7626 +/- 0.0141 | 0.7438 +/- 0.0126 | +| ogbg-molhiv | gin | rocauc | 3 | 0.8052 +/- 0.0145 | 0.7600 +/- 0.0179 | +| ogbg-molhiv | gine | rocauc | 3 | 0.7787 +/- 0.0156 | 0.7505 +/- 0.0200 | +| ogbg-molhiv | graphconv | rocauc | 3 | 0.7656 +/- 0.0284 | 0.7330 +/- 0.0222 | +| ogbg-molhiv | graphsage | rocauc | 3 | 0.7865 +/- 0.0102 | 0.7506 +/- 0.0195 | +| ogbg-molhiv | mf | rocauc | 3 | 0.7718 +/- 0.0137 | 0.7352 +/- 0.0319 | +| ogbg-molhiv | pna | rocauc | 3 | 0.7943 +/- 0.0148 | 0.7520 +/- 0.0114 | +| ogbg-molhiv | resgated | rocauc | 3 | 0.7963 +/- 0.0157 | 0.7316 +/- 0.0205 | +| ogbg-molhiv | sgc | rocauc | 3 | 0.7699 +/- 0.0225 | 0.7038 +/- 0.0055 | +| ogbg-molhiv | tag | rocauc | 3 | 0.7488 +/- 0.0133 | 0.7432 +/- 0.0156 | +| ogbg-molhiv | transformer | rocauc | 3 | 0.7668 +/- 0.0086 | 0.7714 +/- 0.0168 | +| ogbg-mollipo | appnp | rmse | 1 | 0.9015 +/- 0.0000 | 0.9070 +/- 0.0000 | +| ogbg-mollipo | arma | rmse | 1 | 0.7325 +/- 0.0000 | 0.7295 +/- 0.0000 | +| ogbg-mollipo | cheb | rmse | 1 | 0.7188 +/- 0.0000 | 0.7180 +/- 0.0000 | +| ogbg-mollipo | film | rmse | 1 | 0.7620 +/- 0.0000 | 0.7371 +/- 0.0000 | +| ogbg-mollipo | gatv2 | rmse | 1 | 0.6865 +/- 0.0000 | 0.7308 +/- 0.0000 | +| ogbg-mollipo | gcn | rmse | 1 | 0.7379 +/- 0.0000 | 0.7828 +/- 0.0000 | +| ogbg-mollipo | gen | rmse | 1 | 0.7046 +/- 0.0000 | 0.7379 +/- 0.0000 | +| ogbg-mollipo | gin | rmse | 1 | 0.6854 +/- 0.0000 | 0.7390 +/- 0.0000 | +| ogbg-mollipo | gine | rmse | 1 | 0.6615 +/- 0.0000 | 0.7341 +/- 0.0000 | +| ogbg-mollipo | graphconv | rmse | 1 | 0.7178 +/- 0.0000 | 0.7297 +/- 0.0000 | +| ogbg-mollipo | graphsage | rmse | 1 | 0.7239 +/- 0.0000 | 0.7783 +/- 0.0000 | +| ogbg-mollipo | mf | rmse | 1 | 0.7129 +/- 0.0000 | 0.7405 +/- 0.0000 | +| ogbg-mollipo | pna | rmse | 1 | 0.7179 +/- 0.0000 | 0.7749 +/- 0.0000 | +| ogbg-mollipo | resgated | rmse | 1 | 0.6721 +/- 0.0000 | 0.7270 +/- 0.0000 | +| ogbg-mollipo | sgc | rmse | 1 | 0.7505 +/- 0.0000 | 0.8176 +/- 0.0000 | +| ogbg-mollipo | tag | rmse | 1 | 0.6692 +/- 0.0000 | 0.7227 +/- 0.0000 | +| ogbg-mollipo | transformer | rmse | 1 | 0.6810 +/- 0.0000 | 0.7346 +/- 0.0000 | +| ogbg-molsider | appnp | rocauc | 1 | 0.5886 +/- 0.0000 | 0.6004 +/- 0.0000 | +| ogbg-molsider | arma | rocauc | 1 | 0.6273 +/- 0.0000 | 0.6159 +/- 0.0000 | +| ogbg-molsider | cheb | rocauc | 1 | 0.6237 +/- 0.0000 | 0.6033 +/- 0.0000 | +| ogbg-molsider | film | rocauc | 1 | 0.6024 +/- 0.0000 | 0.5898 +/- 0.0000 | +| ogbg-molsider | gatv2 | rocauc | 1 | 0.6071 +/- 0.0000 | 0.6013 +/- 0.0000 | +| ogbg-molsider | gcn | rocauc | 1 | 0.6293 +/- 0.0000 | 0.6086 +/- 0.0000 | +| ogbg-molsider | gen | rocauc | 1 | 0.6519 +/- 0.0000 | 0.5854 +/- 0.0000 | +| ogbg-molsider | gin | rocauc | 1 | 0.6225 +/- 0.0000 | 0.5748 +/- 0.0000 | +| ogbg-molsider | gine | rocauc | 1 | 0.6327 +/- 0.0000 | 0.5495 +/- 0.0000 | +| ogbg-molsider | graphconv | rocauc | 1 | 0.5921 +/- 0.0000 | 0.6151 +/- 0.0000 | +| ogbg-molsider | graphsage | rocauc | 1 | 0.6217 +/- 0.0000 | 0.5807 +/- 0.0000 | +| ogbg-molsider | mf | rocauc | 1 | 0.6202 +/- 0.0000 | 0.5861 +/- 0.0000 | +| ogbg-molsider | pna | rocauc | 1 | 0.6219 +/- 0.0000 | 0.5965 +/- 0.0000 | +| ogbg-molsider | resgated | rocauc | 1 | 0.6209 +/- 0.0000 | 0.5910 +/- 0.0000 | +| ogbg-molsider | sgc | rocauc | 1 | 0.6174 +/- 0.0000 | 0.6043 +/- 0.0000 | +| ogbg-molsider | tag | rocauc | 1 | 0.6439 +/- 0.0000 | 0.6143 +/- 0.0000 | +| ogbg-molsider | transformer | rocauc | 1 | 0.6160 +/- 0.0000 | 0.5980 +/- 0.0000 | +| ogbg-moltox21 | appnp | rocauc | 1 | 0.7255 +/- 0.0000 | 0.7158 +/- 0.0000 | +| ogbg-moltox21 | arma | rocauc | 1 | 0.7799 +/- 0.0000 | 0.7223 +/- 0.0000 | +| ogbg-moltox21 | cheb | rocauc | 1 | 0.7834 +/- 0.0000 | 0.7301 +/- 0.0000 | +| ogbg-moltox21 | film | rocauc | 1 | 0.7702 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gatv2 | rocauc | 1 | 0.7627 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gcn | rocauc | 1 | 0.7580 +/- 0.0000 | 0.7171 +/- 0.0000 | +| ogbg-moltox21 | gen | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7444 +/- 0.0000 | +| ogbg-moltox21 | gin | rocauc | 1 | 0.7690 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-moltox21 | gine | rocauc | 1 | 0.7744 +/- 0.0000 | 0.7328 +/- 0.0000 | +| ogbg-moltox21 | graphconv | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7147 +/- 0.0000 | +| ogbg-moltox21 | graphsage | rocauc | 1 | 0.7709 +/- 0.0000 | 0.7196 +/- 0.0000 | +| ogbg-moltox21 | mf | rocauc | 1 | 0.7773 +/- 0.0000 | 0.7281 +/- 0.0000 | +| ogbg-moltox21 | pna | rocauc | 1 | 0.7660 +/- 0.0000 | 0.6946 +/- 0.0000 | +| ogbg-moltox21 | resgated | rocauc | 1 | 0.7950 +/- 0.0000 | 0.7275 +/- 0.0000 | +| ogbg-moltox21 | sgc | rocauc | 1 | 0.7611 +/- 0.0000 | 0.7240 +/- 0.0000 | +| ogbg-moltox21 | tag | rocauc | 1 | 0.7866 +/- 0.0000 | 0.7416 +/- 0.0000 | +| ogbg-moltox21 | transformer | rocauc | 1 | 0.7656 +/- 0.0000 | 0.7309 +/- 0.0000 | + +Delta vs matching classic +| task | backbone | compute | metric | n | val score (delta) | test score (delta) | adaptive test (delta) | steps | +| --- | --- | --- | --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7168 (0.0604) | 0.7209 (-0.0214) | | | +| ogbg-molbace | appnp | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6802 (0.0238) | 0.6834 (-0.0589) | 0.7826 (0.0403) | 2.09 | +| ogbg-molbace | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7179 (0.0256) | 0.7672 (-0.0167) | | | +| ogbg-molbace | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7114 (-0.0154) | 0.7533 (-0.0436) | | | +| ogbg-molbace | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6652 (-0.0051) | 0.7242 (0.0000) | | | +| ogbg-molbace | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7026 (-0.0004) | 0.7519 (0.0118) | | | +| ogbg-molbace | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6374 (-0.0007) | 0.7733 (0.0339) | | | +| ogbg-molbace | gcn | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6615 (0.0234) | 0.4418 (-0.2975) | 0.5363 (-0.2031) | 2.84 | +| ogbg-molbace | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6894 (-0.0234) | 0.7449 (0.0123) | | | +| ogbg-molbace | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6538 (0.0018) | 0.7169 (-0.0167) | | | +| ogbg-molbace | gin | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6630 (0.0110) | 0.7275 (-0.0061) | 0.7369 (0.0033) | 2.05 | +| ogbg-molbace | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6685 (0.0044) | 0.6994 (-0.0461) | | | +| ogbg-molbace | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7462 (0.0150) | 0.7983 (-0.0052) | | | +| ogbg-molbace | graphconv | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6927 (-0.0385) | 0.6736 (-0.1299) | 0.7348 (-0.0687) | 2.00 | +| ogbg-molbace | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6703 (-0.0055) | 0.7119 (-0.0640) | | | +| ogbg-molbace | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7234 (-0.0187) | 0.7684 (-0.0077) | | | +| ogbg-molbace | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7037 (-0.0480) | 0.7967 (0.1055) | | | +| ogbg-molbace | pna | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6590 (-0.0927) | 0.7480 (0.0569) | 0.7547 (0.0635) | 2.63 | +| ogbg-molbace | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6912 (-0.0260) | 0.7465 (-0.0412) | | | +| ogbg-molbace | resgated | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6941 (-0.0231) | 0.7232 (-0.0645) | 0.7640 (-0.0236) | 2.00 | +| ogbg-molbace | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6454 (-0.0121) | 0.7727 (0.0762) | | | +| ogbg-molbace | sgc | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6440 (-0.0136) | 0.7117 (0.0151) | 0.7500 (0.0534) | 2.01 | +| ogbg-molbace | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7355 (0.0271) | 0.6806 (-0.0539) | | | +| ogbg-molbace | tag | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6546 (-0.0538) | 0.8192 (0.0847) | 0.8143 (0.0798) | 2.11 | +| ogbg-molbace | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6982 (0.0319) | 0.7487 (0.0123) | | | +| ogbg-molbbbp | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9360 (0.0213) | 0.6073 (-0.0314) | | | +| ogbg-molbbbp | appnp | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.8797 (-0.0349) | 0.5456 (-0.0932) | 0.5881 (-0.0507) | 2.01 | +| ogbg-molbbbp | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9415 (0.0048) | 0.6635 (-0.0016) | | | +| ogbg-molbbbp | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9278 (-0.0174) | 0.6659 (0.0145) | | | +| ogbg-molbbbp | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9400 (0.0115) | 0.6323 (0.0023) | | | +| ogbg-molbbbp | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9356 (0.0009) | 0.6560 (0.0235) | | | +| ogbg-molbbbp | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9417 (0.0031) | 0.6017 (-0.0663) | | | +| ogbg-molbbbp | gcn | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9429 (0.0044) | 0.6137 (-0.0542) | 0.6758 (0.0079) | 2.00 | +| ogbg-molbbbp | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9429 (-0.0119) | 0.6037 (-0.0738) | | | +| ogbg-molbbbp | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9526 (0.0275) | 0.5932 (0.0261) | | | +| ogbg-molbbbp | gin | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9282 (0.0031) | 0.6619 (0.0949) | 0.6693 (0.1022) | 2.08 | +| ogbg-molbbbp | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9421 (0.0098) | 0.6976 (0.0816) | | | +| ogbg-molbbbp | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9337 (0.0069) | 0.6518 (0.0618) | | | +| ogbg-molbbbp | graphconv | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9056 (-0.0212) | 0.6369 (0.0469) | 0.6416 (0.0516) | 2.12 | +| ogbg-molbbbp | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9502 (0.0019) | 0.5934 (-0.0354) | | | +| ogbg-molbbbp | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9488 (0.0094) | 0.6481 (0.0116) | | | +| ogbg-molbbbp | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9585 (0.0031) | 0.6682 (0.0264) | | | +| ogbg-molbbbp | pna | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9380 (-0.0174) | 0.6539 (0.0122) | 0.6563 (0.0146) | 2.31 | +| ogbg-molbbbp | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9535 (0.0352) | 0.5839 (-0.0787) | | | +| ogbg-molbbbp | resgated | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9499 (0.0317) | 0.6604 (-0.0022) | 0.6677 (0.0051) | 2.34 | +| ogbg-molbbbp | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9285 (-0.0015) | 0.6454 (0.0215) | | | +| ogbg-molbbbp | sgc | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9347 (0.0047) | 0.6516 (0.0277) | 0.6385 (0.0146) | 2.00 | +| ogbg-molbbbp | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9459 (-0.0017) | 0.6420 (0.0320) | | | +| ogbg-molbbbp | tag | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9406 (-0.0071) | 0.6350 (0.0251) | 0.6147 (0.0047) | 2.01 | +| ogbg-molbbbp | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9355 (-0.0140) | 0.6221 (0.0065) | | | +| ogbg-molclintox | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9029 (0.0513) | 0.8898 (-0.0286) | | | +| ogbg-molclintox | appnp | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9391 (0.0875) | 0.8412 (-0.0772) | 0.9026 (-0.0158) | 2.04 | +| ogbg-molclintox | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9135 (-0.0328) | 0.8863 (0.0185) | | | +| ogbg-molclintox | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8816 (-0.0112) | 0.8982 (-0.0170) | | | +| ogbg-molclintox | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9454 (0.0406) | 0.8430 (0.0699) | | | +| ogbg-molclintox | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9351 (-0.0164) | 0.8328 (-0.0164) | | | +| ogbg-molclintox | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9097 (-0.0221) | 0.8792 (-0.0140) | | | +| ogbg-molclintox | gcn | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9759 (0.0440) | 0.8740 (-0.0192) | 0.8683 (-0.0249) | 2.05 | +| ogbg-molclintox | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9399 (-0.0421) | 0.8194 (0.0066) | | | +| ogbg-molclintox | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9164 (-0.0383) | 0.8788 (0.0202) | | | +| ogbg-molclintox | gin | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9257 (-0.0290) | 0.8803 (0.0216) | 0.8739 (0.0153) | 2.07 | +| ogbg-molclintox | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9225 (-0.0127) | 0.8840 (-0.0030) | | | +| ogbg-molclintox | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8494 (-0.0424) | 0.8186 (-0.0316) | | | +| ogbg-molclintox | graphconv | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.8660 (-0.0258) | 0.8054 (-0.0447) | 0.8241 (-0.0260) | 2.21 | +| ogbg-molclintox | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9579 (0.0436) | 0.8664 (-0.0217) | | | +| ogbg-molclintox | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9147 (-0.0104) | 0.8047 (-0.0323) | | | +| ogbg-molclintox | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9064 (-0.0222) | 0.8735 (0.0132) | | | +| ogbg-molclintox | pna | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.8295 (-0.0991) | 0.9034 (0.0431) | 0.9195 (0.0592) | 2.23 | +| ogbg-molclintox | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9055 (-0.0188) | 0.8979 (-0.0205) | | | +| ogbg-molclintox | resgated | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9116 (-0.0128) | 0.8403 (-0.0781) | 0.8416 (-0.0768) | 2.03 | +| ogbg-molclintox | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9220 (0.0025) | 0.9054 (0.0068) | | | +| ogbg-molclintox | sgc | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9309 (0.0114) | 0.8810 (-0.0176) | 0.9033 (0.0047) | 2.09 | +| ogbg-molclintox | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9183 (-0.0054) | 0.8433 (0.0435) | | | +| ogbg-molclintox | tag | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.8679 (-0.0558) | 0.8433 (0.0434) | 0.8345 (0.0347) | 2.00 | +| ogbg-molclintox | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9322 (0.0051) | 0.8522 (-0.0242) | | | +| ogbg-molesol | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 1.4196 (0.1887) | 1.4929 (0.0284) | | | +| ogbg-molesol | arma | fixed-rrog-T1-ns3 | rmse | 1 | 1.0034 (0.0160) | 1.1272 (-0.0606) | | | +| ogbg-molesol | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 0.9199 (0.0451) | 0.8841 (-0.0118) | | | +| ogbg-molesol | film | fixed-rrog-T1-ns3 | rmse | 1 | 1.0196 (0.0521) | 1.0849 (0.2047) | | | +| ogbg-molesol | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 1.0018 (0.0350) | 0.9780 (0.0098) | | | +| ogbg-molesol | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 0.9591 (0.0818) | 0.9305 (0.1856) | | | +| ogbg-molesol | gen | fixed-rrog-T1-ns3 | rmse | 1 | 1.0027 (0.0062) | 0.9206 (-0.0444) | | | +| ogbg-molesol | gin | fixed-rrog-T1-ns3 | rmse | 1 | 0.9647 (0.0540) | 1.0798 (-0.0899) | | | +| ogbg-molesol | gine | fixed-rrog-T1-ns3 | rmse | 1 | 1.0581 (-0.0295) | 1.0951 (-0.0144) | | | +| ogbg-molesol | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 1.0048 (-0.0307) | 0.9968 (-0.0236) | | | +| ogbg-molesol | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 0.9934 (-0.0254) | 1.0794 (-0.0757) | | | +| ogbg-molesol | mf | fixed-rrog-T1-ns3 | rmse | 1 | 1.0553 (0.0942) | 1.0368 (0.0271) | | | +| ogbg-molesol | pna | fixed-rrog-T1-ns3 | rmse | 1 | 0.9841 (-0.0725) | 0.9092 (0.0060) | | | +| ogbg-molesol | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 0.9873 (-0.0382) | 0.8825 (0.0083) | | | +| ogbg-molesol | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 1.0129 (0.0488) | 0.9373 (0.0407) | | | +| ogbg-molesol | tag | fixed-rrog-T1-ns3 | rmse | 1 | 0.9036 (0.0288) | 0.9462 (0.0215) | | | +| ogbg-molesol | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 0.9841 (-0.0443) | 1.0004 (-0.0512) | | | +| ogbg-molfreesolv | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 5.5593 (0.4869) | 3.6549 (0.9928) | | | +| ogbg-molfreesolv | arma | fixed-rrog-T1-ns3 | rmse | 1 | 5.0683 (-0.8021) | 3.6823 (-0.7053) | | | +| ogbg-molfreesolv | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 3.0142 (-0.0662) | 2.2399 (0.0032) | | | +| ogbg-molfreesolv | film | fixed-rrog-T1-ns3 | rmse | 1 | 3.2952 (-0.1406) | 3.3042 (-0.3460) | | | +| ogbg-molfreesolv | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 3.9984 (0.2103) | 2.5966 (0.1403) | | | +| ogbg-molfreesolv | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 3.5888 (0.1285) | 2.4444 (0.0407) | | | +| ogbg-molfreesolv | gen | fixed-rrog-T1-ns3 | rmse | 1 | 4.3009 (-0.3011) | 2.9063 (-0.3476) | | | +| ogbg-molfreesolv | gin | fixed-rrog-T1-ns3 | rmse | 1 | 3.9743 (0.0447) | 3.4292 (0.0607) | | | +| ogbg-molfreesolv | gine | fixed-rrog-T1-ns3 | rmse | 1 | 4.4468 (-1.1508) | 3.7405 (-0.5963) | | | +| ogbg-molfreesolv | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 2.9106 (-0.3792) | 3.1429 (-0.3476) | | | +| ogbg-molfreesolv | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 3.7380 (-0.2358) | 2.1931 (0.1046) | | | +| ogbg-molfreesolv | mf | fixed-rrog-T1-ns3 | rmse | 1 | 2.5060 (0.2313) | 3.1892 (-0.3007) | | | +| ogbg-molfreesolv | pna | fixed-rrog-T1-ns3 | rmse | 1 | 3.3334 (-0.9708) | 2.4279 (-0.1669) | | | +| ogbg-molfreesolv | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 3.0920 (-0.6148) | 2.0244 (-0.0203) | | | +| ogbg-molfreesolv | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 3.9261 (-0.0114) | 2.4887 (-0.0741) | | | +| ogbg-molfreesolv | tag | fixed-rrog-T1-ns3 | rmse | 1 | 2.7359 (-0.0486) | 2.0588 (0.3237) | | | +| ogbg-molfreesolv | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 4.4180 (-0.3237) | 2.4325 (-0.1120) | | | +| ogbg-molhiv | appnp | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7568 (0.0294) | 0.7303 (0.0321) | | | +| ogbg-molhiv | appnp | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7203 (-0.0471) | 0.6825 (-0.0175) | | | +| ogbg-molhiv | appnp | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7324 (-0.0351) | 0.7487 (0.0487) | 0.7287 (0.0287) | 2.01 | +| ogbg-molhiv | arma | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7823 (0.0023) | 0.7120 (-0.0276) | | | +| ogbg-molhiv | arma | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7926 (0.0054) | 0.7318 (0.0021) | | | +| ogbg-molhiv | cheb | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7898 (0.0099) | 0.7347 (0.0083) | | | +| ogbg-molhiv | cheb | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7735 (-0.0096) | 0.7426 (0.0144) | | | +| ogbg-molhiv | film | fixed-rrog-T1-ns3 | rocauc | 3 | 0.8070 (0.0230) | 0.7523 (0.0018) | | | +| ogbg-molhiv | film | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7633 (-0.0288) | 0.7728 (-0.0114) | | | +| ogbg-molhiv | gatv2 | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7734 (-0.0106) | 0.7269 (-0.0023) | | | +| ogbg-molhiv | gatv2 | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7835 (0.0001) | 0.7466 (-0.0096) | | | +| ogbg-molhiv | gcn | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7829 (0.0078) | 0.7386 (0.0026) | | | +| ogbg-molhiv | gcn | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7455 (-0.0300) | 0.7483 (0.0285) | | | +| ogbg-molhiv | gcn | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7713 (-0.0042) | 0.7476 (0.0278) | 0.7388 (0.0190) | 2.01 | +| ogbg-molhiv | gen | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7664 (0.0038) | 0.7487 (0.0049) | | | +| ogbg-molhiv | gen | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8128 (0.0598) | 0.7631 (0.0318) | | | +| ogbg-molhiv | gin | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7710 (-0.0342) | 0.7548 (-0.0052) | | | +| ogbg-molhiv | gin | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7524 (-0.0644) | 0.7324 (-0.0400) | | | +| ogbg-molhiv | gin | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7412 (-0.0755) | 0.7254 (-0.0470) | 0.7567 (-0.0157) | 2.00 | +| ogbg-molhiv | gine | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7646 (-0.0140) | 0.7352 (-0.0153) | | | +| ogbg-molhiv | gine | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7575 (-0.0368) | 0.7401 (-0.0044) | | | +| ogbg-molhiv | graphconv | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7755 (0.0099) | 0.7305 (-0.0025) | | | +| ogbg-molhiv | graphconv | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7713 (0.0006) | 0.6979 (-0.0129) | | | +| ogbg-molhiv | graphconv | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7485 (-0.0222) | 0.7221 (0.0113) | 0.7285 (0.0177) | 2.00 | +| ogbg-molhiv | graphsage | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7860 (-0.0005) | 0.7290 (-0.0216) | | | +| ogbg-molhiv | graphsage | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7587 (-0.0382) | 0.7641 (0.0016) | | | +| ogbg-molhiv | mf | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7826 (0.0109) | 0.7127 (-0.0225) | | | +| ogbg-molhiv | mf | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7931 (0.0085) | 0.7217 (0.0143) | | | +| ogbg-molhiv | pna | fixed-rrog-T1-ns3 | rocauc | 3 | 0.8141 (0.0198) | 0.7503 (-0.0018) | | | +| ogbg-molhiv | pna | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7890 (0.0111) | 0.7630 (-0.0018) | | | +| ogbg-molhiv | pna | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7385 (-0.0395) | 0.7185 (-0.0463) | 0.7421 (-0.0227) | 2.00 | +| ogbg-molhiv | resgated | fixed-rrog-T1-ns3 | rocauc | 3 | 0.8020 (0.0057) | 0.7383 (0.0066) | | | +| ogbg-molhiv | resgated | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8174 (0.0030) | 0.7055 (-0.0187) | | | +| ogbg-molhiv | resgated | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.8010 (-0.0134) | 0.7787 (0.0545) | 0.7876 (0.0634) | 2.00 | +| ogbg-molhiv | sgc | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7643 (-0.0056) | 0.7105 (0.0067) | | | +| ogbg-molhiv | sgc | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7482 (0.0003) | 0.7177 (0.0158) | | | +| ogbg-molhiv | sgc | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7378 (-0.0100) | 0.7036 (0.0017) | 0.7244 (0.0225) | 2.03 | +| ogbg-molhiv | tag | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7554 (0.0066) | 0.7339 (-0.0093) | | | +| ogbg-molhiv | tag | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7804 (0.0276) | 0.7352 (0.0096) | | | +| ogbg-molhiv | tag | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7326 (-0.0202) | 0.7596 (0.0341) | 0.7786 (0.0531) | 2.00 | +| ogbg-molhiv | transformer | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7844 (0.0177) | 0.7637 (-0.0077) | | | +| ogbg-molhiv | transformer | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8088 (0.0471) | 0.7413 (-0.0134) | | | +| ogbg-mollipo | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 0.8393 (0.0622) | 0.9174 (-0.0104) | | | +| ogbg-mollipo | arma | fixed-rrog-T1-ns3 | rmse | 1 | 0.7173 (0.0152) | 0.7548 (-0.0253) | | | +| ogbg-mollipo | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 0.6990 (0.0198) | 0.7132 (0.0048) | | | +| ogbg-mollipo | film | fixed-rrog-T1-ns3 | rmse | 1 | 0.8122 (-0.0502) | 0.7353 (0.0018) | | | +| ogbg-mollipo | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 0.7080 (-0.0215) | 0.7334 (-0.0026) | | | +| ogbg-mollipo | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 0.7730 (-0.0351) | 0.7759 (0.0069) | | | +| ogbg-mollipo | gen | fixed-rrog-T1-ns3 | rmse | 1 | 0.6594 (0.0452) | 0.7456 (-0.0077) | | | +| ogbg-mollipo | gin | fixed-rrog-T1-ns3 | rmse | 1 | 0.6749 (0.0105) | 0.7073 (0.0317) | | | +| ogbg-mollipo | gine | fixed-rrog-T1-ns3 | rmse | 1 | 0.7168 (-0.0553) | 0.7316 (0.0025) | | | +| ogbg-mollipo | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 0.7372 (-0.0195) | 0.7396 (-0.0099) | | | +| ogbg-mollipo | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 0.7184 (0.0055) | 0.7720 (0.0063) | | | +| ogbg-mollipo | mf | fixed-rrog-T1-ns3 | rmse | 1 | 0.7050 (0.0080) | 0.7101 (0.0304) | | | +| ogbg-mollipo | pna | fixed-rrog-T1-ns3 | rmse | 1 | 0.7466 (-0.0287) | 0.7908 (-0.0159) | | | +| ogbg-mollipo | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 0.6766 (-0.0046) | 0.7144 (0.0126) | | | +| ogbg-mollipo | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 0.7537 (-0.0032) | 0.7490 (0.0685) | | | +| ogbg-mollipo | tag | fixed-rrog-T1-ns3 | rmse | 1 | 0.6743 (-0.0052) | 0.7201 (0.0026) | | | +| ogbg-mollipo | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 0.6688 (0.0121) | 0.7396 (-0.0050) | | | +| ogbg-molsider | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.5938 (0.0051) | 0.5905 (-0.0099) | | | +| ogbg-molsider | appnp | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.5933 (0.0047) | 0.5967 (-0.0037) | 0.5964 (-0.0040) | 7.89 | +| ogbg-molsider | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6344 (0.0071) | 0.6141 (-0.0018) | | | +| ogbg-molsider | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6263 (0.0026) | 0.6096 (0.0062) | | | +| ogbg-molsider | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.5862 (-0.0162) | 0.5974 (0.0076) | | | +| ogbg-molsider | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6462 (0.0391) | 0.6000 (-0.0013) | | | +| ogbg-molsider | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6256 (-0.0037) | 0.6117 (0.0031) | | | +| ogbg-molsider | gcn | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6334 (0.0041) | 0.6300 (0.0213) | 0.6306 (0.0219) | 7.91 | +| ogbg-molsider | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6345 (-0.0175) | 0.6053 (0.0199) | | | +| ogbg-molsider | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6046 (-0.0179) | 0.6022 (0.0274) | | | +| ogbg-molsider | gin | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6075 (-0.0150) | 0.5810 (0.0062) | 0.5810 (0.0062) | 8.00 | +| ogbg-molsider | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6151 (-0.0176) | 0.6150 (0.0655) | | | +| ogbg-molsider | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6010 (0.0089) | 0.5963 (-0.0188) | | | +| ogbg-molsider | graphconv | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6223 (0.0303) | 0.6222 (0.0071) | 0.6222 (0.0071) | 8.00 | +| ogbg-molsider | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6232 (0.0015) | 0.5861 (0.0053) | | | +| ogbg-molsider | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6190 (-0.0012) | 0.5983 (0.0122) | | | +| ogbg-molsider | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6058 (-0.0161) | 0.5721 (-0.0243) | | | +| ogbg-molsider | pna | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.5870 (-0.0349) | 0.5962 (-0.0003) | 0.5962 (-0.0003) | 7.96 | +| ogbg-molsider | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6205 (-0.0005) | 0.5960 (0.0050) | | | +| ogbg-molsider | resgated | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6260 (0.0051) | 0.6259 (0.0349) | 0.6259 (0.0349) | 8.00 | +| ogbg-molsider | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6151 (-0.0022) | 0.6417 (0.0375) | | | +| ogbg-molsider | sgc | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.5980 (-0.0194) | 0.6337 (0.0294) | 0.6337 (0.0294) | 8.00 | +| ogbg-molsider | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6410 (-0.0028) | 0.6102 (-0.0041) | | | +| ogbg-molsider | tag | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.5905 (-0.0534) | 0.6216 (0.0073) | 0.6216 (0.0073) | 8.00 | +| ogbg-molsider | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6315 (0.0156) | 0.6190 (0.0210) | | | +| ogbg-moltox21 | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7280 (0.0025) | 0.7154 (-0.0005) | | | +| ogbg-moltox21 | appnp | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7238 (-0.0017) | 0.6823 (-0.0336) | 0.7138 (-0.0021) | 2.63 | +| ogbg-moltox21 | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7771 (-0.0028) | 0.7209 (-0.0014) | | | +| ogbg-moltox21 | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0125) | 0.7286 (-0.0015) | | | +| ogbg-moltox21 | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7727 (0.0025) | 0.7369 (0.0209) | | | +| ogbg-moltox21 | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7762 (0.0135) | 0.7303 (0.0143) | | | +| ogbg-moltox21 | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7588 (0.0007) | 0.7230 (0.0059) | | | +| ogbg-moltox21 | gcn | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7655 (0.0075) | 0.7134 (-0.0037) | 0.7234 (0.0063) | 3.76 | +| ogbg-moltox21 | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7757 (-0.0077) | 0.7312 (-0.0132) | | | +| ogbg-moltox21 | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7718 (0.0028) | 0.7237 (-0.0005) | | | +| ogbg-moltox21 | gin | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7611 (-0.0079) | 0.7090 (-0.0152) | 0.7127 (-0.0115) | 3.83 | +| ogbg-moltox21 | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7622 (-0.0122) | 0.7193 (-0.0135) | | | +| ogbg-moltox21 | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7820 (-0.0011) | 0.7313 (0.0166) | | | +| ogbg-moltox21 | graphconv | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7816 (-0.0015) | 0.7115 (-0.0032) | 0.7191 (0.0043) | 3.21 | +| ogbg-moltox21 | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7697 (-0.0012) | 0.7205 (0.0009) | | | +| ogbg-moltox21 | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7695 (-0.0078) | 0.7279 (-0.0002) | | | +| ogbg-moltox21 | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7745 (0.0085) | 0.7349 (0.0403) | | | +| ogbg-moltox21 | pna | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7547 (-0.0113) | 0.6949 (0.0003) | 0.7075 (0.0129) | 4.22 | +| ogbg-moltox21 | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7887 (-0.0064) | 0.7380 (0.0104) | | | +| ogbg-moltox21 | resgated | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7796 (-0.0154) | 0.7202 (-0.0074) | 0.7224 (-0.0052) | 3.08 | +| ogbg-moltox21 | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7506 (-0.0105) | 0.7355 (0.0115) | | | +| ogbg-moltox21 | sgc | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7779 (0.0168) | 0.7360 (0.0120) | 0.7478 (0.0238) | 3.49 | +| ogbg-moltox21 | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7839 (-0.0027) | 0.7342 (-0.0074) | | | +| ogbg-moltox21 | tag | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7701 (-0.0165) | 0.7163 (-0.0253) | 0.7254 (-0.0161) | 3.51 | +| ogbg-moltox21 | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7761 (0.0105) | 0.7292 (-0.0018) | | | +[gpu3-ablation] phase2 loss target with q_warmup=30, smaller check +[launch] cuda:3: ogbg-molhiv ogbg-molbbbp ogbg-molsider +[task] ogbg-molhiv on cuda:3 +[run] ogbg-molhiv view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.37199 val_adapt_rocauc=0.37199 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep20 val_rocauc=0.52284 val_adapt_rocauc=0.52284 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.50000 val_adapt_rocauc=0.50000 adapt_steps=8.00 halt=0.12 train_steps=4.51 +ep40 val_rocauc=0.73429 val_adapt_rocauc=0.74357 adapt_steps=2.21 halt=0.46 train_steps=1.66 +ep50 val_rocauc=0.74990 val_adapt_rocauc=0.74007 adapt_steps=2.03 halt=0.45 train_steps=1.79 +ep60 val_rocauc=0.73691 val_adapt_rocauc=0.72381 adapt_steps=2.07 halt=0.45 train_steps=1.77 +ep70 val_rocauc=0.77428 val_adapt_rocauc=0.77133 adapt_steps=2.06 halt=0.45 train_steps=1.83 +ep80 val_rocauc=0.76305 val_adapt_rocauc=0.78219 adapt_steps=2.08 halt=0.45 train_steps=1.83 +ep90 val_rocauc=0.75803 val_adapt_rocauc=0.74196 adapt_steps=2.08 halt=0.45 train_steps=1.81 +ep100 val_rocauc=0.75552 val_adapt_rocauc=0.75433 adapt_steps=2.07 halt=0.45 train_steps=1.83 +[ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=70 val={'rocauc': 0.774284122085048} test={'rocauc': 0.6994457212383399} adaptive={'rocauc': 0.6907394889820196} steps=2.0816921954777534 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molhiv view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.61849 val_adapt_rocauc=0.61849 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep20 val_rocauc=0.67236 val_adapt_rocauc=0.67236 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.55443 val_adapt_rocauc=0.55443 adapt_steps=8.00 halt=0.12 train_steps=4.51 +ep40 val_rocauc=0.67669 val_adapt_rocauc=0.68572 adapt_steps=2.04 halt=0.45 train_steps=1.71 +ep50 val_rocauc=0.71379 val_adapt_rocauc=0.74036 adapt_steps=2.05 halt=0.45 train_steps=1.81 +ep60 val_rocauc=0.68323 val_adapt_rocauc=0.73792 adapt_steps=2.07 halt=0.44 train_steps=1.83 +ep70 val_rocauc=0.68205 val_adapt_rocauc=0.70493 adapt_steps=2.07 halt=0.44 train_steps=1.87 +ep80 val_rocauc=0.74377 val_adapt_rocauc=0.75284 adapt_steps=2.09 halt=0.44 train_steps=1.90 +ep90 val_rocauc=0.70841 val_adapt_rocauc=0.73329 adapt_steps=2.08 halt=0.44 train_steps=1.88 +ep100 val_rocauc=0.72274 val_adapt_rocauc=0.73310 adapt_steps=2.10 halt=0.44 train_steps=1.90 +[ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=80 val={'rocauc': 0.7437720458553793} test={'rocauc': 0.7537553834566137} adaptive={'rocauc': 0.7804708472546787} steps=2.135910527595429 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molhiv view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.58438 val_adapt_rocauc=0.58438 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep20 val_rocauc=0.61779 val_adapt_rocauc=0.61779 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.50074 val_adapt_rocauc=0.50074 adapt_steps=8.00 halt=0.12 train_steps=4.51 +ep40 val_rocauc=0.54256 val_adapt_rocauc=0.63047 adapt_steps=2.04 halt=0.46 train_steps=1.69 +ep50 val_rocauc=0.72845 val_adapt_rocauc=0.69057 adapt_steps=2.09 halt=0.45 train_steps=1.76 +ep60 val_rocauc=0.65977 val_adapt_rocauc=0.67932 adapt_steps=2.10 halt=0.45 train_steps=1.79 +ep70 val_rocauc=0.70633 val_adapt_rocauc=0.71830 adapt_steps=2.06 halt=0.44 train_steps=1.83 +ep80 val_rocauc=0.67811 val_adapt_rocauc=0.73880 adapt_steps=2.06 halt=0.45 train_steps=1.81 +ep90 val_rocauc=0.73965 val_adapt_rocauc=0.75724 adapt_steps=2.10 halt=0.45 train_steps=1.83 +ep100 val_rocauc=0.72724 val_adapt_rocauc=0.75658 adapt_steps=2.08 halt=0.45 train_steps=1.82 +[ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=90 val={'rocauc': 0.7396537575935725} test={'rocauc': 0.7500666293284923} adaptive={'rocauc': 0.7314046234960119} steps=2.136883053732069 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molhiv view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.56478 val_adapt_rocauc=0.56478 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep20 val_rocauc=0.54631 val_adapt_rocauc=0.54631 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.50000 val_adapt_rocauc=0.50000 adapt_steps=8.00 halt=0.12 train_steps=4.51 +ep40 val_rocauc=0.67990 val_adapt_rocauc=0.67585 adapt_steps=2.01 halt=0.47 train_steps=1.63 +ep50 val_rocauc=0.65561 val_adapt_rocauc=0.69113 adapt_steps=2.15 halt=0.44 train_steps=1.89 +ep60 val_rocauc=0.72984 val_adapt_rocauc=0.71413 adapt_steps=2.29 halt=0.44 train_steps=1.90 +ep70 val_rocauc=0.70342 val_adapt_rocauc=0.72345 adapt_steps=2.11 halt=0.44 train_steps=1.90 +ep80 val_rocauc=0.71017 val_adapt_rocauc=0.70042 adapt_steps=2.07 halt=0.44 train_steps=1.84 +ep90 val_rocauc=0.71672 val_adapt_rocauc=0.71984 adapt_steps=2.12 halt=0.44 train_steps=1.83 +ep100 val_rocauc=0.71364 val_adapt_rocauc=0.71268 adapt_steps=2.08 halt=0.44 train_steps=1.84 +[ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=60 val={'rocauc': 0.7298433519498334} test={'rocauc': 0.6791286042604143} adaptive={'rocauc': 0.7162469340852469} steps=2.4831023583758816 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molhiv view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.67715 val_adapt_rocauc=0.67715 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep20 val_rocauc=0.50236 val_adapt_rocauc=0.50236 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.50000 val_adapt_rocauc=0.50000 adapt_steps=8.00 halt=0.12 train_steps=4.51 +ep40 val_rocauc=0.73049 val_adapt_rocauc=0.72163 adapt_steps=2.04 halt=0.45 train_steps=1.72 +ep50 val_rocauc=0.70399 val_adapt_rocauc=0.70432 adapt_steps=2.04 halt=0.44 train_steps=1.84 +ep60 val_rocauc=0.74930 val_adapt_rocauc=0.75474 adapt_steps=2.05 halt=0.44 train_steps=1.83 +ep70 val_rocauc=0.73212 val_adapt_rocauc=0.76013 adapt_steps=2.09 halt=0.44 train_steps=1.83 +ep80 val_rocauc=0.75377 val_adapt_rocauc=0.76654 adapt_steps=2.07 halt=0.45 train_steps=1.81 +ep90 val_rocauc=0.75301 val_adapt_rocauc=0.77432 adapt_steps=2.10 halt=0.45 train_steps=1.82 +ep100 val_rocauc=0.73251 val_adapt_rocauc=0.78027 adapt_steps=2.07 halt=0.45 train_steps=1.82 +[ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=80 val={'rocauc': 0.7537722908093278} test={'rocauc': 0.7703277390447865} adaptive={'rocauc': 0.764460495567701} steps=2.0678336980306344 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molhiv view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.67201 val_adapt_rocauc=0.67201 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep20 val_rocauc=0.62233 val_adapt_rocauc=0.62233 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.65638 val_adapt_rocauc=0.65638 adapt_steps=8.00 halt=0.12 train_steps=4.51 +ep40 val_rocauc=0.72057 val_adapt_rocauc=0.68850 adapt_steps=2.16 halt=0.44 train_steps=1.89 +ep50 val_rocauc=0.70843 val_adapt_rocauc=0.70940 adapt_steps=2.15 halt=0.44 train_steps=1.85 +ep60 val_rocauc=0.64904 val_adapt_rocauc=0.64008 adapt_steps=2.15 halt=0.44 train_steps=1.90 +ep70 val_rocauc=0.65729 val_adapt_rocauc=0.64703 adapt_steps=2.09 halt=0.44 train_steps=1.85 +ep80 val_rocauc=0.68292 val_adapt_rocauc=0.68777 adapt_steps=2.09 halt=0.44 train_steps=1.85 +ep90 val_rocauc=0.69379 val_adapt_rocauc=0.68351 adapt_steps=2.09 halt=0.44 train_steps=1.84 +ep100 val_rocauc=0.68502 val_adapt_rocauc=0.67506 adapt_steps=2.09 halt=0.45 train_steps=1.81 +[ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=40 val={'rocauc': 0.720568783068783} test={'rocauc': 0.7274165202108962} adaptive={'rocauc': 0.747511539427181} steps=2.2569900316070997 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[task] ogbg-molbbbp on cuda:3 +[run] ogbg-molbbbp view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.44429 val_adapt_rocauc=0.44429 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep20 val_rocauc=0.86896 val_adapt_rocauc=0.86896 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep30 val_rocauc=0.85911 val_adapt_rocauc=0.85911 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep40 val_rocauc=0.90103 val_adapt_rocauc=0.93627 adapt_steps=3.02 halt=0.35 train_steps=2.59 +ep50 val_rocauc=0.85224 val_adapt_rocauc=0.91536 adapt_steps=3.34 halt=0.30 train_steps=2.99 +ep60 val_rocauc=0.94265 val_adapt_rocauc=0.94404 adapt_steps=3.14 halt=0.36 train_steps=2.40 +ep70 val_rocauc=0.93976 val_adapt_rocauc=0.93936 adapt_steps=2.47 halt=0.36 train_steps=2.46 +ep80 val_rocauc=0.91945 val_adapt_rocauc=0.91546 adapt_steps=2.47 halt=0.37 train_steps=2.42 +ep90 val_rocauc=0.92034 val_adapt_rocauc=0.92194 adapt_steps=2.34 halt=0.38 train_steps=2.37 +ep100 val_rocauc=0.91835 val_adapt_rocauc=0.91855 adapt_steps=2.29 halt=0.37 train_steps=2.31 +[ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=60 val={'rocauc': 0.9426466195359953} test={'rocauc': 0.6331018518518519} adaptive={'rocauc': 0.638406635802469} steps=3.2058823529411766 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molbbbp view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.66982 val_adapt_rocauc=0.66982 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep20 val_rocauc=0.83013 val_adapt_rocauc=0.83013 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep30 val_rocauc=0.91039 val_adapt_rocauc=0.91039 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep40 val_rocauc=0.91805 val_adapt_rocauc=0.92472 adapt_steps=3.05 halt=0.33 train_steps=2.69 +ep50 val_rocauc=0.90451 val_adapt_rocauc=0.92761 adapt_steps=2.40 halt=0.33 train_steps=2.70 +ep60 val_rocauc=0.86080 val_adapt_rocauc=0.91168 adapt_steps=2.52 halt=0.33 train_steps=2.74 +ep70 val_rocauc=0.93438 val_adapt_rocauc=0.93637 adapt_steps=2.38 halt=0.39 train_steps=2.22 +ep80 val_rocauc=0.92761 val_adapt_rocauc=0.93229 adapt_steps=2.22 halt=0.39 train_steps=2.17 +ep90 val_rocauc=0.92462 val_adapt_rocauc=0.92731 adapt_steps=2.14 halt=0.42 train_steps=1.99 +ep100 val_rocauc=0.92881 val_adapt_rocauc=0.93189 adapt_steps=2.14 halt=0.42 train_steps=1.97 +[ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=70 val={'rocauc': 0.9343821567260779} test={'rocauc': 0.6946373456790124} adaptive={'rocauc': 0.6956983024691358} steps=3.0049019607843137 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molbbbp view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.73623 val_adapt_rocauc=0.73623 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep20 val_rocauc=0.90551 val_adapt_rocauc=0.90551 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep30 val_rocauc=0.93329 val_adapt_rocauc=0.93329 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep40 val_rocauc=0.95221 val_adapt_rocauc=0.94633 adapt_steps=2.30 halt=0.36 train_steps=2.50 +ep50 val_rocauc=0.83879 val_adapt_rocauc=0.89077 adapt_steps=2.45 halt=0.38 train_steps=2.43 +ep60 val_rocauc=0.93149 val_adapt_rocauc=0.93657 adapt_steps=2.44 halt=0.38 train_steps=2.33 +ep70 val_rocauc=0.94842 val_adapt_rocauc=0.94982 adapt_steps=2.18 halt=0.41 train_steps=1.99 +ep80 val_rocauc=0.92452 val_adapt_rocauc=0.92960 adapt_steps=2.18 halt=0.43 train_steps=1.93 +ep90 val_rocauc=0.93100 val_adapt_rocauc=0.93269 adapt_steps=2.17 halt=0.44 train_steps=1.85 +ep100 val_rocauc=0.92502 val_adapt_rocauc=0.92522 adapt_steps=2.18 halt=0.44 train_steps=1.84 +[ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=40 val={'rocauc': 0.9522055162799961} test={'rocauc': 0.6266396604938272} adaptive={'rocauc': 0.6264467592592592} steps=2.7892156862745097 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molbbbp view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.35647 val_adapt_rocauc=0.35647 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep20 val_rocauc=0.80783 val_adapt_rocauc=0.80783 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep30 val_rocauc=0.83362 val_adapt_rocauc=0.83362 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep40 val_rocauc=0.90670 val_adapt_rocauc=0.90869 adapt_steps=3.12 halt=0.30 train_steps=2.90 +ep50 val_rocauc=0.91915 val_adapt_rocauc=0.92751 adapt_steps=2.87 halt=0.34 train_steps=2.55 +ep60 val_rocauc=0.93627 val_adapt_rocauc=0.93707 adapt_steps=2.55 halt=0.37 train_steps=2.44 +ep70 val_rocauc=0.95350 val_adapt_rocauc=0.94932 adapt_steps=2.43 halt=0.37 train_steps=2.44 +ep80 val_rocauc=0.92582 val_adapt_rocauc=0.92721 adapt_steps=2.32 halt=0.39 train_steps=2.31 +ep90 val_rocauc=0.92662 val_adapt_rocauc=0.92662 adapt_steps=2.21 halt=0.41 train_steps=2.10 +ep100 val_rocauc=0.94155 val_adapt_rocauc=0.94175 adapt_steps=2.19 halt=0.41 train_steps=2.06 +[ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=70 val={'rocauc': 0.9534999502140795} test={'rocauc': 0.6597222222222222} adaptive={'rocauc': 0.6678240740740741} steps=3.2450980392156863 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molbbbp view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.84039 val_adapt_rocauc=0.84039 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep20 val_rocauc=0.75326 val_adapt_rocauc=0.75326 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep30 val_rocauc=0.87265 val_adapt_rocauc=0.87265 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep40 val_rocauc=0.93976 val_adapt_rocauc=0.93886 adapt_steps=2.80 halt=0.32 train_steps=2.66 +ep50 val_rocauc=0.91805 val_adapt_rocauc=0.93149 adapt_steps=2.47 halt=0.40 train_steps=2.15 +ep60 val_rocauc=0.88619 val_adapt_rocauc=0.89923 adapt_steps=2.45 halt=0.36 train_steps=2.35 +ep70 val_rocauc=0.94324 val_adapt_rocauc=0.94324 adapt_steps=2.54 halt=0.39 train_steps=2.18 +ep80 val_rocauc=0.94952 val_adapt_rocauc=0.95021 adapt_steps=2.11 halt=0.42 train_steps=2.05 +ep90 val_rocauc=0.94623 val_adapt_rocauc=0.95330 adapt_steps=2.09 halt=0.43 train_steps=1.95 +ep100 val_rocauc=0.94524 val_adapt_rocauc=0.95081 adapt_steps=2.14 halt=0.42 train_steps=1.96 +[ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=80 val={'rocauc': 0.9495170765707459} test={'rocauc': 0.6861496913580247} adaptive={'rocauc': 0.6808449074074074} steps=2.7058823529411766 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molbbbp view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.84487 val_adapt_rocauc=0.84487 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep20 val_rocauc=0.83471 val_adapt_rocauc=0.83471 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep30 val_rocauc=0.89664 val_adapt_rocauc=0.89664 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep40 val_rocauc=0.87255 val_adapt_rocauc=0.91128 adapt_steps=2.08 halt=0.46 train_steps=1.69 +ep50 val_rocauc=0.81778 val_adapt_rocauc=0.90391 adapt_steps=2.08 halt=0.44 train_steps=1.83 +ep60 val_rocauc=0.86707 val_adapt_rocauc=0.90909 adapt_steps=2.05 halt=0.45 train_steps=1.73 +ep70 val_rocauc=0.86588 val_adapt_rocauc=0.90282 adapt_steps=2.05 halt=0.45 train_steps=1.71 +ep80 val_rocauc=0.89664 val_adapt_rocauc=0.92423 adapt_steps=2.01 halt=0.47 train_steps=1.61 +ep90 val_rocauc=0.87175 val_adapt_rocauc=0.90750 adapt_steps=2.02 halt=0.47 train_steps=1.67 +ep100 val_rocauc=0.86787 val_adapt_rocauc=0.90670 adapt_steps=2.04 halt=0.47 train_steps=1.62 +[ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=80 val={'rocauc': 0.8966444289554915} test={'rocauc': 0.6170910493827161} adaptive={'rocauc': 0.6361882716049383} steps=2.0049019607843137 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[task] ogbg-molsider on cuda:3 +[run] ogbg-molsider view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.51835 val_adapt_rocauc=0.51835 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.55881 val_adapt_rocauc=0.55881 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.52823 val_adapt_rocauc=0.52823 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.52164 val_adapt_rocauc=0.52164 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.55790 val_adapt_rocauc=0.55790 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.57934 val_adapt_rocauc=0.57937 adapt_steps=7.83 halt=0.12 train_steps=4.46 +ep70 val_rocauc=0.57559 val_adapt_rocauc=0.57449 adapt_steps=7.95 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.60248 val_adapt_rocauc=0.60248 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.58266 val_adapt_rocauc=0.58280 adapt_steps=7.99 halt=0.12 train_steps=4.50 +ep100 val_rocauc=0.59116 val_adapt_rocauc=0.59116 adapt_steps=8.00 halt=0.12 train_steps=4.50 +[ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=80 val={'rocauc': 0.6024836436339023} test={'rocauc': 0.5932734621249586} adaptive={'rocauc': 0.5932734621249586} steps=8.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molsider view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.56195 val_adapt_rocauc=0.56195 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.59090 val_adapt_rocauc=0.59090 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.56785 val_adapt_rocauc=0.56785 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.55460 val_adapt_rocauc=0.55460 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.59103 val_adapt_rocauc=0.59103 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.56623 val_adapt_rocauc=0.56623 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.61162 val_adapt_rocauc=0.61169 adapt_steps=7.98 halt=0.12 train_steps=4.43 +ep80 val_rocauc=0.62851 val_adapt_rocauc=0.62851 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.63179 val_adapt_rocauc=0.63179 adapt_steps=7.99 halt=0.12 train_steps=4.47 +ep100 val_rocauc=0.62571 val_adapt_rocauc=0.62571 adapt_steps=8.00 halt=0.13 train_steps=4.46 +[ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=90 val={'rocauc': 0.6317896497739357} test={'rocauc': 0.640011295277304} adaptive={'rocauc': 0.6402407710265505} steps=7.937062937062937 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molsider view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.52921 val_adapt_rocauc=0.52921 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.51742 val_adapt_rocauc=0.51742 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.57194 val_adapt_rocauc=0.57194 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.57726 val_adapt_rocauc=0.57637 adapt_steps=7.68 halt=0.12 train_steps=4.40 +ep50 val_rocauc=0.56214 val_adapt_rocauc=0.56238 adapt_steps=7.98 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.59428 val_adapt_rocauc=0.59428 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.62022 val_adapt_rocauc=0.61898 adapt_steps=7.87 halt=0.12 train_steps=4.42 +ep80 val_rocauc=0.61458 val_adapt_rocauc=0.61451 adapt_steps=7.99 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.62914 val_adapt_rocauc=0.62914 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep100 val_rocauc=0.61681 val_adapt_rocauc=0.61660 adapt_steps=7.94 halt=0.13 train_steps=4.49 +[ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=90 val={'rocauc': 0.6291378293840166} test={'rocauc': 0.622805287595805} adaptive={'rocauc': 0.6223183091184133} steps=7.916083916083916 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molsider view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.53256 val_adapt_rocauc=0.53256 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.54926 val_adapt_rocauc=0.54926 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.54957 val_adapt_rocauc=0.54957 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.51981 val_adapt_rocauc=0.52396 adapt_steps=7.78 halt=0.12 train_steps=4.44 +ep50 val_rocauc=0.60657 val_adapt_rocauc=0.60657 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.58438 val_adapt_rocauc=0.58438 adapt_steps=8.00 halt=0.12 train_steps=4.47 +ep70 val_rocauc=0.57212 val_adapt_rocauc=0.57212 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.58304 val_adapt_rocauc=0.58304 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep90 val_rocauc=0.61059 val_adapt_rocauc=0.61099 adapt_steps=7.98 halt=0.12 train_steps=4.49 +ep100 val_rocauc=0.60016 val_adapt_rocauc=0.60046 adapt_steps=7.99 halt=0.12 train_steps=4.48 +[ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=90 val={'rocauc': 0.6105933624956364} test={'rocauc': 0.624320975867962} adaptive={'rocauc': 0.6243824341662988} steps=7.958041958041958 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molsider view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.53539 val_adapt_rocauc=0.53539 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.54274 val_adapt_rocauc=0.54274 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.56668 val_adapt_rocauc=0.56668 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.58346 val_adapt_rocauc=0.58251 adapt_steps=7.85 halt=0.12 train_steps=4.49 +ep50 val_rocauc=0.57517 val_adapt_rocauc=0.57482 adapt_steps=7.76 halt=0.12 train_steps=4.49 +ep60 val_rocauc=0.57520 val_adapt_rocauc=0.57520 adapt_steps=8.00 halt=0.13 train_steps=4.50 +ep70 val_rocauc=0.58768 val_adapt_rocauc=0.58768 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.60462 val_adapt_rocauc=0.60442 adapt_steps=7.89 halt=0.13 train_steps=4.46 +ep90 val_rocauc=0.60757 val_adapt_rocauc=0.60786 adapt_steps=7.91 halt=0.12 train_steps=4.49 +ep100 val_rocauc=0.61648 val_adapt_rocauc=0.61625 adapt_steps=7.95 halt=0.12 train_steps=4.49 +[ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=100 val={'rocauc': 0.6164847255453625} test={'rocauc': 0.6344146740580251} adaptive={'rocauc': 0.6358083894071243} steps=7.916083916083916 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molsider view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.50415 val_adapt_rocauc=0.50415 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.55422 val_adapt_rocauc=0.55422 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.54565 val_adapt_rocauc=0.54565 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.56511 val_adapt_rocauc=0.56078 adapt_steps=7.85 halt=0.13 train_steps=4.44 +ep50 val_rocauc=0.55631 val_adapt_rocauc=0.55109 adapt_steps=7.76 halt=0.13 train_steps=4.48 +ep60 val_rocauc=0.57521 val_adapt_rocauc=0.56829 adapt_steps=7.38 halt=0.13 train_steps=4.46 +ep70 val_rocauc=0.56234 val_adapt_rocauc=0.54971 adapt_steps=7.09 halt=0.13 train_steps=4.41 +ep80 val_rocauc=0.58328 val_adapt_rocauc=0.57728 adapt_steps=7.38 halt=0.13 train_steps=4.44 +ep90 val_rocauc=0.58378 val_adapt_rocauc=0.56802 adapt_steps=7.01 halt=0.13 train_steps=4.39 +ep100 val_rocauc=0.58739 val_adapt_rocauc=0.57353 adapt_steps=7.03 halt=0.13 train_steps=4.38 +[ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=100 val={'rocauc': 0.5873882396417854} test={'rocauc': 0.5819785573765826} adaptive={'rocauc': 0.5894161989454557} steps=7.13986013986014 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[done] collecting summaries + +ZINC-cycle56 classic baseline +| task | backbone | n | val MAE-sum | test MAE-sum | +| --- | --- | --- | --- | --- | +| zinc-cycle56 | appnp | 1 | 1.0040 +/- 0.0000 | 1.0183 +/- 0.0000 | +| zinc-cycle56 | arma | 1 | 0.3456 +/- 0.0000 | 0.3406 +/- 0.0000 | +| zinc-cycle56 | cheb | 1 | 0.4038 +/- 0.0000 | 0.3887 +/- 0.0000 | +| zinc-cycle56 | film | 1 | 0.4906 +/- 0.0000 | 0.4998 +/- 0.0000 | +| zinc-cycle56 | gatv2 | 1 | 0.4084 +/- 0.0000 | 0.4012 +/- 0.0000 | +| zinc-cycle56 | gcn | 1 | 0.5821 +/- 0.0000 | 0.5854 +/- 0.0000 | +| zinc-cycle56 | gen | 1 | 0.3961 +/- 0.0000 | 0.3854 +/- 0.0000 | +| zinc-cycle56 | gin | 1 | 0.2981 +/- 0.0000 | 0.2725 +/- 0.0000 | +| zinc-cycle56 | gine | 1 | 0.2387 +/- 0.0000 | 0.2317 +/- 0.0000 | +| zinc-cycle56 | graphconv | 1 | 0.3507 +/- 0.0000 | 0.3462 +/- 0.0000 | +| zinc-cycle56 | graphsage | 1 | 0.4134 +/- 0.0000 | 0.4179 +/- 0.0000 | +| zinc-cycle56 | mf | 1 | 0.3051 +/- 0.0000 | 0.3031 +/- 0.0000 | +| zinc-cycle56 | pna | 1 | 0.1565 +/- 0.0000 | 0.1539 +/- 0.0000 | +| zinc-cycle56 | resgated | 1 | 0.3183 +/- 0.0000 | 0.3168 +/- 0.0000 | +| zinc-cycle56 | sgc | 1 | 0.6287 +/- 0.0000 | 0.6432 +/- 0.0000 | +| zinc-cycle56 | tag | 1 | 0.2889 +/- 0.0000 | 0.2831 +/- 0.0000 | +| zinc-cycle56 | transformer | 1 | 0.3837 +/- 0.0000 | 0.3760 +/- 0.0000 | + +ZINC-cycle56 delta vs matching classic +| task | backbone | compute | n | val score (improvement) | test score (improvement) | +| --- | --- | --- | --- | --- | --- | +| zinc-cycle56 | appnp | fixed-rrog-T1-ns3+trace | 1 | 0.9730 (0.0310) | 0.9845 (0.0338) | +| zinc-cycle56 | arma | fixed-rrog-T1-ns3+trace | 1 | 0.2414 (0.1042) | 0.2378 (0.1028) | +| zinc-cycle56 | cheb | fixed-rrog-T1-ns3+trace | 1 | 0.2896 (0.1143) | 0.2830 (0.1057) | +| zinc-cycle56 | film | fixed-rrog-T1-ns3+trace | 1 | 0.6898 (-0.1993) | 0.6643 (-0.1646) | +| zinc-cycle56 | gatv2 | fixed-rrog-T1-ns3+trace | 1 | 0.3155 (0.0929) | 0.3121 (0.0891) | +| zinc-cycle56 | gcn | fixed-rrog-T1-ns3+trace | 1 | 0.4380 (0.1441) | 0.4603 (0.1251) | +| zinc-cycle56 | gen | fixed-rrog-T1-ns3+trace | 1 | 0.3554 (0.0407) | 0.3405 (0.0450) | +| zinc-cycle56 | gin | fixed-rrog-T1-ns3+trace | 1 | 0.2269 (0.0711) | 0.2222 (0.0502) | +| zinc-cycle56 | gine | fixed-rrog-T1-ns3+trace | 1 | 0.1641 (0.0745) | 0.1509 (0.0808) | +| zinc-cycle56 | graphconv | fixed-rrog-T1-ns3+trace | 1 | 0.2091 (0.1416) | 0.2060 (0.1402) | +| zinc-cycle56 | graphsage | fixed-rrog-T1-ns3+trace | 1 | 0.3381 (0.0753) | 0.3407 (0.0772) | +| zinc-cycle56 | mf | fixed-rrog-T1-ns3+trace | 1 | 0.1987 (0.1065) | 0.1911 (0.1120) | +| zinc-cycle56 | pna | fixed-rrog-T1-ns3+trace | 1 | 0.1216 (0.0349) | 0.1056 (0.0483) | +| zinc-cycle56 | resgated | fixed-rrog-T1-ns3+trace | 1 | 0.1834 (0.1350) | 0.1765 (0.1403) | +| zinc-cycle56 | sgc | fixed-rrog-T1-ns3+trace | 1 | 0.5008 (0.1278) | 0.5066 (0.1366) | +| zinc-cycle56 | tag | fixed-rrog-T1-ns3+trace | 1 | 0.1410 (0.1479) | 0.1386 (0.1445) | +| zinc-cycle56 | transformer | fixed-rrog-T1-ns3+trace | 1 | 0.3092 (0.0744) | 0.3268 (0.0491) | + +Classic baseline: task x backbone +| task | backbone | metric | n | val | test | +| --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | rocauc | 1 | 0.6564 +/- 0.0000 | 0.7423 +/- 0.0000 | +| ogbg-molbace | arma | rocauc | 1 | 0.6923 +/- 0.0000 | 0.7839 +/- 0.0000 | +| ogbg-molbace | cheb | rocauc | 1 | 0.7267 +/- 0.0000 | 0.7969 +/- 0.0000 | +| ogbg-molbace | film | rocauc | 1 | 0.6703 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molbace | gatv2 | rocauc | 1 | 0.7029 +/- 0.0000 | 0.7400 +/- 0.0000 | +| ogbg-molbace | gcn | rocauc | 1 | 0.6381 +/- 0.0000 | 0.7393 +/- 0.0000 | +| ogbg-molbace | gen | rocauc | 1 | 0.7128 +/- 0.0000 | 0.7326 +/- 0.0000 | +| ogbg-molbace | gin | rocauc | 1 | 0.6520 +/- 0.0000 | 0.7336 +/- 0.0000 | +| ogbg-molbace | gine | rocauc | 1 | 0.6641 +/- 0.0000 | 0.7454 +/- 0.0000 | +| ogbg-molbace | graphconv | rocauc | 1 | 0.7311 +/- 0.0000 | 0.8035 +/- 0.0000 | +| ogbg-molbace | graphsage | rocauc | 1 | 0.6758 +/- 0.0000 | 0.7759 +/- 0.0000 | +| ogbg-molbace | mf | rocauc | 1 | 0.7421 +/- 0.0000 | 0.7760 +/- 0.0000 | +| ogbg-molbace | pna | rocauc | 1 | 0.7516 +/- 0.0000 | 0.6912 +/- 0.0000 | +| ogbg-molbace | resgated | rocauc | 1 | 0.7172 +/- 0.0000 | 0.7877 +/- 0.0000 | +| ogbg-molbace | sgc | rocauc | 1 | 0.6575 +/- 0.0000 | 0.6966 +/- 0.0000 | +| ogbg-molbace | tag | rocauc | 1 | 0.7084 +/- 0.0000 | 0.7345 +/- 0.0000 | +| ogbg-molbace | transformer | rocauc | 1 | 0.6663 +/- 0.0000 | 0.7364 +/- 0.0000 | +| ogbg-molbbbp | appnp | rocauc | 1 | 0.9147 +/- 0.0000 | 0.6388 +/- 0.0000 | +| ogbg-molbbbp | arma | rocauc | 1 | 0.9367 +/- 0.0000 | 0.6651 +/- 0.0000 | +| ogbg-molbbbp | cheb | rocauc | 1 | 0.9452 +/- 0.0000 | 0.6514 +/- 0.0000 | +| ogbg-molbbbp | film | rocauc | 1 | 0.9285 +/- 0.0000 | 0.6300 +/- 0.0000 | +| ogbg-molbbbp | gatv2 | rocauc | 1 | 0.9347 +/- 0.0000 | 0.6324 +/- 0.0000 | +| ogbg-molbbbp | gcn | rocauc | 1 | 0.9386 +/- 0.0000 | 0.6679 +/- 0.0000 | +| ogbg-molbbbp | gen | rocauc | 1 | 0.9549 +/- 0.0000 | 0.6775 +/- 0.0000 | +| ogbg-molbbbp | gin | rocauc | 1 | 0.9251 +/- 0.0000 | 0.5670 +/- 0.0000 | +| ogbg-molbbbp | gine | rocauc | 1 | 0.9324 +/- 0.0000 | 0.6160 +/- 0.0000 | +| ogbg-molbbbp | graphconv | rocauc | 1 | 0.9268 +/- 0.0000 | 0.5900 +/- 0.0000 | +| ogbg-molbbbp | graphsage | rocauc | 1 | 0.9483 +/- 0.0000 | 0.6288 +/- 0.0000 | +| ogbg-molbbbp | mf | rocauc | 1 | 0.9395 +/- 0.0000 | 0.6365 +/- 0.0000 | +| ogbg-molbbbp | pna | rocauc | 1 | 0.9554 +/- 0.0000 | 0.6418 +/- 0.0000 | +| ogbg-molbbbp | resgated | rocauc | 1 | 0.9183 +/- 0.0000 | 0.6626 +/- 0.0000 | +| ogbg-molbbbp | sgc | rocauc | 1 | 0.9300 +/- 0.0000 | 0.6239 +/- 0.0000 | +| ogbg-molbbbp | tag | rocauc | 1 | 0.9476 +/- 0.0000 | 0.6100 +/- 0.0000 | +| ogbg-molbbbp | transformer | rocauc | 1 | 0.9495 +/- 0.0000 | 0.6156 +/- 0.0000 | +| ogbg-molclintox | appnp | rocauc | 1 | 0.8516 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | arma | rocauc | 1 | 0.9463 +/- 0.0000 | 0.8678 +/- 0.0000 | +| ogbg-molclintox | cheb | rocauc | 1 | 0.8928 +/- 0.0000 | 0.9152 +/- 0.0000 | +| ogbg-molclintox | film | rocauc | 1 | 0.9048 +/- 0.0000 | 0.7731 +/- 0.0000 | +| ogbg-molclintox | gatv2 | rocauc | 1 | 0.9515 +/- 0.0000 | 0.8493 +/- 0.0000 | +| ogbg-molclintox | gcn | rocauc | 1 | 0.9318 +/- 0.0000 | 0.8932 +/- 0.0000 | +| ogbg-molclintox | gen | rocauc | 1 | 0.9820 +/- 0.0000 | 0.8128 +/- 0.0000 | +| ogbg-molclintox | gin | rocauc | 1 | 0.9547 +/- 0.0000 | 0.8586 +/- 0.0000 | +| ogbg-molclintox | gine | rocauc | 1 | 0.9353 +/- 0.0000 | 0.8869 +/- 0.0000 | +| ogbg-molclintox | graphconv | rocauc | 1 | 0.8917 +/- 0.0000 | 0.8501 +/- 0.0000 | +| ogbg-molclintox | graphsage | rocauc | 1 | 0.9143 +/- 0.0000 | 0.8882 +/- 0.0000 | +| ogbg-molclintox | mf | rocauc | 1 | 0.9252 +/- 0.0000 | 0.8370 +/- 0.0000 | +| ogbg-molclintox | pna | rocauc | 1 | 0.9286 +/- 0.0000 | 0.8603 +/- 0.0000 | +| ogbg-molclintox | resgated | rocauc | 1 | 0.9244 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | sgc | rocauc | 1 | 0.9195 +/- 0.0000 | 0.8986 +/- 0.0000 | +| ogbg-molclintox | tag | rocauc | 1 | 0.9237 +/- 0.0000 | 0.7998 +/- 0.0000 | +| ogbg-molclintox | transformer | rocauc | 1 | 0.9271 +/- 0.0000 | 0.8764 +/- 0.0000 | +| ogbg-molesol | appnp | rmse | 1 | 1.6083 +/- 0.0000 | 1.5212 +/- 0.0000 | +| ogbg-molesol | arma | rmse | 1 | 1.0195 +/- 0.0000 | 1.0666 +/- 0.0000 | +| ogbg-molesol | cheb | rmse | 1 | 0.9650 +/- 0.0000 | 0.8722 +/- 0.0000 | +| ogbg-molesol | film | rmse | 1 | 1.0718 +/- 0.0000 | 1.2896 +/- 0.0000 | +| ogbg-molesol | gatv2 | rmse | 1 | 1.0368 +/- 0.0000 | 0.9878 +/- 0.0000 | +| ogbg-molesol | gcn | rmse | 1 | 1.0409 +/- 0.0000 | 1.1161 +/- 0.0000 | +| ogbg-molesol | gen | rmse | 1 | 1.0089 +/- 0.0000 | 0.8762 +/- 0.0000 | +| ogbg-molesol | gin | rmse | 1 | 1.0187 +/- 0.0000 | 0.9900 +/- 0.0000 | +| ogbg-molesol | gine | rmse | 1 | 1.0286 +/- 0.0000 | 1.0807 +/- 0.0000 | +| ogbg-molesol | graphconv | rmse | 1 | 0.9741 +/- 0.0000 | 0.9732 +/- 0.0000 | +| ogbg-molesol | graphsage | rmse | 1 | 0.9680 +/- 0.0000 | 1.0038 +/- 0.0000 | +| ogbg-molesol | mf | rmse | 1 | 1.1494 +/- 0.0000 | 1.0639 +/- 0.0000 | +| ogbg-molesol | pna | rmse | 1 | 0.9116 +/- 0.0000 | 0.9153 +/- 0.0000 | +| ogbg-molesol | resgated | rmse | 1 | 0.9492 +/- 0.0000 | 0.8908 +/- 0.0000 | +| ogbg-molesol | sgc | rmse | 1 | 1.0617 +/- 0.0000 | 0.9780 +/- 0.0000 | +| ogbg-molesol | tag | rmse | 1 | 0.9323 +/- 0.0000 | 0.9678 +/- 0.0000 | +| ogbg-molesol | transformer | rmse | 1 | 0.9398 +/- 0.0000 | 0.9492 +/- 0.0000 | +| ogbg-molfreesolv | appnp | rmse | 1 | 6.0462 +/- 0.0000 | 4.6478 +/- 0.0000 | +| ogbg-molfreesolv | arma | rmse | 1 | 4.2662 +/- 0.0000 | 2.9769 +/- 0.0000 | +| ogbg-molfreesolv | cheb | rmse | 1 | 2.9481 +/- 0.0000 | 2.2431 +/- 0.0000 | +| ogbg-molfreesolv | film | rmse | 1 | 3.1546 +/- 0.0000 | 2.9581 +/- 0.0000 | +| ogbg-molfreesolv | gatv2 | rmse | 1 | 4.2086 +/- 0.0000 | 2.7368 +/- 0.0000 | +| ogbg-molfreesolv | gcn | rmse | 1 | 3.7172 +/- 0.0000 | 2.4851 +/- 0.0000 | +| ogbg-molfreesolv | gen | rmse | 1 | 3.9998 +/- 0.0000 | 2.5588 +/- 0.0000 | +| ogbg-molfreesolv | gin | rmse | 1 | 4.0190 +/- 0.0000 | 3.4898 +/- 0.0000 | +| ogbg-molfreesolv | gine | rmse | 1 | 3.2961 +/- 0.0000 | 3.1442 +/- 0.0000 | +| ogbg-molfreesolv | graphconv | rmse | 1 | 2.5314 +/- 0.0000 | 2.7953 +/- 0.0000 | +| ogbg-molfreesolv | graphsage | rmse | 1 | 3.5022 +/- 0.0000 | 2.2977 +/- 0.0000 | +| ogbg-molfreesolv | mf | rmse | 1 | 2.7374 +/- 0.0000 | 2.8885 +/- 0.0000 | +| ogbg-molfreesolv | pna | rmse | 1 | 2.3625 +/- 0.0000 | 2.2610 +/- 0.0000 | +| ogbg-molfreesolv | resgated | rmse | 1 | 2.4772 +/- 0.0000 | 2.0041 +/- 0.0000 | +| ogbg-molfreesolv | sgc | rmse | 1 | 3.9147 +/- 0.0000 | 2.4146 +/- 0.0000 | +| ogbg-molfreesolv | tag | rmse | 1 | 2.6874 +/- 0.0000 | 2.3826 +/- 0.0000 | +| ogbg-molfreesolv | transformer | rmse | 1 | 4.0942 +/- 0.0000 | 2.3205 +/- 0.0000 | +| ogbg-molhiv | appnp | rocauc | 3 | 0.7274 +/- 0.0374 | 0.6982 +/- 0.0073 | +| ogbg-molhiv | arma | rocauc | 3 | 0.7799 +/- 0.0063 | 0.7396 +/- 0.0263 | +| ogbg-molhiv | cheb | rocauc | 3 | 0.7799 +/- 0.0207 | 0.7264 +/- 0.0039 | +| ogbg-molhiv | film | rocauc | 3 | 0.7840 +/- 0.0421 | 0.7505 +/- 0.0298 | +| ogbg-molhiv | gatv2 | rocauc | 3 | 0.7841 +/- 0.0088 | 0.7292 +/- 0.0262 | +| ogbg-molhiv | gcn | rocauc | 3 | 0.7751 +/- 0.0003 | 0.7360 +/- 0.0190 | +| ogbg-molhiv | gen | rocauc | 3 | 0.7626 +/- 0.0141 | 0.7438 +/- 0.0126 | +| ogbg-molhiv | gin | rocauc | 3 | 0.8052 +/- 0.0145 | 0.7600 +/- 0.0179 | +| ogbg-molhiv | gine | rocauc | 3 | 0.7787 +/- 0.0156 | 0.7505 +/- 0.0200 | +| ogbg-molhiv | graphconv | rocauc | 3 | 0.7656 +/- 0.0284 | 0.7330 +/- 0.0222 | +| ogbg-molhiv | graphsage | rocauc | 3 | 0.7865 +/- 0.0102 | 0.7506 +/- 0.0195 | +| ogbg-molhiv | mf | rocauc | 3 | 0.7718 +/- 0.0137 | 0.7352 +/- 0.0319 | +| ogbg-molhiv | pna | rocauc | 3 | 0.7943 +/- 0.0148 | 0.7520 +/- 0.0114 | +| ogbg-molhiv | resgated | rocauc | 3 | 0.7963 +/- 0.0157 | 0.7316 +/- 0.0205 | +| ogbg-molhiv | sgc | rocauc | 3 | 0.7699 +/- 0.0225 | 0.7038 +/- 0.0055 | +| ogbg-molhiv | tag | rocauc | 3 | 0.7488 +/- 0.0133 | 0.7432 +/- 0.0156 | +| ogbg-molhiv | transformer | rocauc | 3 | 0.7668 +/- 0.0086 | 0.7714 +/- 0.0168 | +| ogbg-mollipo | appnp | rmse | 1 | 0.9015 +/- 0.0000 | 0.9070 +/- 0.0000 | +| ogbg-mollipo | arma | rmse | 1 | 0.7325 +/- 0.0000 | 0.7295 +/- 0.0000 | +| ogbg-mollipo | cheb | rmse | 1 | 0.7188 +/- 0.0000 | 0.7180 +/- 0.0000 | +| ogbg-mollipo | film | rmse | 1 | 0.7620 +/- 0.0000 | 0.7371 +/- 0.0000 | +| ogbg-mollipo | gatv2 | rmse | 1 | 0.6865 +/- 0.0000 | 0.7308 +/- 0.0000 | +| ogbg-mollipo | gcn | rmse | 1 | 0.7379 +/- 0.0000 | 0.7828 +/- 0.0000 | +| ogbg-mollipo | gen | rmse | 1 | 0.7046 +/- 0.0000 | 0.7379 +/- 0.0000 | +| ogbg-mollipo | gin | rmse | 1 | 0.6854 +/- 0.0000 | 0.7390 +/- 0.0000 | +| ogbg-mollipo | gine | rmse | 1 | 0.6615 +/- 0.0000 | 0.7341 +/- 0.0000 | +| ogbg-mollipo | graphconv | rmse | 1 | 0.7178 +/- 0.0000 | 0.7297 +/- 0.0000 | +| ogbg-mollipo | graphsage | rmse | 1 | 0.7239 +/- 0.0000 | 0.7783 +/- 0.0000 | +| ogbg-mollipo | mf | rmse | 1 | 0.7129 +/- 0.0000 | 0.7405 +/- 0.0000 | +| ogbg-mollipo | pna | rmse | 1 | 0.7179 +/- 0.0000 | 0.7749 +/- 0.0000 | +| ogbg-mollipo | resgated | rmse | 1 | 0.6721 +/- 0.0000 | 0.7270 +/- 0.0000 | +| ogbg-mollipo | sgc | rmse | 1 | 0.7505 +/- 0.0000 | 0.8176 +/- 0.0000 | +| ogbg-mollipo | tag | rmse | 1 | 0.6692 +/- 0.0000 | 0.7227 +/- 0.0000 | +| ogbg-mollipo | transformer | rmse | 1 | 0.6810 +/- 0.0000 | 0.7346 +/- 0.0000 | +| ogbg-molsider | appnp | rocauc | 1 | 0.5886 +/- 0.0000 | 0.6004 +/- 0.0000 | +| ogbg-molsider | arma | rocauc | 1 | 0.6273 +/- 0.0000 | 0.6159 +/- 0.0000 | +| ogbg-molsider | cheb | rocauc | 1 | 0.6237 +/- 0.0000 | 0.6033 +/- 0.0000 | +| ogbg-molsider | film | rocauc | 1 | 0.6024 +/- 0.0000 | 0.5898 +/- 0.0000 | +| ogbg-molsider | gatv2 | rocauc | 1 | 0.6071 +/- 0.0000 | 0.6013 +/- 0.0000 | +| ogbg-molsider | gcn | rocauc | 1 | 0.6293 +/- 0.0000 | 0.6086 +/- 0.0000 | +| ogbg-molsider | gen | rocauc | 1 | 0.6519 +/- 0.0000 | 0.5854 +/- 0.0000 | +| ogbg-molsider | gin | rocauc | 1 | 0.6225 +/- 0.0000 | 0.5748 +/- 0.0000 | +| ogbg-molsider | gine | rocauc | 1 | 0.6327 +/- 0.0000 | 0.5495 +/- 0.0000 | +| ogbg-molsider | graphconv | rocauc | 1 | 0.5921 +/- 0.0000 | 0.6151 +/- 0.0000 | +| ogbg-molsider | graphsage | rocauc | 1 | 0.6217 +/- 0.0000 | 0.5807 +/- 0.0000 | +| ogbg-molsider | mf | rocauc | 1 | 0.6202 +/- 0.0000 | 0.5861 +/- 0.0000 | +| ogbg-molsider | pna | rocauc | 1 | 0.6219 +/- 0.0000 | 0.5965 +/- 0.0000 | +| ogbg-molsider | resgated | rocauc | 1 | 0.6209 +/- 0.0000 | 0.5910 +/- 0.0000 | +| ogbg-molsider | sgc | rocauc | 1 | 0.6174 +/- 0.0000 | 0.6043 +/- 0.0000 | +| ogbg-molsider | tag | rocauc | 1 | 0.6439 +/- 0.0000 | 0.6143 +/- 0.0000 | +| ogbg-molsider | transformer | rocauc | 1 | 0.6160 +/- 0.0000 | 0.5980 +/- 0.0000 | +| ogbg-moltox21 | appnp | rocauc | 1 | 0.7255 +/- 0.0000 | 0.7158 +/- 0.0000 | +| ogbg-moltox21 | arma | rocauc | 1 | 0.7799 +/- 0.0000 | 0.7223 +/- 0.0000 | +| ogbg-moltox21 | cheb | rocauc | 1 | 0.7834 +/- 0.0000 | 0.7301 +/- 0.0000 | +| ogbg-moltox21 | film | rocauc | 1 | 0.7702 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gatv2 | rocauc | 1 | 0.7627 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gcn | rocauc | 1 | 0.7580 +/- 0.0000 | 0.7171 +/- 0.0000 | +| ogbg-moltox21 | gen | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7444 +/- 0.0000 | +| ogbg-moltox21 | gin | rocauc | 1 | 0.7690 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-moltox21 | gine | rocauc | 1 | 0.7744 +/- 0.0000 | 0.7328 +/- 0.0000 | +| ogbg-moltox21 | graphconv | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7147 +/- 0.0000 | +| ogbg-moltox21 | graphsage | rocauc | 1 | 0.7709 +/- 0.0000 | 0.7196 +/- 0.0000 | +| ogbg-moltox21 | mf | rocauc | 1 | 0.7773 +/- 0.0000 | 0.7281 +/- 0.0000 | +| ogbg-moltox21 | pna | rocauc | 1 | 0.7660 +/- 0.0000 | 0.6946 +/- 0.0000 | +| ogbg-moltox21 | resgated | rocauc | 1 | 0.7950 +/- 0.0000 | 0.7275 +/- 0.0000 | +| ogbg-moltox21 | sgc | rocauc | 1 | 0.7611 +/- 0.0000 | 0.7240 +/- 0.0000 | +| ogbg-moltox21 | tag | rocauc | 1 | 0.7866 +/- 0.0000 | 0.7416 +/- 0.0000 | +| ogbg-moltox21 | transformer | rocauc | 1 | 0.7656 +/- 0.0000 | 0.7309 +/- 0.0000 | + +Delta vs matching classic +| task | backbone | compute | metric | n | val score (delta) | test score (delta) | adaptive test (delta) | steps | +| --- | --- | --- | --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7168 (0.0604) | 0.7209 (-0.0214) | | | +| ogbg-molbace | appnp | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6802 (0.0238) | 0.6834 (-0.0589) | 0.7826 (0.0403) | 2.09 | +| ogbg-molbace | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7179 (0.0256) | 0.7672 (-0.0167) | | | +| ogbg-molbace | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7114 (-0.0154) | 0.7533 (-0.0436) | | | +| ogbg-molbace | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6652 (-0.0051) | 0.7242 (0.0000) | | | +| ogbg-molbace | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7026 (-0.0004) | 0.7519 (0.0118) | | | +| ogbg-molbace | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6374 (-0.0007) | 0.7733 (0.0339) | | | +| ogbg-molbace | gcn | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6615 (0.0234) | 0.4418 (-0.2975) | 0.5363 (-0.2031) | 2.84 | +| ogbg-molbace | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6894 (-0.0234) | 0.7449 (0.0123) | | | +| ogbg-molbace | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6538 (0.0018) | 0.7169 (-0.0167) | | | +| ogbg-molbace | gin | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6630 (0.0110) | 0.7275 (-0.0061) | 0.7369 (0.0033) | 2.05 | +| ogbg-molbace | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6685 (0.0044) | 0.6994 (-0.0461) | | | +| ogbg-molbace | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7462 (0.0150) | 0.7983 (-0.0052) | | | +| ogbg-molbace | graphconv | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6927 (-0.0385) | 0.6736 (-0.1299) | 0.7348 (-0.0687) | 2.00 | +| ogbg-molbace | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6703 (-0.0055) | 0.7119 (-0.0640) | | | +| ogbg-molbace | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7234 (-0.0187) | 0.7684 (-0.0077) | | | +| ogbg-molbace | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7037 (-0.0480) | 0.7967 (0.1055) | | | +| ogbg-molbace | pna | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6590 (-0.0927) | 0.7480 (0.0569) | 0.7547 (0.0635) | 2.63 | +| ogbg-molbace | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6912 (-0.0260) | 0.7465 (-0.0412) | | | +| ogbg-molbace | resgated | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6941 (-0.0231) | 0.7232 (-0.0645) | 0.7640 (-0.0236) | 2.00 | +| ogbg-molbace | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6454 (-0.0121) | 0.7727 (0.0762) | | | +| ogbg-molbace | sgc | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6440 (-0.0136) | 0.7117 (0.0151) | 0.7500 (0.0534) | 2.01 | +| ogbg-molbace | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7355 (0.0271) | 0.6806 (-0.0539) | | | +| ogbg-molbace | tag | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6546 (-0.0538) | 0.8192 (0.0847) | 0.8143 (0.0798) | 2.11 | +| ogbg-molbace | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6982 (0.0319) | 0.7487 (0.0123) | | | +| ogbg-molbbbp | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9360 (0.0213) | 0.6073 (-0.0314) | | | +| ogbg-molbbbp | appnp | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.8797 (-0.0349) | 0.5456 (-0.0932) | 0.5881 (-0.0507) | 2.01 | +| ogbg-molbbbp | appnp | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw30 | rocauc | 1 | 0.8966 (-0.0180) | 0.6171 (-0.0217) | 0.6362 (-0.0026) | 2.00 | +| ogbg-molbbbp | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9415 (0.0048) | 0.6635 (-0.0016) | | | +| ogbg-molbbbp | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9278 (-0.0174) | 0.6659 (0.0145) | | | +| ogbg-molbbbp | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9400 (0.0115) | 0.6323 (0.0023) | | | +| ogbg-molbbbp | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9356 (0.0009) | 0.6560 (0.0235) | | | +| ogbg-molbbbp | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9417 (0.0031) | 0.6017 (-0.0663) | | | +| ogbg-molbbbp | gcn | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9429 (0.0044) | 0.6137 (-0.0542) | 0.6758 (0.0079) | 2.00 | +| ogbg-molbbbp | gcn | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw30 | rocauc | 1 | 0.9344 (-0.0042) | 0.6946 (0.0267) | 0.6957 (0.0278) | 3.00 | +| ogbg-molbbbp | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9429 (-0.0119) | 0.6037 (-0.0738) | | | +| ogbg-molbbbp | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9526 (0.0275) | 0.5932 (0.0261) | | | +| ogbg-molbbbp | gin | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9282 (0.0031) | 0.6619 (0.0949) | 0.6693 (0.1022) | 2.08 | +| ogbg-molbbbp | gin | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw30 | rocauc | 1 | 0.9426 (0.0175) | 0.6331 (0.0661) | 0.6384 (0.0714) | 3.21 | +| ogbg-molbbbp | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9421 (0.0098) | 0.6976 (0.0816) | | | +| ogbg-molbbbp | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9337 (0.0069) | 0.6518 (0.0618) | | | +| ogbg-molbbbp | graphconv | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9056 (-0.0212) | 0.6369 (0.0469) | 0.6416 (0.0516) | 2.12 | +| ogbg-molbbbp | graphconv | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw30 | rocauc | 1 | 0.9495 (0.0227) | 0.6861 (0.0962) | 0.6808 (0.0909) | 2.71 | +| ogbg-molbbbp | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9502 (0.0019) | 0.5934 (-0.0354) | | | +| ogbg-molbbbp | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9488 (0.0094) | 0.6481 (0.0116) | | | +| ogbg-molbbbp | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9585 (0.0031) | 0.6682 (0.0264) | | | +| ogbg-molbbbp | pna | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9380 (-0.0174) | 0.6539 (0.0122) | 0.6563 (0.0146) | 2.31 | +| ogbg-molbbbp | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9535 (0.0352) | 0.5839 (-0.0787) | | | +| ogbg-molbbbp | resgated | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9499 (0.0317) | 0.6604 (-0.0022) | 0.6677 (0.0051) | 2.34 | +| ogbg-molbbbp | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9285 (-0.0015) | 0.6454 (0.0215) | | | +| ogbg-molbbbp | sgc | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9347 (0.0047) | 0.6516 (0.0277) | 0.6385 (0.0146) | 2.00 | +| ogbg-molbbbp | sgc | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw30 | rocauc | 1 | 0.9522 (0.0222) | 0.6266 (0.0027) | 0.6264 (0.0025) | 2.79 | +| ogbg-molbbbp | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9459 (-0.0017) | 0.6420 (0.0320) | | | +| ogbg-molbbbp | tag | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9406 (-0.0071) | 0.6350 (0.0251) | 0.6147 (0.0047) | 2.01 | +| ogbg-molbbbp | tag | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw30 | rocauc | 1 | 0.9535 (0.0059) | 0.6597 (0.0498) | 0.6678 (0.0579) | 3.25 | +| ogbg-molbbbp | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9355 (-0.0140) | 0.6221 (0.0065) | | | +| ogbg-molclintox | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9029 (0.0513) | 0.8898 (-0.0286) | | | +| ogbg-molclintox | appnp | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9391 (0.0875) | 0.8412 (-0.0772) | 0.9026 (-0.0158) | 2.04 | +| ogbg-molclintox | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9135 (-0.0328) | 0.8863 (0.0185) | | | +| ogbg-molclintox | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8816 (-0.0112) | 0.8982 (-0.0170) | | | +| ogbg-molclintox | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9454 (0.0406) | 0.8430 (0.0699) | | | +| ogbg-molclintox | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9351 (-0.0164) | 0.8328 (-0.0164) | | | +| ogbg-molclintox | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9097 (-0.0221) | 0.8792 (-0.0140) | | | +| ogbg-molclintox | gcn | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9759 (0.0440) | 0.8740 (-0.0192) | 0.8683 (-0.0249) | 2.05 | +| ogbg-molclintox | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9399 (-0.0421) | 0.8194 (0.0066) | | | +| ogbg-molclintox | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9164 (-0.0383) | 0.8788 (0.0202) | | | +| ogbg-molclintox | gin | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9257 (-0.0290) | 0.8803 (0.0216) | 0.8739 (0.0153) | 2.07 | +| ogbg-molclintox | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9225 (-0.0127) | 0.8840 (-0.0030) | | | +| ogbg-molclintox | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8494 (-0.0424) | 0.8186 (-0.0316) | | | +| ogbg-molclintox | graphconv | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.8660 (-0.0258) | 0.8054 (-0.0447) | 0.8241 (-0.0260) | 2.21 | +| ogbg-molclintox | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9579 (0.0436) | 0.8664 (-0.0217) | | | +| ogbg-molclintox | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9147 (-0.0104) | 0.8047 (-0.0323) | | | +| ogbg-molclintox | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9064 (-0.0222) | 0.8735 (0.0132) | | | +| ogbg-molclintox | pna | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.8295 (-0.0991) | 0.9034 (0.0431) | 0.9195 (0.0592) | 2.23 | +| ogbg-molclintox | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9055 (-0.0188) | 0.8979 (-0.0205) | | | +| ogbg-molclintox | resgated | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9116 (-0.0128) | 0.8403 (-0.0781) | 0.8416 (-0.0768) | 2.03 | +| ogbg-molclintox | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9220 (0.0025) | 0.9054 (0.0068) | | | +| ogbg-molclintox | sgc | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9309 (0.0114) | 0.8810 (-0.0176) | 0.9033 (0.0047) | 2.09 | +| ogbg-molclintox | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9183 (-0.0054) | 0.8433 (0.0435) | | | +| ogbg-molclintox | tag | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.8679 (-0.0558) | 0.8433 (0.0434) | 0.8345 (0.0347) | 2.00 | +| ogbg-molclintox | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9322 (0.0051) | 0.8522 (-0.0242) | | | +| ogbg-molesol | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 1.4196 (0.1887) | 1.4929 (0.0284) | | | +| ogbg-molesol | arma | fixed-rrog-T1-ns3 | rmse | 1 | 1.0034 (0.0160) | 1.1272 (-0.0606) | | | +| ogbg-molesol | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 0.9199 (0.0451) | 0.8841 (-0.0118) | | | +| ogbg-molesol | film | fixed-rrog-T1-ns3 | rmse | 1 | 1.0196 (0.0521) | 1.0849 (0.2047) | | | +| ogbg-molesol | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 1.0018 (0.0350) | 0.9780 (0.0098) | | | +| ogbg-molesol | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 0.9591 (0.0818) | 0.9305 (0.1856) | | | +| ogbg-molesol | gen | fixed-rrog-T1-ns3 | rmse | 1 | 1.0027 (0.0062) | 0.9206 (-0.0444) | | | +| ogbg-molesol | gin | fixed-rrog-T1-ns3 | rmse | 1 | 0.9647 (0.0540) | 1.0798 (-0.0899) | | | +| ogbg-molesol | gine | fixed-rrog-T1-ns3 | rmse | 1 | 1.0581 (-0.0295) | 1.0951 (-0.0144) | | | +| ogbg-molesol | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 1.0048 (-0.0307) | 0.9968 (-0.0236) | | | +| ogbg-molesol | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 0.9934 (-0.0254) | 1.0794 (-0.0757) | | | +| ogbg-molesol | mf | fixed-rrog-T1-ns3 | rmse | 1 | 1.0553 (0.0942) | 1.0368 (0.0271) | | | +| ogbg-molesol | pna | fixed-rrog-T1-ns3 | rmse | 1 | 0.9841 (-0.0725) | 0.9092 (0.0060) | | | +| ogbg-molesol | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 0.9873 (-0.0382) | 0.8825 (0.0083) | | | +| ogbg-molesol | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 1.0129 (0.0488) | 0.9373 (0.0407) | | | +| ogbg-molesol | tag | fixed-rrog-T1-ns3 | rmse | 1 | 0.9036 (0.0288) | 0.9462 (0.0215) | | | +| ogbg-molesol | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 0.9841 (-0.0443) | 1.0004 (-0.0512) | | | +| ogbg-molfreesolv | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 5.5593 (0.4869) | 3.6549 (0.9928) | | | +| ogbg-molfreesolv | arma | fixed-rrog-T1-ns3 | rmse | 1 | 5.0683 (-0.8021) | 3.6823 (-0.7053) | | | +| ogbg-molfreesolv | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 3.0142 (-0.0662) | 2.2399 (0.0032) | | | +| ogbg-molfreesolv | film | fixed-rrog-T1-ns3 | rmse | 1 | 3.2952 (-0.1406) | 3.3042 (-0.3460) | | | +| ogbg-molfreesolv | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 3.9984 (0.2103) | 2.5966 (0.1403) | | | +| ogbg-molfreesolv | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 3.5888 (0.1285) | 2.4444 (0.0407) | | | +| ogbg-molfreesolv | gen | fixed-rrog-T1-ns3 | rmse | 1 | 4.3009 (-0.3011) | 2.9063 (-0.3476) | | | +| ogbg-molfreesolv | gin | fixed-rrog-T1-ns3 | rmse | 1 | 3.9743 (0.0447) | 3.4292 (0.0607) | | | +| ogbg-molfreesolv | gine | fixed-rrog-T1-ns3 | rmse | 1 | 4.4468 (-1.1508) | 3.7405 (-0.5963) | | | +| ogbg-molfreesolv | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 2.9106 (-0.3792) | 3.1429 (-0.3476) | | | +| ogbg-molfreesolv | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 3.7380 (-0.2358) | 2.1931 (0.1046) | | | +| ogbg-molfreesolv | mf | fixed-rrog-T1-ns3 | rmse | 1 | 2.5060 (0.2313) | 3.1892 (-0.3007) | | | +| ogbg-molfreesolv | pna | fixed-rrog-T1-ns3 | rmse | 1 | 3.3334 (-0.9708) | 2.4279 (-0.1669) | | | +| ogbg-molfreesolv | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 3.0920 (-0.6148) | 2.0244 (-0.0203) | | | +| ogbg-molfreesolv | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 3.9261 (-0.0114) | 2.4887 (-0.0741) | | | +| ogbg-molfreesolv | tag | fixed-rrog-T1-ns3 | rmse | 1 | 2.7359 (-0.0486) | 2.0588 (0.3237) | | | +| ogbg-molfreesolv | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 4.4180 (-0.3237) | 2.4325 (-0.1120) | | | +| ogbg-molhiv | appnp | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7568 (0.0294) | 0.7303 (0.0321) | | | +| ogbg-molhiv | appnp | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7203 (-0.0471) | 0.6825 (-0.0175) | | | +| ogbg-molhiv | appnp | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7324 (-0.0351) | 0.7487 (0.0487) | 0.7287 (0.0287) | 2.01 | +| ogbg-molhiv | appnp | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw30 | rocauc | 1 | 0.7206 (-0.0469) | 0.7274 (0.0274) | 0.7475 (0.0475) | 2.26 | +| ogbg-molhiv | arma | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7823 (0.0023) | 0.7120 (-0.0276) | | | +| ogbg-molhiv | arma | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7926 (0.0054) | 0.7318 (0.0021) | | | +| ogbg-molhiv | cheb | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7898 (0.0099) | 0.7347 (0.0083) | | | +| ogbg-molhiv | cheb | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7735 (-0.0096) | 0.7426 (0.0144) | | | +| ogbg-molhiv | film | fixed-rrog-T1-ns3 | rocauc | 3 | 0.8070 (0.0230) | 0.7523 (0.0018) | | | +| ogbg-molhiv | film | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7633 (-0.0288) | 0.7728 (-0.0114) | | | +| ogbg-molhiv | gatv2 | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7734 (-0.0106) | 0.7269 (-0.0023) | | | +| ogbg-molhiv | gatv2 | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7835 (0.0001) | 0.7466 (-0.0096) | | | +| ogbg-molhiv | gcn | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7829 (0.0078) | 0.7386 (0.0026) | | | +| ogbg-molhiv | gcn | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7455 (-0.0300) | 0.7483 (0.0285) | | | +| ogbg-molhiv | gcn | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7713 (-0.0042) | 0.7476 (0.0278) | 0.7388 (0.0190) | 2.01 | +| ogbg-molhiv | gcn | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw30 | rocauc | 1 | 0.7438 (-0.0317) | 0.7538 (0.0340) | 0.7805 (0.0607) | 2.14 | +| ogbg-molhiv | gen | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7664 (0.0038) | 0.7487 (0.0049) | | | +| ogbg-molhiv | gen | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8128 (0.0598) | 0.7631 (0.0318) | | | +| ogbg-molhiv | gin | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7710 (-0.0342) | 0.7548 (-0.0052) | | | +| ogbg-molhiv | gin | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7524 (-0.0644) | 0.7324 (-0.0400) | | | +| ogbg-molhiv | gin | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7412 (-0.0755) | 0.7254 (-0.0470) | 0.7567 (-0.0157) | 2.00 | +| ogbg-molhiv | gin | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw30 | rocauc | 1 | 0.7743 (-0.0425) | 0.6994 (-0.0730) | 0.6907 (-0.0817) | 2.08 | +| ogbg-molhiv | gine | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7646 (-0.0140) | 0.7352 (-0.0153) | | | +| ogbg-molhiv | gine | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7575 (-0.0368) | 0.7401 (-0.0044) | | | +| ogbg-molhiv | graphconv | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7755 (0.0099) | 0.7305 (-0.0025) | | | +| ogbg-molhiv | graphconv | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7713 (0.0006) | 0.6979 (-0.0129) | | | +| ogbg-molhiv | graphconv | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7485 (-0.0222) | 0.7221 (0.0113) | 0.7285 (0.0177) | 2.00 | +| ogbg-molhiv | graphconv | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw30 | rocauc | 1 | 0.7538 (-0.0169) | 0.7703 (0.0595) | 0.7645 (0.0536) | 2.07 | +| ogbg-molhiv | graphsage | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7860 (-0.0005) | 0.7290 (-0.0216) | | | +| ogbg-molhiv | graphsage | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7587 (-0.0382) | 0.7641 (0.0016) | | | +| ogbg-molhiv | mf | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7826 (0.0109) | 0.7127 (-0.0225) | | | +| ogbg-molhiv | mf | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7931 (0.0085) | 0.7217 (0.0143) | | | +| ogbg-molhiv | pna | fixed-rrog-T1-ns3 | rocauc | 3 | 0.8141 (0.0198) | 0.7503 (-0.0018) | | | +| ogbg-molhiv | pna | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7890 (0.0111) | 0.7630 (-0.0018) | | | +| ogbg-molhiv | pna | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7385 (-0.0395) | 0.7185 (-0.0463) | 0.7421 (-0.0227) | 2.00 | +| ogbg-molhiv | resgated | fixed-rrog-T1-ns3 | rocauc | 3 | 0.8020 (0.0057) | 0.7383 (0.0066) | | | +| ogbg-molhiv | resgated | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8174 (0.0030) | 0.7055 (-0.0187) | | | +| ogbg-molhiv | resgated | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.8010 (-0.0134) | 0.7787 (0.0545) | 0.7876 (0.0634) | 2.00 | +| ogbg-molhiv | sgc | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7643 (-0.0056) | 0.7105 (0.0067) | | | +| ogbg-molhiv | sgc | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7482 (0.0003) | 0.7177 (0.0158) | | | +| ogbg-molhiv | sgc | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7378 (-0.0100) | 0.7036 (0.0017) | 0.7244 (0.0225) | 2.03 | +| ogbg-molhiv | sgc | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw30 | rocauc | 1 | 0.7397 (-0.0082) | 0.7501 (0.0482) | 0.7314 (0.0295) | 2.14 | +| ogbg-molhiv | tag | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7554 (0.0066) | 0.7339 (-0.0093) | | | +| ogbg-molhiv | tag | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7804 (0.0276) | 0.7352 (0.0096) | | | +| ogbg-molhiv | tag | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7326 (-0.0202) | 0.7596 (0.0341) | 0.7786 (0.0531) | 2.00 | +| ogbg-molhiv | tag | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw30 | rocauc | 1 | 0.7298 (-0.0230) | 0.6791 (-0.0464) | 0.7162 (-0.0093) | 2.48 | +| ogbg-molhiv | transformer | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7844 (0.0177) | 0.7637 (-0.0077) | | | +| ogbg-molhiv | transformer | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8088 (0.0471) | 0.7413 (-0.0134) | | | +| ogbg-mollipo | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 0.8393 (0.0622) | 0.9174 (-0.0104) | | | +| ogbg-mollipo | arma | fixed-rrog-T1-ns3 | rmse | 1 | 0.7173 (0.0152) | 0.7548 (-0.0253) | | | +| ogbg-mollipo | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 0.6990 (0.0198) | 0.7132 (0.0048) | | | +| ogbg-mollipo | film | fixed-rrog-T1-ns3 | rmse | 1 | 0.8122 (-0.0502) | 0.7353 (0.0018) | | | +| ogbg-mollipo | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 0.7080 (-0.0215) | 0.7334 (-0.0026) | | | +| ogbg-mollipo | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 0.7730 (-0.0351) | 0.7759 (0.0069) | | | +| ogbg-mollipo | gen | fixed-rrog-T1-ns3 | rmse | 1 | 0.6594 (0.0452) | 0.7456 (-0.0077) | | | +| ogbg-mollipo | gin | fixed-rrog-T1-ns3 | rmse | 1 | 0.6749 (0.0105) | 0.7073 (0.0317) | | | +| ogbg-mollipo | gine | fixed-rrog-T1-ns3 | rmse | 1 | 0.7168 (-0.0553) | 0.7316 (0.0025) | | | +| ogbg-mollipo | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 0.7372 (-0.0195) | 0.7396 (-0.0099) | | | +| ogbg-mollipo | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 0.7184 (0.0055) | 0.7720 (0.0063) | | | +| ogbg-mollipo | mf | fixed-rrog-T1-ns3 | rmse | 1 | 0.7050 (0.0080) | 0.7101 (0.0304) | | | +| ogbg-mollipo | pna | fixed-rrog-T1-ns3 | rmse | 1 | 0.7466 (-0.0287) | 0.7908 (-0.0159) | | | +| ogbg-mollipo | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 0.6766 (-0.0046) | 0.7144 (0.0126) | | | +| ogbg-mollipo | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 0.7537 (-0.0032) | 0.7490 (0.0685) | | | +| ogbg-mollipo | tag | fixed-rrog-T1-ns3 | rmse | 1 | 0.6743 (-0.0052) | 0.7201 (0.0026) | | | +| ogbg-mollipo | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 0.6688 (0.0121) | 0.7396 (-0.0050) | | | +| ogbg-molsider | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.5938 (0.0051) | 0.5905 (-0.0099) | | | +| ogbg-molsider | appnp | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.5933 (0.0047) | 0.5967 (-0.0037) | 0.5964 (-0.0040) | 7.89 | +| ogbg-molsider | appnp | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw30 | rocauc | 1 | 0.5874 (-0.0012) | 0.5820 (-0.0184) | 0.5894 (-0.0110) | 7.14 | +| ogbg-molsider | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6344 (0.0071) | 0.6141 (-0.0018) | | | +| ogbg-molsider | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6263 (0.0026) | 0.6096 (0.0062) | | | +| ogbg-molsider | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.5862 (-0.0162) | 0.5974 (0.0076) | | | +| ogbg-molsider | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6462 (0.0391) | 0.6000 (-0.0013) | | | +| ogbg-molsider | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6256 (-0.0037) | 0.6117 (0.0031) | | | +| ogbg-molsider | gcn | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6334 (0.0041) | 0.6300 (0.0213) | 0.6306 (0.0219) | 7.91 | +| ogbg-molsider | gcn | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw30 | rocauc | 1 | 0.6318 (0.0025) | 0.6400 (0.0314) | 0.6402 (0.0316) | 7.94 | +| ogbg-molsider | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6345 (-0.0175) | 0.6053 (0.0199) | | | +| ogbg-molsider | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6046 (-0.0179) | 0.6022 (0.0274) | | | +| ogbg-molsider | gin | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6075 (-0.0150) | 0.5810 (0.0062) | 0.5810 (0.0062) | 8.00 | +| ogbg-molsider | gin | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw30 | rocauc | 1 | 0.6025 (-0.0200) | 0.5933 (0.0184) | 0.5933 (0.0184) | 8.00 | +| ogbg-molsider | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6151 (-0.0176) | 0.6150 (0.0655) | | | +| ogbg-molsider | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6010 (0.0089) | 0.5963 (-0.0188) | | | +| ogbg-molsider | graphconv | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6223 (0.0303) | 0.6222 (0.0071) | 0.6222 (0.0071) | 8.00 | +| ogbg-molsider | graphconv | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw30 | rocauc | 1 | 0.6165 (0.0244) | 0.6344 (0.0193) | 0.6358 (0.0207) | 7.92 | +| ogbg-molsider | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6232 (0.0015) | 0.5861 (0.0053) | | | +| ogbg-molsider | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6190 (-0.0012) | 0.5983 (0.0122) | | | +| ogbg-molsider | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6058 (-0.0161) | 0.5721 (-0.0243) | | | +| ogbg-molsider | pna | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.5870 (-0.0349) | 0.5962 (-0.0003) | 0.5962 (-0.0003) | 7.96 | +| ogbg-molsider | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6205 (-0.0005) | 0.5960 (0.0050) | | | +| ogbg-molsider | resgated | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6260 (0.0051) | 0.6259 (0.0349) | 0.6259 (0.0349) | 8.00 | +| ogbg-molsider | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6151 (-0.0022) | 0.6417 (0.0375) | | | +| ogbg-molsider | sgc | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.5980 (-0.0194) | 0.6337 (0.0294) | 0.6337 (0.0294) | 8.00 | +| ogbg-molsider | sgc | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw30 | rocauc | 1 | 0.6291 (0.0118) | 0.6228 (0.0185) | 0.6223 (0.0181) | 7.92 | +| ogbg-molsider | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6410 (-0.0028) | 0.6102 (-0.0041) | | | +| ogbg-molsider | tag | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.5905 (-0.0534) | 0.6216 (0.0073) | 0.6216 (0.0073) | 8.00 | +| ogbg-molsider | tag | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw30 | rocauc | 1 | 0.6106 (-0.0333) | 0.6243 (0.0100) | 0.6244 (0.0101) | 7.96 | +| ogbg-molsider | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6315 (0.0156) | 0.6190 (0.0210) | | | +| ogbg-moltox21 | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7280 (0.0025) | 0.7154 (-0.0005) | | | +| ogbg-moltox21 | appnp | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7238 (-0.0017) | 0.6823 (-0.0336) | 0.7138 (-0.0021) | 2.63 | +| ogbg-moltox21 | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7771 (-0.0028) | 0.7209 (-0.0014) | | | +| ogbg-moltox21 | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0125) | 0.7286 (-0.0015) | | | +| ogbg-moltox21 | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7727 (0.0025) | 0.7369 (0.0209) | | | +| ogbg-moltox21 | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7762 (0.0135) | 0.7303 (0.0143) | | | +| ogbg-moltox21 | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7588 (0.0007) | 0.7230 (0.0059) | | | +| ogbg-moltox21 | gcn | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7655 (0.0075) | 0.7134 (-0.0037) | 0.7234 (0.0063) | 3.76 | +| ogbg-moltox21 | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7757 (-0.0077) | 0.7312 (-0.0132) | | | +| ogbg-moltox21 | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7718 (0.0028) | 0.7237 (-0.0005) | | | +| ogbg-moltox21 | gin | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7611 (-0.0079) | 0.7090 (-0.0152) | 0.7127 (-0.0115) | 3.83 | +| ogbg-moltox21 | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7622 (-0.0122) | 0.7193 (-0.0135) | | | +| ogbg-moltox21 | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7820 (-0.0011) | 0.7313 (0.0166) | | | +| ogbg-moltox21 | graphconv | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7816 (-0.0015) | 0.7115 (-0.0032) | 0.7191 (0.0043) | 3.21 | +| ogbg-moltox21 | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7697 (-0.0012) | 0.7205 (0.0009) | | | +| ogbg-moltox21 | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7695 (-0.0078) | 0.7279 (-0.0002) | | | +| ogbg-moltox21 | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7745 (0.0085) | 0.7349 (0.0403) | | | +| ogbg-moltox21 | pna | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7547 (-0.0113) | 0.6949 (0.0003) | 0.7075 (0.0129) | 4.22 | +| ogbg-moltox21 | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7887 (-0.0064) | 0.7380 (0.0104) | | | +| ogbg-moltox21 | resgated | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7796 (-0.0154) | 0.7202 (-0.0074) | 0.7224 (-0.0052) | 3.08 | +| ogbg-moltox21 | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7506 (-0.0105) | 0.7355 (0.0115) | | | +| ogbg-moltox21 | sgc | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7779 (0.0168) | 0.7360 (0.0120) | 0.7478 (0.0238) | 3.49 | +| ogbg-moltox21 | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7839 (-0.0027) | 0.7342 (-0.0074) | | | +| ogbg-moltox21 | tag | rrog-act-stream-T1-ns3-hm8-min2-exact-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7701 (-0.0165) | 0.7163 (-0.0253) | 0.7254 (-0.0161) | 3.51 | +| ogbg-moltox21 | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7761 (0.0105) | 0.7292 (-0.0018) | | | +[gpu3-ablation] done Wed Jun 24 14:55:07 CDT 2026 diff --git a/logs/ogbg-molbace_0.log b/logs/ogbg-molbace_0.log new file mode 100644 index 0000000..6a66adb --- /dev/null +++ b/logs/ogbg-molbace_0.log @@ -0,0 +1,683 @@ +[run] ogbg-molbace view=gin compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view gin --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/bace.zip +
0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 2616.53it/s] +Processing... +Extracting /orion/u/oscarwan/rrog-gnn-runner/data/ogb/bace.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/1513 [00:00<?, ?it/s]
100%|██████████| 1513/1513 [00:00<00:00, 143288.97it/s] +Converting graphs into PyG objects... +
0%| | 0/1513 [00:00<?, ?it/s]
100%|██████████| 1513/1513 [00:00<00:00, 86863.43it/s] +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/ogb/graphproppred/dataset_pyg.py:156: UserWarning: The given NumPy array is not writable, and PyTorch does not support non-writable tensors. This means writing to this tensor will result in undefined behavior. You may want to copy the array to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at /pytorch/torch/csrc/utils/tensor_numpy.cpp:203.) + g.y = torch.from_numpy(graph_label[i]).view(1,-1).to(torch.long) +Done! +Saving... +ep10 val_rocauc=0.65055 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.61502 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.64872 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.64176 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.63370 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.63040 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.64359 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.64615 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.64799 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.65201 halt=0.00 train_steps=1.00 +[ogbg-molbace_gin_classic_T0_ns1_h128_e100_s0] best_ep=100 val={'rocauc': 0.652014652014652} test={'rocauc': 0.7336115458181186} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_gin_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbace view=gin compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view gin --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.43810 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.62821 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.57289 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.63077 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.64469 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.57070 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.63480 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.65385 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.64029 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.64469 halt=0.00 train_steps=3.00 +[ogbg-molbace_gin_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=80 val={'rocauc': 0.6538461538461539} test={'rocauc': 0.7169187967310032} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_gin_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbace view=gine compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view gine --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.55385 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.61978 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.66410 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.58571 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.61868 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.60183 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.60403 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.63297 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.63004 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.62821 halt=0.00 train_steps=1.00 +[ogbg-molbace_gine_classic_T0_ns1_h128_e100_s0] best_ep=30 val={'rocauc': 0.6641025641025642} test={'rocauc': 0.7454355764214919} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_gine_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbace view=gine compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view gine --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.56447 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.64249 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.58901 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.66850 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.64945 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.63516 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.64469 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.63150 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.61941 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.62308 halt=0.00 train_steps=3.00 +[ogbg-molbace_gine_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.6684981684981685} test={'rocauc': 0.6993566336289341} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_gine_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbace view=gcn compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view gcn --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.57326 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.60037 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.63773 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.62161 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.63810 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.60842 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.60916 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.61282 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.61429 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.61209 halt=0.00 train_steps=1.00 +[ogbg-molbace_gcn_classic_T0_ns1_h128_e100_s0] best_ep=50 val={'rocauc': 0.638095238095238} test={'rocauc': 0.7393496783168144} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_gcn_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbace view=gcn compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view gcn --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.55128 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.63114 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.59817 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.63736 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.63040 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.62381 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.61648 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.61978 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.61282 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.61502 halt=0.00 train_steps=3.00 +[ogbg-molbace_gcn_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.6373626373626374} test={'rocauc': 0.7732568249000173} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbace view=graphsage compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view graphsage --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.60696 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.60989 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.65824 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.65531 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.67582 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.66667 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.67363 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.66630 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.67143 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.66960 halt=0.00 train_steps=1.00 +[ogbg-molbace_graphsage_classic_T0_ns1_h128_e100_s0] best_ep=50 val={'rocauc': 0.6758241758241759} test={'rocauc': 0.7758650669448792} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_graphsage_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbace view=graphsage compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view graphsage --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.60696 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.64469 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.67033 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.62894 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.63260 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.64835 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.63956 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.64982 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.64432 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.64762 halt=0.00 train_steps=3.00 +[ogbg-molbace_graphsage_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.6703296703296704} test={'rocauc': 0.7118761954442706} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbace view=gatv2 compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view gatv2 --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.59963 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.66227 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.61795 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.64286 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.65897 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.70183 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.70293 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.68755 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.68718 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.69011 halt=0.00 train_steps=1.00 +[ogbg-molbace_gatv2_classic_T0_ns1_h128_e100_s0] best_ep=70 val={'rocauc': 0.702930402930403} test={'rocauc': 0.7400452095287776} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_gatv2_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbace view=gatv2 compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view gatv2 --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.65238 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.59597 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.70256 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.67692 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.70256 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.69048 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.66777 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.67656 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.67509 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.67326 halt=0.00 train_steps=3.00 +[ogbg-molbace_gatv2_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.7025641025641026} test={'rocauc': 0.751869240132151} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbace view=graphconv compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view graphconv --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.64652 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.73114 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.70586 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.67289 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.64945 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.66886 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.67546 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.66374 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.65934 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.65934 halt=0.00 train_steps=1.00 +[ogbg-molbace_graphconv_classic_T0_ns1_h128_e100_s0] best_ep=20 val={'rocauc': 0.7311355311355311} test={'rocauc': 0.8035124326204138} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_graphconv_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbace view=graphconv compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view graphconv --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.61722 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.70916 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.69634 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.74615 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.61136 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.63260 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.64286 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.64029 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.65128 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.65092 halt=0.00 train_steps=3.00 +[ogbg-molbace_graphconv_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.7461538461538462} test={'rocauc': 0.7982959485306903} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbace view=transformer compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view transformer --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.61355 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.61465 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.60403 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.58242 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.64469 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.64652 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.66484 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.66044 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.66630 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.66593 halt=0.00 train_steps=1.00 +[ogbg-molbace_transformer_classic_T0_ns1_h128_e100_s0] best_ep=90 val={'rocauc': 0.6663003663003664} test={'rocauc': 0.7363936706659711} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_transformer_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbace view=transformer compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view transformer --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.54286 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.62234 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.62967 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.64469 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.62491 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.67179 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.68938 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.69487 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.69817 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.69744 halt=0.00 train_steps=3.00 +[ogbg-molbace_transformer_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=90 val={'rocauc': 0.6981684981684982} test={'rocauc': 0.7487393496783169} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbace view=pna compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view pna --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.61758 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.61758 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.58608 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.67582 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.72784 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.68278 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.72711 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.73810 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.75165 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.75092 halt=0.00 train_steps=1.00 +[ogbg-molbace_pna_classic_T0_ns1_h128_e100_s0] best_ep=90 val={'rocauc': 0.7516483516483518} test={'rocauc': 0.6911841418883674} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_pna_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbace view=pna compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view pna --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.50256 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.40623 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.53407 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.54249 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.62051 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.63736 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.68095 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.70220 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.70110 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.70366 halt=0.00 train_steps=3.00 +[ogbg-molbace_pna_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=100 val={'rocauc': 0.7036630036630036} test={'rocauc': 0.7967310033037731} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_pna_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbace view=gen compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view gen --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.60293 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.63663 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.59158 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.61209 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.69158 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.69744 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.71099 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.71282 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.71026 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.71136 halt=0.00 train_steps=1.00 +[ogbg-molbace_gen_classic_T0_ns1_h128_e100_s0] best_ep=80 val={'rocauc': 0.7128205128205128} test={'rocauc': 0.7325682490001738} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_gen_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbace view=gen compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view gen --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.68938 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.62747 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.64029 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.62381 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.58425 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.61575 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.61319 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.61795 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.62161 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.61941 halt=0.00 train_steps=3.00 +[ogbg-molbace_gen_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=10 val={'rocauc': 0.6893772893772894} test={'rocauc': 0.7449139280125194} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_gen_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbace view=film compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view film --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.63150 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.64615 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.65128 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.64396 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.63443 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.67033 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.66081 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.66740 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.65678 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.65824 halt=0.00 train_steps=1.00 +[ogbg-molbace_film_classic_T0_ns1_h128_e100_s0] best_ep=60 val={'rocauc': 0.6703296703296703} test={'rocauc': 0.7242218744566161} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_film_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbace view=film compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view film --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.60513 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.66520 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.62747 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.61795 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.66081 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.64432 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.64396 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.63553 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.65055 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.65348 halt=0.00 train_steps=3.00 +[ogbg-molbace_film_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=20 val={'rocauc': 0.6652014652014652} test={'rocauc': 0.7242218744566163} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_film_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbace view=resgated compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view resgated --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.67216 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.67875 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.70659 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.65238 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.65275 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.71722 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.69670 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.71136 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.71355 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.71282 halt=0.00 train_steps=1.00 +[ogbg-molbace_resgated_classic_T0_ns1_h128_e100_s0] best_ep=60 val={'rocauc': 0.7172161172161172} test={'rocauc': 0.7876890975482524} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_resgated_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbace view=resgated compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view resgated --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.66777 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.60293 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.63663 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.66813 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.65788 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.68462 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.69121 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.67582 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.68388 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.68168 halt=0.00 train_steps=3.00 +[ogbg-molbace_resgated_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=70 val={'rocauc': 0.6912087912087912} test={'rocauc': 0.7464788732394366} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbace view=tag compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view tag --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.70842 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.59634 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.60842 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.63260 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.66374 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.62308 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.65897 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.65568 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.65128 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.65092 halt=0.00 train_steps=1.00 +[ogbg-molbace_tag_classic_T0_ns1_h128_e100_s0] best_ep=10 val={'rocauc': 0.7084249084249085} test={'rocauc': 0.7344809598330725} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_tag_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbace view=tag compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view tag --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.73553 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.63150 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.63956 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.67289 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.67216 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.70037 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.69231 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.70073 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.69963 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.70110 halt=0.00 train_steps=3.00 +[ogbg-molbace_tag_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=10 val={'rocauc': 0.7355311355311356} test={'rocauc': 0.6805772909059293} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_tag_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbace view=sgc compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view sgc --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.65751 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.54212 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.60842 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.59414 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.61355 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.60916 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.59451 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.60476 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.60549 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.60586 halt=0.00 train_steps=1.00 +[ogbg-molbace_sgc_classic_T0_ns1_h128_e100_s0] best_ep=10 val={'rocauc': 0.6575091575091575} test={'rocauc': 0.6965745087810815} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_sgc_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbace view=sgc compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view sgc --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.60659 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.62894 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.55641 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.64542 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.62491 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.61538 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.61429 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.61026 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.60513 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.60220 halt=0.00 train_steps=3.00 +[ogbg-molbace_sgc_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.6454212454212455} test={'rocauc': 0.772735176491045} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbace view=cheb compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view cheb --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.72674 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.70037 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.67546 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.67289 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.65641 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.69634 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.69011 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.70220 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.70073 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.69890 halt=0.00 train_steps=1.00 +[ogbg-molbace_cheb_classic_T0_ns1_h128_e100_s0] best_ep=10 val={'rocauc': 0.7267399267399268} test={'rocauc': 0.7969048861067639} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_cheb_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbace view=cheb compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view cheb --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.67289 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.69011 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.71136 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.67546 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.69853 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.68901 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.70000 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.70366 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.70403 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.70293 halt=0.00 train_steps=3.00 +[ogbg-molbace_cheb_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.7113553113553114} test={'rocauc': 0.7532603025560771} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbace view=arma compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view arma --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.58132 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.64139 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.58608 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.65751 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.69231 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.66593 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.66300 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.66630 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.66777 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.66850 halt=0.00 train_steps=1.00 +[ogbg-molbace_arma_classic_T0_ns1_h128_e100_s0] best_ep=50 val={'rocauc': 0.6923076923076924} test={'rocauc': 0.7838636758824552} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_arma_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbace view=arma compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view arma --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.69744 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.66667 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.68425 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.66740 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.71795 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.71429 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.69451 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.70220 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.69744 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.69560 halt=0.00 train_steps=3.00 +[ogbg-molbace_arma_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rocauc': 0.717948717948718} test={'rocauc': 0.7671709267953399} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_arma_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbace view=mf compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view mf --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.66960 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.59158 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.69853 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.72088 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.71282 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.72491 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.71905 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.74212 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.73260 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.73223 halt=0.00 train_steps=1.00 +[ogbg-molbace_mf_classic_T0_ns1_h128_e100_s0] best_ep=80 val={'rocauc': 0.7421245421245422} test={'rocauc': 0.7760389497478699} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_mf_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbace view=mf compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view mf --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.65641 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.70293 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.70366 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.71062 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.69414 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.72271 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.72344 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.72271 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.72234 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.72125 halt=0.00 train_steps=3.00 +[ogbg-molbace_mf_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=70 val={'rocauc': 0.7234432234432234} test={'rocauc': 0.7683881064162754} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_mf_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbace view=appnp compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view appnp --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.65641 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.54982 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.64652 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.60440 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.65275 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.61172 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.61209 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.60623 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.61172 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.61465 halt=0.00 train_steps=1.00 +[ogbg-molbace_appnp_classic_T0_ns1_h128_e100_s0] best_ep=10 val={'rocauc': 0.6564102564102564} test={'rocauc': 0.7423056859676577} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_appnp_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbace view=appnp compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view appnp --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.69560 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.59121 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.71685 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.67949 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.62747 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.64505 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.66337 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.65531 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.64615 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.64762 halt=0.00 train_steps=3.00 +[ogbg-molbace_appnp_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.7168498168498169} test={'rocauc': 0.7209181011997913} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json + +Classic baseline: task x backbone +| task | backbone | metric | n | val | test | +| --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | rocauc | 1 | 0.6564 +/- 0.0000 | 0.7423 +/- 0.0000 | +| ogbg-molbace | arma | rocauc | 1 | 0.6923 +/- 0.0000 | 0.7839 +/- 0.0000 | +| ogbg-molbace | cheb | rocauc | 1 | 0.7267 +/- 0.0000 | 0.7969 +/- 0.0000 | +| ogbg-molbace | film | rocauc | 1 | 0.6703 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molbace | gatv2 | rocauc | 1 | 0.7029 +/- 0.0000 | 0.7400 +/- 0.0000 | +| ogbg-molbace | gcn | rocauc | 1 | 0.6381 +/- 0.0000 | 0.7393 +/- 0.0000 | +| ogbg-molbace | gen | rocauc | 1 | 0.7128 +/- 0.0000 | 0.7326 +/- 0.0000 | +| ogbg-molbace | gin | rocauc | 1 | 0.6520 +/- 0.0000 | 0.7336 +/- 0.0000 | +| ogbg-molbace | gine | rocauc | 1 | 0.6641 +/- 0.0000 | 0.7454 +/- 0.0000 | +| ogbg-molbace | graphconv | rocauc | 1 | 0.7311 +/- 0.0000 | 0.8035 +/- 0.0000 | +| ogbg-molbace | graphsage | rocauc | 1 | 0.6758 +/- 0.0000 | 0.7759 +/- 0.0000 | +| ogbg-molbace | mf | rocauc | 1 | 0.7421 +/- 0.0000 | 0.7760 +/- 0.0000 | +| ogbg-molbace | pna | rocauc | 1 | 0.7516 +/- 0.0000 | 0.6912 +/- 0.0000 | +| ogbg-molbace | resgated | rocauc | 1 | 0.7172 +/- 0.0000 | 0.7877 +/- 0.0000 | +| ogbg-molbace | sgc | rocauc | 1 | 0.6575 +/- 0.0000 | 0.6966 +/- 0.0000 | +| ogbg-molbace | tag | rocauc | 1 | 0.7084 +/- 0.0000 | 0.7345 +/- 0.0000 | +| ogbg-molbace | transformer | rocauc | 1 | 0.6663 +/- 0.0000 | 0.7364 +/- 0.0000 | +| ogbg-molbbbp | appnp | rocauc | 1 | 0.9147 +/- 0.0000 | 0.6388 +/- 0.0000 | +| ogbg-molbbbp | arma | rocauc | 1 | 0.9367 +/- 0.0000 | 0.6651 +/- 0.0000 | +| ogbg-molbbbp | cheb | rocauc | 1 | 0.9452 +/- 0.0000 | 0.6514 +/- 0.0000 | +| ogbg-molbbbp | film | rocauc | 1 | 0.9285 +/- 0.0000 | 0.6300 +/- 0.0000 | +| ogbg-molbbbp | gatv2 | rocauc | 1 | 0.9347 +/- 0.0000 | 0.6324 +/- 0.0000 | +| ogbg-molbbbp | gcn | rocauc | 1 | 0.9386 +/- 0.0000 | 0.6679 +/- 0.0000 | +| ogbg-molbbbp | gen | rocauc | 1 | 0.9549 +/- 0.0000 | 0.6775 +/- 0.0000 | +| ogbg-molbbbp | gin | rocauc | 1 | 0.9251 +/- 0.0000 | 0.5670 +/- 0.0000 | +| ogbg-molbbbp | gine | rocauc | 1 | 0.9324 +/- 0.0000 | 0.6160 +/- 0.0000 | +| ogbg-molbbbp | graphconv | rocauc | 1 | 0.9268 +/- 0.0000 | 0.5900 +/- 0.0000 | +| ogbg-molbbbp | graphsage | rocauc | 1 | 0.9483 +/- 0.0000 | 0.6288 +/- 0.0000 | +| ogbg-molbbbp | mf | rocauc | 1 | 0.9395 +/- 0.0000 | 0.6365 +/- 0.0000 | +| ogbg-molbbbp | pna | rocauc | 1 | 0.9554 +/- 0.0000 | 0.6418 +/- 0.0000 | +| ogbg-molbbbp | resgated | rocauc | 1 | 0.9183 +/- 0.0000 | 0.6626 +/- 0.0000 | +| ogbg-molbbbp | sgc | rocauc | 1 | 0.9300 +/- 0.0000 | 0.6239 +/- 0.0000 | +| ogbg-molbbbp | tag | rocauc | 1 | 0.9476 +/- 0.0000 | 0.6100 +/- 0.0000 | +| ogbg-molbbbp | transformer | rocauc | 1 | 0.9495 +/- 0.0000 | 0.6156 +/- 0.0000 | +| ogbg-molhiv | appnp | rocauc | 1 | 0.7675 +/- 0.0000 | 0.7000 +/- 0.0000 | +| ogbg-molhiv | arma | rocauc | 1 | 0.7872 +/- 0.0000 | 0.7296 +/- 0.0000 | +| ogbg-molhiv | cheb | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7282 +/- 0.0000 | +| ogbg-molhiv | film | rocauc | 1 | 0.7922 +/- 0.0000 | 0.7842 +/- 0.0000 | +| ogbg-molhiv | gatv2 | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7563 +/- 0.0000 | +| ogbg-molhiv | gcn | rocauc | 1 | 0.7754 +/- 0.0000 | 0.7198 +/- 0.0000 | +| ogbg-molhiv | gen | rocauc | 1 | 0.7530 +/- 0.0000 | 0.7314 +/- 0.0000 | +| ogbg-molhiv | gin | rocauc | 1 | 0.8167 +/- 0.0000 | 0.7724 +/- 0.0000 | +| ogbg-molhiv | gine | rocauc | 1 | 0.7942 +/- 0.0000 | 0.7445 +/- 0.0000 | +| ogbg-molhiv | graphconv | rocauc | 1 | 0.7707 +/- 0.0000 | 0.7108 +/- 0.0000 | +| ogbg-molhiv | graphsage | rocauc | 1 | 0.7969 +/- 0.0000 | 0.7625 +/- 0.0000 | +| ogbg-molhiv | mf | rocauc | 1 | 0.7845 +/- 0.0000 | 0.7074 +/- 0.0000 | +| ogbg-molhiv | pna | rocauc | 1 | 0.7780 +/- 0.0000 | 0.7648 +/- 0.0000 | +| ogbg-molhiv | resgated | rocauc | 1 | 0.8144 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molhiv | sgc | rocauc | 1 | 0.7479 +/- 0.0000 | 0.7019 +/- 0.0000 | +| ogbg-molhiv | tag | rocauc | 1 | 0.7528 +/- 0.0000 | 0.7255 +/- 0.0000 | +| ogbg-molhiv | transformer | rocauc | 1 | 0.7617 +/- 0.0000 | 0.7547 +/- 0.0000 | + +Delta vs matching classic +| task | backbone | compute | metric | n | val score (delta) | test score (delta) | steps | +| --- | --- | --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7168 (0.0604) | 0.7209 (-0.0214) | | +| ogbg-molbace | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7179 (0.0256) | 0.7672 (-0.0167) | | +| ogbg-molbace | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7114 (-0.0154) | 0.7533 (-0.0436) | | +| ogbg-molbace | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6652 (-0.0051) | 0.7242 (0.0000) | | +| ogbg-molbace | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7026 (-0.0004) | 0.7519 (0.0118) | | +| ogbg-molbace | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6374 (-0.0007) | 0.7733 (0.0339) | | +| ogbg-molbace | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6894 (-0.0234) | 0.7449 (0.0123) | | +| ogbg-molbace | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6538 (0.0018) | 0.7169 (-0.0167) | | +| ogbg-molbace | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6685 (0.0044) | 0.6994 (-0.0461) | | +| ogbg-molbace | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7462 (0.0150) | 0.7983 (-0.0052) | | +| ogbg-molbace | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6703 (-0.0055) | 0.7119 (-0.0640) | | +| ogbg-molbace | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7234 (-0.0187) | 0.7684 (-0.0077) | | +| ogbg-molbace | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7037 (-0.0480) | 0.7967 (0.1055) | | +| ogbg-molbace | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6912 (-0.0260) | 0.7465 (-0.0412) | | +| ogbg-molbace | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6454 (-0.0121) | 0.7727 (0.0762) | | +| ogbg-molbace | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7355 (0.0271) | 0.6806 (-0.0539) | | +| ogbg-molbace | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6982 (0.0319) | 0.7487 (0.0123) | | +| ogbg-molbbbp | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9360 (0.0213) | 0.6073 (-0.0314) | | +| ogbg-molbbbp | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9415 (0.0048) | 0.6635 (-0.0016) | | +| ogbg-molbbbp | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9278 (-0.0174) | 0.6659 (0.0145) | | +| ogbg-molbbbp | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9400 (0.0115) | 0.6323 (0.0023) | | +| ogbg-molbbbp | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9356 (0.0009) | 0.6560 (0.0235) | | +| ogbg-molbbbp | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9417 (0.0031) | 0.6017 (-0.0663) | | +| ogbg-molbbbp | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9429 (-0.0119) | 0.6037 (-0.0738) | | +| ogbg-molbbbp | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9526 (0.0275) | 0.5932 (0.0261) | | +| ogbg-molbbbp | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9421 (0.0098) | 0.6976 (0.0816) | | +| ogbg-molbbbp | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9337 (0.0069) | 0.6518 (0.0618) | | +| ogbg-molbbbp | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9502 (0.0019) | 0.5934 (-0.0354) | | +| ogbg-molbbbp | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9488 (0.0094) | 0.6481 (0.0116) | | +| ogbg-molbbbp | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9585 (0.0031) | 0.6682 (0.0264) | | +| ogbg-molbbbp | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9535 (0.0352) | 0.5839 (-0.0787) | | +| ogbg-molbbbp | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9285 (-0.0015) | 0.6454 (0.0215) | | +| ogbg-molbbbp | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9459 (-0.0017) | 0.6420 (0.0320) | | +| ogbg-molbbbp | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9355 (-0.0140) | 0.6221 (0.0065) | | +| ogbg-molhiv | appnp | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7203 (-0.0471) | 0.6825 (-0.0175) | | +| ogbg-molhiv | arma | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7926 (0.0054) | 0.7318 (0.0021) | | +| ogbg-molhiv | cheb | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7735 (-0.0096) | 0.7426 (0.0144) | | +| ogbg-molhiv | film | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7633 (-0.0288) | 0.7728 (-0.0114) | | +| ogbg-molhiv | gatv2 | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7835 (0.0001) | 0.7466 (-0.0096) | | +| ogbg-molhiv | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7833 (0.0079) | 0.7448 (0.0250) | | +| ogbg-molhiv | gcn | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7455 (-0.0300) | 0.7483 (0.0285) | | +| ogbg-molhiv | gen | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8128 (0.0598) | 0.7631 (0.0318) | | +| ogbg-molhiv | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0457) | 0.7668 (-0.0056) | | +| ogbg-molhiv | gin | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7524 (-0.0644) | 0.7324 (-0.0400) | | +| ogbg-molhiv | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7490 (-0.0453) | 0.7376 (-0.0070) | | +| ogbg-molhiv | gine | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7575 (-0.0368) | 0.7401 (-0.0044) | | +| ogbg-molhiv | graphconv | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7713 (0.0006) | 0.6979 (-0.0129) | | +| ogbg-molhiv | graphsage | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7587 (-0.0382) | 0.7641 (0.0016) | | +| ogbg-molhiv | mf | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7931 (0.0085) | 0.7217 (0.0143) | | +| ogbg-molhiv | pna | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7890 (0.0111) | 0.7630 (-0.0018) | | +| ogbg-molhiv | resgated | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8174 (0.0030) | 0.7055 (-0.0187) | | +| ogbg-molhiv | sgc | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7482 (0.0003) | 0.7177 (0.0158) | | +| ogbg-molhiv | tag | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7804 (0.0276) | 0.7352 (0.0096) | | +| ogbg-molhiv | transformer | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8088 (0.0471) | 0.7413 (-0.0134) | | diff --git a/logs/ogbg-molbace_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log b/logs/ogbg-molbace_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log new file mode 100644 index 0000000..5e24c8a --- /dev/null +++ b/logs/ogbg-molbace_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log @@ -0,0 +1,166 @@ +[run] ogbg-molbace view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/bace.zip +
0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 4.82it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 4.82it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 9.64it/s] +Processing... +Extracting /home/yurenh2/rrog-gnn-runner/data/ogb/bace.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/1513 [00:00<?, ?it/s]
100%|██████████| 1513/1513 [00:00<00:00, 163022.63it/s] +Converting graphs into PyG objects... +
0%| | 0/1513 [00:00<?, ?it/s]
100%|██████████| 1513/1513 [00:00<00:00, 85215.28it/s] +/home/yurenh2/miniconda3/lib/python3.13/site-packages/ogb/graphproppred/dataset_pyg.py:156: UserWarning: The given NumPy array is not writable, and PyTorch does not support non-writable tensors. This means writing to this tensor will result in undefined behavior. You may want to copy the array to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at /pytorch/torch/csrc/utils/tensor_numpy.cpp:213.) + g.y = torch.from_numpy(graph_label[i]).view(1,-1).to(torch.long) +Done! +Saving... +ep10 val_rocauc=0.52894 val_adapt_rocauc=0.53736 adapt_steps=2.04 halt=0.34 train_steps=2.42 +ep20 val_rocauc=0.61941 val_adapt_rocauc=0.62161 adapt_steps=2.00 halt=0.46 train_steps=1.68 +ep30 val_rocauc=0.53260 val_adapt_rocauc=0.65385 adapt_steps=2.09 halt=0.44 train_steps=1.75 +ep40 val_rocauc=0.61319 val_adapt_rocauc=0.66703 adapt_steps=2.00 halt=0.47 train_steps=1.66 +ep50 val_rocauc=0.59048 val_adapt_rocauc=0.58315 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep60 val_rocauc=0.66300 val_adapt_rocauc=0.69487 adapt_steps=2.09 halt=0.47 train_steps=1.60 +ep70 val_rocauc=0.59011 val_adapt_rocauc=0.62601 adapt_steps=2.00 halt=0.48 train_steps=1.55 +ep80 val_rocauc=0.62308 val_adapt_rocauc=0.64579 adapt_steps=2.00 halt=0.47 train_steps=1.59 +ep90 val_rocauc=0.60000 val_adapt_rocauc=0.61868 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.60549 val_adapt_rocauc=0.61355 adapt_steps=2.01 halt=0.47 train_steps=1.57 +[ogbg-molbace_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.6630036630036631} test={'rocauc': 0.7275256477134411} adaptive={'rocauc': 0.7369153190749435} steps=2.0526315789473686 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbace_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.66154 val_adapt_rocauc=0.68828 adapt_steps=2.16 halt=0.45 train_steps=1.71 +ep20 val_rocauc=0.65604 val_adapt_rocauc=0.70476 adapt_steps=2.08 halt=0.47 train_steps=1.66 +ep30 val_rocauc=0.57875 val_adapt_rocauc=0.62674 adapt_steps=2.04 halt=0.44 train_steps=1.81 +ep40 val_rocauc=0.56337 val_adapt_rocauc=0.58608 adapt_steps=2.02 halt=0.47 train_steps=1.59 +ep50 val_rocauc=0.59084 val_adapt_rocauc=0.62527 adapt_steps=2.01 halt=0.46 train_steps=1.60 +ep60 val_rocauc=0.57289 val_adapt_rocauc=0.62161 adapt_steps=2.01 halt=0.48 train_steps=1.58 +ep70 val_rocauc=0.57399 val_adapt_rocauc=0.60659 adapt_steps=2.01 halt=0.48 train_steps=1.55 +ep80 val_rocauc=0.54762 val_adapt_rocauc=0.59560 adapt_steps=2.01 halt=0.48 train_steps=1.59 +ep90 val_rocauc=0.55861 val_adapt_rocauc=0.59634 adapt_steps=2.01 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.56264 val_adapt_rocauc=0.60403 adapt_steps=2.00 halt=0.47 train_steps=1.57 +[ogbg-molbace_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=10 val={'rocauc': 0.6615384615384615} test={'rocauc': 0.4418362023995827} adaptive={'rocauc': 0.5362545644235784} steps=2.8421052631578947 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbace_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.54505 val_adapt_rocauc=0.57875 adapt_steps=2.06 halt=0.44 train_steps=1.70 +ep20 val_rocauc=0.58388 val_adapt_rocauc=0.63223 adapt_steps=2.44 halt=0.47 train_steps=1.62 +ep30 val_rocauc=0.58168 val_adapt_rocauc=0.58205 adapt_steps=2.07 halt=0.47 train_steps=1.58 +ep40 val_rocauc=0.56923 val_adapt_rocauc=0.66410 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep50 val_rocauc=0.59011 val_adapt_rocauc=0.58022 adapt_steps=2.07 halt=0.47 train_steps=1.57 +ep60 val_rocauc=0.60037 val_adapt_rocauc=0.59194 adapt_steps=2.03 halt=0.48 train_steps=1.60 +ep70 val_rocauc=0.64396 val_adapt_rocauc=0.62271 adapt_steps=2.00 halt=0.48 train_steps=1.55 +ep80 val_rocauc=0.63993 val_adapt_rocauc=0.62711 adapt_steps=2.00 halt=0.48 train_steps=1.59 +ep90 val_rocauc=0.63883 val_adapt_rocauc=0.62967 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.64322 val_adapt_rocauc=0.62491 adapt_steps=2.00 halt=0.47 train_steps=1.57 +[ogbg-molbace_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.643956043956044} test={'rocauc': 0.7117023126412798} adaptive={'rocauc': 0.7499565292992523} steps=2.013157894736842 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbace_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.64799 val_adapt_rocauc=0.66227 adapt_steps=2.66 halt=0.44 train_steps=1.78 +ep20 val_rocauc=0.64579 val_adapt_rocauc=0.62674 adapt_steps=2.08 halt=0.43 train_steps=1.80 +ep30 val_rocauc=0.65458 val_adapt_rocauc=0.66300 adapt_steps=2.01 halt=0.47 train_steps=1.62 +ep40 val_rocauc=0.61941 val_adapt_rocauc=0.60806 adapt_steps=2.01 halt=0.46 train_steps=1.67 +ep50 val_rocauc=0.58645 val_adapt_rocauc=0.64908 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep60 val_rocauc=0.57399 val_adapt_rocauc=0.57363 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep70 val_rocauc=0.62161 val_adapt_rocauc=0.63114 adapt_steps=2.00 halt=0.48 train_steps=1.55 +ep80 val_rocauc=0.62930 val_adapt_rocauc=0.64286 adapt_steps=2.00 halt=0.48 train_steps=1.59 +ep90 val_rocauc=0.63553 val_adapt_rocauc=0.63223 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.63736 val_adapt_rocauc=0.63480 adapt_steps=2.00 halt=0.47 train_steps=1.57 +[ogbg-molbace_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rocauc': 0.6545787545787546} test={'rocauc': 0.8191618848895844} adaptive={'rocauc': 0.8142931664058426} steps=2.111842105263158 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbace_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.67802 val_adapt_rocauc=0.70293 adapt_steps=2.01 halt=0.44 train_steps=1.78 +ep20 val_rocauc=0.55751 val_adapt_rocauc=0.55348 adapt_steps=2.03 halt=0.47 train_steps=1.61 +ep30 val_rocauc=0.66337 val_adapt_rocauc=0.66300 adapt_steps=2.01 halt=0.47 train_steps=1.61 +ep40 val_rocauc=0.68901 val_adapt_rocauc=0.67766 adapt_steps=2.09 halt=0.46 train_steps=1.66 +ep50 val_rocauc=0.62857 val_adapt_rocauc=0.71502 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep60 val_rocauc=0.66703 val_adapt_rocauc=0.67033 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep70 val_rocauc=0.69267 val_adapt_rocauc=0.69780 adapt_steps=2.00 halt=0.48 train_steps=1.55 +ep80 val_rocauc=0.67766 val_adapt_rocauc=0.66374 adapt_steps=2.00 halt=0.48 train_steps=1.59 +ep90 val_rocauc=0.67143 val_adapt_rocauc=0.65238 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.68095 val_adapt_rocauc=0.65311 adapt_steps=2.00 halt=0.47 train_steps=1.57 +[ogbg-molbace_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.6926739926739928} test={'rocauc': 0.6736219787862981} adaptive={'rocauc': 0.734828725439054} steps=2.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbace_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.68022 val_adapt_rocauc=0.67143 adapt_steps=2.11 halt=0.48 train_steps=1.58 +ep20 val_rocauc=0.64139 val_adapt_rocauc=0.67692 adapt_steps=2.05 halt=0.48 train_steps=1.60 +ep30 val_rocauc=0.63516 val_adapt_rocauc=0.63077 adapt_steps=2.02 halt=0.47 train_steps=1.57 +ep40 val_rocauc=0.59158 val_adapt_rocauc=0.65128 adapt_steps=2.00 halt=0.48 train_steps=1.59 +ep50 val_rocauc=0.51758 val_adapt_rocauc=0.55788 adapt_steps=2.01 halt=0.47 train_steps=1.56 +ep60 val_rocauc=0.63626 val_adapt_rocauc=0.63700 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep70 val_rocauc=0.56300 val_adapt_rocauc=0.62271 adapt_steps=2.00 halt=0.48 train_steps=1.55 +ep80 val_rocauc=0.55751 val_adapt_rocauc=0.62967 adapt_steps=2.00 halt=0.48 train_steps=1.59 +ep90 val_rocauc=0.55495 val_adapt_rocauc=0.61795 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.54652 val_adapt_rocauc=0.61722 adapt_steps=2.00 halt=0.47 train_steps=1.57 +[ogbg-molbace_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=10 val={'rocauc': 0.6802197802197802} test={'rocauc': 0.6833594157537818} adaptive={'rocauc': 0.7826464962615197} steps=2.0921052631578947 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbace_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=pna compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view pna --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.56447 val_adapt_rocauc=0.56557 adapt_steps=2.00 halt=0.35 train_steps=2.27 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.65751 val_adapt_rocauc=0.67289 adapt_steps=2.16 halt=0.38 train_steps=2.12 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.65897 val_adapt_rocauc=0.65018 adapt_steps=2.56 halt=0.40 train_steps=1.88 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.45604 val_adapt_rocauc=0.66996 adapt_steps=2.13 halt=0.46 train_steps=1.68 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.49560 val_adapt_rocauc=0.68791 adapt_steps=2.13 halt=0.44 train_steps=1.75 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.46227 val_adapt_rocauc=0.68132 adapt_steps=2.05 halt=0.47 train_steps=1.65 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.64432 val_adapt_rocauc=0.67912 adapt_steps=2.00 halt=0.47 train_steps=1.57 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.60220 val_adapt_rocauc=0.64359 adapt_steps=2.04 halt=0.47 train_steps=1.60 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.61136 val_adapt_rocauc=0.68535 adapt_steps=2.01 halt=0.47 train_steps=1.62 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.61978 val_adapt_rocauc=0.68974 adapt_steps=2.01 halt=0.46 train_steps=1.61 +[ogbg-molbace_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rocauc': 0.658974358974359} test={'rocauc': 0.7480438184663536} adaptive={'rocauc': 0.7546513649800034} steps=2.6315789473684212 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbace_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=resgated compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view resgated --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.61282 val_adapt_rocauc=0.59304 adapt_steps=2.04 halt=0.43 train_steps=1.89 +ep20 val_rocauc=0.68938 val_adapt_rocauc=0.61062 adapt_steps=2.04 halt=0.46 train_steps=1.69 +ep30 val_rocauc=0.66740 val_adapt_rocauc=0.70366 adapt_steps=2.12 halt=0.47 train_steps=1.61 +ep40 val_rocauc=0.64212 val_adapt_rocauc=0.67582 adapt_steps=2.01 halt=0.47 train_steps=1.67 +ep50 val_rocauc=0.55604 val_adapt_rocauc=0.57802 adapt_steps=2.00 halt=0.46 train_steps=1.61 +ep60 val_rocauc=0.69414 val_adapt_rocauc=0.69597 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep70 val_rocauc=0.61026 val_adapt_rocauc=0.63590 adapt_steps=2.00 halt=0.48 train_steps=1.55 +ep80 val_rocauc=0.66410 val_adapt_rocauc=0.66300 adapt_steps=2.00 halt=0.48 train_steps=1.59 +ep90 val_rocauc=0.65934 val_adapt_rocauc=0.64835 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.66850 val_adapt_rocauc=0.65128 adapt_steps=2.00 halt=0.47 train_steps=1.57 +[ogbg-molbace_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.6941391941391942} test={'rocauc': 0.7231785776386715} adaptive={'rocauc': 0.7640410363415059} steps=2.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbace_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json diff --git a/logs/ogbg-molbace_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log b/logs/ogbg-molbace_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log new file mode 100644 index 0000000..6fad787 --- /dev/null +++ b/logs/ogbg-molbace_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log @@ -0,0 +1,278 @@ +[run] ogbg-molbace view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.62747 val_adapt_rocauc=0.63956 adapt_steps=5.64 halt=0.17 train_steps=4.09 +ep20 val_rocauc=0.40916 val_adapt_rocauc=0.38755 adapt_steps=2.62 halt=0.15 train_steps=4.15 +ep30 val_rocauc=0.45714 val_adapt_rocauc=0.49011 adapt_steps=5.73 halt=0.17 train_steps=4.04 +ep40 val_rocauc=0.56740 val_adapt_rocauc=0.60037 adapt_steps=3.81 halt=0.24 train_steps=3.51 +ep50 val_rocauc=0.43443 val_adapt_rocauc=0.43736 adapt_steps=4.63 halt=0.20 train_steps=3.57 +ep60 val_rocauc=0.66557 val_adapt_rocauc=0.67289 adapt_steps=4.50 halt=0.22 train_steps=3.60 +ep70 val_rocauc=0.65018 val_adapt_rocauc=0.65604 adapt_steps=4.30 halt=0.27 train_steps=3.14 +ep80 val_rocauc=0.68022 val_adapt_rocauc=0.66520 adapt_steps=4.40 halt=0.30 train_steps=2.85 +ep90 val_rocauc=0.67216 val_adapt_rocauc=0.67070 adapt_steps=4.48 halt=0.27 train_steps=3.13 +ep100 val_rocauc=0.67582 val_adapt_rocauc=0.66447 adapt_steps=4.34 halt=0.30 train_steps=2.93 +[ogbg-molbace_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.6802197802197802} test={'rocauc': 0.723526343244653} adaptive={'rocauc': 0.721961398017736} steps=3.473684210526316 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=gine compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view gine --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.58205 val_adapt_rocauc=0.58462 adapt_steps=7.00 halt=0.27 train_steps=3.01 +ep20 val_rocauc=0.54835 val_adapt_rocauc=0.55495 adapt_steps=7.38 halt=0.13 train_steps=4.38 +ep30 val_rocauc=0.64542 val_adapt_rocauc=0.57033 adapt_steps=4.30 halt=0.15 train_steps=4.25 +ep40 val_rocauc=0.47033 val_adapt_rocauc=0.49597 adapt_steps=4.36 halt=0.18 train_steps=3.89 +ep50 val_rocauc=0.57619 val_adapt_rocauc=0.55971 adapt_steps=4.50 halt=0.18 train_steps=3.77 +ep60 val_rocauc=0.56593 val_adapt_rocauc=0.57143 adapt_steps=4.76 halt=0.24 train_steps=3.54 +ep70 val_rocauc=0.68242 val_adapt_rocauc=0.69780 adapt_steps=3.98 halt=0.25 train_steps=3.42 +ep80 val_rocauc=0.65897 val_adapt_rocauc=0.66081 adapt_steps=4.22 halt=0.26 train_steps=3.37 +ep90 val_rocauc=0.63187 val_adapt_rocauc=0.63150 adapt_steps=4.58 halt=0.24 train_steps=3.38 +ep100 val_rocauc=0.62381 val_adapt_rocauc=0.62637 adapt_steps=4.89 halt=0.25 train_steps=3.32 +[ogbg-molbace_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.6824175824175824} test={'rocauc': 0.7718657624760911} adaptive={'rocauc': 0.7697791688402017} steps=3.1710526315789473 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.59927 val_adapt_rocauc=0.60696 adapt_steps=5.45 halt=0.21 train_steps=3.53 +ep20 val_rocauc=0.61245 val_adapt_rocauc=0.60147 adapt_steps=4.89 halt=0.21 train_steps=3.54 +ep30 val_rocauc=0.71941 val_adapt_rocauc=0.72015 adapt_steps=4.09 halt=0.24 train_steps=3.64 +ep40 val_rocauc=0.66923 val_adapt_rocauc=0.67692 adapt_steps=4.70 halt=0.21 train_steps=3.73 +ep50 val_rocauc=0.72015 val_adapt_rocauc=0.70220 adapt_steps=4.28 halt=0.27 train_steps=3.33 +ep60 val_rocauc=0.66264 val_adapt_rocauc=0.67546 adapt_steps=4.85 halt=0.30 train_steps=2.94 +ep70 val_rocauc=0.57619 val_adapt_rocauc=0.57766 adapt_steps=3.40 halt=0.29 train_steps=3.02 +ep80 val_rocauc=0.60147 val_adapt_rocauc=0.61648 adapt_steps=3.09 halt=0.34 train_steps=2.52 +ep90 val_rocauc=0.63480 val_adapt_rocauc=0.63773 adapt_steps=3.01 halt=0.37 train_steps=2.41 +ep100 val_rocauc=0.63810 val_adapt_rocauc=0.63883 adapt_steps=2.89 halt=0.39 train_steps=2.20 +[ogbg-molbace_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=50 val={'rocauc': 0.7201465201465201} test={'rocauc': 0.7483915840723353} adaptive={'rocauc': 0.7450878108155105} steps=3.960526315789474 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=graphsage compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view graphsage --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.57070 val_adapt_rocauc=0.60293 adapt_steps=5.37 halt=0.30 train_steps=2.89 +ep20 val_rocauc=0.56520 val_adapt_rocauc=0.57692 adapt_steps=6.33 halt=0.20 train_steps=3.67 +ep30 val_rocauc=0.59670 val_adapt_rocauc=0.60916 adapt_steps=3.97 halt=0.25 train_steps=3.37 +ep40 val_rocauc=0.62564 val_adapt_rocauc=0.62454 adapt_steps=2.83 halt=0.30 train_steps=3.03 +ep50 val_rocauc=0.69634 val_adapt_rocauc=0.69597 adapt_steps=4.89 halt=0.23 train_steps=3.60 +ep60 val_rocauc=0.64286 val_adapt_rocauc=0.63480 adapt_steps=3.69 halt=0.26 train_steps=3.31 +ep70 val_rocauc=0.70916 val_adapt_rocauc=0.71502 adapt_steps=4.54 halt=0.26 train_steps=3.45 +ep80 val_rocauc=0.63626 val_adapt_rocauc=0.65897 adapt_steps=4.31 halt=0.28 train_steps=3.07 +ep90 val_rocauc=0.64066 val_adapt_rocauc=0.63590 adapt_steps=3.86 halt=0.32 train_steps=2.74 +ep100 val_rocauc=0.64066 val_adapt_rocauc=0.64835 adapt_steps=3.68 halt=0.30 train_steps=2.89 +[ogbg-molbace_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.7091575091575092} test={'rocauc': 0.7821248478525474} adaptive={'rocauc': 0.7909928708050773} steps=3.75 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=gatv2 compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view gatv2 --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.68608 val_adapt_rocauc=0.68938 adapt_steps=7.89 halt=0.17 train_steps=3.74 +ep20 val_rocauc=0.63260 val_adapt_rocauc=0.62674 adapt_steps=5.79 halt=0.21 train_steps=3.57 +ep30 val_rocauc=0.61612 val_adapt_rocauc=0.64615 adapt_steps=5.33 halt=0.23 train_steps=3.07 +ep40 val_rocauc=0.71319 val_adapt_rocauc=0.71978 adapt_steps=4.52 halt=0.23 train_steps=3.55 +ep50 val_rocauc=0.66960 val_adapt_rocauc=0.65458 adapt_steps=5.34 halt=0.21 train_steps=3.69 +ep60 val_rocauc=0.69927 val_adapt_rocauc=0.68571 adapt_steps=5.17 halt=0.21 train_steps=3.63 +ep70 val_rocauc=0.63956 val_adapt_rocauc=0.64652 adapt_steps=4.17 halt=0.28 train_steps=3.24 +ep80 val_rocauc=0.63333 val_adapt_rocauc=0.63260 adapt_steps=3.86 halt=0.26 train_steps=3.23 +ep90 val_rocauc=0.64103 val_adapt_rocauc=0.65714 adapt_steps=2.97 halt=0.34 train_steps=2.71 +ep100 val_rocauc=0.63297 val_adapt_rocauc=0.63773 adapt_steps=3.26 halt=0.32 train_steps=2.75 +[ogbg-molbace_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=40 val={'rocauc': 0.7131868131868132} test={'rocauc': 0.8261171970092158} adaptive={'rocauc': 0.8262910798122065} steps=4.006578947368421 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.56081 val_adapt_rocauc=0.58388 adapt_steps=6.43 halt=0.27 train_steps=3.07 +ep20 val_rocauc=0.61245 val_adapt_rocauc=0.59780 adapt_steps=7.42 halt=0.18 train_steps=3.93 +ep30 val_rocauc=0.69084 val_adapt_rocauc=0.69231 adapt_steps=5.89 halt=0.22 train_steps=3.39 +ep40 val_rocauc=0.66154 val_adapt_rocauc=0.66520 adapt_steps=3.93 halt=0.21 train_steps=3.61 +ep50 val_rocauc=0.57399 val_adapt_rocauc=0.60147 adapt_steps=3.54 halt=0.32 train_steps=2.79 +ep60 val_rocauc=0.67546 val_adapt_rocauc=0.69011 adapt_steps=3.45 halt=0.30 train_steps=2.92 +ep70 val_rocauc=0.61099 val_adapt_rocauc=0.62564 adapt_steps=3.86 halt=0.33 train_steps=2.69 +ep80 val_rocauc=0.65275 val_adapt_rocauc=0.65458 adapt_steps=3.17 halt=0.37 train_steps=2.41 +ep90 val_rocauc=0.66740 val_adapt_rocauc=0.66703 adapt_steps=3.09 halt=0.40 train_steps=2.22 +ep100 val_rocauc=0.67766 val_adapt_rocauc=0.67875 adapt_steps=3.11 halt=0.36 train_steps=2.30 +[ogbg-molbace_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rocauc': 0.6908424908424909} test={'rocauc': 0.7475221700573813} adaptive={'rocauc': 0.7638671535385151} steps=4.276315789473684 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=transformer compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view transformer --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.63223 val_adapt_rocauc=0.64322 adapt_steps=6.61 halt=0.18 train_steps=3.96 +ep20 val_rocauc=0.54066 val_adapt_rocauc=0.57179 adapt_steps=7.52 halt=0.18 train_steps=3.90 +ep30 val_rocauc=0.51538 val_adapt_rocauc=0.54872 adapt_steps=3.85 halt=0.19 train_steps=3.74 +ep40 val_rocauc=0.61978 val_adapt_rocauc=0.59597 adapt_steps=3.91 halt=0.24 train_steps=3.50 +ep50 val_rocauc=0.57106 val_adapt_rocauc=0.58095 adapt_steps=3.20 halt=0.26 train_steps=3.27 +ep60 val_rocauc=0.62967 val_adapt_rocauc=0.62747 adapt_steps=5.23 halt=0.28 train_steps=3.29 +ep70 val_rocauc=0.61575 val_adapt_rocauc=0.62857 adapt_steps=3.82 halt=0.35 train_steps=2.50 +ep80 val_rocauc=0.65348 val_adapt_rocauc=0.65385 adapt_steps=3.36 halt=0.37 train_steps=2.42 +ep90 val_rocauc=0.64103 val_adapt_rocauc=0.63114 adapt_steps=3.39 halt=0.36 train_steps=2.45 +ep100 val_rocauc=0.64396 val_adapt_rocauc=0.62784 adapt_steps=3.23 halt=0.37 train_steps=2.26 +[ogbg-molbace_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.6534798534798535} test={'rocauc': 0.7191792731698834} adaptive={'rocauc': 0.729264475743349} steps=2.710526315789474 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=pna compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view pna --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.59634 val_adapt_rocauc=0.59707 adapt_steps=7.95 halt=0.19 train_steps=3.73 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.70952 val_adapt_rocauc=0.58462 adapt_steps=3.56 halt=0.17 train_steps=3.89 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.62454 val_adapt_rocauc=0.62454 adapt_steps=7.94 halt=0.18 train_steps=3.65 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.50879 val_adapt_rocauc=0.50623 adapt_steps=7.53 halt=0.13 train_steps=4.40 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.51941 val_adapt_rocauc=0.51319 adapt_steps=6.01 halt=0.18 train_steps=3.86 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.64579 val_adapt_rocauc=0.65238 adapt_steps=6.48 halt=0.18 train_steps=3.94 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.64249 val_adapt_rocauc=0.63333 adapt_steps=4.91 halt=0.24 train_steps=3.31 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.60293 val_adapt_rocauc=0.60806 adapt_steps=5.57 halt=0.22 train_steps=3.46 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.61209 val_adapt_rocauc=0.60952 adapt_steps=5.67 halt=0.23 train_steps=3.43 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.61465 val_adapt_rocauc=0.62491 adapt_steps=6.01 halt=0.23 train_steps=3.48 +[ogbg-molbace_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=20 val={'rocauc': 0.7095238095238096} test={'rocauc': 0.7809076682316118} adaptive={'rocauc': 0.7337854286211093} steps=3.914473684210526 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=gen compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view gen --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.43187 val_adapt_rocauc=0.56960 adapt_steps=3.77 halt=0.20 train_steps=4.07 +ep20 val_rocauc=0.58755 val_adapt_rocauc=0.58315 adapt_steps=6.03 halt=0.16 train_steps=4.18 +ep30 val_rocauc=0.65165 val_adapt_rocauc=0.65201 adapt_steps=7.28 halt=0.17 train_steps=4.07 +ep40 val_rocauc=0.56667 val_adapt_rocauc=0.56703 adapt_steps=7.34 halt=0.19 train_steps=3.89 +ep50 val_rocauc=0.56703 val_adapt_rocauc=0.55275 adapt_steps=5.61 halt=0.21 train_steps=3.62 +ep60 val_rocauc=0.65348 val_adapt_rocauc=0.64286 adapt_steps=4.45 halt=0.28 train_steps=3.22 +ep70 val_rocauc=0.60403 val_adapt_rocauc=0.60623 adapt_steps=6.13 halt=0.20 train_steps=3.81 +ep80 val_rocauc=0.61685 val_adapt_rocauc=0.62051 adapt_steps=4.32 halt=0.29 train_steps=2.95 +ep90 val_rocauc=0.62308 val_adapt_rocauc=0.63223 adapt_steps=4.03 halt=0.32 train_steps=2.75 +ep100 val_rocauc=0.63150 val_adapt_rocauc=0.64066 adapt_steps=3.91 halt=0.31 train_steps=2.88 +[ogbg-molbace_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.6534798534798535} test={'rocauc': 0.6915319074943488} adaptive={'rocauc': 0.6788384628760215} steps=3.9802631578947367 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=film compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view film --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.62637 val_adapt_rocauc=0.61355 adapt_steps=6.25 halt=0.18 train_steps=3.97 +ep20 val_rocauc=0.57436 val_adapt_rocauc=0.57473 adapt_steps=7.62 halt=0.14 train_steps=4.26 +ep30 val_rocauc=0.54359 val_adapt_rocauc=0.56227 adapt_steps=6.98 halt=0.16 train_steps=4.10 +ep40 val_rocauc=0.59689 val_adapt_rocauc=0.58095 adapt_steps=6.34 halt=0.17 train_steps=4.15 +ep50 val_rocauc=0.61868 val_adapt_rocauc=0.61648 adapt_steps=7.64 halt=0.16 train_steps=4.16 +ep60 val_rocauc=0.59634 val_adapt_rocauc=0.59890 adapt_steps=6.07 halt=0.19 train_steps=3.90 +ep70 val_rocauc=0.64670 val_adapt_rocauc=0.64725 adapt_steps=6.14 halt=0.22 train_steps=3.54 +ep80 val_rocauc=0.59744 val_adapt_rocauc=0.59359 adapt_steps=5.54 halt=0.22 train_steps=3.55 +ep90 val_rocauc=0.63333 val_adapt_rocauc=0.63187 adapt_steps=5.75 halt=0.23 train_steps=3.63 +ep100 val_rocauc=0.62381 val_adapt_rocauc=0.61703 adapt_steps=5.77 halt=0.24 train_steps=3.54 +[ogbg-molbace_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.6467032967032967} test={'rocauc': 0.6802295252999478} adaptive={'rocauc': 0.6732742131803164} steps=5.256578947368421 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=resgated compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view resgated --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.61245 val_adapt_rocauc=0.64286 adapt_steps=7.03 halt=0.17 train_steps=3.93 +ep20 val_rocauc=0.53004 val_adapt_rocauc=0.55201 adapt_steps=5.85 halt=0.25 train_steps=3.12 +ep30 val_rocauc=0.69158 val_adapt_rocauc=0.65897 adapt_steps=3.81 halt=0.27 train_steps=3.13 +ep40 val_rocauc=0.58132 val_adapt_rocauc=0.57509 adapt_steps=4.23 halt=0.26 train_steps=3.03 +ep50 val_rocauc=0.73956 val_adapt_rocauc=0.72930 adapt_steps=4.14 halt=0.26 train_steps=3.32 +ep60 val_rocauc=0.67766 val_adapt_rocauc=0.67253 adapt_steps=5.34 halt=0.25 train_steps=3.32 +ep70 val_rocauc=0.72418 val_adapt_rocauc=0.72967 adapt_steps=3.80 halt=0.30 train_steps=2.96 +ep80 val_rocauc=0.71062 val_adapt_rocauc=0.69963 adapt_steps=3.62 halt=0.28 train_steps=3.28 +ep90 val_rocauc=0.71538 val_adapt_rocauc=0.71612 adapt_steps=3.32 halt=0.34 train_steps=2.66 +ep100 val_rocauc=0.69963 val_adapt_rocauc=0.69670 adapt_steps=3.08 halt=0.33 train_steps=2.65 +[ogbg-molbace_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=50 val={'rocauc': 0.7395604395604396} test={'rocauc': 0.7313510693792384} adaptive={'rocauc': 0.7617805599026256} steps=3.388157894736842 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.65641 val_adapt_rocauc=0.66630 adapt_steps=5.21 halt=0.15 train_steps=4.34 +ep20 val_rocauc=0.54725 val_adapt_rocauc=0.53040 adapt_steps=4.77 halt=0.20 train_steps=3.52 +ep30 val_rocauc=0.51172 val_adapt_rocauc=0.58132 adapt_steps=4.25 halt=0.18 train_steps=3.92 +ep40 val_rocauc=0.52821 val_adapt_rocauc=0.54835 adapt_steps=2.84 halt=0.30 train_steps=2.92 +ep50 val_rocauc=0.62088 val_adapt_rocauc=0.63736 adapt_steps=3.09 halt=0.32 train_steps=2.79 +ep60 val_rocauc=0.70842 val_adapt_rocauc=0.69707 adapt_steps=2.97 halt=0.36 train_steps=2.52 +ep70 val_rocauc=0.68938 val_adapt_rocauc=0.72711 adapt_steps=3.27 halt=0.35 train_steps=2.61 +ep80 val_rocauc=0.63516 val_adapt_rocauc=0.66667 adapt_steps=2.93 halt=0.39 train_steps=2.19 +ep90 val_rocauc=0.62894 val_adapt_rocauc=0.65861 adapt_steps=2.70 halt=0.39 train_steps=2.17 +ep100 val_rocauc=0.62930 val_adapt_rocauc=0.66154 adapt_steps=2.59 halt=0.40 train_steps=2.06 +[ogbg-molbace_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.7084249084249085} test={'rocauc': 0.7960354720918101} adaptive={'rocauc': 0.7776038949747869} steps=2.5526315789473686 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.56667 val_adapt_rocauc=0.65934 adapt_steps=5.01 halt=0.16 train_steps=4.12 +ep20 val_rocauc=0.62637 val_adapt_rocauc=0.63626 adapt_steps=5.57 halt=0.17 train_steps=4.08 +ep30 val_rocauc=0.57985 val_adapt_rocauc=0.58498 adapt_steps=6.50 halt=0.21 train_steps=3.54 +ep40 val_rocauc=0.64286 val_adapt_rocauc=0.64469 adapt_steps=6.27 halt=0.20 train_steps=3.71 +ep50 val_rocauc=0.65678 val_adapt_rocauc=0.68791 adapt_steps=4.30 halt=0.25 train_steps=3.33 +ep60 val_rocauc=0.66154 val_adapt_rocauc=0.66410 adapt_steps=3.97 halt=0.25 train_steps=3.40 +ep70 val_rocauc=0.64799 val_adapt_rocauc=0.63223 adapt_steps=3.69 halt=0.27 train_steps=3.13 +ep80 val_rocauc=0.63114 val_adapt_rocauc=0.62711 adapt_steps=4.02 halt=0.29 train_steps=3.02 +ep90 val_rocauc=0.64103 val_adapt_rocauc=0.62125 adapt_steps=3.56 halt=0.31 train_steps=2.86 +ep100 val_rocauc=0.63223 val_adapt_rocauc=0.61795 adapt_steps=3.49 halt=0.33 train_steps=2.77 +[ogbg-molbace_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.6615384615384615} test={'rocauc': 0.7970787689097547} adaptive={'rocauc': 0.7988175969396626} steps=3.638157894736842 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=cheb compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view cheb --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.63846 val_adapt_rocauc=0.65495 adapt_steps=4.03 halt=0.18 train_steps=3.80 +ep20 val_rocauc=0.67143 val_adapt_rocauc=0.69011 adapt_steps=4.54 halt=0.19 train_steps=3.98 +ep30 val_rocauc=0.61245 val_adapt_rocauc=0.69084 adapt_steps=3.26 halt=0.28 train_steps=2.95 +ep40 val_rocauc=0.59817 val_adapt_rocauc=0.60879 adapt_steps=3.16 halt=0.28 train_steps=3.20 +ep50 val_rocauc=0.67729 val_adapt_rocauc=0.68498 adapt_steps=3.72 halt=0.33 train_steps=2.63 +ep60 val_rocauc=0.65714 val_adapt_rocauc=0.68938 adapt_steps=3.75 halt=0.34 train_steps=2.55 +ep70 val_rocauc=0.71648 val_adapt_rocauc=0.73810 adapt_steps=2.87 halt=0.41 train_steps=2.00 +ep80 val_rocauc=0.70440 val_adapt_rocauc=0.70366 adapt_steps=2.56 halt=0.42 train_steps=2.02 +ep90 val_rocauc=0.67656 val_adapt_rocauc=0.68315 adapt_steps=2.33 halt=0.46 train_steps=1.67 +ep100 val_rocauc=0.67729 val_adapt_rocauc=0.68352 adapt_steps=2.35 halt=0.45 train_steps=1.70 +[ogbg-molbace_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.7164835164835166} test={'rocauc': 0.8007303077725613} adaptive={'rocauc': 0.8120326899669622} steps=2.598684210526316 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=arma compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view arma --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.62711 val_adapt_rocauc=0.60293 adapt_steps=4.62 halt=0.25 train_steps=3.40 +ep20 val_rocauc=0.68095 val_adapt_rocauc=0.63114 adapt_steps=4.19 halt=0.27 train_steps=3.04 +ep30 val_rocauc=0.53516 val_adapt_rocauc=0.52125 adapt_steps=6.76 halt=0.21 train_steps=3.47 +ep40 val_rocauc=0.72564 val_adapt_rocauc=0.74139 adapt_steps=4.15 halt=0.26 train_steps=3.14 +ep50 val_rocauc=0.73553 val_adapt_rocauc=0.73480 adapt_steps=4.72 halt=0.26 train_steps=3.28 +ep60 val_rocauc=0.68278 val_adapt_rocauc=0.61465 adapt_steps=3.82 halt=0.30 train_steps=2.82 +ep70 val_rocauc=0.70659 val_adapt_rocauc=0.71245 adapt_steps=3.50 halt=0.34 train_steps=2.66 +ep80 val_rocauc=0.69853 val_adapt_rocauc=0.68718 adapt_steps=3.68 halt=0.34 train_steps=2.53 +ep90 val_rocauc=0.69597 val_adapt_rocauc=0.68901 adapt_steps=2.83 halt=0.40 train_steps=2.18 +ep100 val_rocauc=0.68828 val_adapt_rocauc=0.67766 adapt_steps=2.85 halt=0.39 train_steps=2.21 +[ogbg-molbace_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=50 val={'rocauc': 0.7355311355311356} test={'rocauc': 0.7450878108155102} adaptive={'rocauc': 0.7645626847504782} steps=4.375 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=mf compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view mf --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.74066 val_adapt_rocauc=0.75311 adapt_steps=6.21 halt=0.21 train_steps=3.61 +ep20 val_rocauc=0.68388 val_adapt_rocauc=0.68755 adapt_steps=6.04 halt=0.22 train_steps=3.45 +ep30 val_rocauc=0.77473 val_adapt_rocauc=0.74725 adapt_steps=5.03 halt=0.19 train_steps=3.88 +ep40 val_rocauc=0.63260 val_adapt_rocauc=0.63773 adapt_steps=5.52 halt=0.26 train_steps=3.11 +ep50 val_rocauc=0.62894 val_adapt_rocauc=0.63260 adapt_steps=3.91 halt=0.29 train_steps=2.98 +ep60 val_rocauc=0.70586 val_adapt_rocauc=0.69927 adapt_steps=3.87 halt=0.29 train_steps=2.99 +ep70 val_rocauc=0.67656 val_adapt_rocauc=0.67619 adapt_steps=3.77 halt=0.33 train_steps=2.76 +ep80 val_rocauc=0.68022 val_adapt_rocauc=0.67326 adapt_steps=3.08 halt=0.33 train_steps=2.72 +ep90 val_rocauc=0.67179 val_adapt_rocauc=0.66740 adapt_steps=2.82 halt=0.38 train_steps=2.33 +ep100 val_rocauc=0.67949 val_adapt_rocauc=0.68205 adapt_steps=2.88 halt=0.39 train_steps=2.19 +[ogbg-molbace_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rocauc': 0.7747252747252747} test={'rocauc': 0.8019474873934969} adaptive={'rocauc': 0.7949921752738653} steps=4.980263157894737 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbace view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbace --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.55678 val_adapt_rocauc=0.62051 adapt_steps=2.15 halt=0.39 train_steps=2.28 +ep20 val_rocauc=0.68352 val_adapt_rocauc=0.65495 adapt_steps=2.36 halt=0.42 train_steps=1.96 +ep30 val_rocauc=0.63700 val_adapt_rocauc=0.65092 adapt_steps=2.30 halt=0.44 train_steps=1.66 +ep40 val_rocauc=0.61429 val_adapt_rocauc=0.60037 adapt_steps=2.01 halt=0.46 train_steps=1.65 +ep50 val_rocauc=0.59414 val_adapt_rocauc=0.59011 adapt_steps=2.03 halt=0.47 train_steps=1.57 +ep60 val_rocauc=0.61868 val_adapt_rocauc=0.59670 adapt_steps=2.00 halt=0.48 train_steps=1.59 +ep70 val_rocauc=0.58901 val_adapt_rocauc=0.60256 adapt_steps=2.00 halt=0.47 train_steps=1.59 +ep80 val_rocauc=0.56923 val_adapt_rocauc=0.58608 adapt_steps=2.00 halt=0.47 train_steps=1.62 +ep90 val_rocauc=0.57839 val_adapt_rocauc=0.60183 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep100 val_rocauc=0.58059 val_adapt_rocauc=0.60073 adapt_steps=2.00 halt=0.46 train_steps=1.60 +[ogbg-molbace_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=20 val={'rocauc': 0.6835164835164835} test={'rocauc': 0.7118761954442705} adaptive={'rocauc': 0.7328290732046601} steps=2.1315789473684212 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbace_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json diff --git a/logs/ogbg-molbbbp_0.log b/logs/ogbg-molbbbp_0.log new file mode 100644 index 0000000..c0bb356 --- /dev/null +++ b/logs/ogbg-molbbbp_0.log @@ -0,0 +1,647 @@ +[run] ogbg-molbbbp view=gin compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gin --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/bbbp.zip +
0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 1168.17it/s] +Processing... +Extracting /orion/u/oscarwan/rrog-gnn-runner/data/ogb/bbbp.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/2039 [00:00<?, ?it/s]
100%|██████████| 2039/2039 [00:00<00:00, 165147.94it/s] +Converting graphs into PyG objects... +
0%| | 0/2039 [00:00<?, ?it/s]
100%|██████████| 2039/2039 [00:00<00:00, 59985.45it/s] +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/ogb/graphproppred/dataset_pyg.py:156: UserWarning: The given NumPy array is not writable, and PyTorch does not support non-writable tensors. This means writing to this tensor will result in undefined behavior. You may want to copy the array to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at /pytorch/torch/csrc/utils/tensor_numpy.cpp:203.) + g.y = torch.from_numpy(graph_label[i]).view(1,-1).to(torch.long) +Done! +Saving... +ep10 val_rocauc=0.92512 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.89933 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.88519 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.91098 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.88191 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.88041 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.89565 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.89933 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.90172 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.90202 halt=0.00 train_steps=1.00 +[ogbg-molbbbp_gin_classic_T0_ns1_h128_e100_s0] best_ep=10 val={'rocauc': 0.925121975505327} test={'rocauc': 0.5670331790123456} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_gin_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbbbp view=gin compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gin --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.95260 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.93299 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.92502 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.88410 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.91736 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.92522 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.92801 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.92373 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.92243 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.92512 halt=0.00 train_steps=3.00 +[ogbg-molbbbp_gin_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=10 val={'rocauc': 0.9526038036443294} test={'rocauc': 0.5931712962962963} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_gin_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbbbp view=gine compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gine --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.82535 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.88788 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.91138 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.93239 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.91825 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.90810 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.89137 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.90959 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.90441 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.90690 halt=0.00 train_steps=1.00 +[ogbg-molbbbp_gine_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rocauc': 0.932390719904411} test={'rocauc': 0.6160300925925926} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_gine_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbbbp view=gine compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gine --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.91397 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.90710 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.85363 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.94215 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.90471 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.90909 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.90043 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.90252 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.90103 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.90441 halt=0.00 train_steps=3.00 +[ogbg-molbbbp_gine_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.9421487603305785} test={'rocauc': 0.6976273148148147} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_gine_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbbbp view=gcn compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gcn --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.91297 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.92891 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.92940 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.93856 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.92164 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.92881 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.93110 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.93269 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.93080 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.93299 halt=0.00 train_steps=1.00 +[ogbg-molbbbp_gcn_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rocauc': 0.9385641740515782} test={'rocauc': 0.667920524691358} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_gcn_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbbbp view=gcn compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gcn --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.94165 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.92293 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.90919 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.92632 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.92940 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.91546 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.92642 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.92811 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.92701 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.92592 halt=0.00 train_steps=3.00 +[ogbg-molbbbp_gcn_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=10 val={'rocauc': 0.9416509011251619} test={'rocauc': 0.601658950617284} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbbbp view=graphsage compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view graphsage --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.94832 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.92034 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.93498 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.91576 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.91945 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.91477 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.90999 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.90750 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.90481 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.90232 halt=0.00 train_steps=1.00 +[ogbg-molbbbp_graphsage_classic_T0_ns1_h128_e100_s0] best_ep=10 val={'rocauc': 0.9483222144777457} test={'rocauc': 0.628761574074074} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_graphsage_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbbbp view=graphsage compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view graphsage --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.87882 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.95021 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.92104 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.92144 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.93488 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.93777 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.93199 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.93528 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.93269 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.93468 halt=0.00 train_steps=3.00 +[ogbg-molbbbp_graphsage_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=20 val={'rocauc': 0.9502140794583291} test={'rocauc': 0.5933641975308641} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbbbp view=gatv2 compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gatv2 --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.92393 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.93349 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.91238 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.93468 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.91507 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.92990 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.92960 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.93000 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.92901 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.92851 halt=0.00 train_steps=1.00 +[ogbg-molbbbp_gatv2_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rocauc': 0.9346808722493279} test={'rocauc': 0.6324266975308642} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_gatv2_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbbbp view=gatv2 compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gatv2 --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.88251 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.90780 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.93558 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.93528 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.92154 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.92632 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.92442 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.92592 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.92482 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.92263 halt=0.00 train_steps=3.00 +[ogbg-molbbbp_gatv2_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.935577018819078} test={'rocauc': 0.6559606481481481} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbbbp view=graphconv compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view graphconv --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.92204 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.92681 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.89087 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.89625 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.92034 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.92024 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.91377 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.91745 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.91676 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.91686 halt=0.00 train_steps=1.00 +[ogbg-molbbbp_graphconv_classic_T0_ns1_h128_e100_s0] best_ep=20 val={'rocauc': 0.9268146968037438} test={'rocauc': 0.5899884259259258} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_graphconv_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbbbp view=graphconv compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view graphconv --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.93369 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.93279 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.91566 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.92204 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.92891 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.91805 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.92363 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.91795 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.91536 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.91307 halt=0.00 train_steps=3.00 +[ogbg-molbbbp_graphconv_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=10 val={'rocauc': 0.9336851538384945} test={'rocauc': 0.6518132716049383} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbbbp view=transformer compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view transformer --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.94952 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.93538 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.94613 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.94553 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.93259 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.93657 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.93458 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.93428 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.93339 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.93299 halt=0.00 train_steps=1.00 +[ogbg-molbbbp_transformer_classic_T0_ns1_h128_e100_s0] best_ep=10 val={'rocauc': 0.9495170765707458} test={'rocauc': 0.6156442901234568} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_transformer_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbbbp view=transformer compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view transformer --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.93548 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.91516 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.92582 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.91775 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.92174 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.92871 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.92164 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.92134 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.92004 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.92024 halt=0.00 train_steps=3.00 +[ogbg-molbbbp_transformer_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=10 val={'rocauc': 0.9354774469779946} test={'rocauc': 0.6221064814814815} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbbbp view=pna compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view pna --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.91188 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.88977 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.90929 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.92134 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.90869 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.95539 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.93130 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.92213 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.91795 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.92174 halt=0.00 train_steps=1.00 +[ogbg-molbbbp_pna_classic_T0_ns1_h128_e100_s0] best_ep=60 val={'rocauc': 0.955391815194663} test={'rocauc': 0.6417824074074073} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_pna_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbbbp view=pna compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view pna --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.88579 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.90571 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.80783 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.95848 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.93478 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.94474 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.92841 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.92413 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.91487 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.91875 halt=0.00 train_steps=3.00 +[ogbg-molbbbp_pna_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.9584785422682465} test={'rocauc': 0.6682098765432098} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_pna_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbbbp view=gen compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gen --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.89943 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.92104 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.92502 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.95489 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.92213 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.93408 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.93717 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.93777 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.93797 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.93777 halt=0.00 train_steps=1.00 +[ogbg-molbbbp_gen_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rocauc': 0.9548939559892462} test={'rocauc': 0.677469135802469} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_gen_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbbbp view=gen compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gen --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.93657 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.92353 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.92452 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.94295 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.92174 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.93578 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.94036 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.93976 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.93856 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.93737 halt=0.00 train_steps=3.00 +[ogbg-molbbbp_gen_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.9429453350592453} test={'rocauc': 0.6036844135802468} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_gen_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbbbp view=film compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view film --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.83919 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.85024 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.89167 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.91128 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.92851 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.92303 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.91616 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.91387 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.91407 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.91596 halt=0.00 train_steps=1.00 +[ogbg-molbbbp_film_classic_T0_ns1_h128_e100_s0] best_ep=50 val={'rocauc': 0.9285074181021606} test={'rocauc': 0.6300154320987654} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_film_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbbbp view=film compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view film --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.90122 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.93996 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.91477 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.90312 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.90252 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.90630 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.90959 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.90282 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.90182 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.90252 halt=0.00 train_steps=3.00 +[ogbg-molbbbp_film_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=20 val={'rocauc': 0.939958179826745} test={'rocauc': 0.6323302469135803} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_film_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbbbp view=resgated compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view resgated --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.88957 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.91477 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.87743 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.88967 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.91825 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.91158 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.90630 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.91238 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.91078 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.91317 halt=0.00 train_steps=1.00 +[ogbg-molbbbp_resgated_classic_T0_ns1_h128_e100_s0] best_ep=50 val={'rocauc': 0.9182515184705764} test={'rocauc': 0.6626157407407406} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_resgated_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbbbp view=resgated compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view resgated --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.93807 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.95350 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.92034 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.92124 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.89057 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.89893 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.90401 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.90620 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.90531 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.90381 halt=0.00 train_steps=3.00 +[ogbg-molbbbp_resgated_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=20 val={'rocauc': 0.9534999502140794} test={'rocauc': 0.583912037037037} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbbbp view=tag compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view tag --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.93369 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.92253 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.93607 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.94763 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.92801 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.93677 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.93617 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.93299 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.93319 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.93329 halt=0.00 train_steps=1.00 +[ogbg-molbbbp_tag_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rocauc': 0.9476252115901622} test={'rocauc': 0.6099537037037036} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_tag_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbbbp view=tag compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view tag --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.91367 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.94265 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.94593 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.92960 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.91915 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.91526 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.92064 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.91775 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.91895 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.91805 halt=0.00 train_steps=3.00 +[ogbg-molbbbp_tag_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.9459324902917455} test={'rocauc': 0.6419753086419753} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_tag_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbbbp view=sgc compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view sgc --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.90381 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.92104 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.90272 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.91048 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.92313 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.93000 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.92044 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.91775 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.91566 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.91556 halt=0.00 train_steps=1.00 +[ogbg-molbbbp_sgc_classic_T0_ns1_h128_e100_s0] best_ep=60 val={'rocauc': 0.9300009957184109} test={'rocauc': 0.6239390432098766} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_sgc_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbbbp view=sgc compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view sgc --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.91736 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.88111 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.92831 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.91905 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.92851 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.91636 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.92004 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.91616 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.91526 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.91556 halt=0.00 train_steps=3.00 +[ogbg-molbbbp_sgc_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rocauc': 0.9285074181021606} test={'rocauc': 0.6454475308641976} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbbbp view=cheb compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view cheb --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.91925 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.94524 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.92084 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.91377 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.91497 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.92353 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.91925 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.91726 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.92114 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.92154 halt=0.00 train_steps=1.00 +[ogbg-molbbbp_cheb_classic_T0_ns1_h128_e100_s0] best_ep=20 val={'rocauc': 0.9452354874041621} test={'rocauc': 0.6514274691358024} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_cheb_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbbbp view=cheb compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view cheb --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.90152 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.91805 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.92313 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.92781 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.92423 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.92433 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.91975 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.91755 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.91835 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.91855 halt=0.00 train_steps=3.00 +[ogbg-molbbbp_cheb_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.9278104152145773} test={'rocauc': 0.665895061728395} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbbbp view=arma compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view arma --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.93667 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.90013 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.91367 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.86598 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.88948 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.88997 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.88858 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.88997 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.88938 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.89057 halt=0.00 train_steps=1.00 +[ogbg-molbbbp_arma_classic_T0_ns1_h128_e100_s0] best_ep=10 val={'rocauc': 0.9366723090709947} test={'rocauc': 0.6651234567901235} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_arma_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbbbp view=arma compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view arma --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.94145 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.85263 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.91646 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.89485 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.93100 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.90919 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.91218 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.91367 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.91546 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.91427 halt=0.00 train_steps=3.00 +[ogbg-molbbbp_arma_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=10 val={'rocauc': 0.941451757442995} test={'rocauc': 0.6634837962962963} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_arma_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbbbp view=mf compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view mf --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.91048 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.91984 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.93090 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.93946 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.92323 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.92672 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.92333 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.92084 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.92004 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.91805 halt=0.00 train_steps=1.00 +[ogbg-molbbbp_mf_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rocauc': 0.9394603206213283} test={'rocauc': 0.6364776234567902} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_mf_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbbbp view=mf compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view mf --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.88619 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.94882 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.93797 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.91238 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.92522 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.93229 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.92930 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.92821 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.92811 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.92652 halt=0.00 train_steps=3.00 +[ogbg-molbbbp_mf_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=20 val={'rocauc': 0.9488200736831625} test={'rocauc': 0.6480516975308641} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_mf_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molbbbp view=appnp compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view appnp --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.90122 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.91467 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.88539 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.89416 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.88330 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.89246 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.88788 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.88898 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.89425 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.89167 halt=0.00 train_steps=1.00 +[ogbg-molbbbp_appnp_classic_T0_ns1_h128_e100_s0] best_ep=20 val={'rocauc': 0.9146669321915762} test={'rocauc': 0.6387924382716049} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_appnp_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molbbbp view=appnp compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view appnp --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.93598 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.90202 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.92014 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.93189 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.91188 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.91248 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.90272 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.89844 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.90680 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.90620 halt=0.00 train_steps=3.00 +[ogbg-molbbbp_appnp_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=10 val={'rocauc': 0.9359753061834113} test={'rocauc': 0.6073495370370371} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json + +Classic baseline: task x backbone +| task | backbone | metric | n | val | test | +| --- | --- | --- | --- | --- | --- | +| ogbg-molbbbp | appnp | rocauc | 1 | 0.9147 +/- 0.0000 | 0.6388 +/- 0.0000 | +| ogbg-molbbbp | arma | rocauc | 1 | 0.9367 +/- 0.0000 | 0.6651 +/- 0.0000 | +| ogbg-molbbbp | cheb | rocauc | 1 | 0.9452 +/- 0.0000 | 0.6514 +/- 0.0000 | +| ogbg-molbbbp | film | rocauc | 1 | 0.9285 +/- 0.0000 | 0.6300 +/- 0.0000 | +| ogbg-molbbbp | gatv2 | rocauc | 1 | 0.9347 +/- 0.0000 | 0.6324 +/- 0.0000 | +| ogbg-molbbbp | gcn | rocauc | 1 | 0.9386 +/- 0.0000 | 0.6679 +/- 0.0000 | +| ogbg-molbbbp | gen | rocauc | 1 | 0.9549 +/- 0.0000 | 0.6775 +/- 0.0000 | +| ogbg-molbbbp | gin | rocauc | 1 | 0.9251 +/- 0.0000 | 0.5670 +/- 0.0000 | +| ogbg-molbbbp | gine | rocauc | 1 | 0.9324 +/- 0.0000 | 0.6160 +/- 0.0000 | +| ogbg-molbbbp | graphconv | rocauc | 1 | 0.9268 +/- 0.0000 | 0.5900 +/- 0.0000 | +| ogbg-molbbbp | graphsage | rocauc | 1 | 0.9483 +/- 0.0000 | 0.6288 +/- 0.0000 | +| ogbg-molbbbp | mf | rocauc | 1 | 0.9395 +/- 0.0000 | 0.6365 +/- 0.0000 | +| ogbg-molbbbp | pna | rocauc | 1 | 0.9554 +/- 0.0000 | 0.6418 +/- 0.0000 | +| ogbg-molbbbp | resgated | rocauc | 1 | 0.9183 +/- 0.0000 | 0.6626 +/- 0.0000 | +| ogbg-molbbbp | sgc | rocauc | 1 | 0.9300 +/- 0.0000 | 0.6239 +/- 0.0000 | +| ogbg-molbbbp | tag | rocauc | 1 | 0.9476 +/- 0.0000 | 0.6100 +/- 0.0000 | +| ogbg-molbbbp | transformer | rocauc | 1 | 0.9495 +/- 0.0000 | 0.6156 +/- 0.0000 | +| ogbg-molhiv | appnp | rocauc | 1 | 0.7675 +/- 0.0000 | 0.7000 +/- 0.0000 | +| ogbg-molhiv | arma | rocauc | 1 | 0.7872 +/- 0.0000 | 0.7296 +/- 0.0000 | +| ogbg-molhiv | cheb | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7282 +/- 0.0000 | +| ogbg-molhiv | film | rocauc | 1 | 0.7922 +/- 0.0000 | 0.7842 +/- 0.0000 | +| ogbg-molhiv | gatv2 | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7563 +/- 0.0000 | +| ogbg-molhiv | gcn | rocauc | 1 | 0.7754 +/- 0.0000 | 0.7198 +/- 0.0000 | +| ogbg-molhiv | gen | rocauc | 1 | 0.7530 +/- 0.0000 | 0.7314 +/- 0.0000 | +| ogbg-molhiv | gin | rocauc | 1 | 0.8167 +/- 0.0000 | 0.7724 +/- 0.0000 | +| ogbg-molhiv | gine | rocauc | 1 | 0.7942 +/- 0.0000 | 0.7445 +/- 0.0000 | +| ogbg-molhiv | graphconv | rocauc | 1 | 0.7707 +/- 0.0000 | 0.7108 +/- 0.0000 | +| ogbg-molhiv | graphsage | rocauc | 1 | 0.7969 +/- 0.0000 | 0.7625 +/- 0.0000 | +| ogbg-molhiv | mf | rocauc | 1 | 0.7845 +/- 0.0000 | 0.7074 +/- 0.0000 | +| ogbg-molhiv | pna | rocauc | 1 | 0.7780 +/- 0.0000 | 0.7648 +/- 0.0000 | +| ogbg-molhiv | resgated | rocauc | 1 | 0.8144 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molhiv | sgc | rocauc | 1 | 0.7479 +/- 0.0000 | 0.7019 +/- 0.0000 | +| ogbg-molhiv | tag | rocauc | 1 | 0.7528 +/- 0.0000 | 0.7255 +/- 0.0000 | +| ogbg-molhiv | transformer | rocauc | 1 | 0.7617 +/- 0.0000 | 0.7547 +/- 0.0000 | + +Delta vs matching classic +| task | backbone | compute | metric | n | val score (delta) | test score (delta) | steps | +| --- | --- | --- | --- | --- | --- | --- | --- | +| ogbg-molbbbp | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9360 (0.0213) | 0.6073 (-0.0314) | | +| ogbg-molbbbp | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9415 (0.0048) | 0.6635 (-0.0016) | | +| ogbg-molbbbp | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9278 (-0.0174) | 0.6659 (0.0145) | | +| ogbg-molbbbp | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9400 (0.0115) | 0.6323 (0.0023) | | +| ogbg-molbbbp | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9356 (0.0009) | 0.6560 (0.0235) | | +| ogbg-molbbbp | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9417 (0.0031) | 0.6017 (-0.0663) | | +| ogbg-molbbbp | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9429 (-0.0119) | 0.6037 (-0.0738) | | +| ogbg-molbbbp | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9526 (0.0275) | 0.5932 (0.0261) | | +| ogbg-molbbbp | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9421 (0.0098) | 0.6976 (0.0816) | | +| ogbg-molbbbp | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9337 (0.0069) | 0.6518 (0.0618) | | +| ogbg-molbbbp | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9502 (0.0019) | 0.5934 (-0.0354) | | +| ogbg-molbbbp | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9488 (0.0094) | 0.6481 (0.0116) | | +| ogbg-molbbbp | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9585 (0.0031) | 0.6682 (0.0264) | | +| ogbg-molbbbp | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9535 (0.0352) | 0.5839 (-0.0787) | | +| ogbg-molbbbp | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9285 (-0.0015) | 0.6454 (0.0215) | | +| ogbg-molbbbp | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9459 (-0.0017) | 0.6420 (0.0320) | | +| ogbg-molbbbp | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9355 (-0.0140) | 0.6221 (0.0065) | | +| ogbg-molhiv | appnp | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7203 (-0.0471) | 0.6825 (-0.0175) | | +| ogbg-molhiv | arma | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7926 (0.0054) | 0.7318 (0.0021) | | +| ogbg-molhiv | cheb | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7735 (-0.0096) | 0.7426 (0.0144) | | +| ogbg-molhiv | film | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7633 (-0.0288) | 0.7728 (-0.0114) | | +| ogbg-molhiv | gatv2 | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7835 (0.0001) | 0.7466 (-0.0096) | | +| ogbg-molhiv | gcn | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7455 (-0.0300) | 0.7483 (0.0285) | | +| ogbg-molhiv | gen | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8128 (0.0598) | 0.7631 (0.0318) | | +| ogbg-molhiv | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0457) | 0.7668 (-0.0056) | | +| ogbg-molhiv | gin | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7524 (-0.0644) | 0.7324 (-0.0400) | | +| ogbg-molhiv | gine | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7575 (-0.0368) | 0.7401 (-0.0044) | | +| ogbg-molhiv | graphconv | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7713 (0.0006) | 0.6979 (-0.0129) | | +| ogbg-molhiv | graphsage | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7587 (-0.0382) | 0.7641 (0.0016) | | +| ogbg-molhiv | mf | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7931 (0.0085) | 0.7217 (0.0143) | | +| ogbg-molhiv | pna | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7890 (0.0111) | 0.7630 (-0.0018) | | +| ogbg-molhiv | resgated | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8174 (0.0030) | 0.7055 (-0.0187) | | +| ogbg-molhiv | sgc | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7482 (0.0003) | 0.7177 (0.0158) | | +| ogbg-molhiv | tag | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7804 (0.0276) | 0.7352 (0.0096) | | +| ogbg-molhiv | transformer | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8088 (0.0471) | 0.7413 (-0.0134) | | diff --git a/logs/ogbg-molbbbp_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log b/logs/ogbg-molbbbp_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log new file mode 100644 index 0000000..d6b613d --- /dev/null +++ b/logs/ogbg-molbbbp_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log @@ -0,0 +1,166 @@ +[run] ogbg-molbbbp view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/bbbp.zip +
0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 3.85it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 3.85it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 7.69it/s] +Processing... +Extracting /home/yurenh2/rrog-gnn-runner/data/ogb/bbbp.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/2039 [00:00<?, ?it/s]
100%|██████████| 2039/2039 [00:00<00:00, 167890.73it/s] +Converting graphs into PyG objects... +
0%| | 0/2039 [00:00<?, ?it/s]
100%|██████████| 2039/2039 [00:00<00:00, 85245.66it/s] +/home/yurenh2/miniconda3/lib/python3.13/site-packages/ogb/graphproppred/dataset_pyg.py:156: UserWarning: The given NumPy array is not writable, and PyTorch does not support non-writable tensors. This means writing to this tensor will result in undefined behavior. You may want to copy the array to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at /pytorch/torch/csrc/utils/tensor_numpy.cpp:213.) + g.y = torch.from_numpy(graph_label[i]).view(1,-1).to(torch.long) +Done! +Saving... +ep10 val_rocauc=0.89356 val_adapt_rocauc=0.92960 adapt_steps=2.14 halt=0.41 train_steps=1.93 +ep20 val_rocauc=0.84945 val_adapt_rocauc=0.83680 adapt_steps=2.08 halt=0.46 train_steps=1.71 +ep30 val_rocauc=0.84815 val_adapt_rocauc=0.92940 adapt_steps=2.03 halt=0.46 train_steps=1.68 +ep40 val_rocauc=0.91307 val_adapt_rocauc=0.92452 adapt_steps=2.04 halt=0.46 train_steps=1.64 +ep50 val_rocauc=0.92821 val_adapt_rocauc=0.93647 adapt_steps=2.09 halt=0.47 train_steps=1.60 +ep60 val_rocauc=0.88709 val_adapt_rocauc=0.91686 adapt_steps=2.06 halt=0.47 train_steps=1.60 +ep70 val_rocauc=0.82187 val_adapt_rocauc=0.90979 adapt_steps=2.01 halt=0.47 train_steps=1.60 +ep80 val_rocauc=0.86588 val_adapt_rocauc=0.91317 adapt_steps=2.02 halt=0.48 train_steps=1.57 +ep90 val_rocauc=0.91586 val_adapt_rocauc=0.91596 adapt_steps=2.02 halt=0.48 train_steps=1.58 +ep100 val_rocauc=0.90780 val_adapt_rocauc=0.91327 adapt_steps=2.01 halt=0.47 train_steps=1.60 +[ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=50 val={'rocauc': 0.9282087025789106} test={'rocauc': 0.6619405864197531} adaptive={'rocauc': 0.6692708333333333} steps=2.0833333333333335 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.70039 val_adapt_rocauc=0.92542 adapt_steps=2.07 halt=0.46 train_steps=1.65 +ep20 val_rocauc=0.88380 val_adapt_rocauc=0.92642 adapt_steps=2.02 halt=0.47 train_steps=1.62 +ep30 val_rocauc=0.79638 val_adapt_rocauc=0.91417 adapt_steps=2.01 halt=0.47 train_steps=1.60 +ep40 val_rocauc=0.94295 val_adapt_rocauc=0.95201 adapt_steps=2.01 halt=0.48 train_steps=1.58 +ep50 val_rocauc=0.91327 val_adapt_rocauc=0.92164 adapt_steps=2.00 halt=0.48 train_steps=1.56 +ep60 val_rocauc=0.91407 val_adapt_rocauc=0.93030 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep70 val_rocauc=0.91716 val_adapt_rocauc=0.92801 adapt_steps=2.00 halt=0.47 train_steps=1.59 +ep80 val_rocauc=0.91407 val_adapt_rocauc=0.91825 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep90 val_rocauc=0.90959 val_adapt_rocauc=0.91138 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep100 val_rocauc=0.91228 val_adapt_rocauc=0.91566 adapt_steps=2.00 halt=0.48 train_steps=1.58 +[ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=40 val={'rocauc': 0.9429453350592453} test={'rocauc': 0.6137152777777778} adaptive={'rocauc': 0.675829475308642} steps=2.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.87613 val_adapt_rocauc=0.92184 adapt_steps=2.00 halt=0.42 train_steps=1.95 +ep20 val_rocauc=0.87285 val_adapt_rocauc=0.92134 adapt_steps=2.01 halt=0.46 train_steps=1.74 +ep30 val_rocauc=0.87892 val_adapt_rocauc=0.93090 adapt_steps=2.02 halt=0.46 train_steps=1.66 +ep40 val_rocauc=0.87315 val_adapt_rocauc=0.92920 adapt_steps=2.05 halt=0.47 train_steps=1.60 +ep50 val_rocauc=0.87922 val_adapt_rocauc=0.92104 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep60 val_rocauc=0.89366 val_adapt_rocauc=0.92223 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep70 val_rocauc=0.93468 val_adapt_rocauc=0.94484 adapt_steps=2.00 halt=0.47 train_steps=1.57 +ep80 val_rocauc=0.91945 val_adapt_rocauc=0.92811 adapt_steps=2.00 halt=0.48 train_steps=1.56 +ep90 val_rocauc=0.92253 val_adapt_rocauc=0.93060 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep100 val_rocauc=0.91925 val_adapt_rocauc=0.92930 adapt_steps=2.00 halt=0.48 train_steps=1.58 +[ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.9346808722493279} test={'rocauc': 0.6516203703703703} adaptive={'rocauc': 0.6385030864197532} steps=2.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.78522 val_adapt_rocauc=0.83192 adapt_steps=2.08 halt=0.40 train_steps=2.07 +ep20 val_rocauc=0.92472 val_adapt_rocauc=0.93388 adapt_steps=2.22 halt=0.44 train_steps=1.81 +ep30 val_rocauc=0.94056 val_adapt_rocauc=0.94852 adapt_steps=2.01 halt=0.46 train_steps=1.66 +ep40 val_rocauc=0.89077 val_adapt_rocauc=0.92691 adapt_steps=2.01 halt=0.47 train_steps=1.61 +ep50 val_rocauc=0.89605 val_adapt_rocauc=0.92423 adapt_steps=2.03 halt=0.48 train_steps=1.57 +ep60 val_rocauc=0.90571 val_adapt_rocauc=0.93647 adapt_steps=2.03 halt=0.47 train_steps=1.60 +ep70 val_rocauc=0.91337 val_adapt_rocauc=0.93179 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep80 val_rocauc=0.92512 val_adapt_rocauc=0.93866 adapt_steps=2.01 halt=0.48 train_steps=1.56 +ep90 val_rocauc=0.92194 val_adapt_rocauc=0.93418 adapt_steps=2.01 halt=0.48 train_steps=1.58 +ep100 val_rocauc=0.92134 val_adapt_rocauc=0.93259 adapt_steps=2.01 halt=0.47 train_steps=1.58 +[ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rocauc': 0.9405556108732449} test={'rocauc': 0.635030864197531} adaptive={'rocauc': 0.6146797839506173} steps=2.014705882352941 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.72269 val_adapt_rocauc=0.93777 adapt_steps=2.29 halt=0.42 train_steps=2.02 +ep20 val_rocauc=0.86110 val_adapt_rocauc=0.88460 adapt_steps=2.14 halt=0.47 train_steps=1.61 +ep30 val_rocauc=0.88181 val_adapt_rocauc=0.91278 adapt_steps=2.00 halt=0.47 train_steps=1.63 +ep40 val_rocauc=0.82027 val_adapt_rocauc=0.88151 adapt_steps=2.06 halt=0.46 train_steps=1.67 +ep50 val_rocauc=0.90561 val_adapt_rocauc=0.92393 adapt_steps=2.00 halt=0.47 train_steps=1.57 +ep60 val_rocauc=0.86339 val_adapt_rocauc=0.89804 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep70 val_rocauc=0.84397 val_adapt_rocauc=0.90242 adapt_steps=2.00 halt=0.47 train_steps=1.57 +ep80 val_rocauc=0.86578 val_adapt_rocauc=0.91955 adapt_steps=2.00 halt=0.48 train_steps=1.56 +ep90 val_rocauc=0.84049 val_adapt_rocauc=0.91019 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep100 val_rocauc=0.84556 val_adapt_rocauc=0.91248 adapt_steps=2.00 halt=0.47 train_steps=1.59 +[ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=50 val={'rocauc': 0.9056058946529921} test={'rocauc': 0.6368634259259259} adaptive={'rocauc': 0.6415895061728395} steps=2.1176470588235294 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.76730 val_adapt_rocauc=0.88778 adapt_steps=2.00 halt=0.47 train_steps=1.59 +ep20 val_rocauc=0.87454 val_adapt_rocauc=0.90780 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep30 val_rocauc=0.80006 val_adapt_rocauc=0.87334 adapt_steps=2.00 halt=0.47 train_steps=1.60 +ep40 val_rocauc=0.86010 val_adapt_rocauc=0.90411 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep50 val_rocauc=0.87972 val_adapt_rocauc=0.90810 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep60 val_rocauc=0.83292 val_adapt_rocauc=0.88918 adapt_steps=2.01 halt=0.47 train_steps=1.59 +ep70 val_rocauc=0.84706 val_adapt_rocauc=0.89893 adapt_steps=2.00 halt=0.47 train_steps=1.59 +ep80 val_rocauc=0.83740 val_adapt_rocauc=0.90232 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep90 val_rocauc=0.83670 val_adapt_rocauc=0.90222 adapt_steps=2.00 halt=0.48 train_steps=1.59 +ep100 val_rocauc=0.84357 val_adapt_rocauc=0.90252 adapt_steps=2.00 halt=0.47 train_steps=1.60 +[ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=50 val={'rocauc': 0.8797172159713232} test={'rocauc': 0.5456211419753086} adaptive={'rocauc': 0.5880594135802469} steps=2.0098039215686274 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=pna compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view pna --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.92482 val_adapt_rocauc=0.93149 adapt_steps=2.24 halt=0.44 train_steps=1.79 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.50592 val_adapt_rocauc=0.89495 adapt_steps=2.03 halt=0.45 train_steps=1.73 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.93797 val_adapt_rocauc=0.94275 adapt_steps=2.20 halt=0.44 train_steps=1.75 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.85004 val_adapt_rocauc=0.90750 adapt_steps=2.00 halt=0.44 train_steps=1.77 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.88719 val_adapt_rocauc=0.89734 adapt_steps=2.01 halt=0.47 train_steps=1.60 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.92024 val_adapt_rocauc=0.92930 adapt_steps=2.03 halt=0.46 train_steps=1.65 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.91278 val_adapt_rocauc=0.91975 adapt_steps=2.01 halt=0.47 train_steps=1.62 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.88728 val_adapt_rocauc=0.89485 adapt_steps=2.01 halt=0.48 train_steps=1.58 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.89605 val_adapt_rocauc=0.89157 adapt_steps=2.00 halt=0.48 train_steps=1.59 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.89704 val_adapt_rocauc=0.89196 adapt_steps=2.00 halt=0.47 train_steps=1.59 +[ogbg-molbbbp_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rocauc': 0.9379667430050782} test={'rocauc': 0.6539351851851851} adaptive={'rocauc': 0.6563464506172839} steps=2.3137254901960786 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=resgated compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view resgated --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.80335 val_adapt_rocauc=0.89714 adapt_steps=2.00 halt=0.43 train_steps=1.80 +ep20 val_rocauc=0.94992 val_adapt_rocauc=0.95589 adapt_steps=2.15 halt=0.46 train_steps=1.65 +ep30 val_rocauc=0.89844 val_adapt_rocauc=0.92413 adapt_steps=2.31 halt=0.46 train_steps=1.60 +ep40 val_rocauc=0.88499 val_adapt_rocauc=0.92303 adapt_steps=2.03 halt=0.47 train_steps=1.61 +ep50 val_rocauc=0.87145 val_adapt_rocauc=0.91118 adapt_steps=2.02 halt=0.47 train_steps=1.58 +ep60 val_rocauc=0.83670 val_adapt_rocauc=0.89266 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep70 val_rocauc=0.83142 val_adapt_rocauc=0.89963 adapt_steps=2.01 halt=0.47 train_steps=1.58 +ep80 val_rocauc=0.85273 val_adapt_rocauc=0.90859 adapt_steps=2.00 halt=0.48 train_steps=1.56 +ep90 val_rocauc=0.82246 val_adapt_rocauc=0.89346 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep100 val_rocauc=0.83471 val_adapt_rocauc=0.90033 adapt_steps=2.00 halt=0.48 train_steps=1.58 +[ogbg-molbbbp_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=20 val={'rocauc': 0.9499153639350792} test={'rocauc': 0.6603973765432098} adaptive={'rocauc': 0.6677276234567902} steps=2.343137254901961 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json diff --git a/logs/ogbg-molbbbp_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log b/logs/ogbg-molbbbp_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log new file mode 100644 index 0000000..1402929 --- /dev/null +++ b/logs/ogbg-molbbbp_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log @@ -0,0 +1,278 @@ +[run] ogbg-molbbbp view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.68724 val_adapt_rocauc=0.69058 adapt_steps=2.34 halt=0.32 train_steps=2.70 +ep20 val_rocauc=0.71443 val_adapt_rocauc=0.73106 adapt_steps=4.76 halt=0.35 train_steps=2.43 +ep30 val_rocauc=0.89704 val_adapt_rocauc=0.89107 adapt_steps=2.92 halt=0.32 train_steps=2.76 +ep40 val_rocauc=0.92044 val_adapt_rocauc=0.93149 adapt_steps=3.13 halt=0.31 train_steps=2.82 +ep50 val_rocauc=0.89326 val_adapt_rocauc=0.91984 adapt_steps=2.52 halt=0.34 train_steps=2.62 +ep60 val_rocauc=0.88529 val_adapt_rocauc=0.90411 adapt_steps=2.35 halt=0.39 train_steps=2.28 +ep70 val_rocauc=0.86876 val_adapt_rocauc=0.88728 adapt_steps=2.40 halt=0.38 train_steps=2.31 +ep80 val_rocauc=0.90929 val_adapt_rocauc=0.91228 adapt_steps=2.47 halt=0.38 train_steps=2.27 +ep90 val_rocauc=0.90491 val_adapt_rocauc=0.90760 adapt_steps=2.26 halt=0.42 train_steps=2.01 +ep100 val_rocauc=0.90979 val_adapt_rocauc=0.91825 adapt_steps=2.25 halt=0.41 train_steps=2.05 +[ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=40 val={'rocauc': 0.92044209897441} test={'rocauc': 0.6527777777777778} adaptive={'rocauc': 0.65258487654321} steps=4.872549019607843 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=gine compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gine --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.90073 val_adapt_rocauc=0.88450 adapt_steps=2.43 halt=0.27 train_steps=3.20 +ep20 val_rocauc=0.92024 val_adapt_rocauc=0.93090 adapt_steps=3.02 halt=0.32 train_steps=2.63 +ep30 val_rocauc=0.85622 val_adapt_rocauc=0.87673 adapt_steps=3.15 halt=0.34 train_steps=2.57 +ep40 val_rocauc=0.89276 val_adapt_rocauc=0.88928 adapt_steps=3.26 halt=0.33 train_steps=2.70 +ep50 val_rocauc=0.91795 val_adapt_rocauc=0.92114 adapt_steps=2.88 halt=0.34 train_steps=2.67 +ep60 val_rocauc=0.91696 val_adapt_rocauc=0.90889 adapt_steps=2.46 halt=0.36 train_steps=2.44 +ep70 val_rocauc=0.90501 val_adapt_rocauc=0.89037 adapt_steps=2.88 halt=0.38 train_steps=2.30 +ep80 val_rocauc=0.92054 val_adapt_rocauc=0.91228 adapt_steps=2.57 halt=0.39 train_steps=2.24 +ep90 val_rocauc=0.90949 val_adapt_rocauc=0.90312 adapt_steps=2.32 halt=0.41 train_steps=2.07 +ep100 val_rocauc=0.91576 val_adapt_rocauc=0.91148 adapt_steps=2.29 halt=0.42 train_steps=2.02 +[ogbg-molbbbp_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.9205416708154933} test={'rocauc': 0.591820987654321} adaptive={'rocauc': 0.5948109567901234} steps=2.9166666666666665 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.82177 val_adapt_rocauc=0.93209 adapt_steps=2.11 halt=0.30 train_steps=2.97 +ep20 val_rocauc=0.88241 val_adapt_rocauc=0.89923 adapt_steps=2.39 halt=0.38 train_steps=2.27 +ep30 val_rocauc=0.84248 val_adapt_rocauc=0.89794 adapt_steps=2.54 halt=0.38 train_steps=2.19 +ep40 val_rocauc=0.95280 val_adapt_rocauc=0.95390 adapt_steps=2.17 halt=0.41 train_steps=2.07 +ep50 val_rocauc=0.89525 val_adapt_rocauc=0.92164 adapt_steps=2.07 halt=0.45 train_steps=1.74 +ep60 val_rocauc=0.93727 val_adapt_rocauc=0.93050 adapt_steps=2.03 halt=0.45 train_steps=1.73 +ep70 val_rocauc=0.92612 val_adapt_rocauc=0.92881 adapt_steps=2.03 halt=0.46 train_steps=1.68 +ep80 val_rocauc=0.91845 val_adapt_rocauc=0.92273 adapt_steps=2.01 halt=0.47 train_steps=1.61 +ep90 val_rocauc=0.91278 val_adapt_rocauc=0.91138 adapt_steps=2.00 halt=0.47 train_steps=1.66 +ep100 val_rocauc=0.91477 val_adapt_rocauc=0.91626 adapt_steps=2.00 halt=0.47 train_steps=1.66 +[ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=40 val={'rocauc': 0.9528029473264961} test={'rocauc': 0.6794945987654321} adaptive={'rocauc': 0.6629050925925926} steps=2.269607843137255 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=graphsage compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view graphsage --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.94066 val_adapt_rocauc=0.95440 adapt_steps=2.54 halt=0.30 train_steps=2.86 +ep20 val_rocauc=0.93299 val_adapt_rocauc=0.93956 adapt_steps=2.87 halt=0.38 train_steps=2.26 +ep30 val_rocauc=0.83142 val_adapt_rocauc=0.88171 adapt_steps=2.41 halt=0.36 train_steps=2.40 +ep40 val_rocauc=0.87494 val_adapt_rocauc=0.87374 adapt_steps=2.28 halt=0.40 train_steps=2.07 +ep50 val_rocauc=0.92233 val_adapt_rocauc=0.94285 adapt_steps=2.27 halt=0.38 train_steps=2.38 +ep60 val_rocauc=0.86478 val_adapt_rocauc=0.88539 adapt_steps=2.44 halt=0.40 train_steps=2.08 +ep70 val_rocauc=0.91029 val_adapt_rocauc=0.91377 adapt_steps=2.14 halt=0.45 train_steps=1.75 +ep80 val_rocauc=0.92532 val_adapt_rocauc=0.91218 adapt_steps=2.07 halt=0.46 train_steps=1.68 +ep90 val_rocauc=0.90630 val_adapt_rocauc=0.90202 adapt_steps=2.06 halt=0.45 train_steps=1.73 +ep100 val_rocauc=0.90531 val_adapt_rocauc=0.90083 adapt_steps=2.04 halt=0.46 train_steps=1.67 +[ogbg-molbbbp_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=10 val={'rocauc': 0.9406551827143284} test={'rocauc': 0.6039737654320988} adaptive={'rocauc': 0.6147762345679012} steps=2.5686274509803924 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=gatv2 compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gatv2 --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.87544 val_adapt_rocauc=0.89704 adapt_steps=3.72 halt=0.33 train_steps=2.64 +ep20 val_rocauc=0.92492 val_adapt_rocauc=0.94852 adapt_steps=2.61 halt=0.39 train_steps=2.17 +ep30 val_rocauc=0.89804 val_adapt_rocauc=0.93239 adapt_steps=2.27 halt=0.37 train_steps=2.35 +ep40 val_rocauc=0.90511 val_adapt_rocauc=0.92612 adapt_steps=2.27 halt=0.41 train_steps=2.00 +ep50 val_rocauc=0.90103 val_adapt_rocauc=0.89475 adapt_steps=2.46 halt=0.41 train_steps=2.01 +ep60 val_rocauc=0.90401 val_adapt_rocauc=0.89306 adapt_steps=2.24 halt=0.41 train_steps=2.05 +ep70 val_rocauc=0.93030 val_adapt_rocauc=0.91656 adapt_steps=2.10 halt=0.46 train_steps=1.67 +ep80 val_rocauc=0.92233 val_adapt_rocauc=0.90411 adapt_steps=2.09 halt=0.46 train_steps=1.66 +ep90 val_rocauc=0.91546 val_adapt_rocauc=0.89386 adapt_steps=2.11 halt=0.46 train_steps=1.70 +ep100 val_rocauc=0.91287 val_adapt_rocauc=0.88868 adapt_steps=2.09 halt=0.47 train_steps=1.65 +[ogbg-molbbbp_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.9302997112416609} test={'rocauc': 0.6648341049382716} adaptive={'rocauc': 0.6627121913580247} steps=2.1372549019607843 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.83053 val_adapt_rocauc=0.84875 adapt_steps=3.46 halt=0.34 train_steps=2.62 +ep20 val_rocauc=0.71931 val_adapt_rocauc=0.75465 adapt_steps=3.00 halt=0.37 train_steps=2.40 +ep30 val_rocauc=0.88380 val_adapt_rocauc=0.89704 adapt_steps=2.44 halt=0.37 train_steps=2.40 +ep40 val_rocauc=0.89913 val_adapt_rocauc=0.91507 adapt_steps=2.17 halt=0.37 train_steps=2.35 +ep50 val_rocauc=0.88938 val_adapt_rocauc=0.93737 adapt_steps=2.25 halt=0.43 train_steps=1.90 +ep60 val_rocauc=0.92343 val_adapt_rocauc=0.93757 adapt_steps=2.21 halt=0.41 train_steps=2.04 +ep70 val_rocauc=0.87703 val_adapt_rocauc=0.90889 adapt_steps=2.45 halt=0.41 train_steps=1.97 +ep80 val_rocauc=0.89396 val_adapt_rocauc=0.91726 adapt_steps=2.09 halt=0.46 train_steps=1.73 +ep90 val_rocauc=0.86498 val_adapt_rocauc=0.89167 adapt_steps=2.19 halt=0.46 train_steps=1.70 +ep100 val_rocauc=0.87016 val_adapt_rocauc=0.89545 adapt_steps=2.13 halt=0.47 train_steps=1.68 +[ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.9234292542069104} test={'rocauc': 0.6602044753086419} adaptive={'rocauc': 0.6875} steps=2.7941176470588234 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=transformer compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view transformer --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.87494 val_adapt_rocauc=0.89316 adapt_steps=3.50 halt=0.33 train_steps=2.53 +ep20 val_rocauc=0.88878 val_adapt_rocauc=0.89784 adapt_steps=2.60 halt=0.35 train_steps=2.46 +ep30 val_rocauc=0.85243 val_adapt_rocauc=0.93747 adapt_steps=2.47 halt=0.36 train_steps=2.40 +ep40 val_rocauc=0.93687 val_adapt_rocauc=0.94046 adapt_steps=2.35 halt=0.41 train_steps=2.09 +ep50 val_rocauc=0.90959 val_adapt_rocauc=0.91875 adapt_steps=2.32 halt=0.41 train_steps=2.16 +ep60 val_rocauc=0.93090 val_adapt_rocauc=0.93617 adapt_steps=2.40 halt=0.42 train_steps=1.90 +ep70 val_rocauc=0.93199 val_adapt_rocauc=0.92134 adapt_steps=2.23 halt=0.45 train_steps=1.72 +ep80 val_rocauc=0.93637 val_adapt_rocauc=0.93866 adapt_steps=2.15 halt=0.45 train_steps=1.78 +ep90 val_rocauc=0.93976 val_adapt_rocauc=0.93378 adapt_steps=2.13 halt=0.45 train_steps=1.81 +ep100 val_rocauc=0.93966 val_adapt_rocauc=0.93369 adapt_steps=2.13 halt=0.45 train_steps=1.79 +[ogbg-molbbbp_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rocauc': 0.9397590361445782} test={'rocauc': 0.642554012345679} adaptive={'rocauc': 0.6309799382716049} steps=2.2254901960784315 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=pna compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view pna --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.92731 val_adapt_rocauc=0.92950 adapt_steps=6.11 halt=0.24 train_steps=3.52 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.89097 val_adapt_rocauc=0.90093 adapt_steps=2.08 halt=0.32 train_steps=2.95 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.92433 val_adapt_rocauc=0.92502 adapt_steps=3.31 halt=0.34 train_steps=2.56 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.93777 val_adapt_rocauc=0.94056 adapt_steps=2.97 halt=0.35 train_steps=2.49 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.95001 val_adapt_rocauc=0.95051 adapt_steps=3.67 halt=0.31 train_steps=2.90 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.91317 val_adapt_rocauc=0.89913 adapt_steps=2.84 halt=0.37 train_steps=2.45 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.94583 val_adapt_rocauc=0.94613 adapt_steps=2.63 halt=0.36 train_steps=2.49 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.90770 val_adapt_rocauc=0.90132 adapt_steps=2.44 halt=0.39 train_steps=2.22 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.92761 val_adapt_rocauc=0.92482 adapt_steps=2.29 halt=0.42 train_steps=1.98 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.92871 val_adapt_rocauc=0.92612 adapt_steps=2.34 halt=0.43 train_steps=1.94 +[ogbg-molbbbp_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=50 val={'rocauc': 0.9500149357761626} test={'rocauc': 0.6172839506172839} adaptive={'rocauc': 0.6179591049382716} steps=4.686274509803922 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=gen compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gen --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.78104 val_adapt_rocauc=0.86747 adapt_steps=2.68 halt=0.35 train_steps=2.43 +ep20 val_rocauc=0.89664 val_adapt_rocauc=0.89754 adapt_steps=4.28 halt=0.31 train_steps=2.84 +ep30 val_rocauc=0.92512 val_adapt_rocauc=0.92114 adapt_steps=4.62 halt=0.30 train_steps=3.15 +ep40 val_rocauc=0.88798 val_adapt_rocauc=0.86727 adapt_steps=3.66 halt=0.35 train_steps=2.40 +ep50 val_rocauc=0.92383 val_adapt_rocauc=0.93737 adapt_steps=2.48 halt=0.35 train_steps=2.51 +ep60 val_rocauc=0.91218 val_adapt_rocauc=0.91278 adapt_steps=2.67 halt=0.37 train_steps=2.35 +ep70 val_rocauc=0.90083 val_adapt_rocauc=0.91785 adapt_steps=2.15 halt=0.40 train_steps=2.04 +ep80 val_rocauc=0.91646 val_adapt_rocauc=0.92612 adapt_steps=2.24 halt=0.43 train_steps=1.95 +ep90 val_rocauc=0.91616 val_adapt_rocauc=0.92751 adapt_steps=2.23 halt=0.45 train_steps=1.79 +ep100 val_rocauc=0.90909 val_adapt_rocauc=0.91865 adapt_steps=2.24 halt=0.44 train_steps=1.86 +[ogbg-molbbbp_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rocauc': 0.925121975505327} test={'rocauc': 0.6313657407407408} adaptive={'rocauc': 0.6291473765432098} steps=3.7892156862745097 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=film compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view film --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.65558 val_adapt_rocauc=0.57483 adapt_steps=4.25 halt=0.29 train_steps=2.83 +ep20 val_rocauc=0.89615 val_adapt_rocauc=0.88997 adapt_steps=4.61 halt=0.29 train_steps=3.15 +ep30 val_rocauc=0.91606 val_adapt_rocauc=0.91606 adapt_steps=3.94 halt=0.30 train_steps=2.97 +ep40 val_rocauc=0.87683 val_adapt_rocauc=0.88221 adapt_steps=3.41 halt=0.27 train_steps=3.07 +ep50 val_rocauc=0.93926 val_adapt_rocauc=0.94832 adapt_steps=2.70 halt=0.29 train_steps=3.03 +ep60 val_rocauc=0.92204 val_adapt_rocauc=0.92881 adapt_steps=3.16 halt=0.29 train_steps=2.99 +ep70 val_rocauc=0.89714 val_adapt_rocauc=0.90451 adapt_steps=2.59 halt=0.34 train_steps=2.64 +ep80 val_rocauc=0.91835 val_adapt_rocauc=0.92413 adapt_steps=2.57 halt=0.35 train_steps=2.65 +ep90 val_rocauc=0.91048 val_adapt_rocauc=0.91745 adapt_steps=2.50 halt=0.34 train_steps=2.57 +ep100 val_rocauc=0.92582 val_adapt_rocauc=0.93189 adapt_steps=2.41 halt=0.37 train_steps=2.51 +[ogbg-molbbbp_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=50 val={'rocauc': 0.9392611769391616} test={'rocauc': 0.5584490740740741} adaptive={'rocauc': 0.5745563271604939} steps=3.2058823529411766 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=resgated compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view resgated --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.79478 val_adapt_rocauc=0.79906 adapt_steps=4.00 halt=0.30 train_steps=2.83 +ep20 val_rocauc=0.90192 val_adapt_rocauc=0.90431 adapt_steps=2.94 halt=0.36 train_steps=2.35 +ep30 val_rocauc=0.91327 val_adapt_rocauc=0.93100 adapt_steps=2.63 halt=0.36 train_steps=2.32 +ep40 val_rocauc=0.88051 val_adapt_rocauc=0.89535 adapt_steps=2.30 halt=0.37 train_steps=2.38 +ep50 val_rocauc=0.90401 val_adapt_rocauc=0.90829 adapt_steps=2.96 halt=0.37 train_steps=2.33 +ep60 val_rocauc=0.86060 val_adapt_rocauc=0.87822 adapt_steps=2.16 halt=0.41 train_steps=2.03 +ep70 val_rocauc=0.90859 val_adapt_rocauc=0.90770 adapt_steps=2.04 halt=0.44 train_steps=1.88 +ep80 val_rocauc=0.89893 val_adapt_rocauc=0.90581 adapt_steps=2.04 halt=0.45 train_steps=1.76 +ep90 val_rocauc=0.89824 val_adapt_rocauc=0.89893 adapt_steps=2.02 halt=0.45 train_steps=1.72 +ep100 val_rocauc=0.89206 val_adapt_rocauc=0.89406 adapt_steps=2.01 halt=0.45 train_steps=1.74 +[ogbg-molbbbp_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rocauc': 0.9132729264164094} test={'rocauc': 0.5753279320987655} adaptive={'rocauc': 0.5887345679012346} steps=3.593137254901961 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.79010 val_adapt_rocauc=0.90242 adapt_steps=2.69 halt=0.30 train_steps=2.96 +ep20 val_rocauc=0.78353 val_adapt_rocauc=0.88868 adapt_steps=2.15 halt=0.32 train_steps=2.81 +ep30 val_rocauc=0.94344 val_adapt_rocauc=0.94145 adapt_steps=2.73 halt=0.38 train_steps=2.31 +ep40 val_rocauc=0.86787 val_adapt_rocauc=0.89565 adapt_steps=2.29 halt=0.39 train_steps=2.18 +ep50 val_rocauc=0.94962 val_adapt_rocauc=0.95420 adapt_steps=2.25 halt=0.40 train_steps=2.20 +ep60 val_rocauc=0.93269 val_adapt_rocauc=0.94374 adapt_steps=2.16 halt=0.41 train_steps=2.00 +ep70 val_rocauc=0.93996 val_adapt_rocauc=0.94155 adapt_steps=2.23 halt=0.42 train_steps=1.93 +ep80 val_rocauc=0.93727 val_adapt_rocauc=0.93598 adapt_steps=2.08 halt=0.46 train_steps=1.75 +ep90 val_rocauc=0.93508 val_adapt_rocauc=0.92691 adapt_steps=2.04 halt=0.46 train_steps=1.73 +ep100 val_rocauc=0.93717 val_adapt_rocauc=0.92980 adapt_steps=2.02 halt=0.46 train_steps=1.69 +[ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=50 val={'rocauc': 0.9496166484118291} test={'rocauc': 0.6579861111111112} adaptive={'rocauc': 0.6550925925925926} steps=2.6176470588235294 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.65259 val_adapt_rocauc=0.79578 adapt_steps=2.69 halt=0.32 train_steps=2.68 +ep20 val_rocauc=0.92612 val_adapt_rocauc=0.94066 adapt_steps=2.18 halt=0.38 train_steps=2.24 +ep30 val_rocauc=0.93478 val_adapt_rocauc=0.94484 adapt_steps=2.27 halt=0.34 train_steps=2.50 +ep40 val_rocauc=0.91576 val_adapt_rocauc=0.94056 adapt_steps=2.19 halt=0.42 train_steps=2.00 +ep50 val_rocauc=0.90760 val_adapt_rocauc=0.92552 adapt_steps=2.36 halt=0.41 train_steps=2.02 +ep60 val_rocauc=0.94753 val_adapt_rocauc=0.95798 adapt_steps=2.07 halt=0.45 train_steps=1.74 +ep70 val_rocauc=0.93647 val_adapt_rocauc=0.94066 adapt_steps=2.13 halt=0.46 train_steps=1.65 +ep80 val_rocauc=0.93289 val_adapt_rocauc=0.93777 adapt_steps=2.06 halt=0.46 train_steps=1.67 +ep90 val_rocauc=0.93817 val_adapt_rocauc=0.94165 adapt_steps=2.05 halt=0.47 train_steps=1.68 +ep100 val_rocauc=0.93757 val_adapt_rocauc=0.93916 adapt_steps=2.03 halt=0.46 train_steps=1.68 +[ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.947525639749079} test={'rocauc': 0.6593364197530864} adaptive={'rocauc': 0.6675347222222222} steps=2.2549019607843137 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=cheb compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view cheb --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.79966 val_adapt_rocauc=0.83352 adapt_steps=2.95 halt=0.33 train_steps=2.69 +ep20 val_rocauc=0.87763 val_adapt_rocauc=0.88738 adapt_steps=2.30 halt=0.38 train_steps=2.38 +ep30 val_rocauc=0.83511 val_adapt_rocauc=0.87225 adapt_steps=2.24 halt=0.40 train_steps=2.04 +ep40 val_rocauc=0.93578 val_adapt_rocauc=0.94066 adapt_steps=2.38 halt=0.41 train_steps=2.09 +ep50 val_rocauc=0.92881 val_adapt_rocauc=0.92642 adapt_steps=2.17 halt=0.44 train_steps=1.85 +ep60 val_rocauc=0.92353 val_adapt_rocauc=0.91337 adapt_steps=2.12 halt=0.45 train_steps=1.78 +ep70 val_rocauc=0.94962 val_adapt_rocauc=0.94494 adapt_steps=2.03 halt=0.46 train_steps=1.65 +ep80 val_rocauc=0.93986 val_adapt_rocauc=0.93508 adapt_steps=2.13 halt=0.47 train_steps=1.65 +ep90 val_rocauc=0.93080 val_adapt_rocauc=0.91835 adapt_steps=2.03 halt=0.46 train_steps=1.72 +ep100 val_rocauc=0.92433 val_adapt_rocauc=0.91208 adapt_steps=2.03 halt=0.45 train_steps=1.80 +[ogbg-molbbbp_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.9496166484118291} test={'rocauc': 0.6182484567901234} adaptive={'rocauc': 0.611014660493827} steps=2.1666666666666665 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=arma compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view arma --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.55989 val_adapt_rocauc=0.61585 adapt_steps=2.59 halt=0.37 train_steps=2.15 +ep20 val_rocauc=0.88748 val_adapt_rocauc=0.93000 adapt_steps=2.67 halt=0.40 train_steps=2.09 +ep30 val_rocauc=0.90172 val_adapt_rocauc=0.91427 adapt_steps=2.22 halt=0.39 train_steps=2.27 +ep40 val_rocauc=0.93269 val_adapt_rocauc=0.93189 adapt_steps=2.33 halt=0.38 train_steps=2.31 +ep50 val_rocauc=0.92771 val_adapt_rocauc=0.92433 adapt_steps=2.20 halt=0.46 train_steps=1.75 +ep60 val_rocauc=0.91228 val_adapt_rocauc=0.91984 adapt_steps=2.14 halt=0.44 train_steps=1.83 +ep70 val_rocauc=0.94046 val_adapt_rocauc=0.93757 adapt_steps=2.02 halt=0.45 train_steps=1.70 +ep80 val_rocauc=0.92273 val_adapt_rocauc=0.92801 adapt_steps=2.06 halt=0.47 train_steps=1.64 +ep90 val_rocauc=0.92154 val_adapt_rocauc=0.92542 adapt_steps=2.08 halt=0.45 train_steps=1.79 +ep100 val_rocauc=0.91845 val_adapt_rocauc=0.92233 adapt_steps=2.07 halt=0.46 train_steps=1.74 +[ogbg-molbbbp_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.9404560390321618} test={'rocauc': 0.6411072530864197} adaptive={'rocauc': 0.636766975308642} steps=2.1519607843137254 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=mf compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view mf --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.70109 val_adapt_rocauc=0.81280 adapt_steps=2.37 halt=0.29 train_steps=2.98 +ep20 val_rocauc=0.91815 val_adapt_rocauc=0.92184 adapt_steps=3.19 halt=0.33 train_steps=2.59 +ep30 val_rocauc=0.93030 val_adapt_rocauc=0.94095 adapt_steps=2.34 halt=0.36 train_steps=2.50 +ep40 val_rocauc=0.93677 val_adapt_rocauc=0.94534 adapt_steps=2.69 halt=0.35 train_steps=2.51 +ep50 val_rocauc=0.91098 val_adapt_rocauc=0.91238 adapt_steps=2.40 halt=0.38 train_steps=2.23 +ep60 val_rocauc=0.92184 val_adapt_rocauc=0.92672 adapt_steps=2.20 halt=0.44 train_steps=1.87 +ep70 val_rocauc=0.93598 val_adapt_rocauc=0.93926 adapt_steps=2.13 halt=0.45 train_steps=1.70 +ep80 val_rocauc=0.90790 val_adapt_rocauc=0.91785 adapt_steps=2.10 halt=0.47 train_steps=1.64 +ep90 val_rocauc=0.89864 val_adapt_rocauc=0.91019 adapt_steps=2.09 halt=0.47 train_steps=1.65 +ep100 val_rocauc=0.89406 val_adapt_rocauc=0.90561 adapt_steps=2.11 halt=0.46 train_steps=1.70 +[ogbg-molbbbp_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=40 val={'rocauc': 0.936771880912078} test={'rocauc': 0.662133487654321} adaptive={'rocauc': 0.667824074074074} steps=3.5441176470588234 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molbbbp view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.84975 val_adapt_rocauc=0.88719 adapt_steps=2.18 halt=0.43 train_steps=1.80 +ep20 val_rocauc=0.88748 val_adapt_rocauc=0.92572 adapt_steps=2.08 halt=0.47 train_steps=1.62 +ep30 val_rocauc=0.78114 val_adapt_rocauc=0.87962 adapt_steps=2.04 halt=0.46 train_steps=1.63 +ep40 val_rocauc=0.86936 val_adapt_rocauc=0.91825 adapt_steps=2.01 halt=0.47 train_steps=1.63 +ep50 val_rocauc=0.90660 val_adapt_rocauc=0.93378 adapt_steps=2.00 halt=0.46 train_steps=1.65 +ep60 val_rocauc=0.82316 val_adapt_rocauc=0.90620 adapt_steps=2.01 halt=0.46 train_steps=1.68 +ep70 val_rocauc=0.86389 val_adapt_rocauc=0.90242 adapt_steps=2.00 halt=0.46 train_steps=1.70 +ep80 val_rocauc=0.82684 val_adapt_rocauc=0.89884 adapt_steps=2.02 halt=0.46 train_steps=1.68 +ep90 val_rocauc=0.81639 val_adapt_rocauc=0.89884 adapt_steps=2.01 halt=0.47 train_steps=1.70 +ep100 val_rocauc=0.82445 val_adapt_rocauc=0.90192 adapt_steps=2.01 halt=0.46 train_steps=1.64 +[ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=50 val={'rocauc': 0.9066016130638256} test={'rocauc': 0.5573881172839507} adaptive={'rocauc': 0.6225887345679013} steps=2.014705882352941 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json diff --git a/logs/ogbg-molbbbp_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_e100_s0.log b/logs/ogbg-molbbbp_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_e100_s0.log new file mode 100644 index 0000000..846012d --- /dev/null +++ b/logs/ogbg-molbbbp_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_e100_s0.log @@ -0,0 +1,84 @@ +[run] ogbg-molbbbp view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.44429 val_adapt_rocauc=0.44429 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep20 val_rocauc=0.86896 val_adapt_rocauc=0.86896 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep30 val_rocauc=0.85911 val_adapt_rocauc=0.85911 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep40 val_rocauc=0.90103 val_adapt_rocauc=0.93627 adapt_steps=3.02 halt=0.35 train_steps=2.59 +ep50 val_rocauc=0.85224 val_adapt_rocauc=0.91536 adapt_steps=3.34 halt=0.30 train_steps=2.99 +ep60 val_rocauc=0.94265 val_adapt_rocauc=0.94404 adapt_steps=3.14 halt=0.36 train_steps=2.40 +ep70 val_rocauc=0.93976 val_adapt_rocauc=0.93936 adapt_steps=2.47 halt=0.36 train_steps=2.46 +ep80 val_rocauc=0.91945 val_adapt_rocauc=0.91546 adapt_steps=2.47 halt=0.37 train_steps=2.42 +ep90 val_rocauc=0.92034 val_adapt_rocauc=0.92194 adapt_steps=2.34 halt=0.38 train_steps=2.37 +ep100 val_rocauc=0.91835 val_adapt_rocauc=0.91855 adapt_steps=2.29 halt=0.37 train_steps=2.31 +[ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=60 val={'rocauc': 0.9426466195359953} test={'rocauc': 0.6331018518518519} adaptive={'rocauc': 0.638406635802469} steps=3.2058823529411766 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molbbbp view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.66982 val_adapt_rocauc=0.66982 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep20 val_rocauc=0.83013 val_adapt_rocauc=0.83013 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep30 val_rocauc=0.91039 val_adapt_rocauc=0.91039 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep40 val_rocauc=0.91805 val_adapt_rocauc=0.92472 adapt_steps=3.05 halt=0.33 train_steps=2.69 +ep50 val_rocauc=0.90451 val_adapt_rocauc=0.92761 adapt_steps=2.40 halt=0.33 train_steps=2.70 +ep60 val_rocauc=0.86080 val_adapt_rocauc=0.91168 adapt_steps=2.52 halt=0.33 train_steps=2.74 +ep70 val_rocauc=0.93438 val_adapt_rocauc=0.93637 adapt_steps=2.38 halt=0.39 train_steps=2.22 +ep80 val_rocauc=0.92761 val_adapt_rocauc=0.93229 adapt_steps=2.22 halt=0.39 train_steps=2.17 +ep90 val_rocauc=0.92462 val_adapt_rocauc=0.92731 adapt_steps=2.14 halt=0.42 train_steps=1.99 +ep100 val_rocauc=0.92881 val_adapt_rocauc=0.93189 adapt_steps=2.14 halt=0.42 train_steps=1.97 +[ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=70 val={'rocauc': 0.9343821567260779} test={'rocauc': 0.6946373456790124} adaptive={'rocauc': 0.6956983024691358} steps=3.0049019607843137 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molbbbp view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.73623 val_adapt_rocauc=0.73623 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep20 val_rocauc=0.90551 val_adapt_rocauc=0.90551 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep30 val_rocauc=0.93329 val_adapt_rocauc=0.93329 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep40 val_rocauc=0.95221 val_adapt_rocauc=0.94633 adapt_steps=2.30 halt=0.36 train_steps=2.50 +ep50 val_rocauc=0.83879 val_adapt_rocauc=0.89077 adapt_steps=2.45 halt=0.38 train_steps=2.43 +ep60 val_rocauc=0.93149 val_adapt_rocauc=0.93657 adapt_steps=2.44 halt=0.38 train_steps=2.33 +ep70 val_rocauc=0.94842 val_adapt_rocauc=0.94982 adapt_steps=2.18 halt=0.41 train_steps=1.99 +ep80 val_rocauc=0.92452 val_adapt_rocauc=0.92960 adapt_steps=2.18 halt=0.43 train_steps=1.93 +ep90 val_rocauc=0.93100 val_adapt_rocauc=0.93269 adapt_steps=2.17 halt=0.44 train_steps=1.85 +ep100 val_rocauc=0.92502 val_adapt_rocauc=0.92522 adapt_steps=2.18 halt=0.44 train_steps=1.84 +[ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=40 val={'rocauc': 0.9522055162799961} test={'rocauc': 0.6266396604938272} adaptive={'rocauc': 0.6264467592592592} steps=2.7892156862745097 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molbbbp view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.35647 val_adapt_rocauc=0.35647 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep20 val_rocauc=0.80783 val_adapt_rocauc=0.80783 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep30 val_rocauc=0.83362 val_adapt_rocauc=0.83362 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep40 val_rocauc=0.90670 val_adapt_rocauc=0.90869 adapt_steps=3.12 halt=0.30 train_steps=2.90 +ep50 val_rocauc=0.91915 val_adapt_rocauc=0.92751 adapt_steps=2.87 halt=0.34 train_steps=2.55 +ep60 val_rocauc=0.93627 val_adapt_rocauc=0.93707 adapt_steps=2.55 halt=0.37 train_steps=2.44 +ep70 val_rocauc=0.95350 val_adapt_rocauc=0.94932 adapt_steps=2.43 halt=0.37 train_steps=2.44 +ep80 val_rocauc=0.92582 val_adapt_rocauc=0.92721 adapt_steps=2.32 halt=0.39 train_steps=2.31 +ep90 val_rocauc=0.92662 val_adapt_rocauc=0.92662 adapt_steps=2.21 halt=0.41 train_steps=2.10 +ep100 val_rocauc=0.94155 val_adapt_rocauc=0.94175 adapt_steps=2.19 halt=0.41 train_steps=2.06 +[ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=70 val={'rocauc': 0.9534999502140795} test={'rocauc': 0.6597222222222222} adaptive={'rocauc': 0.6678240740740741} steps=3.2450980392156863 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molbbbp view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.84039 val_adapt_rocauc=0.84039 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep20 val_rocauc=0.75326 val_adapt_rocauc=0.75326 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep30 val_rocauc=0.87265 val_adapt_rocauc=0.87265 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep40 val_rocauc=0.93976 val_adapt_rocauc=0.93886 adapt_steps=2.80 halt=0.32 train_steps=2.66 +ep50 val_rocauc=0.91805 val_adapt_rocauc=0.93149 adapt_steps=2.47 halt=0.40 train_steps=2.15 +ep60 val_rocauc=0.88619 val_adapt_rocauc=0.89923 adapt_steps=2.45 halt=0.36 train_steps=2.35 +ep70 val_rocauc=0.94324 val_adapt_rocauc=0.94324 adapt_steps=2.54 halt=0.39 train_steps=2.18 +ep80 val_rocauc=0.94952 val_adapt_rocauc=0.95021 adapt_steps=2.11 halt=0.42 train_steps=2.05 +ep90 val_rocauc=0.94623 val_adapt_rocauc=0.95330 adapt_steps=2.09 halt=0.43 train_steps=1.95 +ep100 val_rocauc=0.94524 val_adapt_rocauc=0.95081 adapt_steps=2.14 halt=0.42 train_steps=1.96 +[ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=80 val={'rocauc': 0.9495170765707459} test={'rocauc': 0.6861496913580247} adaptive={'rocauc': 0.6808449074074074} steps=2.7058823529411766 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molbbbp view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molbbbp --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.84487 val_adapt_rocauc=0.84487 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep20 val_rocauc=0.83471 val_adapt_rocauc=0.83471 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep30 val_rocauc=0.89664 val_adapt_rocauc=0.89664 adapt_steps=8.00 halt=0.17 train_steps=5.17 +ep40 val_rocauc=0.87255 val_adapt_rocauc=0.91128 adapt_steps=2.08 halt=0.46 train_steps=1.69 +ep50 val_rocauc=0.81778 val_adapt_rocauc=0.90391 adapt_steps=2.08 halt=0.44 train_steps=1.83 +ep60 val_rocauc=0.86707 val_adapt_rocauc=0.90909 adapt_steps=2.05 halt=0.45 train_steps=1.73 +ep70 val_rocauc=0.86588 val_adapt_rocauc=0.90282 adapt_steps=2.05 halt=0.45 train_steps=1.71 +ep80 val_rocauc=0.89664 val_adapt_rocauc=0.92423 adapt_steps=2.01 halt=0.47 train_steps=1.61 +ep90 val_rocauc=0.87175 val_adapt_rocauc=0.90750 adapt_steps=2.02 halt=0.47 train_steps=1.67 +ep100 val_rocauc=0.86787 val_adapt_rocauc=0.90670 adapt_steps=2.04 halt=0.47 train_steps=1.62 +[ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=80 val={'rocauc': 0.8966444289554915} test={'rocauc': 0.6170910493827161} adaptive={'rocauc': 0.6361882716049383} steps=2.0049019607843137 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json diff --git a/logs/ogbg-molclintox_0.log b/logs/ogbg-molclintox_0.log new file mode 100644 index 0000000..71cb703 --- /dev/null +++ b/logs/ogbg-molclintox_0.log @@ -0,0 +1,756 @@ +[run] ogbg-molclintox view=gin compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view gin --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/clintox.zip +
0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 1750.18it/s] +Processing... +Extracting /orion/u/oscarwan/rrog-gnn-runner/data/ogb/clintox.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/1477 [00:00<?, ?it/s]
100%|██████████| 1477/1477 [00:00<00:00, 90670.73it/s] +Converting graphs into PyG objects... +
0%| | 0/1477 [00:00<?, ?it/s]
100%|██████████| 1477/1477 [00:00<00:00, 68546.06it/s] +Done! +Saving... +ep10 val_rocauc=0.83043 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.84184 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.95471 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.93925 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.92535 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.94904 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.93532 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.92022 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.93040 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.92970 halt=0.00 train_steps=1.00 +[ogbg-molclintox_gin_classic_T0_ns1_h128_e100_s0] best_ep=30 val={'rocauc': 0.9547104304146558} test={'rocauc': 0.8586383067459077} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_gin_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molclintox view=gin compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view gin --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.83909 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.83210 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.81964 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.84041 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.87796 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.89288 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.91569 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.91639 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.91030 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.90596 halt=0.00 train_steps=3.00 +[ogbg-molclintox_gin_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=80 val={'rocauc': 0.9163892445582587} test={'rocauc': 0.8788013067806625} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_gin_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molclintox view=gine compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view gine --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.77703 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.89547 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.93305 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.93277 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.93526 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.91819 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.89099 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.90036 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.89695 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.89952 halt=0.00 train_steps=1.00 +[ogbg-molclintox_gine_classic_T0_ns1_h128_e100_s0] best_ep=50 val={'rocauc': 0.9352564102564103} test={'rocauc': 0.8869330622458556} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_gine_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molclintox view=gine compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view gine --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.85987 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.85202 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.92254 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.90400 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.82272 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.90346 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.86070 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.86354 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.85770 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.85969 halt=0.00 train_steps=3.00 +[ogbg-molclintox_gine_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.9225425982468236} test={'rocauc': 0.8839597886907865} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_gine_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molclintox view=gcn compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view gcn --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.90793 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.89688 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.89512 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.90011 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.90978 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.93185 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.92404 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.91820 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.92788 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.92799 halt=0.00 train_steps=1.00 +[ogbg-molclintox_gcn_classic_T0_ns1_h128_e100_s0] best_ep=60 val={'rocauc': 0.9318477297350538} test={'rocauc': 0.8932080422618427} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_gcn_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molclintox view=gcn compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view gcn --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.90811 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.90232 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.85310 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.87060 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.90973 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.90737 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.89160 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.90489 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.90900 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.90818 halt=0.00 train_steps=3.00 +[ogbg-molclintox_gcn_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rocauc': 0.909733576282872} test={'rocauc': 0.8791896917248809} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molclintox view=graphsage compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view graphsage --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.90614 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.86131 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.91430 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.90922 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.88325 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.89701 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.89525 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.88834 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.88706 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.88764 halt=0.00 train_steps=1.00 +[ogbg-molclintox_graphsage_classic_T0_ns1_h128_e100_s0] best_ep=30 val={'rocauc': 0.9143020125414492} test={'rocauc': 0.8881694644284572} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_graphsage_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molclintox view=graphsage compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view graphsage --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.95791 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.84252 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.92818 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.93544 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.91088 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.88493 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.88421 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.87990 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.87311 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.87498 halt=0.00 train_steps=3.00 +[ogbg-molclintox_graphsage_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=10 val={'rocauc': 0.957908171640566} test={'rocauc': 0.8664451047857367} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molclintox view=gatv2 compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view gatv2 --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.84476 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.95149 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.91646 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.86488 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.87970 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.89911 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.86614 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.87327 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.87467 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.87408 halt=0.00 train_steps=1.00 +[ogbg-molclintox_gatv2_classic_T0_ns1_h128_e100_s0] best_ep=20 val={'rocauc': 0.9514880659246856} test={'rocauc': 0.849258853786536} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_gatv2_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molclintox view=gatv2 compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view gatv2 --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.88147 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.91892 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.93508 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.87244 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.89978 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.91147 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.90529 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.89732 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.89978 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.90107 halt=0.00 train_steps=3.00 +[ogbg-molclintox_gatv2_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.9350807643061164} test={'rocauc': 0.8328163556111632} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molclintox view=graphconv compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view graphconv --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.86711 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.85132 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.89173 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.85924 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.85122 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.85203 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.85169 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.85318 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.86031 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.85341 halt=0.00 train_steps=1.00 +[ogbg-molclintox_graphconv_classic_T0_ns1_h128_e100_s0] best_ep=30 val={'rocauc': 0.8917274040513478} test={'rocauc': 0.850132937128558} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_graphconv_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molclintox view=graphconv compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view graphconv --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.84747 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.76048 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.82325 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.84937 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.79834 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.82018 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.79431 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.78760 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.78724 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.79087 halt=0.00 train_steps=3.00 +[ogbg-molclintox_graphconv_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.849372106766473} test={'rocauc': 0.8185512459597539} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molclintox view=transformer compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view transformer --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.92705 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.88443 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.90818 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.87958 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.86168 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.85327 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.85162 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.84566 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.84519 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.84647 halt=0.00 train_steps=1.00 +[ogbg-molclintox_transformer_classic_T0_ns1_h128_e100_s0] best_ep=10 val={'rocauc': 0.9270511178961884} test={'rocauc': 0.8763771591422514} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_transformer_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molclintox view=transformer compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view transformer --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.93220 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.89666 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.87739 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.85882 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.87220 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.86733 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.85830 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.85875 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.85945 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.86015 halt=0.00 train_steps=3.00 +[ogbg-molclintox_transformer_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=10 val={'rocauc': 0.9321957385337667} test={'rocauc': 0.8521686998227505} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molclintox view=pna compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view pna --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.92859 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.80558 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.86447 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.88785 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.89099 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.82869 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.86585 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.86096 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.86236 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.86669 halt=0.00 train_steps=1.00 +[ogbg-molclintox_pna_classic_T0_ns1_h128_e100_s0] best_ep=10 val={'rocauc': 0.9285867887980563} test={'rocauc': 0.8602891599763668} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_pna_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molclintox view=pna compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view pna --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.90641 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.74479 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.80852 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.89954 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.82959 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.80479 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.80490 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.80773 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.77999 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.78094 halt=0.00 train_steps=3.00 +[ogbg-molclintox_pna_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=10 val={'rocauc': 0.9064094356347877} test={'rocauc': 0.8734968546901609} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_pna_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molclintox view=gen compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view gen --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.98202 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.88923 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.88643 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.91053 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.86987 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.85782 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.88061 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.85117 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.83901 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.83713 halt=0.00 train_steps=1.00 +[ogbg-molclintox_gen_classic_T0_ns1_h128_e100_s0] best_ep=10 val={'rocauc': 0.9820184510325356} test={'rocauc': 0.8127689153025406} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_gen_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molclintox view=gen compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view gen --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.90138 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.93158 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.93989 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.92932 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.88558 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.87502 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.85864 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.84902 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.83837 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.83591 halt=0.00 train_steps=3.00 +[ogbg-molclintox_gen_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.9398880462260745} test={'rocauc': 0.8194027386786223} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_gen_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molclintox view=film compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view film --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.90481 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.86948 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.85559 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.87663 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.87551 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.87420 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.86984 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.87219 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.86844 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.86914 halt=0.00 train_steps=1.00 +[ogbg-molclintox_film_classic_T0_ns1_h128_e100_s0] best_ep=10 val={'rocauc': 0.9048138481237074} test={'rocauc': 0.7730589441490285} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_film_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molclintox view=film compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view film --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.88496 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.91233 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.92508 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.93170 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.94537 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.94106 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.93919 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.94293 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.94003 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.93757 halt=0.00 train_steps=3.00 +[ogbg-molclintox_film_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rocauc': 0.9453700055812732} test={'rocauc': 0.8429647586278803} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_film_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molclintox view=resgated compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view resgated --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.87012 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.92438 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.86702 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.91514 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.91738 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.92406 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.90505 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.90496 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.91198 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.91140 halt=0.00 train_steps=1.00 +[ogbg-molclintox_resgated_classic_T0_ns1_h128_e100_s0] best_ep=20 val={'rocauc': 0.9243803145211595} test={'rocauc': 0.9184252597921663} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_resgated_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molclintox view=resgated compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view resgated --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.88666 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.86182 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.87936 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.90554 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.88316 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.87763 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.86391 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.86179 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.86274 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.86226 halt=0.00 train_steps=3.00 +[ogbg-molclintox_resgated_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.9055377720870679} test={'rocauc': 0.8978999409168318} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molclintox view=tag compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view tag --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.92366 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.87789 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.88531 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.87445 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.84911 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.82478 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.81727 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.82848 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.81903 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.81763 halt=0.00 train_steps=1.00 +[ogbg-molclintox_tag_classic_T0_ns1_h128_e100_s0] best_ep=10 val={'rocauc': 0.923656390557799} test={'rocauc': 0.7998149306641643} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_tag_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molclintox view=tag compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view tag --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.80381 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.90305 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.82746 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.91828 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.89686 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.87545 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.86013 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.84718 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.84695 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.84320 halt=0.00 train_steps=3.00 +[ogbg-molclintox_tag_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.9182762073607145} test={'rocauc': 0.8432784207416675} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_tag_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molclintox view=sgc compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view sgc --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.81420 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.87330 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.88533 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.89801 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.90011 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.90184 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.91949 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.90453 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.90570 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.90441 halt=0.00 train_steps=1.00 +[ogbg-molclintox_sgc_classic_T0_ns1_h128_e100_s0] best_ep=70 val={'rocauc': 0.9194852096260546} test={'rocauc': 0.8985793973516839} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_sgc_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molclintox view=sgc compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view sgc --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.80217 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.86031 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.89787 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.92197 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.89216 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.88502 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.87652 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.86729 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.88099 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.87993 halt=0.00 train_steps=3.00 +[ogbg-molclintox_sgc_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.9219696969696969} test={'rocauc': 0.9054147985959059} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molclintox view=cheb compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view cheb --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.87442 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.88236 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.89279 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.85328 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.85443 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.84836 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.84369 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.84240 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.83936 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.83877 halt=0.00 train_steps=1.00 +[ogbg-molclintox_cheb_classic_T0_ns1_h128_e100_s0] best_ep=30 val={'rocauc': 0.8927886667323287} test={'rocauc': 0.9152165224342266} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_cheb_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molclintox view=cheb compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view cheb --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.87090 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.87367 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.80362 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.86133 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.88164 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.86596 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.85975 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.85354 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.84862 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.85259 halt=0.00 train_steps=3.00 +[ogbg-molclintox_cheb_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rocauc': 0.8816384319905446} test={'rocauc': 0.8982283738226811} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molclintox view=arma compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view arma --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.77612 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.90207 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.92264 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.94629 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.91352 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.93214 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.92302 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.92090 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.91950 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.91891 halt=0.00 train_steps=1.00 +[ogbg-molclintox_arma_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rocauc': 0.9462941987589875} test={'rocauc': 0.8678231327981094} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_arma_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molclintox view=arma compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view arma --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.84999 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.88115 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.88909 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.85445 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.91353 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.89471 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.89647 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.88417 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.88465 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.88336 halt=0.00 train_steps=3.00 +[ogbg-molclintox_arma_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rocauc': 0.9135288420499689} test={'rocauc': 0.8863352796024051} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_arma_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molclintox view=mf compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view mf --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.92515 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.89990 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.92116 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.89706 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.91531 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.90167 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.89661 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.89602 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.89731 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.89672 halt=0.00 train_steps=1.00 +[ogbg-molclintox_mf_classic_T0_ns1_h128_e100_s0] best_ep=10 val={'rocauc': 0.9251534850126399} test={'rocauc': 0.8369808501025267} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_mf_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molclintox view=mf compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view mf --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.81387 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.91473 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.91089 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.91420 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.86880 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.88485 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.87498 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.86526 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.85986 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.85916 halt=0.00 train_steps=3.00 +[ogbg-molclintox_mf_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=20 val={'rocauc': 0.9147271742342165} test={'rocauc': 0.804700587356202} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_mf_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molclintox view=appnp compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view appnp --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.74829 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.82319 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.79624 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.80150 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.84421 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.85159 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.83837 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.84119 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.83171 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.83499 halt=0.00 train_steps=1.00 +[ogbg-molclintox_appnp_classic_T0_ns1_h128_e100_s0] best_ep=60 val={'rocauc': 0.8515931251846744} test={'rocauc': 0.9184287352726515} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_appnp_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molclintox view=appnp compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view appnp --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.77085 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.89489 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.84491 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.90294 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.87489 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.87412 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.88602 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.88457 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.87652 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.87735 halt=0.00 train_steps=3.00 +[ogbg-molclintox_appnp_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.9029408385042188} test={'rocauc': 0.8898090223473396} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json + +Classic baseline: task x backbone +| task | backbone | metric | n | val | test | +| --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | rocauc | 1 | 0.6564 +/- 0.0000 | 0.7423 +/- 0.0000 | +| ogbg-molbace | arma | rocauc | 1 | 0.6923 +/- 0.0000 | 0.7839 +/- 0.0000 | +| ogbg-molbace | cheb | rocauc | 1 | 0.7267 +/- 0.0000 | 0.7969 +/- 0.0000 | +| ogbg-molbace | film | rocauc | 1 | 0.6703 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molbace | gatv2 | rocauc | 1 | 0.7029 +/- 0.0000 | 0.7400 +/- 0.0000 | +| ogbg-molbace | gcn | rocauc | 1 | 0.6381 +/- 0.0000 | 0.7393 +/- 0.0000 | +| ogbg-molbace | gen | rocauc | 1 | 0.7128 +/- 0.0000 | 0.7326 +/- 0.0000 | +| ogbg-molbace | gin | rocauc | 1 | 0.6520 +/- 0.0000 | 0.7336 +/- 0.0000 | +| ogbg-molbace | gine | rocauc | 1 | 0.6641 +/- 0.0000 | 0.7454 +/- 0.0000 | +| ogbg-molbace | graphconv | rocauc | 1 | 0.7311 +/- 0.0000 | 0.8035 +/- 0.0000 | +| ogbg-molbace | graphsage | rocauc | 1 | 0.6758 +/- 0.0000 | 0.7759 +/- 0.0000 | +| ogbg-molbace | mf | rocauc | 1 | 0.7421 +/- 0.0000 | 0.7760 +/- 0.0000 | +| ogbg-molbace | pna | rocauc | 1 | 0.7516 +/- 0.0000 | 0.6912 +/- 0.0000 | +| ogbg-molbace | resgated | rocauc | 1 | 0.7172 +/- 0.0000 | 0.7877 +/- 0.0000 | +| ogbg-molbace | sgc | rocauc | 1 | 0.6575 +/- 0.0000 | 0.6966 +/- 0.0000 | +| ogbg-molbace | tag | rocauc | 1 | 0.7084 +/- 0.0000 | 0.7345 +/- 0.0000 | +| ogbg-molbace | transformer | rocauc | 1 | 0.6663 +/- 0.0000 | 0.7364 +/- 0.0000 | +| ogbg-molbbbp | appnp | rocauc | 1 | 0.9147 +/- 0.0000 | 0.6388 +/- 0.0000 | +| ogbg-molbbbp | arma | rocauc | 1 | 0.9367 +/- 0.0000 | 0.6651 +/- 0.0000 | +| ogbg-molbbbp | cheb | rocauc | 1 | 0.9452 +/- 0.0000 | 0.6514 +/- 0.0000 | +| ogbg-molbbbp | film | rocauc | 1 | 0.9285 +/- 0.0000 | 0.6300 +/- 0.0000 | +| ogbg-molbbbp | gatv2 | rocauc | 1 | 0.9347 +/- 0.0000 | 0.6324 +/- 0.0000 | +| ogbg-molbbbp | gcn | rocauc | 1 | 0.9386 +/- 0.0000 | 0.6679 +/- 0.0000 | +| ogbg-molbbbp | gen | rocauc | 1 | 0.9549 +/- 0.0000 | 0.6775 +/- 0.0000 | +| ogbg-molbbbp | gin | rocauc | 1 | 0.9251 +/- 0.0000 | 0.5670 +/- 0.0000 | +| ogbg-molbbbp | gine | rocauc | 1 | 0.9324 +/- 0.0000 | 0.6160 +/- 0.0000 | +| ogbg-molbbbp | graphconv | rocauc | 1 | 0.9268 +/- 0.0000 | 0.5900 +/- 0.0000 | +| ogbg-molbbbp | graphsage | rocauc | 1 | 0.9483 +/- 0.0000 | 0.6288 +/- 0.0000 | +| ogbg-molbbbp | mf | rocauc | 1 | 0.9395 +/- 0.0000 | 0.6365 +/- 0.0000 | +| ogbg-molbbbp | pna | rocauc | 1 | 0.9554 +/- 0.0000 | 0.6418 +/- 0.0000 | +| ogbg-molbbbp | resgated | rocauc | 1 | 0.9183 +/- 0.0000 | 0.6626 +/- 0.0000 | +| ogbg-molbbbp | sgc | rocauc | 1 | 0.9300 +/- 0.0000 | 0.6239 +/- 0.0000 | +| ogbg-molbbbp | tag | rocauc | 1 | 0.9476 +/- 0.0000 | 0.6100 +/- 0.0000 | +| ogbg-molbbbp | transformer | rocauc | 1 | 0.9495 +/- 0.0000 | 0.6156 +/- 0.0000 | +| ogbg-molclintox | appnp | rocauc | 1 | 0.8516 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | arma | rocauc | 1 | 0.9463 +/- 0.0000 | 0.8678 +/- 0.0000 | +| ogbg-molclintox | cheb | rocauc | 1 | 0.8928 +/- 0.0000 | 0.9152 +/- 0.0000 | +| ogbg-molclintox | film | rocauc | 1 | 0.9048 +/- 0.0000 | 0.7731 +/- 0.0000 | +| ogbg-molclintox | gatv2 | rocauc | 1 | 0.9515 +/- 0.0000 | 0.8493 +/- 0.0000 | +| ogbg-molclintox | gcn | rocauc | 1 | 0.9318 +/- 0.0000 | 0.8932 +/- 0.0000 | +| ogbg-molclintox | gen | rocauc | 1 | 0.9820 +/- 0.0000 | 0.8128 +/- 0.0000 | +| ogbg-molclintox | gin | rocauc | 1 | 0.9547 +/- 0.0000 | 0.8586 +/- 0.0000 | +| ogbg-molclintox | gine | rocauc | 1 | 0.9353 +/- 0.0000 | 0.8869 +/- 0.0000 | +| ogbg-molclintox | graphconv | rocauc | 1 | 0.8917 +/- 0.0000 | 0.8501 +/- 0.0000 | +| ogbg-molclintox | graphsage | rocauc | 1 | 0.9143 +/- 0.0000 | 0.8882 +/- 0.0000 | +| ogbg-molclintox | mf | rocauc | 1 | 0.9252 +/- 0.0000 | 0.8370 +/- 0.0000 | +| ogbg-molclintox | pna | rocauc | 1 | 0.9286 +/- 0.0000 | 0.8603 +/- 0.0000 | +| ogbg-molclintox | resgated | rocauc | 1 | 0.9244 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | sgc | rocauc | 1 | 0.9195 +/- 0.0000 | 0.8986 +/- 0.0000 | +| ogbg-molclintox | tag | rocauc | 1 | 0.9237 +/- 0.0000 | 0.7998 +/- 0.0000 | +| ogbg-molclintox | transformer | rocauc | 1 | 0.9271 +/- 0.0000 | 0.8764 +/- 0.0000 | +| ogbg-molhiv | appnp | rocauc | 1 | 0.7675 +/- 0.0000 | 0.7000 +/- 0.0000 | +| ogbg-molhiv | arma | rocauc | 1 | 0.7872 +/- 0.0000 | 0.7296 +/- 0.0000 | +| ogbg-molhiv | cheb | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7282 +/- 0.0000 | +| ogbg-molhiv | film | rocauc | 1 | 0.7922 +/- 0.0000 | 0.7842 +/- 0.0000 | +| ogbg-molhiv | gatv2 | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7563 +/- 0.0000 | +| ogbg-molhiv | gcn | rocauc | 1 | 0.7754 +/- 0.0000 | 0.7198 +/- 0.0000 | +| ogbg-molhiv | gen | rocauc | 1 | 0.7530 +/- 0.0000 | 0.7314 +/- 0.0000 | +| ogbg-molhiv | gin | rocauc | 1 | 0.8167 +/- 0.0000 | 0.7724 +/- 0.0000 | +| ogbg-molhiv | gine | rocauc | 1 | 0.7942 +/- 0.0000 | 0.7445 +/- 0.0000 | +| ogbg-molhiv | graphconv | rocauc | 1 | 0.7707 +/- 0.0000 | 0.7108 +/- 0.0000 | +| ogbg-molhiv | graphsage | rocauc | 1 | 0.7969 +/- 0.0000 | 0.7625 +/- 0.0000 | +| ogbg-molhiv | mf | rocauc | 1 | 0.7845 +/- 0.0000 | 0.7074 +/- 0.0000 | +| ogbg-molhiv | pna | rocauc | 1 | 0.7780 +/- 0.0000 | 0.7648 +/- 0.0000 | +| ogbg-molhiv | resgated | rocauc | 1 | 0.8144 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molhiv | sgc | rocauc | 1 | 0.7479 +/- 0.0000 | 0.7019 +/- 0.0000 | +| ogbg-molhiv | tag | rocauc | 1 | 0.7528 +/- 0.0000 | 0.7255 +/- 0.0000 | +| ogbg-molhiv | transformer | rocauc | 1 | 0.7617 +/- 0.0000 | 0.7547 +/- 0.0000 | +| ogbg-moltox21 | appnp | rocauc | 1 | 0.7255 +/- 0.0000 | 0.7158 +/- 0.0000 | +| ogbg-moltox21 | arma | rocauc | 1 | 0.7799 +/- 0.0000 | 0.7223 +/- 0.0000 | +| ogbg-moltox21 | cheb | rocauc | 1 | 0.7834 +/- 0.0000 | 0.7301 +/- 0.0000 | +| ogbg-moltox21 | film | rocauc | 1 | 0.7702 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gatv2 | rocauc | 1 | 0.7627 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gcn | rocauc | 1 | 0.7580 +/- 0.0000 | 0.7171 +/- 0.0000 | +| ogbg-moltox21 | gen | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7444 +/- 0.0000 | +| ogbg-moltox21 | gin | rocauc | 1 | 0.7690 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-moltox21 | gine | rocauc | 1 | 0.7744 +/- 0.0000 | 0.7328 +/- 0.0000 | +| ogbg-moltox21 | graphconv | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7147 +/- 0.0000 | +| ogbg-moltox21 | graphsage | rocauc | 1 | 0.7709 +/- 0.0000 | 0.7196 +/- 0.0000 | +| ogbg-moltox21 | mf | rocauc | 1 | 0.7773 +/- 0.0000 | 0.7281 +/- 0.0000 | +| ogbg-moltox21 | pna | rocauc | 1 | 0.7660 +/- 0.0000 | 0.6946 +/- 0.0000 | +| ogbg-moltox21 | resgated | rocauc | 1 | 0.7950 +/- 0.0000 | 0.7275 +/- 0.0000 | +| ogbg-moltox21 | sgc | rocauc | 1 | 0.7611 +/- 0.0000 | 0.7240 +/- 0.0000 | +| ogbg-moltox21 | tag | rocauc | 1 | 0.7866 +/- 0.0000 | 0.7416 +/- 0.0000 | +| ogbg-moltox21 | transformer | rocauc | 1 | 0.7656 +/- 0.0000 | 0.7309 +/- 0.0000 | + +Delta vs matching classic +| task | backbone | compute | metric | n | val score (delta) | test score (delta) | steps | +| --- | --- | --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7168 (0.0604) | 0.7209 (-0.0214) | | +| ogbg-molbace | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7179 (0.0256) | 0.7672 (-0.0167) | | +| ogbg-molbace | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7114 (-0.0154) | 0.7533 (-0.0436) | | +| ogbg-molbace | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6652 (-0.0051) | 0.7242 (0.0000) | | +| ogbg-molbace | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7026 (-0.0004) | 0.7519 (0.0118) | | +| ogbg-molbace | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6374 (-0.0007) | 0.7733 (0.0339) | | +| ogbg-molbace | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6894 (-0.0234) | 0.7449 (0.0123) | | +| ogbg-molbace | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6538 (0.0018) | 0.7169 (-0.0167) | | +| ogbg-molbace | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6685 (0.0044) | 0.6994 (-0.0461) | | +| ogbg-molbace | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7462 (0.0150) | 0.7983 (-0.0052) | | +| ogbg-molbace | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6703 (-0.0055) | 0.7119 (-0.0640) | | +| ogbg-molbace | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7234 (-0.0187) | 0.7684 (-0.0077) | | +| ogbg-molbace | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7037 (-0.0480) | 0.7967 (0.1055) | | +| ogbg-molbace | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6912 (-0.0260) | 0.7465 (-0.0412) | | +| ogbg-molbace | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6454 (-0.0121) | 0.7727 (0.0762) | | +| ogbg-molbace | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7355 (0.0271) | 0.6806 (-0.0539) | | +| ogbg-molbace | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6982 (0.0319) | 0.7487 (0.0123) | | +| ogbg-molbbbp | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9360 (0.0213) | 0.6073 (-0.0314) | | +| ogbg-molbbbp | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9415 (0.0048) | 0.6635 (-0.0016) | | +| ogbg-molbbbp | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9278 (-0.0174) | 0.6659 (0.0145) | | +| ogbg-molbbbp | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9400 (0.0115) | 0.6323 (0.0023) | | +| ogbg-molbbbp | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9356 (0.0009) | 0.6560 (0.0235) | | +| ogbg-molbbbp | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9417 (0.0031) | 0.6017 (-0.0663) | | +| ogbg-molbbbp | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9429 (-0.0119) | 0.6037 (-0.0738) | | +| ogbg-molbbbp | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9526 (0.0275) | 0.5932 (0.0261) | | +| ogbg-molbbbp | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9421 (0.0098) | 0.6976 (0.0816) | | +| ogbg-molbbbp | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9337 (0.0069) | 0.6518 (0.0618) | | +| ogbg-molbbbp | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9502 (0.0019) | 0.5934 (-0.0354) | | +| ogbg-molbbbp | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9488 (0.0094) | 0.6481 (0.0116) | | +| ogbg-molbbbp | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9585 (0.0031) | 0.6682 (0.0264) | | +| ogbg-molbbbp | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9535 (0.0352) | 0.5839 (-0.0787) | | +| ogbg-molbbbp | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9285 (-0.0015) | 0.6454 (0.0215) | | +| ogbg-molbbbp | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9459 (-0.0017) | 0.6420 (0.0320) | | +| ogbg-molbbbp | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9355 (-0.0140) | 0.6221 (0.0065) | | +| ogbg-molclintox | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9029 (0.0513) | 0.8898 (-0.0286) | | +| ogbg-molclintox | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9135 (-0.0328) | 0.8863 (0.0185) | | +| ogbg-molclintox | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8816 (-0.0112) | 0.8982 (-0.0170) | | +| ogbg-molclintox | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9454 (0.0406) | 0.8430 (0.0699) | | +| ogbg-molclintox | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9351 (-0.0164) | 0.8328 (-0.0164) | | +| ogbg-molclintox | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9097 (-0.0221) | 0.8792 (-0.0140) | | +| ogbg-molclintox | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9399 (-0.0421) | 0.8194 (0.0066) | | +| ogbg-molclintox | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9164 (-0.0383) | 0.8788 (0.0202) | | +| ogbg-molclintox | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9225 (-0.0127) | 0.8840 (-0.0030) | | +| ogbg-molclintox | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8494 (-0.0424) | 0.8186 (-0.0316) | | +| ogbg-molclintox | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9579 (0.0436) | 0.8664 (-0.0217) | | +| ogbg-molclintox | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9147 (-0.0104) | 0.8047 (-0.0323) | | +| ogbg-molclintox | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9064 (-0.0222) | 0.8735 (0.0132) | | +| ogbg-molclintox | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9055 (-0.0188) | 0.8979 (-0.0205) | | +| ogbg-molclintox | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9220 (0.0025) | 0.9054 (0.0068) | | +| ogbg-molclintox | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9183 (-0.0054) | 0.8433 (0.0435) | | +| ogbg-molclintox | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9322 (0.0051) | 0.8522 (-0.0242) | | +| ogbg-molhiv | appnp | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7203 (-0.0471) | 0.6825 (-0.0175) | | +| ogbg-molhiv | arma | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7926 (0.0054) | 0.7318 (0.0021) | | +| ogbg-molhiv | cheb | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7735 (-0.0096) | 0.7426 (0.0144) | | +| ogbg-molhiv | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8251 (0.0330) | 0.7725 (-0.0117) | | +| ogbg-molhiv | film | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7633 (-0.0288) | 0.7728 (-0.0114) | | +| ogbg-molhiv | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8049 (0.0214) | 0.7486 (-0.0077) | | +| ogbg-molhiv | gatv2 | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7835 (0.0001) | 0.7466 (-0.0096) | | +| ogbg-molhiv | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7833 (0.0079) | 0.7448 (0.0250) | | +| ogbg-molhiv | gcn | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7455 (-0.0300) | 0.7483 (0.0285) | | +| ogbg-molhiv | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7740 (0.0210) | 0.7590 (0.0276) | | +| ogbg-molhiv | gen | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8128 (0.0598) | 0.7631 (0.0318) | | +| ogbg-molhiv | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0457) | 0.7668 (-0.0056) | | +| ogbg-molhiv | gin | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7524 (-0.0644) | 0.7324 (-0.0400) | | +| ogbg-molhiv | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7490 (-0.0453) | 0.7376 (-0.0070) | | +| ogbg-molhiv | gine | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7575 (-0.0368) | 0.7401 (-0.0044) | | +| ogbg-molhiv | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7817 (0.0110) | 0.7493 (0.0385) | | +| ogbg-molhiv | graphconv | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7713 (0.0006) | 0.6979 (-0.0129) | | +| ogbg-molhiv | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7893 (-0.0075) | 0.7633 (0.0008) | | +| ogbg-molhiv | graphsage | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7587 (-0.0382) | 0.7641 (0.0016) | | +| ogbg-molhiv | mf | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7931 (0.0085) | 0.7217 (0.0143) | | +| ogbg-molhiv | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8097 (0.0317) | 0.7602 (-0.0046) | | +| ogbg-molhiv | pna | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7890 (0.0111) | 0.7630 (-0.0018) | | +| ogbg-molhiv | resgated | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8174 (0.0030) | 0.7055 (-0.0187) | | +| ogbg-molhiv | sgc | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7482 (0.0003) | 0.7177 (0.0158) | | +| ogbg-molhiv | tag | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7804 (0.0276) | 0.7352 (0.0096) | | +| ogbg-molhiv | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7838 (0.0221) | 0.7648 (0.0100) | | +| ogbg-molhiv | transformer | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8088 (0.0471) | 0.7413 (-0.0134) | | +| ogbg-moltox21 | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7280 (0.0025) | 0.7154 (-0.0005) | | +| ogbg-moltox21 | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7771 (-0.0028) | 0.7209 (-0.0014) | | +| ogbg-moltox21 | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0125) | 0.7286 (-0.0015) | | +| ogbg-moltox21 | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7727 (0.0025) | 0.7369 (0.0209) | | +| ogbg-moltox21 | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7762 (0.0135) | 0.7303 (0.0143) | | +| ogbg-moltox21 | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7588 (0.0007) | 0.7230 (0.0059) | | +| ogbg-moltox21 | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7757 (-0.0077) | 0.7312 (-0.0132) | | +| ogbg-moltox21 | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7718 (0.0028) | 0.7237 (-0.0005) | | +| ogbg-moltox21 | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7622 (-0.0122) | 0.7193 (-0.0135) | | +| ogbg-moltox21 | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7820 (-0.0011) | 0.7313 (0.0166) | | +| ogbg-moltox21 | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7697 (-0.0012) | 0.7205 (0.0009) | | +| ogbg-moltox21 | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7695 (-0.0078) | 0.7279 (-0.0002) | | +| ogbg-moltox21 | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7745 (0.0085) | 0.7349 (0.0403) | | +| ogbg-moltox21 | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7887 (-0.0064) | 0.7380 (0.0104) | | +| ogbg-moltox21 | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7506 (-0.0105) | 0.7355 (0.0115) | | +| ogbg-moltox21 | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7839 (-0.0027) | 0.7342 (-0.0074) | | +| ogbg-moltox21 | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7761 (0.0105) | 0.7292 (-0.0018) | | diff --git a/logs/ogbg-molclintox_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log b/logs/ogbg-molclintox_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log new file mode 100644 index 0000000..fb2874c --- /dev/null +++ b/logs/ogbg-molclintox_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log @@ -0,0 +1,164 @@ +[run] ogbg-molclintox view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/clintox.zip +
0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 4.81it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 4.81it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 9.61it/s] +Processing... +Extracting /home/yurenh2/rrog-gnn-runner/data/ogb/clintox.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/1477 [00:00<?, ?it/s]
100%|██████████| 1477/1477 [00:00<00:00, 169141.78it/s] +Converting graphs into PyG objects... +
0%| | 0/1477 [00:00<?, ?it/s]
100%|██████████| 1477/1477 [00:00<00:00, 83199.98it/s] +Done! +Saving... +ep10 val_rocauc=0.60624 val_adapt_rocauc=0.74118 adapt_steps=2.01 halt=0.40 train_steps=2.12 +ep20 val_rocauc=0.78931 val_adapt_rocauc=0.78193 adapt_steps=2.51 halt=0.46 train_steps=1.67 +ep30 val_rocauc=0.87347 val_adapt_rocauc=0.88131 adapt_steps=2.23 halt=0.43 train_steps=1.76 +ep40 val_rocauc=0.90655 val_adapt_rocauc=0.89215 adapt_steps=2.11 halt=0.43 train_steps=1.90 +ep50 val_rocauc=0.90059 val_adapt_rocauc=0.89949 adapt_steps=2.04 halt=0.45 train_steps=1.68 +ep60 val_rocauc=0.92569 val_adapt_rocauc=0.91470 adapt_steps=2.04 halt=0.46 train_steps=1.73 +ep70 val_rocauc=0.85343 val_adapt_rocauc=0.84051 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep80 val_rocauc=0.90430 val_adapt_rocauc=0.88959 adapt_steps=2.00 halt=0.47 train_steps=1.61 +ep90 val_rocauc=0.91698 val_adapt_rocauc=0.90556 adapt_steps=2.01 halt=0.47 train_steps=1.59 +ep100 val_rocauc=0.89472 val_adapt_rocauc=0.88990 adapt_steps=2.01 halt=0.46 train_steps=1.67 +[ogbg-molclintox_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.925691092944614} test={'rocauc': 0.880287943558197} adaptive={'rocauc': 0.8739417161922636} steps=2.0675675675675675 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molclintox_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.82183 val_adapt_rocauc=0.86297 adapt_steps=2.22 halt=0.43 train_steps=1.73 +ep20 val_rocauc=0.76252 val_adapt_rocauc=0.86505 adapt_steps=2.26 halt=0.47 train_steps=1.63 +ep30 val_rocauc=0.83688 val_adapt_rocauc=0.89876 adapt_steps=2.09 halt=0.45 train_steps=1.62 +ep40 val_rocauc=0.81513 val_adapt_rocauc=0.86423 adapt_steps=2.01 halt=0.46 train_steps=1.65 +ep50 val_rocauc=0.93016 val_adapt_rocauc=0.95113 adapt_steps=2.00 halt=0.47 train_steps=1.62 +ep60 val_rocauc=0.96179 val_adapt_rocauc=0.96556 adapt_steps=2.00 halt=0.47 train_steps=1.64 +ep70 val_rocauc=0.94241 val_adapt_rocauc=0.94934 adapt_steps=2.00 halt=0.47 train_steps=1.64 +ep80 val_rocauc=0.97166 val_adapt_rocauc=0.96956 adapt_steps=2.00 halt=0.46 train_steps=1.63 +ep90 val_rocauc=0.97588 val_adapt_rocauc=0.97344 adapt_steps=2.00 halt=0.46 train_steps=1.62 +ep100 val_rocauc=0.97353 val_adapt_rocauc=0.96875 adapt_steps=2.00 halt=0.45 train_steps=1.63 +[ogbg-molclintox_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rocauc': 0.9758757674250633} test={'rocauc': 0.8739825530879644} adaptive={'rocauc': 0.8682749452611824} steps=2.054054054054054 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molclintox_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.68124 val_adapt_rocauc=0.73447 adapt_steps=2.00 halt=0.43 train_steps=1.98 +ep20 val_rocauc=0.74983 val_adapt_rocauc=0.82573 adapt_steps=2.00 halt=0.45 train_steps=1.75 +ep30 val_rocauc=0.83839 val_adapt_rocauc=0.86462 adapt_steps=2.07 halt=0.45 train_steps=1.69 +ep40 val_rocauc=0.85645 val_adapt_rocauc=0.90685 adapt_steps=2.11 halt=0.47 train_steps=1.61 +ep50 val_rocauc=0.82385 val_adapt_rocauc=0.82321 adapt_steps=2.01 halt=0.47 train_steps=1.56 +ep60 val_rocauc=0.87257 val_adapt_rocauc=0.89450 adapt_steps=2.02 halt=0.47 train_steps=1.61 +ep70 val_rocauc=0.93091 val_adapt_rocauc=0.93933 adapt_steps=2.01 halt=0.47 train_steps=1.61 +ep80 val_rocauc=0.91830 val_adapt_rocauc=0.92507 adapt_steps=2.03 halt=0.47 train_steps=1.67 +ep90 val_rocauc=0.91036 val_adapt_rocauc=0.91478 adapt_steps=2.01 halt=0.47 train_steps=1.67 +ep100 val_rocauc=0.91573 val_adapt_rocauc=0.91911 adapt_steps=2.01 halt=0.47 train_steps=1.63 +[ogbg-molclintox_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.9309095833743721} test={'rocauc': 0.8809821707851111} adaptive={'rocauc': 0.9033008375907969} steps=2.0878378378378377 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molclintox_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.64072 val_adapt_rocauc=0.74493 adapt_steps=2.03 halt=0.41 train_steps=2.16 +ep20 val_rocauc=0.69510 val_adapt_rocauc=0.88005 adapt_steps=2.13 halt=0.47 train_steps=1.63 +ep30 val_rocauc=0.86787 val_adapt_rocauc=0.86841 adapt_steps=2.00 halt=0.46 train_steps=1.64 +ep40 val_rocauc=0.79619 val_adapt_rocauc=0.83481 adapt_steps=2.00 halt=0.46 train_steps=1.68 +ep50 val_rocauc=0.81643 val_adapt_rocauc=0.85514 adapt_steps=2.04 halt=0.44 train_steps=1.79 +ep60 val_rocauc=0.85361 val_adapt_rocauc=0.91327 adapt_steps=2.00 halt=0.48 train_steps=1.59 +ep70 val_rocauc=0.85772 val_adapt_rocauc=0.91744 adapt_steps=2.00 halt=0.47 train_steps=1.59 +ep80 val_rocauc=0.84607 val_adapt_rocauc=0.91703 adapt_steps=2.00 halt=0.46 train_steps=1.63 +ep90 val_rocauc=0.86604 val_adapt_rocauc=0.92838 adapt_steps=2.00 halt=0.47 train_steps=1.61 +ep100 val_rocauc=0.85561 val_adapt_rocauc=0.91784 adapt_steps=2.00 halt=0.46 train_steps=1.62 +[ogbg-molclintox_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rocauc': 0.8678740273810697} test={'rocauc': 0.8432636499496056} adaptive={'rocauc': 0.8344932749452612} steps=2.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molclintox_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.71091 val_adapt_rocauc=0.73332 adapt_steps=2.07 halt=0.42 train_steps=1.94 +ep20 val_rocauc=0.77725 val_adapt_rocauc=0.79820 adapt_steps=2.14 halt=0.46 train_steps=1.73 +ep30 val_rocauc=0.85712 val_adapt_rocauc=0.83995 adapt_steps=2.12 halt=0.44 train_steps=1.69 +ep40 val_rocauc=0.86597 val_adapt_rocauc=0.88025 adapt_steps=2.14 halt=0.45 train_steps=1.71 +ep50 val_rocauc=0.83623 val_adapt_rocauc=0.85307 adapt_steps=2.01 halt=0.46 train_steps=1.61 +ep60 val_rocauc=0.84827 val_adapt_rocauc=0.85414 adapt_steps=2.03 halt=0.47 train_steps=1.66 +ep70 val_rocauc=0.86190 val_adapt_rocauc=0.88018 adapt_steps=2.00 halt=0.47 train_steps=1.62 +ep80 val_rocauc=0.81287 val_adapt_rocauc=0.85623 adapt_steps=2.04 halt=0.45 train_steps=1.78 +ep90 val_rocauc=0.81184 val_adapt_rocauc=0.85519 adapt_steps=2.03 halt=0.46 train_steps=1.73 +ep100 val_rocauc=0.80130 val_adapt_rocauc=0.84348 adapt_steps=2.05 halt=0.45 train_steps=1.75 +[ogbg-molclintox_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=40 val={'rocauc': 0.8659657244164286} test={'rocauc': 0.805447815660515} adaptive={'rocauc': 0.8240981128140966} steps=2.2094594594594597 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molclintox_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.76585 val_adapt_rocauc=0.86739 adapt_steps=2.02 halt=0.45 train_steps=1.70 +ep20 val_rocauc=0.86039 val_adapt_rocauc=0.86324 adapt_steps=2.00 halt=0.47 train_steps=1.62 +ep30 val_rocauc=0.90459 val_adapt_rocauc=0.89663 adapt_steps=2.02 halt=0.47 train_steps=1.59 +ep40 val_rocauc=0.90971 val_adapt_rocauc=0.88686 adapt_steps=2.00 halt=0.45 train_steps=1.69 +ep50 val_rocauc=0.93832 val_adapt_rocauc=0.92655 adapt_steps=2.00 halt=0.46 train_steps=1.61 +ep60 val_rocauc=0.89696 val_adapt_rocauc=0.91244 adapt_steps=2.03 halt=0.47 train_steps=1.65 +ep70 val_rocauc=0.92770 val_adapt_rocauc=0.92621 adapt_steps=2.01 halt=0.47 train_steps=1.62 +ep80 val_rocauc=0.93654 val_adapt_rocauc=0.94478 adapt_steps=2.01 halt=0.46 train_steps=1.69 +ep90 val_rocauc=0.93512 val_adapt_rocauc=0.94803 adapt_steps=2.01 halt=0.46 train_steps=1.63 +ep100 val_rocauc=0.93911 val_adapt_rocauc=0.94431 adapt_steps=2.00 halt=0.46 train_steps=1.64 +[ogbg-molclintox_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.9391148757345941} test={'rocauc': 0.8412244117749279} adaptive={'rocauc': 0.9026361519480067} steps=2.0405405405405403 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molclintox_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=pna compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view pna --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.73449 val_adapt_rocauc=0.82290 adapt_steps=2.02 halt=0.44 train_steps=1.88 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.72647 val_adapt_rocauc=0.81333 adapt_steps=2.02 halt=0.41 train_steps=1.96 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.69121 val_adapt_rocauc=0.81663 adapt_steps=2.03 halt=0.45 train_steps=1.67 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.68050 val_adapt_rocauc=0.79323 adapt_steps=2.05 halt=0.39 train_steps=2.17 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.78235 val_adapt_rocauc=0.82074 adapt_steps=2.27 halt=0.42 train_steps=1.74 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.77786 val_adapt_rocauc=0.80819 adapt_steps=2.03 halt=0.44 train_steps=1.77 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.80327 val_adapt_rocauc=0.80844 adapt_steps=2.07 halt=0.45 train_steps=1.65 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.82184 val_adapt_rocauc=0.81128 adapt_steps=2.07 halt=0.46 train_steps=1.66 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.81683 val_adapt_rocauc=0.80189 adapt_steps=2.05 halt=0.47 train_steps=1.62 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.82947 val_adapt_rocauc=0.80329 adapt_steps=2.05 halt=0.46 train_steps=1.66 +[ogbg-molclintox_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.8294650185495256} test={'rocauc': 0.9034242171480207} adaptive={'rocauc': 0.9194748548986897} steps=2.22972972972973 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molclintox_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=resgated compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view resgated --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.86017 val_adapt_rocauc=0.85805 adapt_steps=2.00 halt=0.44 train_steps=1.96 +ep20 val_rocauc=0.81251 val_adapt_rocauc=0.81417 adapt_steps=2.05 halt=0.46 train_steps=1.74 +ep30 val_rocauc=0.83266 val_adapt_rocauc=0.88528 adapt_steps=2.09 halt=0.44 train_steps=1.83 +ep40 val_rocauc=0.89601 val_adapt_rocauc=0.90433 adapt_steps=2.14 halt=0.47 train_steps=1.62 +ep50 val_rocauc=0.84727 val_adapt_rocauc=0.87116 adapt_steps=2.09 halt=0.46 train_steps=1.60 +ep60 val_rocauc=0.85582 val_adapt_rocauc=0.90812 adapt_steps=2.07 halt=0.47 train_steps=1.67 +ep70 val_rocauc=0.91150 val_adapt_rocauc=0.90620 adapt_steps=2.02 halt=0.46 train_steps=1.65 +ep80 val_rocauc=0.91162 val_adapt_rocauc=0.89879 adapt_steps=2.03 halt=0.47 train_steps=1.61 +ep90 val_rocauc=0.89291 val_adapt_rocauc=0.89228 adapt_steps=2.01 halt=0.47 train_steps=1.63 +ep100 val_rocauc=0.89000 val_adapt_rocauc=0.88702 adapt_steps=2.02 halt=0.45 train_steps=1.68 +[ogbg-molclintox_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.9116172559834532} test={'rocauc': 0.8402903763945366} adaptive={'rocauc': 0.8415754353039308} steps=2.0337837837837838 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molclintox_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json diff --git a/logs/ogbg-molclintox_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log b/logs/ogbg-molclintox_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log new file mode 100644 index 0000000..fdfc936 --- /dev/null +++ b/logs/ogbg-molclintox_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log @@ -0,0 +1,278 @@ +[run] ogbg-molclintox view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.77209 val_adapt_rocauc=0.80519 adapt_steps=2.72 halt=0.34 train_steps=2.51 +ep20 val_rocauc=0.78183 val_adapt_rocauc=0.80016 adapt_steps=2.06 halt=0.37 train_steps=2.64 +ep30 val_rocauc=0.78255 val_adapt_rocauc=0.76576 adapt_steps=4.13 halt=0.34 train_steps=2.65 +ep40 val_rocauc=0.94888 val_adapt_rocauc=0.93689 adapt_steps=2.55 halt=0.37 train_steps=2.28 +ep50 val_rocauc=0.88011 val_adapt_rocauc=0.87381 adapt_steps=2.15 halt=0.38 train_steps=2.23 +ep60 val_rocauc=0.95997 val_adapt_rocauc=0.96159 adapt_steps=2.24 halt=0.37 train_steps=2.55 +ep70 val_rocauc=0.92487 val_adapt_rocauc=0.91931 adapt_steps=2.11 halt=0.39 train_steps=2.34 +ep80 val_rocauc=0.93713 val_adapt_rocauc=0.92883 adapt_steps=2.45 halt=0.42 train_steps=2.15 +ep90 val_rocauc=0.94286 val_adapt_rocauc=0.93582 adapt_steps=2.32 halt=0.41 train_steps=2.08 +ep100 val_rocauc=0.93878 val_adapt_rocauc=0.92695 adapt_steps=2.21 halt=0.40 train_steps=2.15 +[ogbg-molclintox_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.9599674972914409} test={'rocauc': 0.8033521009279533} adaptive={'rocauc': 0.8111476036562055} steps=2.7094594594594597 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=gine compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view gine --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.76383 val_adapt_rocauc=0.77994 adapt_steps=2.01 halt=0.36 train_steps=2.43 +ep20 val_rocauc=0.80870 val_adapt_rocauc=0.86788 adapt_steps=3.20 halt=0.36 train_steps=2.52 +ep30 val_rocauc=0.75884 val_adapt_rocauc=0.80281 adapt_steps=2.47 halt=0.35 train_steps=2.59 +ep40 val_rocauc=0.86243 val_adapt_rocauc=0.89579 adapt_steps=2.90 halt=0.34 train_steps=2.62 +ep50 val_rocauc=0.89135 val_adapt_rocauc=0.86760 adapt_steps=2.41 halt=0.38 train_steps=2.29 +ep60 val_rocauc=0.90485 val_adapt_rocauc=0.88818 adapt_steps=2.26 halt=0.40 train_steps=2.20 +ep70 val_rocauc=0.93950 val_adapt_rocauc=0.93379 adapt_steps=2.16 halt=0.39 train_steps=2.27 +ep80 val_rocauc=0.94562 val_adapt_rocauc=0.91967 adapt_steps=2.22 halt=0.40 train_steps=2.25 +ep90 val_rocauc=0.93472 val_adapt_rocauc=0.91171 adapt_steps=2.22 halt=0.41 train_steps=2.02 +ep100 val_rocauc=0.93612 val_adapt_rocauc=0.91308 adapt_steps=2.22 halt=0.41 train_steps=2.14 +[ogbg-molclintox_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.9456195213237466} test={'rocauc': 0.9048100649914852} adaptive={'rocauc': 0.9068831891008932} steps=2.2972972972972974 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.85640 val_adapt_rocauc=0.82455 adapt_steps=2.11 halt=0.38 train_steps=2.49 +ep20 val_rocauc=0.82161 val_adapt_rocauc=0.86794 adapt_steps=2.25 halt=0.42 train_steps=1.95 +ep30 val_rocauc=0.90791 val_adapt_rocauc=0.90606 adapt_steps=2.48 halt=0.40 train_steps=2.22 +ep40 val_rocauc=0.87426 val_adapt_rocauc=0.86053 adapt_steps=2.28 halt=0.39 train_steps=2.23 +ep50 val_rocauc=0.90999 val_adapt_rocauc=0.93044 adapt_steps=2.48 halt=0.40 train_steps=2.19 +ep60 val_rocauc=0.92425 val_adapt_rocauc=0.92174 adapt_steps=2.33 halt=0.43 train_steps=1.93 +ep70 val_rocauc=0.91453 val_adapt_rocauc=0.92876 adapt_steps=2.26 halt=0.42 train_steps=2.06 +ep80 val_rocauc=0.94111 val_adapt_rocauc=0.92515 adapt_steps=2.18 halt=0.44 train_steps=1.91 +ep90 val_rocauc=0.94603 val_adapt_rocauc=0.94386 adapt_steps=2.16 halt=0.43 train_steps=1.97 +ep100 val_rocauc=0.93669 val_adapt_rocauc=0.93404 adapt_steps=2.24 halt=0.42 train_steps=1.93 +[ogbg-molclintox_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rocauc': 0.9460307298335469} test={'rocauc': 0.8712221527126125} adaptive={'rocauc': 0.8801906301046121} steps=2.2027027027027026 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=graphsage compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view graphsage --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.79462 val_adapt_rocauc=0.82656 adapt_steps=2.22 halt=0.34 train_steps=2.52 +ep20 val_rocauc=0.84462 val_adapt_rocauc=0.87055 adapt_steps=2.30 halt=0.38 train_steps=2.43 +ep30 val_rocauc=0.75120 val_adapt_rocauc=0.82551 adapt_steps=2.07 halt=0.40 train_steps=2.12 +ep40 val_rocauc=0.93718 val_adapt_rocauc=0.93679 adapt_steps=2.45 halt=0.39 train_steps=2.33 +ep50 val_rocauc=0.94727 val_adapt_rocauc=0.94822 adapt_steps=2.40 halt=0.40 train_steps=2.11 +ep60 val_rocauc=0.95164 val_adapt_rocauc=0.94490 adapt_steps=2.51 halt=0.40 train_steps=2.18 +ep70 val_rocauc=0.87261 val_adapt_rocauc=0.87261 adapt_steps=2.23 halt=0.40 train_steps=2.12 +ep80 val_rocauc=0.89686 val_adapt_rocauc=0.89115 adapt_steps=2.20 halt=0.42 train_steps=2.05 +ep90 val_rocauc=0.88179 val_adapt_rocauc=0.87664 adapt_steps=2.16 halt=0.41 train_steps=2.02 +ep100 val_rocauc=0.89555 val_adapt_rocauc=0.89160 adapt_steps=2.14 halt=0.41 train_steps=2.08 +[ogbg-molclintox_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.9516390886109196} test={'rocauc': 0.88216296527995} adaptive={'rocauc': 0.8780280123727106} steps=2.4324324324324325 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=gatv2 compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view gatv2 --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.70967 val_adapt_rocauc=0.85199 adapt_steps=2.37 halt=0.37 train_steps=2.39 +ep20 val_rocauc=0.89092 val_adapt_rocauc=0.92549 adapt_steps=2.22 halt=0.44 train_steps=1.89 +ep30 val_rocauc=0.81332 val_adapt_rocauc=0.83200 adapt_steps=2.01 halt=0.45 train_steps=1.79 +ep40 val_rocauc=0.80582 val_adapt_rocauc=0.83143 adapt_steps=2.14 halt=0.40 train_steps=2.12 +ep50 val_rocauc=0.92910 val_adapt_rocauc=0.93248 adapt_steps=2.32 halt=0.41 train_steps=2.22 +ep60 val_rocauc=0.92482 val_adapt_rocauc=0.93468 adapt_steps=2.32 halt=0.41 train_steps=2.17 +ep70 val_rocauc=0.92105 val_adapt_rocauc=0.93623 adapt_steps=2.38 halt=0.41 train_steps=2.15 +ep80 val_rocauc=0.92617 val_adapt_rocauc=0.93959 adapt_steps=2.31 halt=0.41 train_steps=2.12 +ep90 val_rocauc=0.94562 val_adapt_rocauc=0.95085 adapt_steps=2.28 halt=0.41 train_steps=2.20 +ep100 val_rocauc=0.95068 val_adapt_rocauc=0.95672 adapt_steps=2.28 halt=0.40 train_steps=2.14 +[ogbg-molclintox_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.9506763189861781} test={'rocauc': 0.8617905675459633} adaptive={'rocauc': 0.834407256803253} steps=2.3378378378378377 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.69917 val_adapt_rocauc=0.72403 adapt_steps=2.24 halt=0.39 train_steps=2.26 +ep20 val_rocauc=0.81950 val_adapt_rocauc=0.82965 adapt_steps=2.00 halt=0.34 train_steps=2.75 +ep30 val_rocauc=0.80323 val_adapt_rocauc=0.78038 adapt_steps=2.73 halt=0.34 train_steps=2.70 +ep40 val_rocauc=0.89633 val_adapt_rocauc=0.85819 adapt_steps=2.17 halt=0.37 train_steps=2.38 +ep50 val_rocauc=0.93302 val_adapt_rocauc=0.93985 adapt_steps=2.71 halt=0.38 train_steps=2.37 +ep60 val_rocauc=0.94116 val_adapt_rocauc=0.94729 adapt_steps=2.39 halt=0.41 train_steps=2.13 +ep70 val_rocauc=0.95746 val_adapt_rocauc=0.93137 adapt_steps=2.28 halt=0.41 train_steps=2.12 +ep80 val_rocauc=0.94965 val_adapt_rocauc=0.93652 adapt_steps=2.24 halt=0.41 train_steps=2.13 +ep90 val_rocauc=0.95186 val_adapt_rocauc=0.93864 adapt_steps=2.24 halt=0.41 train_steps=2.05 +ep100 val_rocauc=0.95550 val_adapt_rocauc=0.93900 adapt_steps=2.28 halt=0.41 train_steps=2.03 +[ogbg-molclintox_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.9574583866837387} test={'rocauc': 0.881274111145866} adaptive={'rocauc': 0.8484968546901609} steps=2.4121621621621623 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=transformer compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view transformer --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.66344 val_adapt_rocauc=0.75035 adapt_steps=2.91 halt=0.33 train_steps=2.69 +ep20 val_rocauc=0.67594 val_adapt_rocauc=0.72203 adapt_steps=2.06 halt=0.39 train_steps=2.32 +ep30 val_rocauc=0.85214 val_adapt_rocauc=0.88626 adapt_steps=2.31 halt=0.40 train_steps=2.06 +ep40 val_rocauc=0.76707 val_adapt_rocauc=0.81695 adapt_steps=2.36 halt=0.38 train_steps=2.22 +ep50 val_rocauc=0.76833 val_adapt_rocauc=0.77783 adapt_steps=2.26 halt=0.40 train_steps=2.13 +ep60 val_rocauc=0.79067 val_adapt_rocauc=0.78862 adapt_steps=2.30 halt=0.43 train_steps=2.04 +ep70 val_rocauc=0.79816 val_adapt_rocauc=0.79690 adapt_steps=2.20 halt=0.41 train_steps=1.99 +ep80 val_rocauc=0.78835 val_adapt_rocauc=0.78999 adapt_steps=2.22 halt=0.41 train_steps=2.03 +ep90 val_rocauc=0.78740 val_adapt_rocauc=0.78532 adapt_steps=2.21 halt=0.43 train_steps=1.98 +ep100 val_rocauc=0.78905 val_adapt_rocauc=0.78792 adapt_steps=2.24 halt=0.42 train_steps=1.98 +[ogbg-molclintox_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rocauc': 0.8521414031977412} test={'rocauc': 0.7332707746846001} adaptive={'rocauc': 0.7908464532721649} steps=3.2567567567567566 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=pna compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view pna --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.68589 val_adapt_rocauc=0.92664 adapt_steps=2.16 halt=0.41 train_steps=1.91 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.85293 val_adapt_rocauc=0.85189 adapt_steps=2.44 halt=0.35 train_steps=2.56 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.77476 val_adapt_rocauc=0.82179 adapt_steps=2.44 halt=0.28 train_steps=3.08 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.87414 val_adapt_rocauc=0.89831 adapt_steps=2.53 halt=0.30 train_steps=2.83 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.86257 val_adapt_rocauc=0.88010 adapt_steps=2.60 halt=0.32 train_steps=2.83 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.71890 val_adapt_rocauc=0.77423 adapt_steps=3.07 halt=0.36 train_steps=2.45 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.80193 val_adapt_rocauc=0.81742 adapt_steps=2.28 halt=0.37 train_steps=2.40 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.82369 val_adapt_rocauc=0.84324 adapt_steps=2.29 halt=0.38 train_steps=2.34 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.86654 val_adapt_rocauc=0.87053 adapt_steps=2.28 halt=0.41 train_steps=2.17 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.86785 val_adapt_rocauc=0.86774 adapt_steps=2.23 halt=0.40 train_steps=2.14 +[ogbg-molclintox_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=40 val={'rocauc': 0.874143110410716} test={'rocauc': 0.8539203419872797} adaptive={'rocauc': 0.8613908872901679} steps=3.675675675675676 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=gen compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view gen --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.84544 val_adapt_rocauc=0.85771 adapt_steps=2.57 halt=0.29 train_steps=2.87 +ep20 val_rocauc=0.95110 val_adapt_rocauc=0.91548 adapt_steps=3.41 halt=0.33 train_steps=2.66 +ep30 val_rocauc=0.83528 val_adapt_rocauc=0.89928 adapt_steps=2.29 halt=0.31 train_steps=2.91 +ep40 val_rocauc=0.76843 val_adapt_rocauc=0.80352 adapt_steps=2.51 halt=0.34 train_steps=2.56 +ep50 val_rocauc=0.80865 val_adapt_rocauc=0.85913 adapt_steps=2.77 halt=0.36 train_steps=2.47 +ep60 val_rocauc=0.88044 val_adapt_rocauc=0.89659 adapt_steps=2.14 halt=0.42 train_steps=2.05 +ep70 val_rocauc=0.92773 val_adapt_rocauc=0.93695 adapt_steps=2.28 halt=0.40 train_steps=2.12 +ep80 val_rocauc=0.96265 val_adapt_rocauc=0.95789 adapt_steps=2.37 halt=0.39 train_steps=2.27 +ep90 val_rocauc=0.95997 val_adapt_rocauc=0.95404 adapt_steps=2.19 halt=0.40 train_steps=2.22 +ep100 val_rocauc=0.95236 val_adapt_rocauc=0.95381 adapt_steps=2.16 halt=0.40 train_steps=2.06 +[ogbg-molclintox_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.962652253849437} test={'rocauc': 0.7993926597852152} adaptive={'rocauc': 0.8024780175859313} steps=2.52027027027027 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=film compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view film --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.85317 val_adapt_rocauc=0.88605 adapt_steps=2.39 halt=0.28 train_steps=3.00 +ep20 val_rocauc=0.81828 val_adapt_rocauc=0.82320 adapt_steps=2.45 halt=0.27 train_steps=3.23 +ep30 val_rocauc=0.84258 val_adapt_rocauc=0.95090 adapt_steps=2.46 halt=0.34 train_steps=2.48 +ep40 val_rocauc=0.75162 val_adapt_rocauc=0.79277 adapt_steps=2.35 halt=0.29 train_steps=3.14 +ep50 val_rocauc=0.78711 val_adapt_rocauc=0.87848 adapt_steps=2.74 halt=0.28 train_steps=3.02 +ep60 val_rocauc=0.81069 val_adapt_rocauc=0.91211 adapt_steps=2.38 halt=0.33 train_steps=2.62 +ep70 val_rocauc=0.81552 val_adapt_rocauc=0.90454 adapt_steps=2.36 halt=0.33 train_steps=2.65 +ep80 val_rocauc=0.82161 val_adapt_rocauc=0.91004 adapt_steps=2.32 halt=0.35 train_steps=2.57 +ep90 val_rocauc=0.81750 val_adapt_rocauc=0.88712 adapt_steps=2.42 halt=0.34 train_steps=2.62 +ep100 val_rocauc=0.82991 val_adapt_rocauc=0.90417 adapt_steps=2.39 halt=0.32 train_steps=2.82 +[ogbg-molclintox_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=10 val={'rocauc': 0.8531673725335697} test={'rocauc': 0.8229512042539882} adaptive={'rocauc': 0.8409142251416258} steps=3.5675675675675675 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=resgated compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view resgated --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.74252 val_adapt_rocauc=0.79094 adapt_steps=2.14 halt=0.36 train_steps=2.48 +ep20 val_rocauc=0.81568 val_adapt_rocauc=0.85910 adapt_steps=2.39 halt=0.35 train_steps=2.46 +ep30 val_rocauc=0.84840 val_adapt_rocauc=0.92310 adapt_steps=2.11 halt=0.41 train_steps=2.09 +ep40 val_rocauc=0.95769 val_adapt_rocauc=0.94539 adapt_steps=2.16 halt=0.43 train_steps=1.87 +ep50 val_rocauc=0.92392 val_adapt_rocauc=0.94729 adapt_steps=2.65 halt=0.37 train_steps=2.31 +ep60 val_rocauc=0.92694 val_adapt_rocauc=0.91922 adapt_steps=2.72 halt=0.37 train_steps=2.49 +ep70 val_rocauc=0.90361 val_adapt_rocauc=0.89307 adapt_steps=2.32 halt=0.43 train_steps=1.98 +ep80 val_rocauc=0.91214 val_adapt_rocauc=0.90406 adapt_steps=2.36 halt=0.41 train_steps=2.09 +ep90 val_rocauc=0.90185 val_adapt_rocauc=0.89822 adapt_steps=2.32 halt=0.42 train_steps=2.04 +ep100 val_rocauc=0.89869 val_adapt_rocauc=0.89844 adapt_steps=2.29 halt=0.42 train_steps=1.99 +[ogbg-molclintox_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=40 val={'rocauc': 0.957693949243245} test={'rocauc': 0.8777291210509853} adaptive={'rocauc': 0.8950795885031105} steps=2.2567567567567566 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.82868 val_adapt_rocauc=0.84050 adapt_steps=2.43 halt=0.39 train_steps=2.17 +ep20 val_rocauc=0.68167 val_adapt_rocauc=0.82555 adapt_steps=2.24 halt=0.39 train_steps=2.29 +ep30 val_rocauc=0.90011 val_adapt_rocauc=0.87969 adapt_steps=2.48 halt=0.35 train_steps=2.43 +ep40 val_rocauc=0.87408 val_adapt_rocauc=0.90534 adapt_steps=2.23 halt=0.38 train_steps=2.23 +ep50 val_rocauc=0.86302 val_adapt_rocauc=0.87087 adapt_steps=2.50 halt=0.42 train_steps=2.01 +ep60 val_rocauc=0.88360 val_adapt_rocauc=0.90039 adapt_steps=2.14 halt=0.41 train_steps=2.16 +ep70 val_rocauc=0.86734 val_adapt_rocauc=0.88072 adapt_steps=2.36 halt=0.42 train_steps=1.95 +ep80 val_rocauc=0.87492 val_adapt_rocauc=0.87176 adapt_steps=2.22 halt=0.42 train_steps=1.94 +ep90 val_rocauc=0.87822 val_adapt_rocauc=0.87936 adapt_steps=2.20 halt=0.42 train_steps=2.04 +ep100 val_rocauc=0.87463 val_adapt_rocauc=0.87752 adapt_steps=2.26 halt=0.42 train_steps=1.91 +[ogbg-molclintox_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rocauc': 0.9001050592599888} test={'rocauc': 0.8008871163938415} adaptive={'rocauc': 0.8083576616967296} steps=2.5945945945945947 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.75045 val_adapt_rocauc=0.76256 adapt_steps=2.63 halt=0.35 train_steps=2.42 +ep20 val_rocauc=0.84107 val_adapt_rocauc=0.82692 adapt_steps=2.05 halt=0.39 train_steps=2.28 +ep30 val_rocauc=0.82797 val_adapt_rocauc=0.80820 adapt_steps=2.16 halt=0.40 train_steps=2.17 +ep40 val_rocauc=0.91055 val_adapt_rocauc=0.89387 adapt_steps=2.19 halt=0.43 train_steps=1.88 +ep50 val_rocauc=0.89428 val_adapt_rocauc=0.87914 adapt_steps=2.42 halt=0.38 train_steps=2.22 +ep60 val_rocauc=0.89904 val_adapt_rocauc=0.88187 adapt_steps=2.34 halt=0.43 train_steps=1.92 +ep70 val_rocauc=0.91524 val_adapt_rocauc=0.90461 adapt_steps=2.33 halt=0.43 train_steps=1.88 +ep80 val_rocauc=0.91526 val_adapt_rocauc=0.89527 adapt_steps=2.31 halt=0.43 train_steps=1.99 +ep90 val_rocauc=0.91339 val_adapt_rocauc=0.90184 adapt_steps=2.32 halt=0.44 train_steps=1.94 +ep100 val_rocauc=0.91057 val_adapt_rocauc=0.90055 adapt_steps=2.30 halt=0.42 train_steps=2.02 +[ogbg-molclintox_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.9152647821661906} test={'rocauc': 0.8882589580509506} adaptive={'rocauc': 0.8904589371980676} steps=2.25 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=cheb compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view cheb --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.78798 val_adapt_rocauc=0.83382 adapt_steps=2.20 halt=0.39 train_steps=2.27 +ep20 val_rocauc=0.71633 val_adapt_rocauc=0.74377 adapt_steps=2.78 halt=0.42 train_steps=1.99 +ep30 val_rocauc=0.89270 val_adapt_rocauc=0.90791 adapt_steps=2.54 halt=0.41 train_steps=1.95 +ep40 val_rocauc=0.91721 val_adapt_rocauc=0.93704 adapt_steps=2.25 halt=0.42 train_steps=1.89 +ep50 val_rocauc=0.88995 val_adapt_rocauc=0.88075 adapt_steps=2.22 halt=0.40 train_steps=2.14 +ep60 val_rocauc=0.87245 val_adapt_rocauc=0.86085 adapt_steps=2.17 halt=0.44 train_steps=1.96 +ep70 val_rocauc=0.89380 val_adapt_rocauc=0.88259 adapt_steps=2.09 halt=0.42 train_steps=1.94 +ep80 val_rocauc=0.89714 val_adapt_rocauc=0.89109 adapt_steps=2.17 halt=0.44 train_steps=1.92 +ep90 val_rocauc=0.90792 val_adapt_rocauc=0.89461 adapt_steps=2.18 halt=0.43 train_steps=1.91 +ep100 val_rocauc=0.91072 val_adapt_rocauc=0.90068 adapt_steps=2.14 halt=0.41 train_steps=1.96 +[ogbg-molclintox_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=40 val={'rocauc': 0.9172116615778587} test={'rocauc': 0.906584297779168} adaptive={'rocauc': 0.9058335939943698} steps=2.97972972972973 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=arma compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view arma --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.81318 val_adapt_rocauc=0.80930 adapt_steps=2.37 halt=0.35 train_steps=2.35 +ep20 val_rocauc=0.69804 val_adapt_rocauc=0.82638 adapt_steps=2.15 halt=0.31 train_steps=2.87 +ep30 val_rocauc=0.94232 val_adapt_rocauc=0.92281 adapt_steps=2.83 halt=0.39 train_steps=2.09 +ep40 val_rocauc=0.86469 val_adapt_rocauc=0.88327 adapt_steps=2.67 halt=0.36 train_steps=2.54 +ep50 val_rocauc=0.89535 val_adapt_rocauc=0.90887 adapt_steps=2.19 halt=0.37 train_steps=2.46 +ep60 val_rocauc=0.92823 val_adapt_rocauc=0.93065 adapt_steps=2.24 halt=0.41 train_steps=2.09 +ep70 val_rocauc=0.93024 val_adapt_rocauc=0.93498 adapt_steps=2.20 halt=0.43 train_steps=1.91 +ep80 val_rocauc=0.92742 val_adapt_rocauc=0.93392 adapt_steps=2.17 halt=0.42 train_steps=2.07 +ep90 val_rocauc=0.93094 val_adapt_rocauc=0.94491 adapt_steps=2.17 halt=0.45 train_steps=1.81 +ep100 val_rocauc=0.93728 val_adapt_rocauc=0.94060 adapt_steps=2.16 halt=0.41 train_steps=2.07 +[ogbg-molclintox_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rocauc': 0.942323287041597} test={'rocauc': 0.8458372432488792} adaptive={'rocauc': 0.8651226844611268} steps=2.722972972972973 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=mf compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view mf --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.93105 val_adapt_rocauc=0.89417 adapt_steps=2.82 halt=0.32 train_steps=2.64 +ep20 val_rocauc=0.81868 val_adapt_rocauc=0.81868 adapt_steps=2.54 halt=0.35 train_steps=2.46 +ep30 val_rocauc=0.80286 val_adapt_rocauc=0.78639 adapt_steps=2.11 halt=0.37 train_steps=2.59 +ep40 val_rocauc=0.80906 val_adapt_rocauc=0.83030 adapt_steps=2.18 halt=0.36 train_steps=2.49 +ep50 val_rocauc=0.85998 val_adapt_rocauc=0.83241 adapt_steps=2.39 halt=0.40 train_steps=2.20 +ep60 val_rocauc=0.90338 val_adapt_rocauc=0.86791 adapt_steps=2.18 halt=0.42 train_steps=2.08 +ep70 val_rocauc=0.94162 val_adapt_rocauc=0.91534 adapt_steps=2.16 halt=0.42 train_steps=2.04 +ep80 val_rocauc=0.89972 val_adapt_rocauc=0.89221 adapt_steps=2.14 halt=0.43 train_steps=2.03 +ep90 val_rocauc=0.91851 val_adapt_rocauc=0.90667 adapt_steps=2.11 halt=0.42 train_steps=2.01 +ep100 val_rocauc=0.92030 val_adapt_rocauc=0.90645 adapt_steps=2.14 halt=0.41 train_steps=2.03 +[ogbg-molclintox_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.9416239863422963} test={'rocauc': 0.852654398220554} adaptive={'rocauc': 0.8698067632850242} steps=2.5675675675675675 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molclintox view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molclintox --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.71982 val_adapt_rocauc=0.77487 adapt_steps=2.08 halt=0.44 train_steps=1.89 +ep20 val_rocauc=0.74144 val_adapt_rocauc=0.75935 adapt_steps=2.03 halt=0.46 train_steps=1.69 +ep30 val_rocauc=0.87530 val_adapt_rocauc=0.86698 adapt_steps=2.09 halt=0.45 train_steps=1.73 +ep40 val_rocauc=0.85439 val_adapt_rocauc=0.85187 adapt_steps=2.16 halt=0.42 train_steps=1.92 +ep50 val_rocauc=0.85586 val_adapt_rocauc=0.88542 adapt_steps=2.04 halt=0.44 train_steps=1.83 +ep60 val_rocauc=0.91564 val_adapt_rocauc=0.92289 adapt_steps=2.16 halt=0.45 train_steps=1.84 +ep70 val_rocauc=0.85864 val_adapt_rocauc=0.90628 adapt_steps=2.09 halt=0.45 train_steps=1.71 +ep80 val_rocauc=0.85984 val_adapt_rocauc=0.91203 adapt_steps=2.01 halt=0.44 train_steps=1.90 +ep90 val_rocauc=0.86275 val_adapt_rocauc=0.89833 adapt_steps=2.03 halt=0.44 train_steps=1.91 +ep100 val_rocauc=0.84485 val_adapt_rocauc=0.89378 adapt_steps=2.02 halt=0.43 train_steps=1.93 +[ogbg-molclintox_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.9156406973308382} test={'rocauc': 0.7779932575678588} adaptive={'rocauc': 0.886122406422688} steps=2.1621621621621623 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molclintox_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json diff --git a/logs/ogbg-molesol_0.log b/logs/ogbg-molesol_0.log new file mode 100644 index 0000000..8cd6dec --- /dev/null +++ b/logs/ogbg-molesol_0.log @@ -0,0 +1,757 @@ +[run] ogbg-molesol view=gin compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view gin --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/esol.zip +
0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 9198.04it/s] +Processing... +Extracting /orion/u/oscarwan/rrog-gnn-runner/data/ogb/esol.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/1128 [00:00<?, ?it/s]
100%|██████████| 1128/1128 [00:00<00:00, 161760.63it/s] +Converting graphs into PyG objects... +
0%| | 0/1128 [00:00<?, ?it/s]
100%|██████████| 1128/1128 [00:00<00:00, 90847.86it/s] +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/ogb/graphproppred/dataset_pyg.py:158: UserWarning: The given NumPy array is not writable, and PyTorch does not support non-writable tensors. This means writing to this tensor will result in undefined behavior. You may want to copy the array to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at /pytorch/torch/csrc/utils/tensor_numpy.cpp:203.) + g.y = torch.from_numpy(graph_label[i]).view(1,-1).to(torch.float32) +Done! +Saving... +ep10 val_rmse=1.55132 halt=0.00 train_steps=1.00 +ep20 val_rmse=1.85249 halt=0.00 train_steps=1.00 +ep30 val_rmse=1.28538 halt=0.00 train_steps=1.00 +ep40 val_rmse=1.16869 halt=0.00 train_steps=1.00 +ep50 val_rmse=1.06721 halt=0.00 train_steps=1.00 +ep60 val_rmse=1.01867 halt=0.00 train_steps=1.00 +ep70 val_rmse=1.04139 halt=0.00 train_steps=1.00 +ep80 val_rmse=1.04699 halt=0.00 train_steps=1.00 +ep90 val_rmse=1.04597 halt=0.00 train_steps=1.00 +ep100 val_rmse=1.05181 halt=0.00 train_steps=1.00 +[ogbg-molesol_gin_classic_T0_ns1_h128_e100_s0] best_ep=60 val={'rmse': np.float32(1.018667)} test={'rmse': np.float32(0.9899856)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_gin_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molesol view=gin compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view gin --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.15780 halt=0.00 train_steps=3.00 +ep20 val_rmse=1.74314 halt=0.00 train_steps=3.00 +ep30 val_rmse=1.18904 halt=0.00 train_steps=3.00 +ep40 val_rmse=0.98340 halt=0.00 train_steps=3.00 +ep50 val_rmse=1.06552 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.97743 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.97563 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.96466 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.97039 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.97051 halt=0.00 train_steps=3.00 +[ogbg-molesol_gin_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=80 val={'rmse': np.float32(0.9646594)} test={'rmse': np.float32(1.0798396)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_gin_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molesol view=gine compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view gine --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.71976 halt=0.00 train_steps=1.00 +ep20 val_rmse=1.59364 halt=0.00 train_steps=1.00 +ep30 val_rmse=1.05039 halt=0.00 train_steps=1.00 +ep40 val_rmse=1.08315 halt=0.00 train_steps=1.00 +ep50 val_rmse=1.24026 halt=0.00 train_steps=1.00 +ep60 val_rmse=1.16317 halt=0.00 train_steps=1.00 +ep70 val_rmse=1.03410 halt=0.00 train_steps=1.00 +ep80 val_rmse=1.04083 halt=0.00 train_steps=1.00 +ep90 val_rmse=1.03215 halt=0.00 train_steps=1.00 +ep100 val_rmse=1.02862 halt=0.00 train_steps=1.00 +[ogbg-molesol_gine_classic_T0_ns1_h128_e100_s0] best_ep=100 val={'rmse': np.float32(1.0286155)} test={'rmse': np.float32(1.0806612)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_gine_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molesol view=gine compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view gine --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.49705 halt=0.00 train_steps=3.00 +ep20 val_rmse=1.28800 halt=0.00 train_steps=3.00 +ep30 val_rmse=1.52334 halt=0.00 train_steps=3.00 +ep40 val_rmse=1.35057 halt=0.00 train_steps=3.00 +ep50 val_rmse=1.06045 halt=0.00 train_steps=3.00 +ep60 val_rmse=1.09347 halt=0.00 train_steps=3.00 +ep70 val_rmse=1.06311 halt=0.00 train_steps=3.00 +ep80 val_rmse=1.08356 halt=0.00 train_steps=3.00 +ep90 val_rmse=1.06803 halt=0.00 train_steps=3.00 +ep100 val_rmse=1.05808 halt=0.00 train_steps=3.00 +[ogbg-molesol_gine_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=100 val={'rmse': np.float32(1.0580767)} test={'rmse': np.float32(1.0950748)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_gine_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molesol view=gcn compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view gcn --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.27627 halt=0.00 train_steps=1.00 +ep20 val_rmse=1.05226 halt=0.00 train_steps=1.00 +ep30 val_rmse=1.11377 halt=0.00 train_steps=1.00 +ep40 val_rmse=1.04089 halt=0.00 train_steps=1.00 +ep50 val_rmse=1.13518 halt=0.00 train_steps=1.00 +ep60 val_rmse=1.04774 halt=0.00 train_steps=1.00 +ep70 val_rmse=1.05628 halt=0.00 train_steps=1.00 +ep80 val_rmse=1.06343 halt=0.00 train_steps=1.00 +ep90 val_rmse=1.05586 halt=0.00 train_steps=1.00 +ep100 val_rmse=1.05581 halt=0.00 train_steps=1.00 +[ogbg-molesol_gcn_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rmse': np.float32(1.040891)} test={'rmse': np.float32(1.1161426)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_gcn_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molesol view=gcn compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view gcn --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.07314 halt=0.00 train_steps=3.00 +ep20 val_rmse=1.12097 halt=0.00 train_steps=3.00 +ep30 val_rmse=0.98673 halt=0.00 train_steps=3.00 +ep40 val_rmse=0.97671 halt=0.00 train_steps=3.00 +ep50 val_rmse=1.00746 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.99924 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.97496 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.95908 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.98357 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.98355 halt=0.00 train_steps=3.00 +[ogbg-molesol_gcn_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=80 val={'rmse': np.float32(0.9590842)} test={'rmse': np.float32(0.9305291)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molesol view=graphsage compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view graphsage --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.03649 halt=0.00 train_steps=1.00 +ep20 val_rmse=1.00381 halt=0.00 train_steps=1.00 +ep30 val_rmse=1.04979 halt=0.00 train_steps=1.00 +ep40 val_rmse=0.96911 halt=0.00 train_steps=1.00 +ep50 val_rmse=0.99778 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.99357 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.97284 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.96802 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.97458 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.97439 halt=0.00 train_steps=1.00 +[ogbg-molesol_graphsage_classic_T0_ns1_h128_e100_s0] best_ep=80 val={'rmse': np.float32(0.9680215)} test={'rmse': np.float32(1.0037521)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_graphsage_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molesol view=graphsage compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view graphsage --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.08617 halt=0.00 train_steps=3.00 +ep20 val_rmse=0.99342 halt=0.00 train_steps=3.00 +ep30 val_rmse=1.16581 halt=0.00 train_steps=3.00 +ep40 val_rmse=1.07873 halt=0.00 train_steps=3.00 +ep50 val_rmse=1.12930 halt=0.00 train_steps=3.00 +ep60 val_rmse=1.04825 halt=0.00 train_steps=3.00 +ep70 val_rmse=1.07985 halt=0.00 train_steps=3.00 +ep80 val_rmse=1.08909 halt=0.00 train_steps=3.00 +ep90 val_rmse=1.07709 halt=0.00 train_steps=3.00 +ep100 val_rmse=1.08338 halt=0.00 train_steps=3.00 +[ogbg-molesol_graphsage_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=20 val={'rmse': np.float32(0.9934181)} test={'rmse': np.float32(1.0794438)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molesol view=gatv2 compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view gatv2 --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.24588 halt=0.00 train_steps=1.00 +ep20 val_rmse=1.12725 halt=0.00 train_steps=1.00 +ep30 val_rmse=1.03778 halt=0.00 train_steps=1.00 +ep40 val_rmse=1.22700 halt=0.00 train_steps=1.00 +ep50 val_rmse=1.08767 halt=0.00 train_steps=1.00 +ep60 val_rmse=1.07285 halt=0.00 train_steps=1.00 +ep70 val_rmse=1.05946 halt=0.00 train_steps=1.00 +ep80 val_rmse=1.03678 halt=0.00 train_steps=1.00 +ep90 val_rmse=1.06707 halt=0.00 train_steps=1.00 +ep100 val_rmse=1.07297 halt=0.00 train_steps=1.00 +[ogbg-molesol_gatv2_classic_T0_ns1_h128_e100_s0] best_ep=80 val={'rmse': np.float32(1.0367837)} test={'rmse': np.float32(0.9878302)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_gatv2_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molesol view=gatv2 compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view gatv2 --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.14944 halt=0.00 train_steps=3.00 +ep20 val_rmse=1.07425 halt=0.00 train_steps=3.00 +ep30 val_rmse=1.01105 halt=0.00 train_steps=3.00 +ep40 val_rmse=1.00182 halt=0.00 train_steps=3.00 +ep50 val_rmse=1.08651 halt=0.00 train_steps=3.00 +ep60 val_rmse=1.00579 halt=0.00 train_steps=3.00 +ep70 val_rmse=1.06140 halt=0.00 train_steps=3.00 +ep80 val_rmse=1.05534 halt=0.00 train_steps=3.00 +ep90 val_rmse=1.06903 halt=0.00 train_steps=3.00 +ep100 val_rmse=1.07107 halt=0.00 train_steps=3.00 +[ogbg-molesol_gatv2_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rmse': np.float32(1.001817)} test={'rmse': np.float32(0.97798175)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molesol view=graphconv compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view graphconv --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=2.15562 halt=0.00 train_steps=1.00 +ep20 val_rmse=1.01649 halt=0.00 train_steps=1.00 +ep30 val_rmse=1.07876 halt=0.00 train_steps=1.00 +ep40 val_rmse=1.13149 halt=0.00 train_steps=1.00 +ep50 val_rmse=1.11394 halt=0.00 train_steps=1.00 +ep60 val_rmse=1.04659 halt=0.00 train_steps=1.00 +ep70 val_rmse=1.00497 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.99220 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.97410 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.97473 halt=0.00 train_steps=1.00 +[ogbg-molesol_graphconv_classic_T0_ns1_h128_e100_s0] best_ep=90 val={'rmse': np.float32(0.97409904)} test={'rmse': np.float32(0.97323257)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_graphconv_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molesol view=graphconv compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view graphconv --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.59797 halt=0.00 train_steps=3.00 +ep20 val_rmse=1.52589 halt=0.00 train_steps=3.00 +ep30 val_rmse=1.26935 halt=0.00 train_steps=3.00 +ep40 val_rmse=1.00482 halt=0.00 train_steps=3.00 +ep50 val_rmse=1.04145 halt=0.00 train_steps=3.00 +ep60 val_rmse=1.11448 halt=0.00 train_steps=3.00 +ep70 val_rmse=1.11833 halt=0.00 train_steps=3.00 +ep80 val_rmse=1.07841 halt=0.00 train_steps=3.00 +ep90 val_rmse=1.09266 halt=0.00 train_steps=3.00 +ep100 val_rmse=1.10812 halt=0.00 train_steps=3.00 +[ogbg-molesol_graphconv_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rmse': np.float32(1.0048155)} test={'rmse': np.float32(0.9968388)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molesol view=transformer compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view transformer --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.03814 halt=0.00 train_steps=1.00 +ep20 val_rmse=1.00847 halt=0.00 train_steps=1.00 +ep30 val_rmse=0.96101 halt=0.00 train_steps=1.00 +ep40 val_rmse=0.95978 halt=0.00 train_steps=1.00 +ep50 val_rmse=0.97335 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.97677 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.93977 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.95833 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.95792 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.95845 halt=0.00 train_steps=1.00 +[ogbg-molesol_transformer_classic_T0_ns1_h128_e100_s0] best_ep=70 val={'rmse': np.float32(0.9397741)} test={'rmse': np.float32(0.9491862)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_transformer_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molesol view=transformer compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view transformer --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.06235 halt=0.00 train_steps=3.00 +ep20 val_rmse=1.00463 halt=0.00 train_steps=3.00 +ep30 val_rmse=0.98407 halt=0.00 train_steps=3.00 +ep40 val_rmse=1.03132 halt=0.00 train_steps=3.00 +ep50 val_rmse=0.98438 halt=0.00 train_steps=3.00 +ep60 val_rmse=1.02566 halt=0.00 train_steps=3.00 +ep70 val_rmse=1.01917 halt=0.00 train_steps=3.00 +ep80 val_rmse=1.04620 halt=0.00 train_steps=3.00 +ep90 val_rmse=1.05332 halt=0.00 train_steps=3.00 +ep100 val_rmse=1.04784 halt=0.00 train_steps=3.00 +[ogbg-molesol_transformer_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rmse': np.float32(0.9840657)} test={'rmse': np.float32(1.0003974)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molesol view=pna compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view pna --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rmse=1.65394 halt=0.00 train_steps=1.00 +ep20 val_rmse=1.25086 halt=0.00 train_steps=1.00 +ep30 val_rmse=1.22408 halt=0.00 train_steps=1.00 +ep40 val_rmse=1.52592 halt=0.00 train_steps=1.00 +ep50 val_rmse=0.95818 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.93502 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.91648 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.91764 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.91157 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.92239 halt=0.00 train_steps=1.00 +[ogbg-molesol_pna_classic_T0_ns1_h128_e100_s0] best_ep=90 val={'rmse': np.float32(0.91156536)} test={'rmse': np.float32(0.91526616)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_pna_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molesol view=pna compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view pna --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rmse=1.04130 halt=0.00 train_steps=3.00 +ep20 val_rmse=1.11945 halt=0.00 train_steps=3.00 +ep30 val_rmse=1.16403 halt=0.00 train_steps=3.00 +ep40 val_rmse=1.31558 halt=0.00 train_steps=3.00 +ep50 val_rmse=0.98405 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.99907 halt=0.00 train_steps=3.00 +ep70 val_rmse=1.04776 halt=0.00 train_steps=3.00 +ep80 val_rmse=1.07359 halt=0.00 train_steps=3.00 +ep90 val_rmse=1.09525 halt=0.00 train_steps=3.00 +ep100 val_rmse=1.07509 halt=0.00 train_steps=3.00 +[ogbg-molesol_pna_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rmse': np.float32(0.98405296)} test={'rmse': np.float32(0.9092428)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_pna_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molesol view=gen compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view gen --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.08524 halt=0.00 train_steps=1.00 +ep20 val_rmse=1.05132 halt=0.00 train_steps=1.00 +ep30 val_rmse=1.03850 halt=0.00 train_steps=1.00 +ep40 val_rmse=1.00889 halt=0.00 train_steps=1.00 +ep50 val_rmse=1.05118 halt=0.00 train_steps=1.00 +ep60 val_rmse=1.03397 halt=0.00 train_steps=1.00 +ep70 val_rmse=1.05106 halt=0.00 train_steps=1.00 +ep80 val_rmse=1.06416 halt=0.00 train_steps=1.00 +ep90 val_rmse=1.07429 halt=0.00 train_steps=1.00 +ep100 val_rmse=1.07824 halt=0.00 train_steps=1.00 +[ogbg-molesol_gen_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rmse': np.float32(1.0088853)} test={'rmse': np.float32(0.87622714)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_gen_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molesol view=gen compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view gen --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.11115 halt=0.00 train_steps=3.00 +ep20 val_rmse=1.21492 halt=0.00 train_steps=3.00 +ep30 val_rmse=1.01682 halt=0.00 train_steps=3.00 +ep40 val_rmse=1.08134 halt=0.00 train_steps=3.00 +ep50 val_rmse=1.00267 halt=0.00 train_steps=3.00 +ep60 val_rmse=1.06206 halt=0.00 train_steps=3.00 +ep70 val_rmse=1.03358 halt=0.00 train_steps=3.00 +ep80 val_rmse=1.01448 halt=0.00 train_steps=3.00 +ep90 val_rmse=1.01315 halt=0.00 train_steps=3.00 +ep100 val_rmse=1.01756 halt=0.00 train_steps=3.00 +[ogbg-molesol_gen_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rmse': np.float32(1.0026727)} test={'rmse': np.float32(0.92061317)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_gen_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molesol view=film compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view film --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.76181 halt=0.00 train_steps=1.00 +ep20 val_rmse=1.52145 halt=0.00 train_steps=1.00 +ep30 val_rmse=1.27713 halt=0.00 train_steps=1.00 +ep40 val_rmse=1.21887 halt=0.00 train_steps=1.00 +ep50 val_rmse=1.11418 halt=0.00 train_steps=1.00 +ep60 val_rmse=1.08223 halt=0.00 train_steps=1.00 +ep70 val_rmse=1.07944 halt=0.00 train_steps=1.00 +ep80 val_rmse=1.08273 halt=0.00 train_steps=1.00 +ep90 val_rmse=1.07177 halt=0.00 train_steps=1.00 +ep100 val_rmse=1.07711 halt=0.00 train_steps=1.00 +[ogbg-molesol_film_classic_T0_ns1_h128_e100_s0] best_ep=90 val={'rmse': np.float32(1.0717738)} test={'rmse': np.float32(1.2896088)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_film_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molesol view=film compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view film --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.47310 halt=0.00 train_steps=3.00 +ep20 val_rmse=1.62945 halt=0.00 train_steps=3.00 +ep30 val_rmse=1.15701 halt=0.00 train_steps=3.00 +ep40 val_rmse=1.21397 halt=0.00 train_steps=3.00 +ep50 val_rmse=1.06834 halt=0.00 train_steps=3.00 +ep60 val_rmse=1.03025 halt=0.00 train_steps=3.00 +ep70 val_rmse=1.14875 halt=0.00 train_steps=3.00 +ep80 val_rmse=1.01964 halt=0.00 train_steps=3.00 +ep90 val_rmse=1.02214 halt=0.00 train_steps=3.00 +ep100 val_rmse=1.03526 halt=0.00 train_steps=3.00 +[ogbg-molesol_film_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=80 val={'rmse': np.float32(1.0196408)} test={'rmse': np.float32(1.084922)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_film_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molesol view=resgated compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view resgated --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.13044 halt=0.00 train_steps=1.00 +ep20 val_rmse=1.07395 halt=0.00 train_steps=1.00 +ep30 val_rmse=0.97508 halt=0.00 train_steps=1.00 +ep40 val_rmse=1.08038 halt=0.00 train_steps=1.00 +ep50 val_rmse=1.01758 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.94915 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.96798 halt=0.00 train_steps=1.00 +ep80 val_rmse=1.01548 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.99474 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.99260 halt=0.00 train_steps=1.00 +[ogbg-molesol_resgated_classic_T0_ns1_h128_e100_s0] best_ep=60 val={'rmse': np.float32(0.9491545)} test={'rmse': np.float32(0.8908002)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_resgated_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molesol view=resgated compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view resgated --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.11687 halt=0.00 train_steps=3.00 +ep20 val_rmse=1.06236 halt=0.00 train_steps=3.00 +ep30 val_rmse=1.05365 halt=0.00 train_steps=3.00 +ep40 val_rmse=1.06597 halt=0.00 train_steps=3.00 +ep50 val_rmse=1.05752 halt=0.00 train_steps=3.00 +ep60 val_rmse=1.04122 halt=0.00 train_steps=3.00 +ep70 val_rmse=1.00897 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.98734 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.99571 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.99361 halt=0.00 train_steps=3.00 +[ogbg-molesol_resgated_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=80 val={'rmse': np.float32(0.98733556)} test={'rmse': np.float32(0.8825017)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molesol view=tag compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view tag --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.21819 halt=0.00 train_steps=1.00 +ep20 val_rmse=0.98698 halt=0.00 train_steps=1.00 +ep30 val_rmse=0.93235 halt=0.00 train_steps=1.00 +ep40 val_rmse=1.08652 halt=0.00 train_steps=1.00 +ep50 val_rmse=1.05470 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.95672 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.95119 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.95477 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.96258 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.95642 halt=0.00 train_steps=1.00 +[ogbg-molesol_tag_classic_T0_ns1_h128_e100_s0] best_ep=30 val={'rmse': np.float32(0.9323491)} test={'rmse': np.float32(0.9677547)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_tag_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molesol view=tag compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view tag --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.45321 halt=0.00 train_steps=3.00 +ep20 val_rmse=1.12140 halt=0.00 train_steps=3.00 +ep30 val_rmse=1.32783 halt=0.00 train_steps=3.00 +ep40 val_rmse=1.08941 halt=0.00 train_steps=3.00 +ep50 val_rmse=0.90360 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.97927 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.95696 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.94772 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.95704 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.95720 halt=0.00 train_steps=3.00 +[ogbg-molesol_tag_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rmse': np.float32(0.90359575)} test={'rmse': np.float32(0.94621307)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_tag_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molesol view=sgc compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view sgc --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.24034 halt=0.00 train_steps=1.00 +ep20 val_rmse=1.09760 halt=0.00 train_steps=1.00 +ep30 val_rmse=1.08614 halt=0.00 train_steps=1.00 +ep40 val_rmse=1.31586 halt=0.00 train_steps=1.00 +ep50 val_rmse=1.15240 halt=0.00 train_steps=1.00 +ep60 val_rmse=1.07828 halt=0.00 train_steps=1.00 +ep70 val_rmse=1.10383 halt=0.00 train_steps=1.00 +ep80 val_rmse=1.06528 halt=0.00 train_steps=1.00 +ep90 val_rmse=1.06407 halt=0.00 train_steps=1.00 +ep100 val_rmse=1.06170 halt=0.00 train_steps=1.00 +[ogbg-molesol_sgc_classic_T0_ns1_h128_e100_s0] best_ep=100 val={'rmse': np.float32(1.0616996)} test={'rmse': np.float32(0.9779573)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_sgc_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molesol view=sgc compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view sgc --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.05239 halt=0.00 train_steps=3.00 +ep20 val_rmse=1.22334 halt=0.00 train_steps=3.00 +ep30 val_rmse=1.01723 halt=0.00 train_steps=3.00 +ep40 val_rmse=1.02365 halt=0.00 train_steps=3.00 +ep50 val_rmse=1.03673 halt=0.00 train_steps=3.00 +ep60 val_rmse=1.01829 halt=0.00 train_steps=3.00 +ep70 val_rmse=1.03733 halt=0.00 train_steps=3.00 +ep80 val_rmse=1.01637 halt=0.00 train_steps=3.00 +ep90 val_rmse=1.01291 halt=0.00 train_steps=3.00 +ep100 val_rmse=1.01402 halt=0.00 train_steps=3.00 +[ogbg-molesol_sgc_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=90 val={'rmse': np.float32(1.012914)} test={'rmse': np.float32(0.93728936)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molesol view=cheb compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view cheb --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.05592 halt=0.00 train_steps=1.00 +ep20 val_rmse=1.20034 halt=0.00 train_steps=1.00 +ep30 val_rmse=1.04960 halt=0.00 train_steps=1.00 +ep40 val_rmse=1.04264 halt=0.00 train_steps=1.00 +ep50 val_rmse=0.99688 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.96500 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.98661 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.97827 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.97583 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.97404 halt=0.00 train_steps=1.00 +[ogbg-molesol_cheb_classic_T0_ns1_h128_e100_s0] best_ep=60 val={'rmse': np.float32(0.96499854)} test={'rmse': np.float32(0.8722475)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_cheb_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molesol view=cheb compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view cheb --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.11822 halt=0.00 train_steps=3.00 +ep20 val_rmse=1.09404 halt=0.00 train_steps=3.00 +ep30 val_rmse=0.94869 halt=0.00 train_steps=3.00 +ep40 val_rmse=0.91990 halt=0.00 train_steps=3.00 +ep50 val_rmse=0.99420 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.94945 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.94930 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.93166 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.94542 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.94151 halt=0.00 train_steps=3.00 +[ogbg-molesol_cheb_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rmse': np.float32(0.9198978)} test={'rmse': np.float32(0.88406515)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molesol view=arma compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view arma --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.17207 halt=0.00 train_steps=1.00 +ep20 val_rmse=1.31463 halt=0.00 train_steps=1.00 +ep30 val_rmse=1.14849 halt=0.00 train_steps=1.00 +ep40 val_rmse=1.08189 halt=0.00 train_steps=1.00 +ep50 val_rmse=1.10686 halt=0.00 train_steps=1.00 +ep60 val_rmse=1.07767 halt=0.00 train_steps=1.00 +ep70 val_rmse=1.06414 halt=0.00 train_steps=1.00 +ep80 val_rmse=1.01946 halt=0.00 train_steps=1.00 +ep90 val_rmse=1.03369 halt=0.00 train_steps=1.00 +ep100 val_rmse=1.03917 halt=0.00 train_steps=1.00 +[ogbg-molesol_arma_classic_T0_ns1_h128_e100_s0] best_ep=80 val={'rmse': np.float32(1.0194643)} test={'rmse': np.float32(1.0665998)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_arma_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molesol view=arma compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view arma --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.41924 halt=0.00 train_steps=3.00 +ep20 val_rmse=1.34309 halt=0.00 train_steps=3.00 +ep30 val_rmse=1.18316 halt=0.00 train_steps=3.00 +ep40 val_rmse=1.16171 halt=0.00 train_steps=3.00 +ep50 val_rmse=1.06878 halt=0.00 train_steps=3.00 +ep60 val_rmse=1.11578 halt=0.00 train_steps=3.00 +ep70 val_rmse=1.03151 halt=0.00 train_steps=3.00 +ep80 val_rmse=1.00344 halt=0.00 train_steps=3.00 +ep90 val_rmse=1.04059 halt=0.00 train_steps=3.00 +ep100 val_rmse=1.04341 halt=0.00 train_steps=3.00 +[ogbg-molesol_arma_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=80 val={'rmse': np.float32(1.0034424)} test={'rmse': np.float32(1.1272348)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_arma_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molesol view=mf compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view mf --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.64768 halt=0.00 train_steps=1.00 +ep20 val_rmse=1.55084 halt=0.00 train_steps=1.00 +ep30 val_rmse=1.39699 halt=0.00 train_steps=1.00 +ep40 val_rmse=1.40672 halt=0.00 train_steps=1.00 +ep50 val_rmse=1.16995 halt=0.00 train_steps=1.00 +ep60 val_rmse=1.26174 halt=0.00 train_steps=1.00 +ep70 val_rmse=1.14943 halt=0.00 train_steps=1.00 +ep80 val_rmse=1.16326 halt=0.00 train_steps=1.00 +ep90 val_rmse=1.15271 halt=0.00 train_steps=1.00 +ep100 val_rmse=1.15059 halt=0.00 train_steps=1.00 +[ogbg-molesol_mf_classic_T0_ns1_h128_e100_s0] best_ep=70 val={'rmse': np.float32(1.1494334)} test={'rmse': np.float32(1.0638543)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_mf_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molesol view=mf compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view mf --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.52906 halt=0.00 train_steps=3.00 +ep20 val_rmse=1.24056 halt=0.00 train_steps=3.00 +ep30 val_rmse=1.22429 halt=0.00 train_steps=3.00 +ep40 val_rmse=1.05528 halt=0.00 train_steps=3.00 +ep50 val_rmse=1.21370 halt=0.00 train_steps=3.00 +ep60 val_rmse=1.21516 halt=0.00 train_steps=3.00 +ep70 val_rmse=1.11821 halt=0.00 train_steps=3.00 +ep80 val_rmse=1.15312 halt=0.00 train_steps=3.00 +ep90 val_rmse=1.09602 halt=0.00 train_steps=3.00 +ep100 val_rmse=1.10826 halt=0.00 train_steps=3.00 +[ogbg-molesol_mf_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rmse': np.float32(1.055278)} test={'rmse': np.float32(1.0367582)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_mf_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molesol view=appnp compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view appnp --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.82593 halt=0.00 train_steps=1.00 +ep20 val_rmse=1.84712 halt=0.00 train_steps=1.00 +ep30 val_rmse=2.11191 halt=0.00 train_steps=1.00 +ep40 val_rmse=1.78404 halt=0.00 train_steps=1.00 +ep50 val_rmse=1.60830 halt=0.00 train_steps=1.00 +ep60 val_rmse=1.61893 halt=0.00 train_steps=1.00 +ep70 val_rmse=1.65620 halt=0.00 train_steps=1.00 +ep80 val_rmse=1.62803 halt=0.00 train_steps=1.00 +ep90 val_rmse=1.63849 halt=0.00 train_steps=1.00 +ep100 val_rmse=1.65824 halt=0.00 train_steps=1.00 +[ogbg-molesol_appnp_classic_T0_ns1_h128_e100_s0] best_ep=50 val={'rmse': np.float32(1.6082952)} test={'rmse': np.float32(1.5212218)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_appnp_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molesol view=appnp compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view appnp --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.92888 halt=0.00 train_steps=3.00 +ep20 val_rmse=2.07388 halt=0.00 train_steps=3.00 +ep30 val_rmse=1.80534 halt=0.00 train_steps=3.00 +ep40 val_rmse=1.75562 halt=0.00 train_steps=3.00 +ep50 val_rmse=1.86712 halt=0.00 train_steps=3.00 +ep60 val_rmse=1.53509 halt=0.00 train_steps=3.00 +ep70 val_rmse=1.49896 halt=0.00 train_steps=3.00 +ep80 val_rmse=1.47594 halt=0.00 train_steps=3.00 +ep90 val_rmse=1.43690 halt=0.00 train_steps=3.00 +ep100 val_rmse=1.41956 halt=0.00 train_steps=3.00 +[ogbg-molesol_appnp_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=100 val={'rmse': np.float32(1.4195601)} test={'rmse': np.float32(1.4928638)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json + +Classic baseline: task x backbone +| task | backbone | metric | n | val | test | +| --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | rocauc | 1 | 0.6564 +/- 0.0000 | 0.7423 +/- 0.0000 | +| ogbg-molbace | arma | rocauc | 1 | 0.6923 +/- 0.0000 | 0.7839 +/- 0.0000 | +| ogbg-molbace | cheb | rocauc | 1 | 0.7267 +/- 0.0000 | 0.7969 +/- 0.0000 | +| ogbg-molbace | film | rocauc | 1 | 0.6703 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molbace | gatv2 | rocauc | 1 | 0.7029 +/- 0.0000 | 0.7400 +/- 0.0000 | +| ogbg-molbace | gcn | rocauc | 1 | 0.6381 +/- 0.0000 | 0.7393 +/- 0.0000 | +| ogbg-molbace | gen | rocauc | 1 | 0.7128 +/- 0.0000 | 0.7326 +/- 0.0000 | +| ogbg-molbace | gin | rocauc | 1 | 0.6520 +/- 0.0000 | 0.7336 +/- 0.0000 | +| ogbg-molbace | gine | rocauc | 1 | 0.6641 +/- 0.0000 | 0.7454 +/- 0.0000 | +| ogbg-molbace | graphconv | rocauc | 1 | 0.7311 +/- 0.0000 | 0.8035 +/- 0.0000 | +| ogbg-molbace | graphsage | rocauc | 1 | 0.6758 +/- 0.0000 | 0.7759 +/- 0.0000 | +| ogbg-molbace | mf | rocauc | 1 | 0.7421 +/- 0.0000 | 0.7760 +/- 0.0000 | +| ogbg-molbace | pna | rocauc | 1 | 0.7516 +/- 0.0000 | 0.6912 +/- 0.0000 | +| ogbg-molbace | resgated | rocauc | 1 | 0.7172 +/- 0.0000 | 0.7877 +/- 0.0000 | +| ogbg-molbace | sgc | rocauc | 1 | 0.6575 +/- 0.0000 | 0.6966 +/- 0.0000 | +| ogbg-molbace | tag | rocauc | 1 | 0.7084 +/- 0.0000 | 0.7345 +/- 0.0000 | +| ogbg-molbace | transformer | rocauc | 1 | 0.6663 +/- 0.0000 | 0.7364 +/- 0.0000 | +| ogbg-molbbbp | appnp | rocauc | 1 | 0.9147 +/- 0.0000 | 0.6388 +/- 0.0000 | +| ogbg-molbbbp | arma | rocauc | 1 | 0.9367 +/- 0.0000 | 0.6651 +/- 0.0000 | +| ogbg-molbbbp | cheb | rocauc | 1 | 0.9452 +/- 0.0000 | 0.6514 +/- 0.0000 | +| ogbg-molbbbp | film | rocauc | 1 | 0.9285 +/- 0.0000 | 0.6300 +/- 0.0000 | +| ogbg-molbbbp | gatv2 | rocauc | 1 | 0.9347 +/- 0.0000 | 0.6324 +/- 0.0000 | +| ogbg-molbbbp | gcn | rocauc | 1 | 0.9386 +/- 0.0000 | 0.6679 +/- 0.0000 | +| ogbg-molbbbp | gen | rocauc | 1 | 0.9549 +/- 0.0000 | 0.6775 +/- 0.0000 | +| ogbg-molbbbp | gin | rocauc | 1 | 0.9251 +/- 0.0000 | 0.5670 +/- 0.0000 | +| ogbg-molbbbp | gine | rocauc | 1 | 0.9324 +/- 0.0000 | 0.6160 +/- 0.0000 | +| ogbg-molbbbp | graphconv | rocauc | 1 | 0.9268 +/- 0.0000 | 0.5900 +/- 0.0000 | +| ogbg-molbbbp | graphsage | rocauc | 1 | 0.9483 +/- 0.0000 | 0.6288 +/- 0.0000 | +| ogbg-molbbbp | mf | rocauc | 1 | 0.9395 +/- 0.0000 | 0.6365 +/- 0.0000 | +| ogbg-molbbbp | pna | rocauc | 1 | 0.9554 +/- 0.0000 | 0.6418 +/- 0.0000 | +| ogbg-molbbbp | resgated | rocauc | 1 | 0.9183 +/- 0.0000 | 0.6626 +/- 0.0000 | +| ogbg-molbbbp | sgc | rocauc | 1 | 0.9300 +/- 0.0000 | 0.6239 +/- 0.0000 | +| ogbg-molbbbp | tag | rocauc | 1 | 0.9476 +/- 0.0000 | 0.6100 +/- 0.0000 | +| ogbg-molbbbp | transformer | rocauc | 1 | 0.9495 +/- 0.0000 | 0.6156 +/- 0.0000 | +| ogbg-molclintox | appnp | rocauc | 1 | 0.8516 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | arma | rocauc | 1 | 0.9463 +/- 0.0000 | 0.8678 +/- 0.0000 | +| ogbg-molclintox | cheb | rocauc | 1 | 0.8928 +/- 0.0000 | 0.9152 +/- 0.0000 | +| ogbg-molclintox | film | rocauc | 1 | 0.9048 +/- 0.0000 | 0.7731 +/- 0.0000 | +| ogbg-molclintox | gatv2 | rocauc | 1 | 0.9515 +/- 0.0000 | 0.8493 +/- 0.0000 | +| ogbg-molclintox | gcn | rocauc | 1 | 0.9318 +/- 0.0000 | 0.8932 +/- 0.0000 | +| ogbg-molclintox | gen | rocauc | 1 | 0.9820 +/- 0.0000 | 0.8128 +/- 0.0000 | +| ogbg-molclintox | gin | rocauc | 1 | 0.9547 +/- 0.0000 | 0.8586 +/- 0.0000 | +| ogbg-molclintox | gine | rocauc | 1 | 0.9353 +/- 0.0000 | 0.8869 +/- 0.0000 | +| ogbg-molclintox | graphconv | rocauc | 1 | 0.8917 +/- 0.0000 | 0.8501 +/- 0.0000 | +| ogbg-molclintox | graphsage | rocauc | 1 | 0.9143 +/- 0.0000 | 0.8882 +/- 0.0000 | +| ogbg-molclintox | mf | rocauc | 1 | 0.9252 +/- 0.0000 | 0.8370 +/- 0.0000 | +| ogbg-molclintox | pna | rocauc | 1 | 0.9286 +/- 0.0000 | 0.8603 +/- 0.0000 | +| ogbg-molclintox | resgated | rocauc | 1 | 0.9244 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | sgc | rocauc | 1 | 0.9195 +/- 0.0000 | 0.8986 +/- 0.0000 | +| ogbg-molclintox | tag | rocauc | 1 | 0.9237 +/- 0.0000 | 0.7998 +/- 0.0000 | +| ogbg-molclintox | transformer | rocauc | 1 | 0.9271 +/- 0.0000 | 0.8764 +/- 0.0000 | +| ogbg-molesol | appnp | rmse | 1 | 1.6083 +/- 0.0000 | 1.5212 +/- 0.0000 | +| ogbg-molesol | arma | rmse | 1 | 1.0195 +/- 0.0000 | 1.0666 +/- 0.0000 | +| ogbg-molesol | cheb | rmse | 1 | 0.9650 +/- 0.0000 | 0.8722 +/- 0.0000 | +| ogbg-molesol | film | rmse | 1 | 1.0718 +/- 0.0000 | 1.2896 +/- 0.0000 | +| ogbg-molesol | gatv2 | rmse | 1 | 1.0368 +/- 0.0000 | 0.9878 +/- 0.0000 | +| ogbg-molesol | gcn | rmse | 1 | 1.0409 +/- 0.0000 | 1.1161 +/- 0.0000 | +| ogbg-molesol | gen | rmse | 1 | 1.0089 +/- 0.0000 | 0.8762 +/- 0.0000 | +| ogbg-molesol | gin | rmse | 1 | 1.0187 +/- 0.0000 | 0.9900 +/- 0.0000 | +| ogbg-molesol | gine | rmse | 1 | 1.0286 +/- 0.0000 | 1.0807 +/- 0.0000 | +| ogbg-molesol | graphconv | rmse | 1 | 0.9741 +/- 0.0000 | 0.9732 +/- 0.0000 | +| ogbg-molesol | graphsage | rmse | 1 | 0.9680 +/- 0.0000 | 1.0038 +/- 0.0000 | +| ogbg-molesol | mf | rmse | 1 | 1.1494 +/- 0.0000 | 1.0639 +/- 0.0000 | +| ogbg-molesol | pna | rmse | 1 | 0.9116 +/- 0.0000 | 0.9153 +/- 0.0000 | +| ogbg-molesol | resgated | rmse | 1 | 0.9492 +/- 0.0000 | 0.8908 +/- 0.0000 | +| ogbg-molesol | sgc | rmse | 1 | 1.0617 +/- 0.0000 | 0.9780 +/- 0.0000 | +| ogbg-molesol | tag | rmse | 1 | 0.9323 +/- 0.0000 | 0.9678 +/- 0.0000 | +| ogbg-molesol | transformer | rmse | 1 | 0.9398 +/- 0.0000 | 0.9492 +/- 0.0000 | +| ogbg-molhiv | appnp | rocauc | 1 | 0.7675 +/- 0.0000 | 0.7000 +/- 0.0000 | +| ogbg-molhiv | arma | rocauc | 1 | 0.7872 +/- 0.0000 | 0.7296 +/- 0.0000 | +| ogbg-molhiv | cheb | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7282 +/- 0.0000 | +| ogbg-molhiv | film | rocauc | 1 | 0.7922 +/- 0.0000 | 0.7842 +/- 0.0000 | +| ogbg-molhiv | gatv2 | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7563 +/- 0.0000 | +| ogbg-molhiv | gcn | rocauc | 1 | 0.7754 +/- 0.0000 | 0.7198 +/- 0.0000 | +| ogbg-molhiv | gen | rocauc | 1 | 0.7530 +/- 0.0000 | 0.7314 +/- 0.0000 | +| ogbg-molhiv | gin | rocauc | 1 | 0.8167 +/- 0.0000 | 0.7724 +/- 0.0000 | +| ogbg-molhiv | gine | rocauc | 1 | 0.7942 +/- 0.0000 | 0.7445 +/- 0.0000 | +| ogbg-molhiv | graphconv | rocauc | 1 | 0.7707 +/- 0.0000 | 0.7108 +/- 0.0000 | +| ogbg-molhiv | graphsage | rocauc | 1 | 0.7969 +/- 0.0000 | 0.7625 +/- 0.0000 | +| ogbg-molhiv | mf | rocauc | 1 | 0.7845 +/- 0.0000 | 0.7074 +/- 0.0000 | +| ogbg-molhiv | pna | rocauc | 1 | 0.7780 +/- 0.0000 | 0.7648 +/- 0.0000 | +| ogbg-molhiv | resgated | rocauc | 1 | 0.8144 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molhiv | sgc | rocauc | 1 | 0.7479 +/- 0.0000 | 0.7019 +/- 0.0000 | +| ogbg-molhiv | tag | rocauc | 1 | 0.7528 +/- 0.0000 | 0.7255 +/- 0.0000 | +| ogbg-molhiv | transformer | rocauc | 1 | 0.7617 +/- 0.0000 | 0.7547 +/- 0.0000 | +| ogbg-molsider | appnp | rocauc | 1 | 0.5886 +/- 0.0000 | 0.6004 +/- 0.0000 | +| ogbg-molsider | arma | rocauc | 1 | 0.6273 +/- 0.0000 | 0.6159 +/- 0.0000 | +| ogbg-molsider | cheb | rocauc | 1 | 0.6237 +/- 0.0000 | 0.6033 +/- 0.0000 | +| ogbg-molsider | film | rocauc | 1 | 0.6024 +/- 0.0000 | 0.5898 +/- 0.0000 | +| ogbg-molsider | gatv2 | rocauc | 1 | 0.6071 +/- 0.0000 | 0.6013 +/- 0.0000 | +| ogbg-molsider | gcn | rocauc | 1 | 0.6293 +/- 0.0000 | 0.6086 +/- 0.0000 | +| ogbg-molsider | gen | rocauc | 1 | 0.6519 +/- 0.0000 | 0.5854 +/- 0.0000 | +| ogbg-molsider | gin | rocauc | 1 | 0.6225 +/- 0.0000 | 0.5748 +/- 0.0000 | +| ogbg-molsider | gine | rocauc | 1 | 0.6327 +/- 0.0000 | 0.5495 +/- 0.0000 | +| ogbg-molsider | graphconv | rocauc | 1 | 0.5921 +/- 0.0000 | 0.6151 +/- 0.0000 | +| ogbg-molsider | graphsage | rocauc | 1 | 0.6217 +/- 0.0000 | 0.5807 +/- 0.0000 | +| ogbg-molsider | mf | rocauc | 1 | 0.6202 +/- 0.0000 | 0.5861 +/- 0.0000 | +| ogbg-molsider | pna | rocauc | 1 | 0.6219 +/- 0.0000 | 0.5965 +/- 0.0000 | +| ogbg-molsider | resgated | rocauc | 1 | 0.6209 +/- 0.0000 | 0.5910 +/- 0.0000 | +| ogbg-molsider | sgc | rocauc | 1 | 0.6174 +/- 0.0000 | 0.6043 +/- 0.0000 | +| ogbg-molsider | tag | rocauc | 1 | 0.6439 +/- 0.0000 | 0.6143 +/- 0.0000 | +| ogbg-molsider | transformer | rocauc | 1 | 0.6160 +/- 0.0000 | 0.5980 +/- 0.0000 | +| ogbg-moltox21 | appnp | rocauc | 1 | 0.7255 +/- 0.0000 | 0.7158 +/- 0.0000 | +| ogbg-moltox21 | arma | rocauc | 1 | 0.7799 +/- 0.0000 | 0.7223 +/- 0.0000 | +| ogbg-moltox21 | cheb | rocauc | 1 | 0.7834 +/- 0.0000 | 0.7301 +/- 0.0000 | +| ogbg-moltox21 | film | rocauc | 1 | 0.7702 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gatv2 | rocauc | 1 | 0.7627 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gcn | rocauc | 1 | 0.7580 +/- 0.0000 | 0.7171 +/- 0.0000 | +| ogbg-moltox21 | gen | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7444 +/- 0.0000 | +| ogbg-moltox21 | gin | rocauc | 1 | 0.7690 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-moltox21 | gine | rocauc | 1 | 0.7744 +/- 0.0000 | 0.7328 +/- 0.0000 | +| ogbg-moltox21 | graphconv | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7147 +/- 0.0000 | +| ogbg-moltox21 | graphsage | rocauc | 1 | 0.7709 +/- 0.0000 | 0.7196 +/- 0.0000 | +| ogbg-moltox21 | mf | rocauc | 1 | 0.7773 +/- 0.0000 | 0.7281 +/- 0.0000 | +| ogbg-moltox21 | pna | rocauc | 1 | 0.7660 +/- 0.0000 | 0.6946 +/- 0.0000 | +| ogbg-moltox21 | resgated | rocauc | 1 | 0.7950 +/- 0.0000 | 0.7275 +/- 0.0000 | +| ogbg-moltox21 | sgc | rocauc | 1 | 0.7611 +/- 0.0000 | 0.7240 +/- 0.0000 | +| ogbg-moltox21 | tag | rocauc | 1 | 0.7866 +/- 0.0000 | 0.7416 +/- 0.0000 | +| ogbg-moltox21 | transformer | rocauc | 1 | 0.7656 +/- 0.0000 | 0.7309 +/- 0.0000 | + +Delta vs matching classic +| task | backbone | compute | metric | n | val score (delta) | test score (delta) | steps | +| --- | --- | --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7168 (0.0604) | 0.7209 (-0.0214) | | +| ogbg-molbace | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7179 (0.0256) | 0.7672 (-0.0167) | | +| ogbg-molbace | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7114 (-0.0154) | 0.7533 (-0.0436) | | +| ogbg-molbace | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6652 (-0.0051) | 0.7242 (0.0000) | | +| ogbg-molbace | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7026 (-0.0004) | 0.7519 (0.0118) | | +| ogbg-molbace | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6374 (-0.0007) | 0.7733 (0.0339) | | +| ogbg-molbace | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6894 (-0.0234) | 0.7449 (0.0123) | | +| ogbg-molbace | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6538 (0.0018) | 0.7169 (-0.0167) | | +| ogbg-molbace | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6685 (0.0044) | 0.6994 (-0.0461) | | +| ogbg-molbace | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7462 (0.0150) | 0.7983 (-0.0052) | | +| ogbg-molbace | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6703 (-0.0055) | 0.7119 (-0.0640) | | +| ogbg-molbace | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7234 (-0.0187) | 0.7684 (-0.0077) | | +| ogbg-molbace | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7037 (-0.0480) | 0.7967 (0.1055) | | +| ogbg-molbace | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6912 (-0.0260) | 0.7465 (-0.0412) | | +| ogbg-molbace | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6454 (-0.0121) | 0.7727 (0.0762) | | +| ogbg-molbace | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7355 (0.0271) | 0.6806 (-0.0539) | | +| ogbg-molbace | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6982 (0.0319) | 0.7487 (0.0123) | | +| ogbg-molbbbp | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9360 (0.0213) | 0.6073 (-0.0314) | | +| ogbg-molbbbp | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9415 (0.0048) | 0.6635 (-0.0016) | | +| ogbg-molbbbp | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9278 (-0.0174) | 0.6659 (0.0145) | | +| ogbg-molbbbp | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9400 (0.0115) | 0.6323 (0.0023) | | +| ogbg-molbbbp | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9356 (0.0009) | 0.6560 (0.0235) | | +| ogbg-molbbbp | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9417 (0.0031) | 0.6017 (-0.0663) | | +| ogbg-molbbbp | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9429 (-0.0119) | 0.6037 (-0.0738) | | +| ogbg-molbbbp | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9526 (0.0275) | 0.5932 (0.0261) | | +| ogbg-molbbbp | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9421 (0.0098) | 0.6976 (0.0816) | | +| ogbg-molbbbp | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9337 (0.0069) | 0.6518 (0.0618) | | +| ogbg-molbbbp | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9502 (0.0019) | 0.5934 (-0.0354) | | +| ogbg-molbbbp | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9488 (0.0094) | 0.6481 (0.0116) | | +| ogbg-molbbbp | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9585 (0.0031) | 0.6682 (0.0264) | | +| ogbg-molbbbp | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9535 (0.0352) | 0.5839 (-0.0787) | | +| ogbg-molbbbp | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9285 (-0.0015) | 0.6454 (0.0215) | | +| ogbg-molbbbp | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9459 (-0.0017) | 0.6420 (0.0320) | | +| ogbg-molbbbp | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9355 (-0.0140) | 0.6221 (0.0065) | | +| ogbg-molclintox | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9029 (0.0513) | 0.8898 (-0.0286) | | +| ogbg-molclintox | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9135 (-0.0328) | 0.8863 (0.0185) | | +| ogbg-molclintox | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8816 (-0.0112) | 0.8982 (-0.0170) | | +| ogbg-molclintox | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9454 (0.0406) | 0.8430 (0.0699) | | +| ogbg-molclintox | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9351 (-0.0164) | 0.8328 (-0.0164) | | +| ogbg-molclintox | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9097 (-0.0221) | 0.8792 (-0.0140) | | +| ogbg-molclintox | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9399 (-0.0421) | 0.8194 (0.0066) | | +| ogbg-molclintox | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9164 (-0.0383) | 0.8788 (0.0202) | | +| ogbg-molclintox | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9225 (-0.0127) | 0.8840 (-0.0030) | | +| ogbg-molclintox | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8494 (-0.0424) | 0.8186 (-0.0316) | | +| ogbg-molclintox | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9579 (0.0436) | 0.8664 (-0.0217) | | +| ogbg-molclintox | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9147 (-0.0104) | 0.8047 (-0.0323) | | +| ogbg-molclintox | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9064 (-0.0222) | 0.8735 (0.0132) | | +| ogbg-molclintox | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9055 (-0.0188) | 0.8979 (-0.0205) | | +| ogbg-molclintox | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9220 (0.0025) | 0.9054 (0.0068) | | +| ogbg-molclintox | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9183 (-0.0054) | 0.8433 (0.0435) | | +| ogbg-molclintox | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9322 (0.0051) | 0.8522 (-0.0242) | | +| ogbg-molesol | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 1.4196 (0.1887) | 1.4929 (0.0284) | | +| ogbg-molesol | arma | fixed-rrog-T1-ns3 | rmse | 1 | 1.0034 (0.0160) | 1.1272 (-0.0606) | | +| ogbg-molesol | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 0.9199 (0.0451) | 0.8841 (-0.0118) | | +| ogbg-molesol | film | fixed-rrog-T1-ns3 | rmse | 1 | 1.0196 (0.0521) | 1.0849 (0.2047) | | +| ogbg-molesol | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 1.0018 (0.0350) | 0.9780 (0.0098) | | +| ogbg-molesol | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 0.9591 (0.0818) | 0.9305 (0.1856) | | +| ogbg-molesol | gen | fixed-rrog-T1-ns3 | rmse | 1 | 1.0027 (0.0062) | 0.9206 (-0.0444) | | +| ogbg-molesol | gin | fixed-rrog-T1-ns3 | rmse | 1 | 0.9647 (0.0540) | 1.0798 (-0.0899) | | +| ogbg-molesol | gine | fixed-rrog-T1-ns3 | rmse | 1 | 1.0581 (-0.0295) | 1.0951 (-0.0144) | | +| ogbg-molesol | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 1.0048 (-0.0307) | 0.9968 (-0.0236) | | +| ogbg-molesol | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 0.9934 (-0.0254) | 1.0794 (-0.0757) | | +| ogbg-molesol | mf | fixed-rrog-T1-ns3 | rmse | 1 | 1.0553 (0.0942) | 1.0368 (0.0271) | | +| ogbg-molesol | pna | fixed-rrog-T1-ns3 | rmse | 1 | 0.9841 (-0.0725) | 0.9092 (0.0060) | | +| ogbg-molesol | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 0.9873 (-0.0382) | 0.8825 (0.0083) | | +| ogbg-molesol | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 1.0129 (0.0488) | 0.9373 (0.0407) | | +| ogbg-molesol | tag | fixed-rrog-T1-ns3 | rmse | 1 | 0.9036 (0.0288) | 0.9462 (0.0215) | | +| ogbg-molesol | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 0.9841 (-0.0443) | 1.0004 (-0.0512) | | +| ogbg-molhiv | appnp | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7203 (-0.0471) | 0.6825 (-0.0175) | | +| ogbg-molhiv | arma | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7926 (0.0054) | 0.7318 (0.0021) | | +| ogbg-molhiv | cheb | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7735 (-0.0096) | 0.7426 (0.0144) | | +| ogbg-molhiv | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8251 (0.0330) | 0.7725 (-0.0117) | | +| ogbg-molhiv | film | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7633 (-0.0288) | 0.7728 (-0.0114) | | +| ogbg-molhiv | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8049 (0.0214) | 0.7486 (-0.0077) | | +| ogbg-molhiv | gatv2 | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7835 (0.0001) | 0.7466 (-0.0096) | | +| ogbg-molhiv | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7833 (0.0079) | 0.7448 (0.0250) | | +| ogbg-molhiv | gcn | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7455 (-0.0300) | 0.7483 (0.0285) | | +| ogbg-molhiv | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7740 (0.0210) | 0.7590 (0.0276) | | +| ogbg-molhiv | gen | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8128 (0.0598) | 0.7631 (0.0318) | | +| ogbg-molhiv | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0457) | 0.7668 (-0.0056) | | +| ogbg-molhiv | gin | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7524 (-0.0644) | 0.7324 (-0.0400) | | +| ogbg-molhiv | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7490 (-0.0453) | 0.7376 (-0.0070) | | +| ogbg-molhiv | gine | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7575 (-0.0368) | 0.7401 (-0.0044) | | +| ogbg-molhiv | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7817 (0.0110) | 0.7493 (0.0385) | | +| ogbg-molhiv | graphconv | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7713 (0.0006) | 0.6979 (-0.0129) | | +| ogbg-molhiv | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7893 (-0.0075) | 0.7633 (0.0008) | | +| ogbg-molhiv | graphsage | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7587 (-0.0382) | 0.7641 (0.0016) | | +| ogbg-molhiv | mf | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7931 (0.0085) | 0.7217 (0.0143) | | +| ogbg-molhiv | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8097 (0.0317) | 0.7602 (-0.0046) | | +| ogbg-molhiv | pna | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7890 (0.0111) | 0.7630 (-0.0018) | | +| ogbg-molhiv | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7923 (-0.0221) | 0.7227 (-0.0015) | | +| ogbg-molhiv | resgated | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8174 (0.0030) | 0.7055 (-0.0187) | | +| ogbg-molhiv | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7659 (0.0181) | 0.7136 (0.0117) | | +| ogbg-molhiv | sgc | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7482 (0.0003) | 0.7177 (0.0158) | | +| ogbg-molhiv | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7717 (0.0189) | 0.7181 (-0.0074) | | +| ogbg-molhiv | tag | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7804 (0.0276) | 0.7352 (0.0096) | | +| ogbg-molhiv | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7838 (0.0221) | 0.7648 (0.0100) | | +| ogbg-molhiv | transformer | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8088 (0.0471) | 0.7413 (-0.0134) | | +| ogbg-molsider | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.5938 (0.0051) | 0.5905 (-0.0099) | | +| ogbg-molsider | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6344 (0.0071) | 0.6141 (-0.0018) | | +| ogbg-molsider | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6263 (0.0026) | 0.6096 (0.0062) | | +| ogbg-molsider | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.5862 (-0.0162) | 0.5974 (0.0076) | | +| ogbg-molsider | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6462 (0.0391) | 0.6000 (-0.0013) | | +| ogbg-molsider | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6256 (-0.0037) | 0.6117 (0.0031) | | +| ogbg-molsider | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6345 (-0.0175) | 0.6053 (0.0199) | | +| ogbg-molsider | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6046 (-0.0179) | 0.6022 (0.0274) | | +| ogbg-molsider | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6151 (-0.0176) | 0.6150 (0.0655) | | +| ogbg-molsider | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6010 (0.0089) | 0.5963 (-0.0188) | | +| ogbg-molsider | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6232 (0.0015) | 0.5861 (0.0053) | | +| ogbg-molsider | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6190 (-0.0012) | 0.5983 (0.0122) | | +| ogbg-molsider | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6058 (-0.0161) | 0.5721 (-0.0243) | | +| ogbg-molsider | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6205 (-0.0005) | 0.5960 (0.0050) | | +| ogbg-molsider | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6151 (-0.0022) | 0.6417 (0.0375) | | +| ogbg-molsider | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6410 (-0.0028) | 0.6102 (-0.0041) | | +| ogbg-molsider | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6315 (0.0156) | 0.6190 (0.0210) | | +| ogbg-moltox21 | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7280 (0.0025) | 0.7154 (-0.0005) | | +| ogbg-moltox21 | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7771 (-0.0028) | 0.7209 (-0.0014) | | +| ogbg-moltox21 | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0125) | 0.7286 (-0.0015) | | +| ogbg-moltox21 | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7727 (0.0025) | 0.7369 (0.0209) | | +| ogbg-moltox21 | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7762 (0.0135) | 0.7303 (0.0143) | | +| ogbg-moltox21 | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7588 (0.0007) | 0.7230 (0.0059) | | +| ogbg-moltox21 | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7757 (-0.0077) | 0.7312 (-0.0132) | | +| ogbg-moltox21 | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7718 (0.0028) | 0.7237 (-0.0005) | | +| ogbg-moltox21 | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7622 (-0.0122) | 0.7193 (-0.0135) | | +| ogbg-moltox21 | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7820 (-0.0011) | 0.7313 (0.0166) | | +| ogbg-moltox21 | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7697 (-0.0012) | 0.7205 (0.0009) | | +| ogbg-moltox21 | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7695 (-0.0078) | 0.7279 (-0.0002) | | +| ogbg-moltox21 | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7745 (0.0085) | 0.7349 (0.0403) | | +| ogbg-moltox21 | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7887 (-0.0064) | 0.7380 (0.0104) | | +| ogbg-moltox21 | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7506 (-0.0105) | 0.7355 (0.0115) | | +| ogbg-moltox21 | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7839 (-0.0027) | 0.7342 (-0.0074) | | +| ogbg-moltox21 | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7761 (0.0105) | 0.7292 (-0.0018) | | diff --git a/logs/ogbg-molesol_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log b/logs/ogbg-molesol_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log new file mode 100644 index 0000000..b367ebd --- /dev/null +++ b/logs/ogbg-molesol_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log @@ -0,0 +1,31 @@ +[run] ogbg-molesol view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/esol.zip +
0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 9.67it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 9.67it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 19.32it/s] +Processing... +Extracting /home/yurenh2/rrog-gnn-runner/data/ogb/esol.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/1128 [00:00<?, ?it/s]
100%|██████████| 1128/1128 [00:00<00:00, 184042.28it/s] +Converting graphs into PyG objects... +
0%| | 0/1128 [00:00<?, ?it/s]
100%|██████████| 1128/1128 [00:00<00:00, 77870.45it/s] +/home/yurenh2/miniconda3/lib/python3.13/site-packages/ogb/graphproppred/dataset_pyg.py:158: UserWarning: The given NumPy array is not writable, and PyTorch does not support non-writable tensors. This means writing to this tensor will result in undefined behavior. You may want to copy the array to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at /pytorch/torch/csrc/utils/tensor_numpy.cpp:213.) + g.y = torch.from_numpy(graph_label[i]).view(1,-1).to(torch.float32) +Done! +Saving... +Traceback (most recent call last): + File "/home/yurenh2/rrog-gnn-runner/rrog/train_ogb_graphprop.py", line 704, in <module> + main() + ~~~~^^ + File "/home/yurenh2/rrog-gnn-runner/rrog/train_ogb_graphprop.py", line 601, in main + act_state, train_metrics = train_epoch( + ~~~~~~~~~~~^ + model, train_loader, opt, dev, args, act_state, ema_state, ep + 1, metric) + ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ + File "/home/yurenh2/rrog-gnn-runner/rrog/train_ogb_graphprop.py", line 507, in train_epoch + act_state, m = act_train_step(model, act_state, batch, opt, dev, args, epoch, metric) + ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ + File "/home/yurenh2/rrog-gnn-runner/rrog/train_ogb_graphprop.py", line 412, in act_train_step + raise ValueError(args.halt_target) +ValueError: exact diff --git a/logs/ogbg-molesol_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log b/logs/ogbg-molesol_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log new file mode 100644 index 0000000..cd5a0e1 --- /dev/null +++ b/logs/ogbg-molesol_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log @@ -0,0 +1,242 @@ +[run] ogbg-molesol view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=2.63809 val_adapt_rmse=2.39395 adapt_steps=6.48 halt=0.19 train_steps=3.84 +ep20 val_rmse=4.26988 val_adapt_rmse=3.11447 adapt_steps=3.99 halt=0.16 train_steps=4.33 +ep30 val_rmse=4.14634 val_adapt_rmse=3.52731 adapt_steps=4.76 halt=0.16 train_steps=4.14 +ep40 val_rmse=2.34153 val_adapt_rmse=1.55824 adapt_steps=2.54 halt=0.29 train_steps=2.64 +ep50 val_rmse=2.10126 val_adapt_rmse=1.29124 adapt_steps=2.93 halt=0.34 train_steps=2.23 +ep60 val_rmse=1.97711 val_adapt_rmse=1.38502 adapt_steps=3.55 halt=0.29 train_steps=2.55 +ep70 val_rmse=1.85198 val_adapt_rmse=1.17093 adapt_steps=2.89 halt=0.35 train_steps=2.24 +ep80 val_rmse=1.40467 val_adapt_rmse=0.94661 adapt_steps=2.88 halt=0.37 train_steps=2.11 +ep90 val_rmse=1.51603 val_adapt_rmse=0.96581 adapt_steps=2.71 halt=0.39 train_steps=1.94 +ep100 val_rmse=1.55791 val_adapt_rmse=0.98643 adapt_steps=2.61 halt=0.40 train_steps=1.96 +[ogbg-molesol_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rmse': np.float32(1.4046698)} test={'rmse': np.float32(2.0651195)} adaptive={'rmse': np.float32(0.96633816)} steps=2.982300884955752 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molesol view=gine compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view gine --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=3.38193 val_adapt_rmse=3.24861 adapt_steps=5.82 halt=0.18 train_steps=4.23 +ep20 val_rmse=2.14610 val_adapt_rmse=1.81691 adapt_steps=4.67 halt=0.18 train_steps=3.98 +ep30 val_rmse=2.42302 val_adapt_rmse=2.12907 adapt_steps=4.80 halt=0.19 train_steps=3.43 +ep40 val_rmse=1.72178 val_adapt_rmse=1.35344 adapt_steps=4.30 halt=0.24 train_steps=3.14 +ep50 val_rmse=2.54499 val_adapt_rmse=1.50567 adapt_steps=2.35 halt=0.30 train_steps=2.66 +ep60 val_rmse=1.52869 val_adapt_rmse=1.10370 adapt_steps=3.33 halt=0.34 train_steps=2.66 +ep70 val_rmse=1.72160 val_adapt_rmse=1.01718 adapt_steps=3.65 halt=0.35 train_steps=2.32 +ep80 val_rmse=1.64223 val_adapt_rmse=1.07042 adapt_steps=2.33 halt=0.38 train_steps=2.24 +ep90 val_rmse=1.31103 val_adapt_rmse=1.01651 adapt_steps=2.51 halt=0.41 train_steps=2.03 +ep100 val_rmse=1.36548 val_adapt_rmse=1.01212 adapt_steps=2.47 halt=0.40 train_steps=2.11 +[ogbg-molesol_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rmse': np.float32(1.3110343)} test={'rmse': np.float32(2.0394285)} adaptive={'rmse': np.float32(1.0992771)} steps=2.8849557522123894 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molesol view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=2.02916 val_adapt_rmse=1.75337 adapt_steps=4.50 halt=0.23 train_steps=3.50 +ep20 val_rmse=1.54387 val_adapt_rmse=1.38205 adapt_steps=4.77 halt=0.22 train_steps=3.63 +ep30 val_rmse=1.69653 val_adapt_rmse=1.49022 adapt_steps=4.99 halt=0.22 train_steps=3.20 +ep40 val_rmse=2.92037 val_adapt_rmse=1.90808 adapt_steps=3.73 halt=0.25 train_steps=3.16 +ep50 val_rmse=1.03997 val_adapt_rmse=0.90930 adapt_steps=3.62 halt=0.29 train_steps=2.79 +ep60 val_rmse=1.07837 val_adapt_rmse=1.00303 adapt_steps=3.17 halt=0.39 train_steps=2.10 +ep70 val_rmse=1.16818 val_adapt_rmse=0.92152 adapt_steps=3.02 halt=0.38 train_steps=2.08 +ep80 val_rmse=1.08067 val_adapt_rmse=0.92960 adapt_steps=3.04 halt=0.38 train_steps=2.18 +ep90 val_rmse=1.02939 val_adapt_rmse=0.87992 adapt_steps=2.79 halt=0.40 train_steps=2.00 +ep100 val_rmse=1.04713 val_adapt_rmse=0.88052 adapt_steps=2.70 halt=0.40 train_steps=1.98 +[ogbg-molesol_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rmse': np.float32(1.0293915)} test={'rmse': np.float32(1.2572919)} adaptive={'rmse': np.float32(0.92217094)} steps=2.7168141592920354 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molesol view=graphsage compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view graphsage --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=2.09992 val_adapt_rmse=1.91741 adapt_steps=5.06 halt=0.15 train_steps=4.24 +ep20 val_rmse=1.34611 val_adapt_rmse=1.17463 adapt_steps=3.27 halt=0.20 train_steps=3.81 +ep30 val_rmse=2.05686 val_adapt_rmse=1.52317 adapt_steps=3.48 halt=0.24 train_steps=3.01 +ep40 val_rmse=1.58216 val_adapt_rmse=1.15681 adapt_steps=2.60 halt=0.34 train_steps=2.19 +ep50 val_rmse=1.32595 val_adapt_rmse=1.11669 adapt_steps=3.81 halt=0.24 train_steps=2.77 +ep60 val_rmse=1.68484 val_adapt_rmse=1.33655 adapt_steps=2.79 halt=0.38 train_steps=2.03 +ep70 val_rmse=1.46531 val_adapt_rmse=1.02634 adapt_steps=2.50 halt=0.36 train_steps=2.18 +ep80 val_rmse=1.21621 val_adapt_rmse=0.92526 adapt_steps=2.48 halt=0.40 train_steps=1.95 +ep90 val_rmse=1.15871 val_adapt_rmse=0.92033 adapt_steps=2.41 halt=0.43 train_steps=1.76 +ep100 val_rmse=1.19358 val_adapt_rmse=0.92401 adapt_steps=2.24 halt=0.44 train_steps=1.82 +[ogbg-molesol_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rmse': np.float32(1.1587086)} test={'rmse': np.float32(1.3228503)} adaptive={'rmse': np.float32(0.9323515)} steps=2.398230088495575 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molesol view=gatv2 compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view gatv2 --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=1.71115 val_adapt_rmse=1.59292 adapt_steps=5.16 halt=0.19 train_steps=3.79 +ep20 val_rmse=2.04041 val_adapt_rmse=1.48254 adapt_steps=3.27 halt=0.19 train_steps=3.61 +ep30 val_rmse=2.19314 val_adapt_rmse=1.41846 adapt_steps=2.98 halt=0.26 train_steps=3.01 +ep40 val_rmse=1.26104 val_adapt_rmse=1.11810 adapt_steps=2.53 halt=0.31 train_steps=2.64 +ep50 val_rmse=1.35004 val_adapt_rmse=1.06584 adapt_steps=3.13 halt=0.32 train_steps=2.50 +ep60 val_rmse=1.14151 val_adapt_rmse=0.91810 adapt_steps=2.64 halt=0.39 train_steps=2.00 +ep70 val_rmse=1.08552 val_adapt_rmse=0.98888 adapt_steps=3.42 halt=0.35 train_steps=2.30 +ep80 val_rmse=1.01822 val_adapt_rmse=0.95246 adapt_steps=2.61 halt=0.44 train_steps=1.82 +ep90 val_rmse=0.98423 val_adapt_rmse=0.94151 adapt_steps=2.59 halt=0.44 train_steps=1.75 +ep100 val_rmse=1.02002 val_adapt_rmse=0.97264 adapt_steps=2.60 halt=0.46 train_steps=1.75 +[ogbg-molesol_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rmse': np.float32(0.9842344)} test={'rmse': np.float32(0.95342916)} adaptive={'rmse': np.float32(0.88059396)} steps=2.4867256637168142 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molesol view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=3.24691 val_adapt_rmse=3.06485 adapt_steps=5.43 halt=0.16 train_steps=4.14 +ep20 val_rmse=2.19544 val_adapt_rmse=1.92386 adapt_steps=4.11 halt=0.22 train_steps=3.14 +ep30 val_rmse=1.85038 val_adapt_rmse=1.84516 adapt_steps=5.91 halt=0.20 train_steps=3.80 +ep40 val_rmse=1.80320 val_adapt_rmse=1.53707 adapt_steps=4.28 halt=0.24 train_steps=3.32 +ep50 val_rmse=1.61943 val_adapt_rmse=1.16471 adapt_steps=4.05 halt=0.34 train_steps=2.62 +ep60 val_rmse=1.38128 val_adapt_rmse=1.12648 adapt_steps=4.63 halt=0.30 train_steps=2.80 +ep70 val_rmse=1.15362 val_adapt_rmse=0.98844 adapt_steps=2.86 halt=0.38 train_steps=2.03 +ep80 val_rmse=1.14805 val_adapt_rmse=1.00274 adapt_steps=3.15 halt=0.43 train_steps=1.82 +ep90 val_rmse=1.14935 val_adapt_rmse=1.02412 adapt_steps=3.17 halt=0.42 train_steps=1.87 +ep100 val_rmse=1.15233 val_adapt_rmse=1.03384 adapt_steps=3.10 halt=0.43 train_steps=1.84 +[ogbg-molesol_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rmse': np.float32(1.148049)} test={'rmse': np.float32(1.2080547)} adaptive={'rmse': np.float32(1.0046481)} steps=2.743362831858407 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molesol view=transformer compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view transformer --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=1.80556 val_adapt_rmse=1.57940 adapt_steps=5.16 halt=0.21 train_steps=3.72 +ep20 val_rmse=2.04585 val_adapt_rmse=1.53384 adapt_steps=4.59 halt=0.19 train_steps=3.46 +ep30 val_rmse=2.20692 val_adapt_rmse=1.76335 adapt_steps=2.60 halt=0.24 train_steps=3.17 +ep40 val_rmse=1.06643 val_adapt_rmse=1.01122 adapt_steps=2.19 halt=0.37 train_steps=2.20 +ep50 val_rmse=1.26673 val_adapt_rmse=1.02385 adapt_steps=2.27 halt=0.35 train_steps=2.07 +ep60 val_rmse=1.27758 val_adapt_rmse=1.04181 adapt_steps=2.62 halt=0.34 train_steps=2.26 +ep70 val_rmse=1.27827 val_adapt_rmse=1.01072 adapt_steps=2.54 halt=0.36 train_steps=2.05 +ep80 val_rmse=1.20543 val_adapt_rmse=1.03738 adapt_steps=2.62 halt=0.41 train_steps=1.93 +ep90 val_rmse=1.26838 val_adapt_rmse=1.02284 adapt_steps=2.44 halt=0.44 train_steps=1.75 +ep100 val_rmse=1.23701 val_adapt_rmse=1.02901 adapt_steps=2.45 halt=0.44 train_steps=1.76 +[ogbg-molesol_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=40 val={'rmse': np.float32(1.0664288)} test={'rmse': np.float32(0.95339394)} adaptive={'rmse': np.float32(0.8505217)} steps=2.2831858407079646 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molesol view=pna compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view pna --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rmse=2.43831 val_adapt_rmse=2.32531 adapt_steps=5.19 halt=0.16 train_steps=4.00 +ep20 val_rmse=2.56767 val_adapt_rmse=1.59439 adapt_steps=3.97 halt=0.17 train_steps=3.98 +ep30 val_rmse=1.46321 val_adapt_rmse=1.22048 adapt_steps=3.73 halt=0.24 train_steps=3.12 +ep40 val_rmse=1.91382 val_adapt_rmse=1.86215 adapt_steps=3.05 halt=0.22 train_steps=3.11 +ep50 val_rmse=1.55782 val_adapt_rmse=1.32158 adapt_steps=2.92 halt=0.32 train_steps=2.34 +ep60 val_rmse=1.68320 val_adapt_rmse=1.18630 adapt_steps=2.27 halt=0.35 train_steps=2.29 +ep70 val_rmse=1.38794 val_adapt_rmse=1.15712 adapt_steps=2.46 halt=0.33 train_steps=2.29 +ep80 val_rmse=1.28100 val_adapt_rmse=1.02706 adapt_steps=2.46 halt=0.35 train_steps=2.23 +ep90 val_rmse=1.47195 val_adapt_rmse=1.10808 adapt_steps=2.43 halt=0.35 train_steps=2.19 +ep100 val_rmse=1.45332 val_adapt_rmse=1.10590 adapt_steps=2.44 halt=0.35 train_steps=2.21 +[ogbg-molesol_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rmse': np.float32(1.2809987)} test={'rmse': np.float32(1.4175682)} adaptive={'rmse': np.float32(0.98294556)} steps=2.601769911504425 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molesol view=gen compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view gen --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=1.68554 val_adapt_rmse=1.40872 adapt_steps=4.66 halt=0.17 train_steps=4.16 +ep20 val_rmse=1.78903 val_adapt_rmse=1.34417 adapt_steps=3.88 halt=0.27 train_steps=2.88 +ep30 val_rmse=1.43062 val_adapt_rmse=1.26301 adapt_steps=2.82 halt=0.29 train_steps=2.68 +ep40 val_rmse=1.26387 val_adapt_rmse=1.08550 adapt_steps=2.36 halt=0.32 train_steps=2.40 +ep50 val_rmse=1.43121 val_adapt_rmse=1.00136 adapt_steps=2.40 halt=0.32 train_steps=2.47 +ep60 val_rmse=1.16224 val_adapt_rmse=1.00159 adapt_steps=2.69 halt=0.32 train_steps=2.49 +ep70 val_rmse=1.36256 val_adapt_rmse=1.13936 adapt_steps=2.18 halt=0.39 train_steps=2.13 +ep80 val_rmse=1.19902 val_adapt_rmse=0.99500 adapt_steps=2.50 halt=0.39 train_steps=1.97 +ep90 val_rmse=1.19996 val_adapt_rmse=1.00030 adapt_steps=2.23 halt=0.41 train_steps=1.93 +ep100 val_rmse=1.16268 val_adapt_rmse=0.98398 adapt_steps=2.26 halt=0.40 train_steps=2.02 +[ogbg-molesol_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rmse': np.float32(1.1622369)} test={'rmse': np.float32(1.4459299)} adaptive={'rmse': np.float32(1.0918992)} steps=2.6106194690265485 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molesol view=film compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view film --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=2.15953 val_adapt_rmse=1.69788 adapt_steps=5.27 halt=0.13 train_steps=4.40 +ep20 val_rmse=1.76413 val_adapt_rmse=1.78195 adapt_steps=5.78 halt=0.17 train_steps=4.04 +ep30 val_rmse=1.71072 val_adapt_rmse=1.54898 adapt_steps=4.97 halt=0.15 train_steps=3.94 +ep40 val_rmse=1.73032 val_adapt_rmse=1.23604 adapt_steps=4.69 halt=0.19 train_steps=3.30 +ep50 val_rmse=1.80233 val_adapt_rmse=1.54453 adapt_steps=4.03 halt=0.23 train_steps=3.17 +ep60 val_rmse=2.03690 val_adapt_rmse=1.28646 adapt_steps=3.64 halt=0.22 train_steps=3.11 +ep70 val_rmse=1.81923 val_adapt_rmse=1.44603 adapt_steps=4.35 halt=0.20 train_steps=3.30 +ep80 val_rmse=1.36738 val_adapt_rmse=1.27507 adapt_steps=4.00 halt=0.28 train_steps=2.75 +ep90 val_rmse=1.47914 val_adapt_rmse=1.26687 adapt_steps=3.88 halt=0.27 train_steps=2.67 +ep100 val_rmse=1.56815 val_adapt_rmse=1.29753 adapt_steps=3.90 halt=0.28 train_steps=2.80 +[ogbg-molesol_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rmse': np.float32(1.3673769)} test={'rmse': np.float32(1.364793)} adaptive={'rmse': np.float32(1.12864)} steps=3.6106194690265485 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molesol view=resgated compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view resgated --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=2.01199 val_adapt_rmse=1.99778 adapt_steps=6.58 halt=0.17 train_steps=4.21 +ep20 val_rmse=2.81354 val_adapt_rmse=1.57554 adapt_steps=3.77 halt=0.24 train_steps=3.39 +ep30 val_rmse=2.27715 val_adapt_rmse=1.78467 adapt_steps=2.41 halt=0.31 train_steps=2.96 +ep40 val_rmse=2.06149 val_adapt_rmse=1.59902 adapt_steps=4.17 halt=0.25 train_steps=2.81 +ep50 val_rmse=1.25669 val_adapt_rmse=1.02207 adapt_steps=3.41 halt=0.33 train_steps=2.60 +ep60 val_rmse=1.24545 val_adapt_rmse=1.02109 adapt_steps=3.96 halt=0.38 train_steps=2.21 +ep70 val_rmse=1.11263 val_adapt_rmse=0.97278 adapt_steps=2.63 halt=0.47 train_steps=1.62 +ep80 val_rmse=1.21134 val_adapt_rmse=1.06008 adapt_steps=3.45 halt=0.41 train_steps=1.89 +ep90 val_rmse=1.09389 val_adapt_rmse=0.97993 adapt_steps=3.27 halt=0.41 train_steps=1.90 +ep100 val_rmse=1.14293 val_adapt_rmse=1.00867 adapt_steps=3.06 halt=0.44 train_steps=1.83 +[ogbg-molesol_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rmse': np.float32(1.0938909)} test={'rmse': np.float32(1.0833443)} adaptive={'rmse': np.float32(0.9181242)} steps=3.230088495575221 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molesol view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=3.47158 val_adapt_rmse=2.85814 adapt_steps=6.48 halt=0.15 train_steps=4.28 +ep20 val_rmse=2.59229 val_adapt_rmse=2.29301 adapt_steps=4.50 halt=0.19 train_steps=3.54 +ep30 val_rmse=1.38104 val_adapt_rmse=1.23529 adapt_steps=3.79 halt=0.17 train_steps=4.02 +ep40 val_rmse=1.62549 val_adapt_rmse=1.31054 adapt_steps=3.39 halt=0.24 train_steps=3.04 +ep50 val_rmse=1.17882 val_adapt_rmse=1.00373 adapt_steps=3.59 halt=0.26 train_steps=2.89 +ep60 val_rmse=1.11478 val_adapt_rmse=1.01010 adapt_steps=2.65 halt=0.36 train_steps=2.17 +ep70 val_rmse=1.21310 val_adapt_rmse=1.04888 adapt_steps=2.49 halt=0.35 train_steps=2.14 +ep80 val_rmse=1.13492 val_adapt_rmse=1.00575 adapt_steps=2.39 halt=0.40 train_steps=1.92 +ep90 val_rmse=1.10848 val_adapt_rmse=0.98178 adapt_steps=2.41 halt=0.39 train_steps=1.99 +ep100 val_rmse=1.08712 val_adapt_rmse=0.96400 adapt_steps=2.39 halt=0.44 train_steps=1.82 +[ogbg-molesol_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rmse': np.float32(1.087122)} test={'rmse': np.float32(1.2508167)} adaptive={'rmse': np.float32(1.0189501)} steps=2.353982300884956 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molesol view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=2.13452 val_adapt_rmse=1.54890 adapt_steps=4.80 halt=0.18 train_steps=4.20 +ep20 val_rmse=1.80887 val_adapt_rmse=1.55135 adapt_steps=4.19 halt=0.20 train_steps=3.79 +ep30 val_rmse=1.56727 val_adapt_rmse=1.38135 adapt_steps=3.77 halt=0.28 train_steps=3.18 +ep40 val_rmse=1.44096 val_adapt_rmse=1.19056 adapt_steps=5.21 halt=0.21 train_steps=3.29 +ep50 val_rmse=1.27696 val_adapt_rmse=1.20518 adapt_steps=2.98 halt=0.28 train_steps=2.83 +ep60 val_rmse=1.03453 val_adapt_rmse=1.03118 adapt_steps=3.41 halt=0.29 train_steps=2.72 +ep70 val_rmse=1.36152 val_adapt_rmse=1.19328 adapt_steps=2.70 halt=0.37 train_steps=2.20 +ep80 val_rmse=1.10044 val_adapt_rmse=1.00095 adapt_steps=2.53 halt=0.41 train_steps=1.89 +ep90 val_rmse=1.09772 val_adapt_rmse=1.00221 adapt_steps=2.59 halt=0.43 train_steps=1.80 +ep100 val_rmse=1.08154 val_adapt_rmse=1.01459 adapt_steps=2.57 halt=0.42 train_steps=1.90 +[ogbg-molesol_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rmse': np.float32(1.0345254)} test={'rmse': np.float32(1.0465622)} adaptive={'rmse': np.float32(0.97806746)} steps=3.2831858407079646 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molesol view=cheb compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view cheb --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=1.61304 val_adapt_rmse=1.41832 adapt_steps=3.95 halt=0.23 train_steps=3.80 +ep20 val_rmse=2.75789 val_adapt_rmse=2.14843 adapt_steps=3.42 halt=0.25 train_steps=3.13 +ep30 val_rmse=1.83964 val_adapt_rmse=1.52535 adapt_steps=3.04 halt=0.22 train_steps=3.33 +ep40 val_rmse=1.78527 val_adapt_rmse=1.47363 adapt_steps=2.77 halt=0.34 train_steps=2.29 +ep50 val_rmse=1.79619 val_adapt_rmse=1.39923 adapt_steps=2.56 halt=0.46 train_steps=1.75 +ep60 val_rmse=1.55892 val_adapt_rmse=1.29826 adapt_steps=2.79 halt=0.40 train_steps=2.14 +ep70 val_rmse=1.21742 val_adapt_rmse=1.01859 adapt_steps=2.35 halt=0.43 train_steps=1.82 +ep80 val_rmse=1.06434 val_adapt_rmse=0.91884 adapt_steps=2.42 halt=0.44 train_steps=1.73 +ep90 val_rmse=1.08489 val_adapt_rmse=0.95548 adapt_steps=2.42 halt=0.46 train_steps=1.66 +ep100 val_rmse=1.08888 val_adapt_rmse=0.95485 adapt_steps=2.50 halt=0.46 train_steps=1.74 +[ogbg-molesol_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rmse': np.float32(1.0643402)} test={'rmse': np.float32(1.034204)} adaptive={'rmse': np.float32(0.8497807)} steps=2.601769911504425 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molesol view=arma compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view arma --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=4.56663 val_adapt_rmse=3.60617 adapt_steps=2.74 halt=0.19 train_steps=3.89 +ep20 val_rmse=1.79390 val_adapt_rmse=1.59002 adapt_steps=3.36 halt=0.18 train_steps=3.97 +ep30 val_rmse=2.24326 val_adapt_rmse=1.60470 adapt_steps=3.49 halt=0.18 train_steps=3.64 +ep40 val_rmse=1.96715 val_adapt_rmse=1.62786 adapt_steps=2.96 halt=0.23 train_steps=3.09 +ep50 val_rmse=1.30996 val_adapt_rmse=1.07779 adapt_steps=2.49 halt=0.31 train_steps=2.61 +ep60 val_rmse=1.59369 val_adapt_rmse=1.15346 adapt_steps=2.60 halt=0.31 train_steps=2.58 +ep70 val_rmse=1.33600 val_adapt_rmse=1.06852 adapt_steps=2.23 halt=0.39 train_steps=2.12 +ep80 val_rmse=1.51381 val_adapt_rmse=1.08174 adapt_steps=2.51 halt=0.36 train_steps=2.25 +ep90 val_rmse=1.57786 val_adapt_rmse=1.05584 adapt_steps=2.32 halt=0.37 train_steps=2.15 +ep100 val_rmse=1.51730 val_adapt_rmse=1.01467 adapt_steps=2.27 halt=0.39 train_steps=2.00 +[ogbg-molesol_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=50 val={'rmse': np.float32(1.3099641)} test={'rmse': np.float32(1.5309947)} adaptive={'rmse': np.float32(1.0385827)} steps=2.575221238938053 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molesol view=mf compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view mf --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=3.91043 val_adapt_rmse=3.93609 adapt_steps=7.12 halt=0.15 train_steps=4.32 +ep20 val_rmse=1.56765 val_adapt_rmse=1.40924 adapt_steps=3.93 halt=0.21 train_steps=3.97 +ep30 val_rmse=2.21943 val_adapt_rmse=1.92857 adapt_steps=4.80 halt=0.21 train_steps=3.70 +ep40 val_rmse=1.34838 val_adapt_rmse=1.13183 adapt_steps=2.79 halt=0.24 train_steps=2.98 +ep50 val_rmse=2.04182 val_adapt_rmse=1.18497 adapt_steps=3.55 halt=0.32 train_steps=2.48 +ep60 val_rmse=1.07650 val_adapt_rmse=1.06298 adapt_steps=3.69 halt=0.38 train_steps=2.00 +ep70 val_rmse=1.17131 val_adapt_rmse=1.05686 adapt_steps=3.22 halt=0.40 train_steps=2.01 +ep80 val_rmse=1.16899 val_adapt_rmse=1.03185 adapt_steps=4.14 halt=0.37 train_steps=2.18 +ep90 val_rmse=1.09374 val_adapt_rmse=1.03779 adapt_steps=3.41 halt=0.41 train_steps=1.92 +ep100 val_rmse=1.13886 val_adapt_rmse=1.05515 adapt_steps=3.32 halt=0.42 train_steps=1.92 +[ogbg-molesol_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rmse': np.float32(1.0765038)} test={'rmse': np.float32(1.0843762)} adaptive={'rmse': np.float32(0.95887977)} steps=3.4070796460176993 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molesol view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=5.21048 val_adapt_rmse=2.38789 adapt_steps=5.34 halt=0.15 train_steps=4.20 +ep20 val_rmse=2.82679 val_adapt_rmse=2.25175 adapt_steps=6.12 halt=0.18 train_steps=3.93 +ep30 val_rmse=1.68909 val_adapt_rmse=1.41500 adapt_steps=4.84 halt=0.19 train_steps=3.72 +ep40 val_rmse=2.08134 val_adapt_rmse=1.83294 adapt_steps=4.53 halt=0.20 train_steps=3.51 +ep50 val_rmse=1.95089 val_adapt_rmse=1.48969 adapt_steps=3.67 halt=0.26 train_steps=2.94 +ep60 val_rmse=1.80235 val_adapt_rmse=1.37428 adapt_steps=3.46 halt=0.33 train_steps=2.30 +ep70 val_rmse=1.62703 val_adapt_rmse=1.25301 adapt_steps=2.74 halt=0.42 train_steps=1.88 +ep80 val_rmse=1.70083 val_adapt_rmse=1.27133 adapt_steps=2.71 halt=0.39 train_steps=2.06 +ep90 val_rmse=1.71529 val_adapt_rmse=1.30814 adapt_steps=2.67 halt=0.40 train_steps=1.94 +ep100 val_rmse=1.69038 val_adapt_rmse=1.31634 adapt_steps=2.68 halt=0.40 train_steps=1.95 +[ogbg-molesol_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rmse': np.float32(1.6270279)} test={'rmse': np.float32(1.2973164)} adaptive={'rmse': np.float32(1.0733075)} steps=2.814159292035398 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molesol_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json diff --git a/logs/ogbg-molfreesolv_0.log b/logs/ogbg-molfreesolv_0.log new file mode 100644 index 0000000..d163fe6 --- /dev/null +++ b/logs/ogbg-molfreesolv_0.log @@ -0,0 +1,791 @@ +[run] ogbg-molfreesolv view=gin compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view gin --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/freesolv.zip +
0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 10407.70it/s] +Processing... +Extracting /orion/u/oscarwan/rrog-gnn-runner/data/ogb/freesolv.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/642 [00:00<?, ?it/s]
100%|██████████| 642/642 [00:00<00:00, 168802.86it/s] +Converting graphs into PyG objects... +
0%| | 0/642 [00:00<?, ?it/s]
100%|██████████| 642/642 [00:00<00:00, 94320.05it/s] +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/ogb/graphproppred/dataset_pyg.py:158: UserWarning: The given NumPy array is not writable, and PyTorch does not support non-writable tensors. This means writing to this tensor will result in undefined behavior. You may want to copy the array to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at /pytorch/torch/csrc/utils/tensor_numpy.cpp:203.) + g.y = torch.from_numpy(graph_label[i]).view(1,-1).to(torch.float32) +Done! +Saving... +ep10 val_rmse=4.92044 halt=0.00 train_steps=1.00 +ep20 val_rmse=4.21001 halt=0.00 train_steps=1.00 +ep30 val_rmse=5.88032 halt=0.00 train_steps=1.00 +ep40 val_rmse=4.01899 halt=0.00 train_steps=1.00 +ep50 val_rmse=4.83673 halt=0.00 train_steps=1.00 +ep60 val_rmse=4.75203 halt=0.00 train_steps=1.00 +ep70 val_rmse=4.81207 halt=0.00 train_steps=1.00 +ep80 val_rmse=4.62906 halt=0.00 train_steps=1.00 +ep90 val_rmse=4.50698 halt=0.00 train_steps=1.00 +ep100 val_rmse=4.52164 halt=0.00 train_steps=1.00 +[ogbg-molfreesolv_gin_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rmse': np.float32(4.018989)} test={'rmse': np.float32(3.4898324)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_gin_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molfreesolv view=gin compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view gin --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=5.69277 halt=0.00 train_steps=3.00 +ep20 val_rmse=4.87275 halt=0.00 train_steps=3.00 +ep30 val_rmse=4.67094 halt=0.00 train_steps=3.00 +ep40 val_rmse=4.24027 halt=0.00 train_steps=3.00 +ep50 val_rmse=4.51482 halt=0.00 train_steps=3.00 +ep60 val_rmse=4.30742 halt=0.00 train_steps=3.00 +ep70 val_rmse=3.98909 halt=0.00 train_steps=3.00 +ep80 val_rmse=3.97428 halt=0.00 train_steps=3.00 +ep90 val_rmse=4.05014 halt=0.00 train_steps=3.00 +ep100 val_rmse=4.03284 halt=0.00 train_steps=3.00 +[ogbg-molfreesolv_gin_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=80 val={'rmse': np.float32(3.974279)} test={'rmse': np.float32(3.4291606)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_gin_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molfreesolv view=gine compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view gine --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=4.86551 halt=0.00 train_steps=1.00 +ep20 val_rmse=4.32178 halt=0.00 train_steps=1.00 +ep30 val_rmse=3.57485 halt=0.00 train_steps=1.00 +ep40 val_rmse=4.90044 halt=0.00 train_steps=1.00 +ep50 val_rmse=3.29792 halt=0.00 train_steps=1.00 +ep60 val_rmse=3.68413 halt=0.00 train_steps=1.00 +ep70 val_rmse=3.29607 halt=0.00 train_steps=1.00 +ep80 val_rmse=3.49131 halt=0.00 train_steps=1.00 +ep90 val_rmse=3.40593 halt=0.00 train_steps=1.00 +ep100 val_rmse=3.33543 halt=0.00 train_steps=1.00 +[ogbg-molfreesolv_gine_classic_T0_ns1_h128_e100_s0] best_ep=70 val={'rmse': np.float32(3.2960742)} test={'rmse': np.float32(3.1442)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_gine_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molfreesolv view=gine compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view gine --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=5.02814 halt=0.00 train_steps=3.00 +ep20 val_rmse=4.68627 halt=0.00 train_steps=3.00 +ep30 val_rmse=5.03131 halt=0.00 train_steps=3.00 +ep40 val_rmse=4.77823 halt=0.00 train_steps=3.00 +ep50 val_rmse=4.73792 halt=0.00 train_steps=3.00 +ep60 val_rmse=4.50008 halt=0.00 train_steps=3.00 +ep70 val_rmse=4.52713 halt=0.00 train_steps=3.00 +ep80 val_rmse=4.49676 halt=0.00 train_steps=3.00 +ep90 val_rmse=4.45230 halt=0.00 train_steps=3.00 +ep100 val_rmse=4.44683 halt=0.00 train_steps=3.00 +[ogbg-molfreesolv_gine_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=100 val={'rmse': np.float32(4.446826)} test={'rmse': np.float32(3.7405443)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_gine_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molfreesolv view=gcn compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view gcn --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=4.71523 halt=0.00 train_steps=1.00 +ep20 val_rmse=4.07630 halt=0.00 train_steps=1.00 +ep30 val_rmse=3.90654 halt=0.00 train_steps=1.00 +ep40 val_rmse=3.85416 halt=0.00 train_steps=1.00 +ep50 val_rmse=3.90803 halt=0.00 train_steps=1.00 +ep60 val_rmse=3.77325 halt=0.00 train_steps=1.00 +ep70 val_rmse=3.76295 halt=0.00 train_steps=1.00 +ep80 val_rmse=3.72133 halt=0.00 train_steps=1.00 +ep90 val_rmse=3.71725 halt=0.00 train_steps=1.00 +ep100 val_rmse=3.71896 halt=0.00 train_steps=1.00 +[ogbg-molfreesolv_gcn_classic_T0_ns1_h128_e100_s0] best_ep=90 val={'rmse': np.float32(3.717249)} test={'rmse': np.float32(2.4850736)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_gcn_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molfreesolv view=gcn compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view gcn --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=4.78492 halt=0.00 train_steps=3.00 +ep20 val_rmse=4.13954 halt=0.00 train_steps=3.00 +ep30 val_rmse=4.05433 halt=0.00 train_steps=3.00 +ep40 val_rmse=3.93636 halt=0.00 train_steps=3.00 +ep50 val_rmse=3.93483 halt=0.00 train_steps=3.00 +ep60 val_rmse=3.64456 halt=0.00 train_steps=3.00 +ep70 val_rmse=3.58876 halt=0.00 train_steps=3.00 +ep80 val_rmse=3.59718 halt=0.00 train_steps=3.00 +ep90 val_rmse=3.62452 halt=0.00 train_steps=3.00 +ep100 val_rmse=3.62109 halt=0.00 train_steps=3.00 +[ogbg-molfreesolv_gcn_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=70 val={'rmse': np.float32(3.5887632)} test={'rmse': np.float32(2.4443517)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molfreesolv view=graphsage compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view graphsage --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=4.72648 halt=0.00 train_steps=1.00 +ep20 val_rmse=3.88867 halt=0.00 train_steps=1.00 +ep30 val_rmse=3.71380 halt=0.00 train_steps=1.00 +ep40 val_rmse=3.60818 halt=0.00 train_steps=1.00 +ep50 val_rmse=3.51239 halt=0.00 train_steps=1.00 +ep60 val_rmse=3.62984 halt=0.00 train_steps=1.00 +ep70 val_rmse=3.52360 halt=0.00 train_steps=1.00 +ep80 val_rmse=3.50222 halt=0.00 train_steps=1.00 +ep90 val_rmse=3.54229 halt=0.00 train_steps=1.00 +ep100 val_rmse=3.54700 halt=0.00 train_steps=1.00 +[ogbg-molfreesolv_graphsage_classic_T0_ns1_h128_e100_s0] best_ep=80 val={'rmse': np.float32(3.5022244)} test={'rmse': np.float32(2.2976508)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_graphsage_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molfreesolv view=graphsage compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view graphsage --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=4.71051 halt=0.00 train_steps=3.00 +ep20 val_rmse=3.91339 halt=0.00 train_steps=3.00 +ep30 val_rmse=3.73800 halt=0.00 train_steps=3.00 +ep40 val_rmse=3.80182 halt=0.00 train_steps=3.00 +ep50 val_rmse=3.99368 halt=0.00 train_steps=3.00 +ep60 val_rmse=3.94183 halt=0.00 train_steps=3.00 +ep70 val_rmse=3.87635 halt=0.00 train_steps=3.00 +ep80 val_rmse=3.87881 halt=0.00 train_steps=3.00 +ep90 val_rmse=3.84911 halt=0.00 train_steps=3.00 +ep100 val_rmse=3.87383 halt=0.00 train_steps=3.00 +[ogbg-molfreesolv_graphsage_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rmse': np.float32(3.7380002)} test={'rmse': np.float32(2.1930819)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molfreesolv view=gatv2 compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view gatv2 --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=5.95246 halt=0.00 train_steps=1.00 +ep20 val_rmse=4.44878 halt=0.00 train_steps=1.00 +ep30 val_rmse=4.50800 halt=0.00 train_steps=1.00 +ep40 val_rmse=4.24659 halt=0.00 train_steps=1.00 +ep50 val_rmse=4.22831 halt=0.00 train_steps=1.00 +ep60 val_rmse=4.35569 halt=0.00 train_steps=1.00 +ep70 val_rmse=4.24215 halt=0.00 train_steps=1.00 +ep80 val_rmse=4.26319 halt=0.00 train_steps=1.00 +ep90 val_rmse=4.20864 halt=0.00 train_steps=1.00 +ep100 val_rmse=4.21115 halt=0.00 train_steps=1.00 +[ogbg-molfreesolv_gatv2_classic_T0_ns1_h128_e100_s0] best_ep=90 val={'rmse': np.float32(4.208639)} test={'rmse': np.float32(2.7368205)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_gatv2_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molfreesolv view=gatv2 compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view gatv2 --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=5.94490 halt=0.00 train_steps=3.00 +ep20 val_rmse=4.65428 halt=0.00 train_steps=3.00 +ep30 val_rmse=4.29749 halt=0.00 train_steps=3.00 +ep40 val_rmse=4.12340 halt=0.00 train_steps=3.00 +ep50 val_rmse=4.25488 halt=0.00 train_steps=3.00 +ep60 val_rmse=4.06765 halt=0.00 train_steps=3.00 +ep70 val_rmse=4.09304 halt=0.00 train_steps=3.00 +ep80 val_rmse=4.01331 halt=0.00 train_steps=3.00 +ep90 val_rmse=4.00158 halt=0.00 train_steps=3.00 +ep100 val_rmse=3.99838 halt=0.00 train_steps=3.00 +[ogbg-molfreesolv_gatv2_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=100 val={'rmse': np.float32(3.998377)} test={'rmse': np.float32(2.5965567)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molfreesolv view=graphconv compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view graphconv --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=3.07331 halt=0.00 train_steps=1.00 +ep20 val_rmse=2.53140 halt=0.00 train_steps=1.00 +ep30 val_rmse=2.55559 halt=0.00 train_steps=1.00 +ep40 val_rmse=2.62623 halt=0.00 train_steps=1.00 +ep50 val_rmse=3.25355 halt=0.00 train_steps=1.00 +ep60 val_rmse=2.74169 halt=0.00 train_steps=1.00 +ep70 val_rmse=2.84224 halt=0.00 train_steps=1.00 +ep80 val_rmse=2.78214 halt=0.00 train_steps=1.00 +ep90 val_rmse=2.72548 halt=0.00 train_steps=1.00 +ep100 val_rmse=2.73173 halt=0.00 train_steps=1.00 +[ogbg-molfreesolv_graphconv_classic_T0_ns1_h128_e100_s0] best_ep=20 val={'rmse': np.float32(2.5313969)} test={'rmse': np.float32(2.795284)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_graphconv_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molfreesolv view=graphconv compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view graphconv --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=3.21212 halt=0.00 train_steps=3.00 +ep20 val_rmse=2.99255 halt=0.00 train_steps=3.00 +ep30 val_rmse=3.08147 halt=0.00 train_steps=3.00 +ep40 val_rmse=2.91062 halt=0.00 train_steps=3.00 +ep50 val_rmse=3.21417 halt=0.00 train_steps=3.00 +ep60 val_rmse=3.16880 halt=0.00 train_steps=3.00 +ep70 val_rmse=3.02580 halt=0.00 train_steps=3.00 +ep80 val_rmse=2.93491 halt=0.00 train_steps=3.00 +ep90 val_rmse=2.99295 halt=0.00 train_steps=3.00 +ep100 val_rmse=3.01130 halt=0.00 train_steps=3.00 +[ogbg-molfreesolv_graphconv_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rmse': np.float32(2.9106228)} test={'rmse': np.float32(3.1428812)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molfreesolv view=transformer compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view transformer --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=5.42232 halt=0.00 train_steps=1.00 +ep20 val_rmse=4.43692 halt=0.00 train_steps=1.00 +ep30 val_rmse=4.38100 halt=0.00 train_steps=1.00 +ep40 val_rmse=4.49382 halt=0.00 train_steps=1.00 +ep50 val_rmse=4.12729 halt=0.00 train_steps=1.00 +ep60 val_rmse=4.16616 halt=0.00 train_steps=1.00 +ep70 val_rmse=4.09424 halt=0.00 train_steps=1.00 +ep80 val_rmse=4.18276 halt=0.00 train_steps=1.00 +ep90 val_rmse=4.16477 halt=0.00 train_steps=1.00 +ep100 val_rmse=4.14398 halt=0.00 train_steps=1.00 +[ogbg-molfreesolv_transformer_classic_T0_ns1_h128_e100_s0] best_ep=70 val={'rmse': np.float32(4.0942407)} test={'rmse': np.float32(2.3205414)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_transformer_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molfreesolv view=transformer compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view transformer --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=5.63800 halt=0.00 train_steps=3.00 +ep20 val_rmse=4.57586 halt=0.00 train_steps=3.00 +ep30 val_rmse=4.90990 halt=0.00 train_steps=3.00 +ep40 val_rmse=4.67940 halt=0.00 train_steps=3.00 +ep50 val_rmse=4.52739 halt=0.00 train_steps=3.00 +ep60 val_rmse=4.41796 halt=0.00 train_steps=3.00 +ep70 val_rmse=4.51618 halt=0.00 train_steps=3.00 +ep80 val_rmse=4.42805 halt=0.00 train_steps=3.00 +ep90 val_rmse=4.42820 halt=0.00 train_steps=3.00 +ep100 val_rmse=4.42252 halt=0.00 train_steps=3.00 +[ogbg-molfreesolv_transformer_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=60 val={'rmse': np.float32(4.4179597)} test={'rmse': np.float32(2.4325464)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molfreesolv view=pna compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view pna --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rmse=7.08726 halt=0.00 train_steps=1.00 +ep20 val_rmse=2.42038 halt=0.00 train_steps=1.00 +ep30 val_rmse=2.47916 halt=0.00 train_steps=1.00 +ep40 val_rmse=2.36253 halt=0.00 train_steps=1.00 +ep50 val_rmse=2.72878 halt=0.00 train_steps=1.00 +ep60 val_rmse=2.68118 halt=0.00 train_steps=1.00 +ep70 val_rmse=2.76569 halt=0.00 train_steps=1.00 +ep80 val_rmse=2.72183 halt=0.00 train_steps=1.00 +ep90 val_rmse=2.67237 halt=0.00 train_steps=1.00 +ep100 val_rmse=2.63575 halt=0.00 train_steps=1.00 +[ogbg-molfreesolv_pna_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rmse': np.float32(2.3625338)} test={'rmse': np.float32(2.2610388)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_pna_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molfreesolv view=pna compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view pna --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rmse=6.07708 halt=0.00 train_steps=3.00 +ep20 val_rmse=3.50565 halt=0.00 train_steps=3.00 +ep30 val_rmse=3.68059 halt=0.00 train_steps=3.00 +ep40 val_rmse=3.33337 halt=0.00 train_steps=3.00 +ep50 val_rmse=3.86831 halt=0.00 train_steps=3.00 +ep60 val_rmse=3.85257 halt=0.00 train_steps=3.00 +ep70 val_rmse=3.68717 halt=0.00 train_steps=3.00 +ep80 val_rmse=3.93787 halt=0.00 train_steps=3.00 +ep90 val_rmse=3.86548 halt=0.00 train_steps=3.00 +ep100 val_rmse=3.84458 halt=0.00 train_steps=3.00 +[ogbg-molfreesolv_pna_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rmse': np.float32(3.3333704)} test={'rmse': np.float32(2.4279492)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_pna_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molfreesolv view=gen compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view gen --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=5.69543 halt=0.00 train_steps=1.00 +ep20 val_rmse=4.55089 halt=0.00 train_steps=1.00 +ep30 val_rmse=4.35563 halt=0.00 train_steps=1.00 +ep40 val_rmse=3.99981 halt=0.00 train_steps=1.00 +ep50 val_rmse=4.18017 halt=0.00 train_steps=1.00 +ep60 val_rmse=4.07753 halt=0.00 train_steps=1.00 +ep70 val_rmse=4.06395 halt=0.00 train_steps=1.00 +ep80 val_rmse=4.04242 halt=0.00 train_steps=1.00 +ep90 val_rmse=4.02520 halt=0.00 train_steps=1.00 +ep100 val_rmse=4.02873 halt=0.00 train_steps=1.00 +[ogbg-molfreesolv_gen_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rmse': np.float32(3.9998085)} test={'rmse': np.float32(2.5587628)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_gen_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molfreesolv view=gen compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view gen --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=6.14156 halt=0.00 train_steps=3.00 +ep20 val_rmse=5.10186 halt=0.00 train_steps=3.00 +ep30 val_rmse=4.80566 halt=0.00 train_steps=3.00 +ep40 val_rmse=4.79767 halt=0.00 train_steps=3.00 +ep50 val_rmse=4.56064 halt=0.00 train_steps=3.00 +ep60 val_rmse=4.45480 halt=0.00 train_steps=3.00 +ep70 val_rmse=4.35459 halt=0.00 train_steps=3.00 +ep80 val_rmse=4.30087 halt=0.00 train_steps=3.00 +ep90 val_rmse=4.30667 halt=0.00 train_steps=3.00 +ep100 val_rmse=4.30497 halt=0.00 train_steps=3.00 +[ogbg-molfreesolv_gen_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=80 val={'rmse': np.float32(4.3008733)} test={'rmse': np.float32(2.906334)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_gen_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molfreesolv view=film compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view film --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=5.06705 halt=0.00 train_steps=1.00 +ep20 val_rmse=3.57658 halt=0.00 train_steps=1.00 +ep30 val_rmse=3.15460 halt=0.00 train_steps=1.00 +ep40 val_rmse=3.44054 halt=0.00 train_steps=1.00 +ep50 val_rmse=3.20349 halt=0.00 train_steps=1.00 +ep60 val_rmse=3.20162 halt=0.00 train_steps=1.00 +ep70 val_rmse=3.27482 halt=0.00 train_steps=1.00 +ep80 val_rmse=3.32754 halt=0.00 train_steps=1.00 +ep90 val_rmse=3.41237 halt=0.00 train_steps=1.00 +ep100 val_rmse=3.39052 halt=0.00 train_steps=1.00 +[ogbg-molfreesolv_film_classic_T0_ns1_h128_e100_s0] best_ep=30 val={'rmse': np.float32(3.1545956)} test={'rmse': np.float32(2.9581118)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_film_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molfreesolv view=film compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view film --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=5.46774 halt=0.00 train_steps=3.00 +ep20 val_rmse=3.29521 halt=0.00 train_steps=3.00 +ep30 val_rmse=3.57690 halt=0.00 train_steps=3.00 +ep40 val_rmse=3.82412 halt=0.00 train_steps=3.00 +ep50 val_rmse=3.59615 halt=0.00 train_steps=3.00 +ep60 val_rmse=3.63985 halt=0.00 train_steps=3.00 +ep70 val_rmse=3.70173 halt=0.00 train_steps=3.00 +ep80 val_rmse=3.75424 halt=0.00 train_steps=3.00 +ep90 val_rmse=3.67384 halt=0.00 train_steps=3.00 +ep100 val_rmse=3.68652 halt=0.00 train_steps=3.00 +[ogbg-molfreesolv_film_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=20 val={'rmse': np.float32(3.29521)} test={'rmse': np.float32(3.3041592)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_film_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molfreesolv view=resgated compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view resgated --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=3.78635 halt=0.00 train_steps=1.00 +ep20 val_rmse=2.73636 halt=0.00 train_steps=1.00 +ep30 val_rmse=2.50124 halt=0.00 train_steps=1.00 +ep40 val_rmse=2.88505 halt=0.00 train_steps=1.00 +ep50 val_rmse=2.47723 halt=0.00 train_steps=1.00 +ep60 val_rmse=2.71000 halt=0.00 train_steps=1.00 +ep70 val_rmse=2.55505 halt=0.00 train_steps=1.00 +ep80 val_rmse=2.65575 halt=0.00 train_steps=1.00 +ep90 val_rmse=2.60532 halt=0.00 train_steps=1.00 +ep100 val_rmse=2.59153 halt=0.00 train_steps=1.00 +[ogbg-molfreesolv_resgated_classic_T0_ns1_h128_e100_s0] best_ep=50 val={'rmse': np.float32(2.4772303)} test={'rmse': np.float32(2.0041325)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_resgated_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molfreesolv view=resgated compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view resgated --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=3.82155 halt=0.00 train_steps=3.00 +ep20 val_rmse=3.63399 halt=0.00 train_steps=3.00 +ep30 val_rmse=3.24781 halt=0.00 train_steps=3.00 +ep40 val_rmse=3.12599 halt=0.00 train_steps=3.00 +ep50 val_rmse=3.31301 halt=0.00 train_steps=3.00 +ep60 val_rmse=3.19715 halt=0.00 train_steps=3.00 +ep70 val_rmse=3.09199 halt=0.00 train_steps=3.00 +ep80 val_rmse=3.22759 halt=0.00 train_steps=3.00 +ep90 val_rmse=3.18645 halt=0.00 train_steps=3.00 +ep100 val_rmse=3.21453 halt=0.00 train_steps=3.00 +[ogbg-molfreesolv_resgated_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=70 val={'rmse': np.float32(3.0919929)} test={'rmse': np.float32(2.0244017)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molfreesolv view=tag compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view tag --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=3.85084 halt=0.00 train_steps=1.00 +ep20 val_rmse=2.68736 halt=0.00 train_steps=1.00 +ep30 val_rmse=2.99814 halt=0.00 train_steps=1.00 +ep40 val_rmse=2.75192 halt=0.00 train_steps=1.00 +ep50 val_rmse=3.09092 halt=0.00 train_steps=1.00 +ep60 val_rmse=2.86459 halt=0.00 train_steps=1.00 +ep70 val_rmse=2.91348 halt=0.00 train_steps=1.00 +ep80 val_rmse=2.90389 halt=0.00 train_steps=1.00 +ep90 val_rmse=2.91836 halt=0.00 train_steps=1.00 +ep100 val_rmse=2.87933 halt=0.00 train_steps=1.00 +[ogbg-molfreesolv_tag_classic_T0_ns1_h128_e100_s0] best_ep=20 val={'rmse': np.float32(2.687361)} test={'rmse': np.float32(2.3825674)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_tag_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molfreesolv view=tag compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view tag --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=4.28550 halt=0.00 train_steps=3.00 +ep20 val_rmse=3.20135 halt=0.00 train_steps=3.00 +ep30 val_rmse=2.91026 halt=0.00 train_steps=3.00 +ep40 val_rmse=2.91577 halt=0.00 train_steps=3.00 +ep50 val_rmse=3.09084 halt=0.00 train_steps=3.00 +ep60 val_rmse=2.92237 halt=0.00 train_steps=3.00 +ep70 val_rmse=2.73592 halt=0.00 train_steps=3.00 +ep80 val_rmse=2.80961 halt=0.00 train_steps=3.00 +ep90 val_rmse=2.85082 halt=0.00 train_steps=3.00 +ep100 val_rmse=2.81498 halt=0.00 train_steps=3.00 +[ogbg-molfreesolv_tag_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=70 val={'rmse': np.float32(2.73592)} test={'rmse': np.float32(2.0588315)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_tag_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molfreesolv view=sgc compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view sgc --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=4.97420 halt=0.00 train_steps=1.00 +ep20 val_rmse=4.20020 halt=0.00 train_steps=1.00 +ep30 val_rmse=4.29133 halt=0.00 train_steps=1.00 +ep40 val_rmse=4.60694 halt=0.00 train_steps=1.00 +ep50 val_rmse=3.91468 halt=0.00 train_steps=1.00 +ep60 val_rmse=4.04141 halt=0.00 train_steps=1.00 +ep70 val_rmse=4.17447 halt=0.00 train_steps=1.00 +ep80 val_rmse=3.99554 halt=0.00 train_steps=1.00 +ep90 val_rmse=3.97791 halt=0.00 train_steps=1.00 +ep100 val_rmse=3.97451 halt=0.00 train_steps=1.00 +[ogbg-molfreesolv_sgc_classic_T0_ns1_h128_e100_s0] best_ep=50 val={'rmse': np.float32(3.9146762)} test={'rmse': np.float32(2.4146173)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_sgc_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molfreesolv view=sgc compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view sgc --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=5.24142 halt=0.00 train_steps=3.00 +ep20 val_rmse=4.17618 halt=0.00 train_steps=3.00 +ep30 val_rmse=4.51520 halt=0.00 train_steps=3.00 +ep40 val_rmse=4.31196 halt=0.00 train_steps=3.00 +ep50 val_rmse=3.92612 halt=0.00 train_steps=3.00 +ep60 val_rmse=4.11906 halt=0.00 train_steps=3.00 +ep70 val_rmse=4.22515 halt=0.00 train_steps=3.00 +ep80 val_rmse=4.09939 halt=0.00 train_steps=3.00 +ep90 val_rmse=4.09924 halt=0.00 train_steps=3.00 +ep100 val_rmse=4.07970 halt=0.00 train_steps=3.00 +[ogbg-molfreesolv_sgc_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rmse': np.float32(3.92612)} test={'rmse': np.float32(2.4887)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molfreesolv view=cheb compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view cheb --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=3.18941 halt=0.00 train_steps=1.00 +ep20 val_rmse=3.06171 halt=0.00 train_steps=1.00 +ep30 val_rmse=3.24982 halt=0.00 train_steps=1.00 +ep40 val_rmse=2.97628 halt=0.00 train_steps=1.00 +ep50 val_rmse=2.94807 halt=0.00 train_steps=1.00 +ep60 val_rmse=3.08814 halt=0.00 train_steps=1.00 +ep70 val_rmse=3.12051 halt=0.00 train_steps=1.00 +ep80 val_rmse=3.12037 halt=0.00 train_steps=1.00 +ep90 val_rmse=3.09842 halt=0.00 train_steps=1.00 +ep100 val_rmse=3.09739 halt=0.00 train_steps=1.00 +[ogbg-molfreesolv_cheb_classic_T0_ns1_h128_e100_s0] best_ep=50 val={'rmse': np.float32(2.9480722)} test={'rmse': np.float32(2.2430642)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_cheb_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molfreesolv view=cheb compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view cheb --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=3.33920 halt=0.00 train_steps=3.00 +ep20 val_rmse=3.46261 halt=0.00 train_steps=3.00 +ep30 val_rmse=3.31249 halt=0.00 train_steps=3.00 +ep40 val_rmse=3.05654 halt=0.00 train_steps=3.00 +ep50 val_rmse=3.01424 halt=0.00 train_steps=3.00 +ep60 val_rmse=3.15586 halt=0.00 train_steps=3.00 +ep70 val_rmse=3.12835 halt=0.00 train_steps=3.00 +ep80 val_rmse=3.13340 halt=0.00 train_steps=3.00 +ep90 val_rmse=3.15037 halt=0.00 train_steps=3.00 +ep100 val_rmse=3.13037 halt=0.00 train_steps=3.00 +[ogbg-molfreesolv_cheb_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rmse': np.float32(3.0142417)} test={'rmse': np.float32(2.2398787)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molfreesolv view=arma compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view arma --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=6.27576 halt=0.00 train_steps=1.00 +ep20 val_rmse=6.02140 halt=0.00 train_steps=1.00 +ep30 val_rmse=4.90560 halt=0.00 train_steps=1.00 +ep40 val_rmse=4.39309 halt=0.00 train_steps=1.00 +ep50 val_rmse=4.27866 halt=0.00 train_steps=1.00 +ep60 val_rmse=4.26618 halt=0.00 train_steps=1.00 +ep70 val_rmse=4.60082 halt=0.00 train_steps=1.00 +ep80 val_rmse=4.52637 halt=0.00 train_steps=1.00 +ep90 val_rmse=4.54133 halt=0.00 train_steps=1.00 +ep100 val_rmse=4.52805 halt=0.00 train_steps=1.00 +[ogbg-molfreesolv_arma_classic_T0_ns1_h128_e100_s0] best_ep=60 val={'rmse': np.float32(4.2661796)} test={'rmse': np.float32(2.9769132)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_arma_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molfreesolv view=arma compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view arma --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=5.06825 halt=0.00 train_steps=3.00 +ep20 val_rmse=5.41479 halt=0.00 train_steps=3.00 +ep30 val_rmse=6.53946 halt=0.00 train_steps=3.00 +ep40 val_rmse=5.65785 halt=0.00 train_steps=3.00 +ep50 val_rmse=5.77324 halt=0.00 train_steps=3.00 +ep60 val_rmse=5.91626 halt=0.00 train_steps=3.00 +ep70 val_rmse=5.61429 halt=0.00 train_steps=3.00 +ep80 val_rmse=5.67131 halt=0.00 train_steps=3.00 +ep90 val_rmse=5.66869 halt=0.00 train_steps=3.00 +ep100 val_rmse=5.67086 halt=0.00 train_steps=3.00 +[ogbg-molfreesolv_arma_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=10 val={'rmse': np.float32(5.068254)} test={'rmse': np.float32(3.6822548)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_arma_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molfreesolv view=mf compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view mf --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=3.43838 halt=0.00 train_steps=1.00 +ep20 val_rmse=2.85473 halt=0.00 train_steps=1.00 +ep30 val_rmse=2.73737 halt=0.00 train_steps=1.00 +ep40 val_rmse=2.77326 halt=0.00 train_steps=1.00 +ep50 val_rmse=2.86892 halt=0.00 train_steps=1.00 +ep60 val_rmse=2.84167 halt=0.00 train_steps=1.00 +ep70 val_rmse=2.98379 halt=0.00 train_steps=1.00 +ep80 val_rmse=2.91592 halt=0.00 train_steps=1.00 +ep90 val_rmse=2.85642 halt=0.00 train_steps=1.00 +ep100 val_rmse=2.90593 halt=0.00 train_steps=1.00 +[ogbg-molfreesolv_mf_classic_T0_ns1_h128_e100_s0] best_ep=30 val={'rmse': np.float32(2.7373676)} test={'rmse': np.float32(2.8884995)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_mf_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molfreesolv view=mf compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view mf --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=3.35105 halt=0.00 train_steps=3.00 +ep20 val_rmse=2.80208 halt=0.00 train_steps=3.00 +ep30 val_rmse=2.63276 halt=0.00 train_steps=3.00 +ep40 val_rmse=2.50604 halt=0.00 train_steps=3.00 +ep50 val_rmse=2.86816 halt=0.00 train_steps=3.00 +ep60 val_rmse=2.64704 halt=0.00 train_steps=3.00 +ep70 val_rmse=2.82985 halt=0.00 train_steps=3.00 +ep80 val_rmse=2.78860 halt=0.00 train_steps=3.00 +ep90 val_rmse=2.79351 halt=0.00 train_steps=3.00 +ep100 val_rmse=2.79727 halt=0.00 train_steps=3.00 +[ogbg-molfreesolv_mf_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rmse': np.float32(2.5060387)} test={'rmse': np.float32(3.1891541)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_mf_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molfreesolv view=appnp compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view appnp --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=6.04619 halt=0.00 train_steps=1.00 +ep20 val_rmse=10.89709 halt=0.00 train_steps=1.00 +ep30 val_rmse=10.14273 halt=0.00 train_steps=1.00 +ep40 val_rmse=10.99318 halt=0.00 train_steps=1.00 +ep50 val_rmse=9.67413 halt=0.00 train_steps=1.00 +ep60 val_rmse=9.13696 halt=0.00 train_steps=1.00 +ep70 val_rmse=9.46892 halt=0.00 train_steps=1.00 +ep80 val_rmse=9.52322 halt=0.00 train_steps=1.00 +ep90 val_rmse=9.60440 halt=0.00 train_steps=1.00 +ep100 val_rmse=9.61254 halt=0.00 train_steps=1.00 +[ogbg-molfreesolv_appnp_classic_T0_ns1_h128_e100_s0] best_ep=10 val={'rmse': np.float32(6.0461874)} test={'rmse': np.float32(4.647762)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_appnp_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molfreesolv view=appnp compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molfreesolv --view appnp --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=5.55929 halt=0.00 train_steps=3.00 +ep20 val_rmse=9.63447 halt=0.00 train_steps=3.00 +ep30 val_rmse=7.79098 halt=0.00 train_steps=3.00 +ep40 val_rmse=8.98404 halt=0.00 train_steps=3.00 +ep50 val_rmse=6.08084 halt=0.00 train_steps=3.00 +ep60 val_rmse=9.37069 halt=0.00 train_steps=3.00 +ep70 val_rmse=7.20140 halt=0.00 train_steps=3.00 +ep80 val_rmse=8.13046 halt=0.00 train_steps=3.00 +ep90 val_rmse=7.07030 halt=0.00 train_steps=3.00 +ep100 val_rmse=6.67070 halt=0.00 train_steps=3.00 +[ogbg-molfreesolv_appnp_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=10 val={'rmse': np.float32(5.5592947)} test={'rmse': np.float32(3.6549187)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molfreesolv_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json + +Classic baseline: task x backbone +| task | backbone | metric | n | val | test | +| --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | rocauc | 1 | 0.6564 +/- 0.0000 | 0.7423 +/- 0.0000 | +| ogbg-molbace | arma | rocauc | 1 | 0.6923 +/- 0.0000 | 0.7839 +/- 0.0000 | +| ogbg-molbace | cheb | rocauc | 1 | 0.7267 +/- 0.0000 | 0.7969 +/- 0.0000 | +| ogbg-molbace | film | rocauc | 1 | 0.6703 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molbace | gatv2 | rocauc | 1 | 0.7029 +/- 0.0000 | 0.7400 +/- 0.0000 | +| ogbg-molbace | gcn | rocauc | 1 | 0.6381 +/- 0.0000 | 0.7393 +/- 0.0000 | +| ogbg-molbace | gen | rocauc | 1 | 0.7128 +/- 0.0000 | 0.7326 +/- 0.0000 | +| ogbg-molbace | gin | rocauc | 1 | 0.6520 +/- 0.0000 | 0.7336 +/- 0.0000 | +| ogbg-molbace | gine | rocauc | 1 | 0.6641 +/- 0.0000 | 0.7454 +/- 0.0000 | +| ogbg-molbace | graphconv | rocauc | 1 | 0.7311 +/- 0.0000 | 0.8035 +/- 0.0000 | +| ogbg-molbace | graphsage | rocauc | 1 | 0.6758 +/- 0.0000 | 0.7759 +/- 0.0000 | +| ogbg-molbace | mf | rocauc | 1 | 0.7421 +/- 0.0000 | 0.7760 +/- 0.0000 | +| ogbg-molbace | pna | rocauc | 1 | 0.7516 +/- 0.0000 | 0.6912 +/- 0.0000 | +| ogbg-molbace | resgated | rocauc | 1 | 0.7172 +/- 0.0000 | 0.7877 +/- 0.0000 | +| ogbg-molbace | sgc | rocauc | 1 | 0.6575 +/- 0.0000 | 0.6966 +/- 0.0000 | +| ogbg-molbace | tag | rocauc | 1 | 0.7084 +/- 0.0000 | 0.7345 +/- 0.0000 | +| ogbg-molbace | transformer | rocauc | 1 | 0.6663 +/- 0.0000 | 0.7364 +/- 0.0000 | +| ogbg-molbbbp | appnp | rocauc | 1 | 0.9147 +/- 0.0000 | 0.6388 +/- 0.0000 | +| ogbg-molbbbp | arma | rocauc | 1 | 0.9367 +/- 0.0000 | 0.6651 +/- 0.0000 | +| ogbg-molbbbp | cheb | rocauc | 1 | 0.9452 +/- 0.0000 | 0.6514 +/- 0.0000 | +| ogbg-molbbbp | film | rocauc | 1 | 0.9285 +/- 0.0000 | 0.6300 +/- 0.0000 | +| ogbg-molbbbp | gatv2 | rocauc | 1 | 0.9347 +/- 0.0000 | 0.6324 +/- 0.0000 | +| ogbg-molbbbp | gcn | rocauc | 1 | 0.9386 +/- 0.0000 | 0.6679 +/- 0.0000 | +| ogbg-molbbbp | gen | rocauc | 1 | 0.9549 +/- 0.0000 | 0.6775 +/- 0.0000 | +| ogbg-molbbbp | gin | rocauc | 1 | 0.9251 +/- 0.0000 | 0.5670 +/- 0.0000 | +| ogbg-molbbbp | gine | rocauc | 1 | 0.9324 +/- 0.0000 | 0.6160 +/- 0.0000 | +| ogbg-molbbbp | graphconv | rocauc | 1 | 0.9268 +/- 0.0000 | 0.5900 +/- 0.0000 | +| ogbg-molbbbp | graphsage | rocauc | 1 | 0.9483 +/- 0.0000 | 0.6288 +/- 0.0000 | +| ogbg-molbbbp | mf | rocauc | 1 | 0.9395 +/- 0.0000 | 0.6365 +/- 0.0000 | +| ogbg-molbbbp | pna | rocauc | 1 | 0.9554 +/- 0.0000 | 0.6418 +/- 0.0000 | +| ogbg-molbbbp | resgated | rocauc | 1 | 0.9183 +/- 0.0000 | 0.6626 +/- 0.0000 | +| ogbg-molbbbp | sgc | rocauc | 1 | 0.9300 +/- 0.0000 | 0.6239 +/- 0.0000 | +| ogbg-molbbbp | tag | rocauc | 1 | 0.9476 +/- 0.0000 | 0.6100 +/- 0.0000 | +| ogbg-molbbbp | transformer | rocauc | 1 | 0.9495 +/- 0.0000 | 0.6156 +/- 0.0000 | +| ogbg-molclintox | appnp | rocauc | 1 | 0.8516 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | arma | rocauc | 1 | 0.9463 +/- 0.0000 | 0.8678 +/- 0.0000 | +| ogbg-molclintox | cheb | rocauc | 1 | 0.8928 +/- 0.0000 | 0.9152 +/- 0.0000 | +| ogbg-molclintox | film | rocauc | 1 | 0.9048 +/- 0.0000 | 0.7731 +/- 0.0000 | +| ogbg-molclintox | gatv2 | rocauc | 1 | 0.9515 +/- 0.0000 | 0.8493 +/- 0.0000 | +| ogbg-molclintox | gcn | rocauc | 1 | 0.9318 +/- 0.0000 | 0.8932 +/- 0.0000 | +| ogbg-molclintox | gen | rocauc | 1 | 0.9820 +/- 0.0000 | 0.8128 +/- 0.0000 | +| ogbg-molclintox | gin | rocauc | 1 | 0.9547 +/- 0.0000 | 0.8586 +/- 0.0000 | +| ogbg-molclintox | gine | rocauc | 1 | 0.9353 +/- 0.0000 | 0.8869 +/- 0.0000 | +| ogbg-molclintox | graphconv | rocauc | 1 | 0.8917 +/- 0.0000 | 0.8501 +/- 0.0000 | +| ogbg-molclintox | graphsage | rocauc | 1 | 0.9143 +/- 0.0000 | 0.8882 +/- 0.0000 | +| ogbg-molclintox | mf | rocauc | 1 | 0.9252 +/- 0.0000 | 0.8370 +/- 0.0000 | +| ogbg-molclintox | pna | rocauc | 1 | 0.9286 +/- 0.0000 | 0.8603 +/- 0.0000 | +| ogbg-molclintox | resgated | rocauc | 1 | 0.9244 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | sgc | rocauc | 1 | 0.9195 +/- 0.0000 | 0.8986 +/- 0.0000 | +| ogbg-molclintox | tag | rocauc | 1 | 0.9237 +/- 0.0000 | 0.7998 +/- 0.0000 | +| ogbg-molclintox | transformer | rocauc | 1 | 0.9271 +/- 0.0000 | 0.8764 +/- 0.0000 | +| ogbg-molesol | appnp | rmse | 1 | 1.6083 +/- 0.0000 | 1.5212 +/- 0.0000 | +| ogbg-molesol | arma | rmse | 1 | 1.0195 +/- 0.0000 | 1.0666 +/- 0.0000 | +| ogbg-molesol | cheb | rmse | 1 | 0.9650 +/- 0.0000 | 0.8722 +/- 0.0000 | +| ogbg-molesol | film | rmse | 1 | 1.0718 +/- 0.0000 | 1.2896 +/- 0.0000 | +| ogbg-molesol | gatv2 | rmse | 1 | 1.0368 +/- 0.0000 | 0.9878 +/- 0.0000 | +| ogbg-molesol | gcn | rmse | 1 | 1.0409 +/- 0.0000 | 1.1161 +/- 0.0000 | +| ogbg-molesol | gen | rmse | 1 | 1.0089 +/- 0.0000 | 0.8762 +/- 0.0000 | +| ogbg-molesol | gin | rmse | 1 | 1.0187 +/- 0.0000 | 0.9900 +/- 0.0000 | +| ogbg-molesol | gine | rmse | 1 | 1.0286 +/- 0.0000 | 1.0807 +/- 0.0000 | +| ogbg-molesol | graphconv | rmse | 1 | 0.9741 +/- 0.0000 | 0.9732 +/- 0.0000 | +| ogbg-molesol | graphsage | rmse | 1 | 0.9680 +/- 0.0000 | 1.0038 +/- 0.0000 | +| ogbg-molesol | mf | rmse | 1 | 1.1494 +/- 0.0000 | 1.0639 +/- 0.0000 | +| ogbg-molesol | pna | rmse | 1 | 0.9116 +/- 0.0000 | 0.9153 +/- 0.0000 | +| ogbg-molesol | resgated | rmse | 1 | 0.9492 +/- 0.0000 | 0.8908 +/- 0.0000 | +| ogbg-molesol | sgc | rmse | 1 | 1.0617 +/- 0.0000 | 0.9780 +/- 0.0000 | +| ogbg-molesol | tag | rmse | 1 | 0.9323 +/- 0.0000 | 0.9678 +/- 0.0000 | +| ogbg-molesol | transformer | rmse | 1 | 0.9398 +/- 0.0000 | 0.9492 +/- 0.0000 | +| ogbg-molfreesolv | appnp | rmse | 1 | 6.0462 +/- 0.0000 | 4.6478 +/- 0.0000 | +| ogbg-molfreesolv | arma | rmse | 1 | 4.2662 +/- 0.0000 | 2.9769 +/- 0.0000 | +| ogbg-molfreesolv | cheb | rmse | 1 | 2.9481 +/- 0.0000 | 2.2431 +/- 0.0000 | +| ogbg-molfreesolv | film | rmse | 1 | 3.1546 +/- 0.0000 | 2.9581 +/- 0.0000 | +| ogbg-molfreesolv | gatv2 | rmse | 1 | 4.2086 +/- 0.0000 | 2.7368 +/- 0.0000 | +| ogbg-molfreesolv | gcn | rmse | 1 | 3.7172 +/- 0.0000 | 2.4851 +/- 0.0000 | +| ogbg-molfreesolv | gen | rmse | 1 | 3.9998 +/- 0.0000 | 2.5588 +/- 0.0000 | +| ogbg-molfreesolv | gin | rmse | 1 | 4.0190 +/- 0.0000 | 3.4898 +/- 0.0000 | +| ogbg-molfreesolv | gine | rmse | 1 | 3.2961 +/- 0.0000 | 3.1442 +/- 0.0000 | +| ogbg-molfreesolv | graphconv | rmse | 1 | 2.5314 +/- 0.0000 | 2.7953 +/- 0.0000 | +| ogbg-molfreesolv | graphsage | rmse | 1 | 3.5022 +/- 0.0000 | 2.2977 +/- 0.0000 | +| ogbg-molfreesolv | mf | rmse | 1 | 2.7374 +/- 0.0000 | 2.8885 +/- 0.0000 | +| ogbg-molfreesolv | pna | rmse | 1 | 2.3625 +/- 0.0000 | 2.2610 +/- 0.0000 | +| ogbg-molfreesolv | resgated | rmse | 1 | 2.4772 +/- 0.0000 | 2.0041 +/- 0.0000 | +| ogbg-molfreesolv | sgc | rmse | 1 | 3.9147 +/- 0.0000 | 2.4146 +/- 0.0000 | +| ogbg-molfreesolv | tag | rmse | 1 | 2.6874 +/- 0.0000 | 2.3826 +/- 0.0000 | +| ogbg-molfreesolv | transformer | rmse | 1 | 4.0942 +/- 0.0000 | 2.3205 +/- 0.0000 | +| ogbg-molhiv | appnp | rocauc | 1 | 0.7675 +/- 0.0000 | 0.7000 +/- 0.0000 | +| ogbg-molhiv | arma | rocauc | 1 | 0.7872 +/- 0.0000 | 0.7296 +/- 0.0000 | +| ogbg-molhiv | cheb | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7282 +/- 0.0000 | +| ogbg-molhiv | film | rocauc | 1 | 0.7922 +/- 0.0000 | 0.7842 +/- 0.0000 | +| ogbg-molhiv | gatv2 | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7563 +/- 0.0000 | +| ogbg-molhiv | gcn | rocauc | 1 | 0.7754 +/- 0.0000 | 0.7198 +/- 0.0000 | +| ogbg-molhiv | gen | rocauc | 1 | 0.7530 +/- 0.0000 | 0.7314 +/- 0.0000 | +| ogbg-molhiv | gin | rocauc | 1 | 0.8167 +/- 0.0000 | 0.7724 +/- 0.0000 | +| ogbg-molhiv | gine | rocauc | 1 | 0.7942 +/- 0.0000 | 0.7445 +/- 0.0000 | +| ogbg-molhiv | graphconv | rocauc | 1 | 0.7707 +/- 0.0000 | 0.7108 +/- 0.0000 | +| ogbg-molhiv | graphsage | rocauc | 1 | 0.7969 +/- 0.0000 | 0.7625 +/- 0.0000 | +| ogbg-molhiv | mf | rocauc | 1 | 0.7845 +/- 0.0000 | 0.7074 +/- 0.0000 | +| ogbg-molhiv | pna | rocauc | 1 | 0.7780 +/- 0.0000 | 0.7648 +/- 0.0000 | +| ogbg-molhiv | resgated | rocauc | 1 | 0.8144 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molhiv | sgc | rocauc | 1 | 0.7479 +/- 0.0000 | 0.7019 +/- 0.0000 | +| ogbg-molhiv | tag | rocauc | 1 | 0.7528 +/- 0.0000 | 0.7255 +/- 0.0000 | +| ogbg-molhiv | transformer | rocauc | 1 | 0.7617 +/- 0.0000 | 0.7547 +/- 0.0000 | +| ogbg-molsider | appnp | rocauc | 1 | 0.5886 +/- 0.0000 | 0.6004 +/- 0.0000 | +| ogbg-molsider | arma | rocauc | 1 | 0.6273 +/- 0.0000 | 0.6159 +/- 0.0000 | +| ogbg-molsider | cheb | rocauc | 1 | 0.6237 +/- 0.0000 | 0.6033 +/- 0.0000 | +| ogbg-molsider | film | rocauc | 1 | 0.6024 +/- 0.0000 | 0.5898 +/- 0.0000 | +| ogbg-molsider | gatv2 | rocauc | 1 | 0.6071 +/- 0.0000 | 0.6013 +/- 0.0000 | +| ogbg-molsider | gcn | rocauc | 1 | 0.6293 +/- 0.0000 | 0.6086 +/- 0.0000 | +| ogbg-molsider | gen | rocauc | 1 | 0.6519 +/- 0.0000 | 0.5854 +/- 0.0000 | +| ogbg-molsider | gin | rocauc | 1 | 0.6225 +/- 0.0000 | 0.5748 +/- 0.0000 | +| ogbg-molsider | gine | rocauc | 1 | 0.6327 +/- 0.0000 | 0.5495 +/- 0.0000 | +| ogbg-molsider | graphconv | rocauc | 1 | 0.5921 +/- 0.0000 | 0.6151 +/- 0.0000 | +| ogbg-molsider | graphsage | rocauc | 1 | 0.6217 +/- 0.0000 | 0.5807 +/- 0.0000 | +| ogbg-molsider | mf | rocauc | 1 | 0.6202 +/- 0.0000 | 0.5861 +/- 0.0000 | +| ogbg-molsider | pna | rocauc | 1 | 0.6219 +/- 0.0000 | 0.5965 +/- 0.0000 | +| ogbg-molsider | resgated | rocauc | 1 | 0.6209 +/- 0.0000 | 0.5910 +/- 0.0000 | +| ogbg-molsider | sgc | rocauc | 1 | 0.6174 +/- 0.0000 | 0.6043 +/- 0.0000 | +| ogbg-molsider | tag | rocauc | 1 | 0.6439 +/- 0.0000 | 0.6143 +/- 0.0000 | +| ogbg-molsider | transformer | rocauc | 1 | 0.6160 +/- 0.0000 | 0.5980 +/- 0.0000 | +| ogbg-moltox21 | appnp | rocauc | 1 | 0.7255 +/- 0.0000 | 0.7158 +/- 0.0000 | +| ogbg-moltox21 | arma | rocauc | 1 | 0.7799 +/- 0.0000 | 0.7223 +/- 0.0000 | +| ogbg-moltox21 | cheb | rocauc | 1 | 0.7834 +/- 0.0000 | 0.7301 +/- 0.0000 | +| ogbg-moltox21 | film | rocauc | 1 | 0.7702 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gatv2 | rocauc | 1 | 0.7627 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gcn | rocauc | 1 | 0.7580 +/- 0.0000 | 0.7171 +/- 0.0000 | +| ogbg-moltox21 | gen | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7444 +/- 0.0000 | +| ogbg-moltox21 | gin | rocauc | 1 | 0.7690 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-moltox21 | gine | rocauc | 1 | 0.7744 +/- 0.0000 | 0.7328 +/- 0.0000 | +| ogbg-moltox21 | graphconv | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7147 +/- 0.0000 | +| ogbg-moltox21 | graphsage | rocauc | 1 | 0.7709 +/- 0.0000 | 0.7196 +/- 0.0000 | +| ogbg-moltox21 | mf | rocauc | 1 | 0.7773 +/- 0.0000 | 0.7281 +/- 0.0000 | +| ogbg-moltox21 | pna | rocauc | 1 | 0.7660 +/- 0.0000 | 0.6946 +/- 0.0000 | +| ogbg-moltox21 | resgated | rocauc | 1 | 0.7950 +/- 0.0000 | 0.7275 +/- 0.0000 | +| ogbg-moltox21 | sgc | rocauc | 1 | 0.7611 +/- 0.0000 | 0.7240 +/- 0.0000 | +| ogbg-moltox21 | tag | rocauc | 1 | 0.7866 +/- 0.0000 | 0.7416 +/- 0.0000 | +| ogbg-moltox21 | transformer | rocauc | 1 | 0.7656 +/- 0.0000 | 0.7309 +/- 0.0000 | + +Delta vs matching classic +| task | backbone | compute | metric | n | val score (delta) | test score (delta) | steps | +| --- | --- | --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7168 (0.0604) | 0.7209 (-0.0214) | | +| ogbg-molbace | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7179 (0.0256) | 0.7672 (-0.0167) | | +| ogbg-molbace | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7114 (-0.0154) | 0.7533 (-0.0436) | | +| ogbg-molbace | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6652 (-0.0051) | 0.7242 (0.0000) | | +| ogbg-molbace | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7026 (-0.0004) | 0.7519 (0.0118) | | +| ogbg-molbace | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6374 (-0.0007) | 0.7733 (0.0339) | | +| ogbg-molbace | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6894 (-0.0234) | 0.7449 (0.0123) | | +| ogbg-molbace | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6538 (0.0018) | 0.7169 (-0.0167) | | +| ogbg-molbace | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6685 (0.0044) | 0.6994 (-0.0461) | | +| ogbg-molbace | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7462 (0.0150) | 0.7983 (-0.0052) | | +| ogbg-molbace | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6703 (-0.0055) | 0.7119 (-0.0640) | | +| ogbg-molbace | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7234 (-0.0187) | 0.7684 (-0.0077) | | +| ogbg-molbace | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7037 (-0.0480) | 0.7967 (0.1055) | | +| ogbg-molbace | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6912 (-0.0260) | 0.7465 (-0.0412) | | +| ogbg-molbace | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6454 (-0.0121) | 0.7727 (0.0762) | | +| ogbg-molbace | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7355 (0.0271) | 0.6806 (-0.0539) | | +| ogbg-molbace | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6982 (0.0319) | 0.7487 (0.0123) | | +| ogbg-molbbbp | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9360 (0.0213) | 0.6073 (-0.0314) | | +| ogbg-molbbbp | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9415 (0.0048) | 0.6635 (-0.0016) | | +| ogbg-molbbbp | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9278 (-0.0174) | 0.6659 (0.0145) | | +| ogbg-molbbbp | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9400 (0.0115) | 0.6323 (0.0023) | | +| ogbg-molbbbp | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9356 (0.0009) | 0.6560 (0.0235) | | +| ogbg-molbbbp | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9417 (0.0031) | 0.6017 (-0.0663) | | +| ogbg-molbbbp | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9429 (-0.0119) | 0.6037 (-0.0738) | | +| ogbg-molbbbp | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9526 (0.0275) | 0.5932 (0.0261) | | +| ogbg-molbbbp | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9421 (0.0098) | 0.6976 (0.0816) | | +| ogbg-molbbbp | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9337 (0.0069) | 0.6518 (0.0618) | | +| ogbg-molbbbp | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9502 (0.0019) | 0.5934 (-0.0354) | | +| ogbg-molbbbp | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9488 (0.0094) | 0.6481 (0.0116) | | +| ogbg-molbbbp | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9585 (0.0031) | 0.6682 (0.0264) | | +| ogbg-molbbbp | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9535 (0.0352) | 0.5839 (-0.0787) | | +| ogbg-molbbbp | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9285 (-0.0015) | 0.6454 (0.0215) | | +| ogbg-molbbbp | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9459 (-0.0017) | 0.6420 (0.0320) | | +| ogbg-molbbbp | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9355 (-0.0140) | 0.6221 (0.0065) | | +| ogbg-molclintox | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9029 (0.0513) | 0.8898 (-0.0286) | | +| ogbg-molclintox | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9135 (-0.0328) | 0.8863 (0.0185) | | +| ogbg-molclintox | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8816 (-0.0112) | 0.8982 (-0.0170) | | +| ogbg-molclintox | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9454 (0.0406) | 0.8430 (0.0699) | | +| ogbg-molclintox | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9351 (-0.0164) | 0.8328 (-0.0164) | | +| ogbg-molclintox | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9097 (-0.0221) | 0.8792 (-0.0140) | | +| ogbg-molclintox | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9399 (-0.0421) | 0.8194 (0.0066) | | +| ogbg-molclintox | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9164 (-0.0383) | 0.8788 (0.0202) | | +| ogbg-molclintox | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9225 (-0.0127) | 0.8840 (-0.0030) | | +| ogbg-molclintox | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8494 (-0.0424) | 0.8186 (-0.0316) | | +| ogbg-molclintox | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9579 (0.0436) | 0.8664 (-0.0217) | | +| ogbg-molclintox | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9147 (-0.0104) | 0.8047 (-0.0323) | | +| ogbg-molclintox | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9064 (-0.0222) | 0.8735 (0.0132) | | +| ogbg-molclintox | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9055 (-0.0188) | 0.8979 (-0.0205) | | +| ogbg-molclintox | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9220 (0.0025) | 0.9054 (0.0068) | | +| ogbg-molclintox | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9183 (-0.0054) | 0.8433 (0.0435) | | +| ogbg-molclintox | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9322 (0.0051) | 0.8522 (-0.0242) | | +| ogbg-molesol | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 1.4196 (0.1887) | 1.4929 (0.0284) | | +| ogbg-molesol | arma | fixed-rrog-T1-ns3 | rmse | 1 | 1.0034 (0.0160) | 1.1272 (-0.0606) | | +| ogbg-molesol | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 0.9199 (0.0451) | 0.8841 (-0.0118) | | +| ogbg-molesol | film | fixed-rrog-T1-ns3 | rmse | 1 | 1.0196 (0.0521) | 1.0849 (0.2047) | | +| ogbg-molesol | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 1.0018 (0.0350) | 0.9780 (0.0098) | | +| ogbg-molesol | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 0.9591 (0.0818) | 0.9305 (0.1856) | | +| ogbg-molesol | gen | fixed-rrog-T1-ns3 | rmse | 1 | 1.0027 (0.0062) | 0.9206 (-0.0444) | | +| ogbg-molesol | gin | fixed-rrog-T1-ns3 | rmse | 1 | 0.9647 (0.0540) | 1.0798 (-0.0899) | | +| ogbg-molesol | gine | fixed-rrog-T1-ns3 | rmse | 1 | 1.0581 (-0.0295) | 1.0951 (-0.0144) | | +| ogbg-molesol | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 1.0048 (-0.0307) | 0.9968 (-0.0236) | | +| ogbg-molesol | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 0.9934 (-0.0254) | 1.0794 (-0.0757) | | +| ogbg-molesol | mf | fixed-rrog-T1-ns3 | rmse | 1 | 1.0553 (0.0942) | 1.0368 (0.0271) | | +| ogbg-molesol | pna | fixed-rrog-T1-ns3 | rmse | 1 | 0.9841 (-0.0725) | 0.9092 (0.0060) | | +| ogbg-molesol | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 0.9873 (-0.0382) | 0.8825 (0.0083) | | +| ogbg-molesol | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 1.0129 (0.0488) | 0.9373 (0.0407) | | +| ogbg-molesol | tag | fixed-rrog-T1-ns3 | rmse | 1 | 0.9036 (0.0288) | 0.9462 (0.0215) | | +| ogbg-molesol | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 0.9841 (-0.0443) | 1.0004 (-0.0512) | | +| ogbg-molfreesolv | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 5.5593 (0.4869) | 3.6549 (0.9928) | | +| ogbg-molfreesolv | arma | fixed-rrog-T1-ns3 | rmse | 1 | 5.0683 (-0.8021) | 3.6823 (-0.7053) | | +| ogbg-molfreesolv | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 3.0142 (-0.0662) | 2.2399 (0.0032) | | +| ogbg-molfreesolv | film | fixed-rrog-T1-ns3 | rmse | 1 | 3.2952 (-0.1406) | 3.3042 (-0.3460) | | +| ogbg-molfreesolv | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 3.9984 (0.2103) | 2.5966 (0.1403) | | +| ogbg-molfreesolv | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 3.5888 (0.1285) | 2.4444 (0.0407) | | +| ogbg-molfreesolv | gen | fixed-rrog-T1-ns3 | rmse | 1 | 4.3009 (-0.3011) | 2.9063 (-0.3476) | | +| ogbg-molfreesolv | gin | fixed-rrog-T1-ns3 | rmse | 1 | 3.9743 (0.0447) | 3.4292 (0.0607) | | +| ogbg-molfreesolv | gine | fixed-rrog-T1-ns3 | rmse | 1 | 4.4468 (-1.1508) | 3.7405 (-0.5963) | | +| ogbg-molfreesolv | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 2.9106 (-0.3792) | 3.1429 (-0.3476) | | +| ogbg-molfreesolv | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 3.7380 (-0.2358) | 2.1931 (0.1046) | | +| ogbg-molfreesolv | mf | fixed-rrog-T1-ns3 | rmse | 1 | 2.5060 (0.2313) | 3.1892 (-0.3007) | | +| ogbg-molfreesolv | pna | fixed-rrog-T1-ns3 | rmse | 1 | 3.3334 (-0.9708) | 2.4279 (-0.1669) | | +| ogbg-molfreesolv | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 3.0920 (-0.6148) | 2.0244 (-0.0203) | | +| ogbg-molfreesolv | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 3.9261 (-0.0114) | 2.4887 (-0.0741) | | +| ogbg-molfreesolv | tag | fixed-rrog-T1-ns3 | rmse | 1 | 2.7359 (-0.0486) | 2.0588 (0.3237) | | +| ogbg-molfreesolv | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 4.4180 (-0.3237) | 2.4325 (-0.1120) | | +| ogbg-molhiv | appnp | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7203 (-0.0471) | 0.6825 (-0.0175) | | +| ogbg-molhiv | arma | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7926 (0.0054) | 0.7318 (0.0021) | | +| ogbg-molhiv | cheb | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7735 (-0.0096) | 0.7426 (0.0144) | | +| ogbg-molhiv | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8251 (0.0330) | 0.7725 (-0.0117) | | +| ogbg-molhiv | film | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7633 (-0.0288) | 0.7728 (-0.0114) | | +| ogbg-molhiv | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8049 (0.0214) | 0.7486 (-0.0077) | | +| ogbg-molhiv | gatv2 | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7835 (0.0001) | 0.7466 (-0.0096) | | +| ogbg-molhiv | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7833 (0.0079) | 0.7448 (0.0250) | | +| ogbg-molhiv | gcn | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7455 (-0.0300) | 0.7483 (0.0285) | | +| ogbg-molhiv | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7740 (0.0210) | 0.7590 (0.0276) | | +| ogbg-molhiv | gen | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8128 (0.0598) | 0.7631 (0.0318) | | +| ogbg-molhiv | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0457) | 0.7668 (-0.0056) | | +| ogbg-molhiv | gin | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7524 (-0.0644) | 0.7324 (-0.0400) | | +| ogbg-molhiv | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7490 (-0.0453) | 0.7376 (-0.0070) | | +| ogbg-molhiv | gine | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7575 (-0.0368) | 0.7401 (-0.0044) | | +| ogbg-molhiv | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7817 (0.0110) | 0.7493 (0.0385) | | +| ogbg-molhiv | graphconv | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7713 (0.0006) | 0.6979 (-0.0129) | | +| ogbg-molhiv | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7893 (-0.0075) | 0.7633 (0.0008) | | +| ogbg-molhiv | graphsage | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7587 (-0.0382) | 0.7641 (0.0016) | | +| ogbg-molhiv | mf | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7931 (0.0085) | 0.7217 (0.0143) | | +| ogbg-molhiv | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8097 (0.0317) | 0.7602 (-0.0046) | | +| ogbg-molhiv | pna | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7890 (0.0111) | 0.7630 (-0.0018) | | +| ogbg-molhiv | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7923 (-0.0221) | 0.7227 (-0.0015) | | +| ogbg-molhiv | resgated | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8174 (0.0030) | 0.7055 (-0.0187) | | +| ogbg-molhiv | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7659 (0.0181) | 0.7136 (0.0117) | | +| ogbg-molhiv | sgc | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7482 (0.0003) | 0.7177 (0.0158) | | +| ogbg-molhiv | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7717 (0.0189) | 0.7181 (-0.0074) | | +| ogbg-molhiv | tag | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7804 (0.0276) | 0.7352 (0.0096) | | +| ogbg-molhiv | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7838 (0.0221) | 0.7648 (0.0100) | | +| ogbg-molhiv | transformer | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8088 (0.0471) | 0.7413 (-0.0134) | | +| ogbg-molsider | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.5938 (0.0051) | 0.5905 (-0.0099) | | +| ogbg-molsider | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6344 (0.0071) | 0.6141 (-0.0018) | | +| ogbg-molsider | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6263 (0.0026) | 0.6096 (0.0062) | | +| ogbg-molsider | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.5862 (-0.0162) | 0.5974 (0.0076) | | +| ogbg-molsider | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6462 (0.0391) | 0.6000 (-0.0013) | | +| ogbg-molsider | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6256 (-0.0037) | 0.6117 (0.0031) | | +| ogbg-molsider | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6345 (-0.0175) | 0.6053 (0.0199) | | +| ogbg-molsider | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6046 (-0.0179) | 0.6022 (0.0274) | | +| ogbg-molsider | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6151 (-0.0176) | 0.6150 (0.0655) | | +| ogbg-molsider | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6010 (0.0089) | 0.5963 (-0.0188) | | +| ogbg-molsider | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6232 (0.0015) | 0.5861 (0.0053) | | +| ogbg-molsider | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6190 (-0.0012) | 0.5983 (0.0122) | | +| ogbg-molsider | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6058 (-0.0161) | 0.5721 (-0.0243) | | +| ogbg-molsider | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6205 (-0.0005) | 0.5960 (0.0050) | | +| ogbg-molsider | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6151 (-0.0022) | 0.6417 (0.0375) | | +| ogbg-molsider | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6410 (-0.0028) | 0.6102 (-0.0041) | | +| ogbg-molsider | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6315 (0.0156) | 0.6190 (0.0210) | | +| ogbg-moltox21 | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7280 (0.0025) | 0.7154 (-0.0005) | | +| ogbg-moltox21 | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7771 (-0.0028) | 0.7209 (-0.0014) | | +| ogbg-moltox21 | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0125) | 0.7286 (-0.0015) | | +| ogbg-moltox21 | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7727 (0.0025) | 0.7369 (0.0209) | | +| ogbg-moltox21 | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7762 (0.0135) | 0.7303 (0.0143) | | +| ogbg-moltox21 | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7588 (0.0007) | 0.7230 (0.0059) | | +| ogbg-moltox21 | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7757 (-0.0077) | 0.7312 (-0.0132) | | +| ogbg-moltox21 | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7718 (0.0028) | 0.7237 (-0.0005) | | +| ogbg-moltox21 | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7622 (-0.0122) | 0.7193 (-0.0135) | | +| ogbg-moltox21 | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7820 (-0.0011) | 0.7313 (0.0166) | | +| ogbg-moltox21 | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7697 (-0.0012) | 0.7205 (0.0009) | | +| ogbg-moltox21 | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7695 (-0.0078) | 0.7279 (-0.0002) | | +| ogbg-moltox21 | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7745 (0.0085) | 0.7349 (0.0403) | | +| ogbg-moltox21 | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7887 (-0.0064) | 0.7380 (0.0104) | | +| ogbg-moltox21 | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7506 (-0.0105) | 0.7355 (0.0115) | | +| ogbg-moltox21 | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7839 (-0.0027) | 0.7342 (-0.0074) | | +| ogbg-moltox21 | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7761 (0.0105) | 0.7292 (-0.0018) | | diff --git a/logs/ogbg-molhiv_0.log b/logs/ogbg-molhiv_0.log new file mode 100644 index 0000000..2937659 --- /dev/null +++ b/logs/ogbg-molhiv_0.log @@ -0,0 +1,612 @@ +[run] ogbg-molhiv view=gin compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gin --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/hiv.zip +
0%| | 0/3 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/3 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/3 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/3 [00:00<?, ?it/s]
Downloaded 0.00 GB: 100%|██████████| 3/3 [00:00<00:00, 152.24it/s] +Processing... +Extracting /orion/u/oscarwan/rrog-gnn-runner/data/ogb/hiv.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/41127 [00:00<?, ?it/s]
40%|████ | 16530/41127 [00:00<00:00, 165281.64it/s]
80%|████████ | 33059/41127 [00:00<00:00, 164790.93it/s]
100%|██████████| 41127/41127 [00:00<00:00, 159504.03it/s] +Converting graphs into PyG objects... +
0%| | 0/41127 [00:00<?, ?it/s]
22%|██▏ | 8880/41127 [00:00<00:00, 88790.35it/s]
43%|████▎ | 17760/41127 [00:00<00:00, 53218.06it/s]
65%|██████▍ | 26610/41127 [00:00<00:00, 65034.35it/s]
86%|████████▋ | 35550/41127 [00:00<00:00, 72919.08it/s]
100%|██████████| 41127/41127 [00:00<00:00, 71411.66it/s] +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/ogb/graphproppred/dataset_pyg.py:156: UserWarning: The given NumPy array is not writable, and PyTorch does not support non-writable tensors. This means writing to this tensor will result in undefined behavior. You may want to copy the array to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at /pytorch/torch/csrc/utils/tensor_numpy.cpp:203.) + g.y = torch.from_numpy(graph_label[i]).view(1,-1).to(torch.long) +Done! +Saving... +ep10 val_rocauc=0.68958 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.62677 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.75666 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.81675 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.79400 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.77580 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.77900 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.79025 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.78752 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.78382 halt=0.00 train_steps=1.00 +[ogbg-molhiv_gin_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rocauc': 0.816746889084852} test={'rocauc': 0.7723980764402558} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gin_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=gin compute=fixed-rrog T=3 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gin --compute fixed-rrog --T 3 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.65495 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.70925 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.75238 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.70341 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.73133 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.69975 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.74462 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.73833 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.73695 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.73852 halt=0.00 train_steps=3.00 +[ogbg-molhiv_gin_fixed-rrog_T3_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.7523760533019792} test={'rocauc': 0.7324378609088626} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gin_fixed-rrog_T3_ns3_h128_e100_s0.json +[run] ogbg-molhiv view=gine compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gine --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.62164 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.74372 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.74063 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.76519 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.78176 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.78597 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.79424 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.78335 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.78834 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.78578 halt=0.00 train_steps=1.00 +[ogbg-molhiv_gine_classic_T0_ns1_h128_e100_s0] best_ep=70 val={'rocauc': 0.7942448069762884} test={'rocauc': 0.7445141852874717} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gine_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=gine compute=fixed-rrog T=3 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gine --compute fixed-rrog --T 3 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.61178 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.71290 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.72785 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.75746 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.71552 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.73246 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.73966 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.74506 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.73921 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.73342 halt=0.00 train_steps=3.00 +[ogbg-molhiv_gine_fixed-rrog_T3_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.7574588477366255} test={'rocauc': 0.7400818864790746} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gine_fixed-rrog_T3_ns3_h128_e100_s0.json +[run] ogbg-molhiv view=gcn compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gcn --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.65811 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.74430 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.77543 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.73750 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.75570 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.75804 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.74526 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.72804 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.74118 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.73306 halt=0.00 train_steps=1.00 +[ogbg-molhiv_gcn_classic_T0_ns1_h128_e100_s0] best_ep=30 val={'rocauc': 0.7754323437193807} test={'rocauc': 0.719778288495336} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gcn_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=gcn compute=fixed-rrog T=3 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gcn --compute fixed-rrog --T 3 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.63622 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.69664 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.74131 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.74547 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.73229 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.73274 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.73576 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.73819 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.74222 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.73546 halt=0.00 train_steps=3.00 +[ogbg-molhiv_gcn_fixed-rrog_T3_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.7454683519498334} test={'rocauc': 0.7482879159504818} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gcn_fixed-rrog_T3_ns3_h128_e100_s0.json +[run] ogbg-molhiv view=graphsage compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view graphsage --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.71550 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.76542 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.71584 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.79686 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.72350 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.76958 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.74210 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.72790 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.74689 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.74191 halt=0.00 train_steps=1.00 +[ogbg-molhiv_graphsage_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rocauc': 0.7968596903782088} test={'rocauc': 0.7625118291199134} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_graphsage_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=graphsage compute=fixed-rrog T=3 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view graphsage --compute fixed-rrog --T 3 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.66879 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.75868 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.73014 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.74615 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.74824 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.73541 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.74158 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.74460 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.74456 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.73640 halt=0.00 train_steps=3.00 +[ogbg-molhiv_graphsage_fixed-rrog_T3_ns3_h128_e100_s0] best_ep=20 val={'rocauc': 0.7586759626690183} test={'rocauc': 0.7641070704339598} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_graphsage_fixed-rrog_T3_ns3_h128_e100_s0.json +[run] ogbg-molhiv view=gatv2 compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gatv2 --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.71585 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.78346 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.75100 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.77132 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.76468 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.73519 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.74196 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.75164 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.74230 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.74250 halt=0.00 train_steps=1.00 +[ogbg-molhiv_gatv2_classic_T0_ns1_h128_e100_s0] best_ep=20 val={'rocauc': 0.7834576474622771} test={'rocauc': 0.75625253481141} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gatv2_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=gatv2 compute=fixed-rrog T=3 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gatv2 --compute fixed-rrog --T 3 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.71208 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.78355 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.73986 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.77098 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.74696 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.74733 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.71626 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.70159 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.69616 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.69278 halt=0.00 train_steps=3.00 +[ogbg-molhiv_gatv2_fixed-rrog_T3_ns3_h128_e100_s0] best_ep=20 val={'rocauc': 0.7835464432686655} test={'rocauc': 0.746617354525966} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gatv2_fixed-rrog_T3_ns3_h128_e100_s0.json +[run] ogbg-molhiv view=graphconv compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view graphconv --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.70572 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.75834 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.75592 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.71993 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.74917 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.76022 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.76575 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.77066 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.76111 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.76138 halt=0.00 train_steps=1.00 +[ogbg-molhiv_graphconv_classic_T0_ns1_h128_e100_s0] best_ep=80 val={'rocauc': 0.7706618655692731} test={'rocauc': 0.7108113327796983} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_graphconv_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=graphconv compute=fixed-rrog T=3 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view graphconv --compute fixed-rrog --T 3 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.69385 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.74585 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.70566 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.76126 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.74274 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.73851 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.75489 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.77125 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.76654 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.76644 halt=0.00 train_steps=3.00 +[ogbg-molhiv_graphconv_fixed-rrog_T3_ns3_h128_e100_s0] best_ep=80 val={'rocauc': 0.7712528169704094} test={'rocauc': 0.6979180748952278} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_graphconv_fixed-rrog_T3_ns3_h128_e100_s0.json +[run] ogbg-molhiv view=transformer compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view transformer --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.73727 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.75895 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.76173 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.72264 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.74231 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.73453 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.73009 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.72118 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.71814 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.72113 halt=0.00 train_steps=1.00 +[ogbg-molhiv_transformer_classic_T0_ns1_h128_e100_s0] best_ep=30 val={'rocauc': 0.7617332941407015} test={'rocauc': 0.7547248884682979} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_transformer_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=transformer compute=fixed-rrog T=3 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view transformer --compute fixed-rrog --T 3 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.71907 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.77500 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.75579 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.80881 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.75874 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75197 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.70705 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.71709 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.71606 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.71290 halt=0.00 train_steps=3.00 +[ogbg-molhiv_transformer_fixed-rrog_T3_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.8088103811483441} test={'rocauc': 0.7413024585256572} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_transformer_fixed-rrog_T3_ns3_h128_e100_s0.json +[run] ogbg-molhiv view=pna compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view pna --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.74671 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.72354 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.74514 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.68222 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.73145 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.77795 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.75368 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.70352 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.72530 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.72001 halt=0.00 train_steps=1.00 +[ogbg-molhiv_pna_classic_T0_ns1_h128_e100_s0] best_ep=60 val={'rocauc': 0.7779523074661963} test={'rocauc': 0.7647926765677203} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_pna_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=pna compute=fixed-rrog T=3 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view pna --compute fixed-rrog --T 3 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.59545 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.66872 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.63794 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.65636 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.75063 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.78904 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.76138 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.77449 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.76722 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.76642 halt=0.00 train_steps=3.00 +[ogbg-molhiv_pna_fixed-rrog_T3_ns3_h128_e100_s0] best_ep=60 val={'rocauc': 0.7890395355673133} test={'rocauc': 0.7629792000618011} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_pna_fixed-rrog_T3_ns3_h128_e100_s0.json +[run] ogbg-molhiv view=gen compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gen --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.69984 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.70881 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.75302 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.72936 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.70265 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.70368 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.70119 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.70259 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.68337 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.68908 halt=0.00 train_steps=1.00 +[ogbg-molhiv_gen_classic_T0_ns1_h128_e100_s0] best_ep=30 val={'rocauc': 0.7530159954928474} test={'rocauc': 0.7313524788041483} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gen_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=gen compute=fixed-rrog T=3 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gen --compute fixed-rrog --T 3 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.69494 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.72712 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.73977 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.77045 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.76458 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.81280 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.75125 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.75873 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.75440 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.73884 halt=0.00 train_steps=3.00 +[ogbg-molhiv_gen_fixed-rrog_T3_ns3_h128_e100_s0] best_ep=60 val={'rocauc': 0.8127970066627475} test={'rocauc': 0.7631375654222755} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gen_fixed-rrog_T3_ns3_h128_e100_s0.json +[run] ogbg-molhiv view=film compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view film --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.74848 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.79215 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.78752 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.77785 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.78076 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.75260 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.77654 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.75306 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.74877 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.74891 halt=0.00 train_steps=1.00 +[ogbg-molhiv_film_classic_T0_ns1_h128_e100_s0] best_ep=20 val={'rocauc': 0.7921535126396236} test={'rocauc': 0.7842136773595473} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_film_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=film compute=fixed-rrog T=3 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view film --compute fixed-rrog --T 3 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.69034 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.74088 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.76331 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.76182 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.73312 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75706 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.72671 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.70616 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.71340 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.70973 halt=0.00 train_steps=3.00 +[ogbg-molhiv_film_fixed-rrog_T3_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.7633101851851851} test={'rocauc': 0.7727785395623709} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_film_fixed-rrog_T3_ns3_h128_e100_s0.json +[run] ogbg-molhiv view=resgated compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view resgated --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.68158 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.79255 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.79856 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.78576 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.80478 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.79662 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.79878 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.81437 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.80889 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.80836 halt=0.00 train_steps=1.00 +[ogbg-molhiv_resgated_classic_T0_ns1_h128_e100_s0] best_ep=80 val={'rocauc': 0.8143738977072311} test={'rocauc': 0.7241738928909403} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_resgated_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=resgated compute=fixed-rrog T=3 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view resgated --compute fixed-rrog --T 3 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.68104 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.77799 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.78871 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.79660 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.78792 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.80129 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.80478 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.81735 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.80159 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.80293 halt=0.00 train_steps=3.00 +[ogbg-molhiv_resgated_fixed-rrog_T3_ns3_h128_e100_s0] best_ep=80 val={'rocauc': 0.8173500881834216} test={'rocauc': 0.7054809865003185} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_resgated_fixed-rrog_T3_ns3_h128_e100_s0.json +[run] ogbg-molhiv view=tag compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view tag --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.57852 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.71945 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.68145 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.74554 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.73004 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.75214 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.75283 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.74456 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.74209 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.74289 halt=0.00 train_steps=1.00 +[ogbg-molhiv_tag_classic_T0_ns1_h128_e100_s0] best_ep=70 val={'rocauc': 0.7528292181069958} test={'rocauc': 0.7255354487340427} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_tag_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=tag compute=fixed-rrog T=3 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view tag --compute fixed-rrog --T 3 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.60822 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.72299 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.72619 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.76570 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.77329 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.76888 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.78038 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.77078 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.77102 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.77014 halt=0.00 train_steps=3.00 +[ogbg-molhiv_tag_fixed-rrog_T3_ns3_h128_e100_s0] best_ep=70 val={'rocauc': 0.7803834754066236} test={'rocauc': 0.7351764228741382} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_tag_fixed-rrog_T3_ns3_h128_e100_s0.json +[run] ogbg-molhiv view=sgc compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view sgc --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.71821 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.72852 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.71183 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.73111 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.72198 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.74022 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.73184 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.74786 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.74065 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.73686 halt=0.00 train_steps=1.00 +[ogbg-molhiv_sgc_classic_T0_ns1_h128_e100_s0] best_ep=80 val={'rocauc': 0.7478597148736037} test={'rocauc': 0.7019100407501111} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_sgc_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=sgc compute=fixed-rrog T=3 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view sgc --compute fixed-rrog --T 3 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.69664 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.68565 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.69235 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.71844 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.74817 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.72886 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.72618 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.73125 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.73147 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.72471 halt=0.00 train_steps=3.00 +[ogbg-molhiv_sgc_fixed-rrog_T3_ns3_h128_e100_s0] best_ep=50 val={'rocauc': 0.7481720311581422} test={'rocauc': 0.7177311265184728} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_sgc_fixed-rrog_T3_ns3_h128_e100_s0.json +[run] ogbg-molhiv view=cheb compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view cheb --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.75239 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.75098 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.78237 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.74148 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.78134 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.78312 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.77063 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.75010 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.76070 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.76190 halt=0.00 train_steps=1.00 +[ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s0] best_ep=60 val={'rocauc': 0.783120835782873} test={'rocauc': 0.7281735838853589} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=cheb compute=fixed-rrog T=3 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view cheb --compute fixed-rrog --T 3 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.74773 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.72303 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.75490 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.77348 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.76761 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.76278 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.75326 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.73576 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.74163 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.73885 halt=0.00 train_steps=3.00 +[ogbg-molhiv_cheb_fixed-rrog_T3_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.7734757740544776} test={'rocauc': 0.7425713126943356} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_cheb_fixed-rrog_T3_ns3_h128_e100_s0.json +[run] ogbg-molhiv view=arma compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view arma --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.72501 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.70732 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.71658 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.75121 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.78409 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.77785 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.78721 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.77699 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.78586 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.78516 halt=0.00 train_steps=1.00 +[ogbg-molhiv_arma_classic_T0_ns1_h128_e100_s0] best_ep=70 val={'rocauc': 0.7872115667254557} test={'rocauc': 0.7296336352575368} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_arma_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=arma compute=fixed-rrog T=3 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view arma --compute fixed-rrog --T 3 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.65686 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.76562 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.70968 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.75652 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.76905 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75629 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.77282 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.78131 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.79265 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.79150 halt=0.00 train_steps=3.00 +[ogbg-molhiv_arma_fixed-rrog_T3_ns3_h128_e100_s0] best_ep=90 val={'rocauc': 0.7926495443856555} test={'rocauc': 0.7317541860599857} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_arma_fixed-rrog_T3_ns3_h128_e100_s0.json +[run] ogbg-molhiv view=mf compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view mf --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.71708 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.77319 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.76736 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.76895 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.76902 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.78454 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.77621 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.77615 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.76938 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.76895 halt=0.00 train_steps=1.00 +[ogbg-molhiv_mf_classic_T0_ns1_h128_e100_s0] best_ep=60 val={'rocauc': 0.784538506760729} test={'rocauc': 0.7073504702678692} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_mf_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=mf compute=fixed-rrog T=3 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view mf --compute fixed-rrog --T 3 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.70505 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.76439 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.77684 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.77297 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.79308 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75479 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.75477 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.75694 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.74535 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.74554 halt=0.00 train_steps=3.00 +[ogbg-molhiv_mf_fixed-rrog_T3_ns3_h128_e100_s0] best_ep=50 val={'rocauc': 0.7930782137958065} test={'rocauc': 0.7216728789663763} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_mf_fixed-rrog_T3_ns3_h128_e100_s0.json +[run] ogbg-molhiv view=appnp compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view appnp --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.69287 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.71781 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.76749 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.69366 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.69388 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.70828 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.69664 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.71279 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.72196 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.72063 halt=0.00 train_steps=1.00 +[ogbg-molhiv_appnp_classic_T0_ns1_h128_e100_s0] best_ep=30 val={'rocauc': 0.7674851190476192} test={'rocauc': 0.7000000000000001} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_appnp_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=appnp compute=fixed-rrog T=3 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view appnp --compute fixed-rrog --T 3 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.67495 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.71270 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.72034 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.69504 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.64499 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.66316 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.66686 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.64643 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.66936 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.67262 halt=0.00 train_steps=3.00 +[ogbg-molhiv_appnp_fixed-rrog_T3_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.7203422006662747} test={'rocauc': 0.682502558952471} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_appnp_fixed-rrog_T3_ns3_h128_e100_s0.json + +Classic baseline: task x backbone +| task | backbone | metric | n | val | test | +| --- | --- | --- | --- | --- | --- | +| ogbg-molhiv | appnp | rocauc | 1 | 0.7675 +/- 0.0000 | 0.7000 +/- 0.0000 | +| ogbg-molhiv | arma | rocauc | 1 | 0.7872 +/- 0.0000 | 0.7296 +/- 0.0000 | +| ogbg-molhiv | cheb | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7282 +/- 0.0000 | +| ogbg-molhiv | film | rocauc | 1 | 0.7922 +/- 0.0000 | 0.7842 +/- 0.0000 | +| ogbg-molhiv | gatv2 | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7563 +/- 0.0000 | +| ogbg-molhiv | gcn | rocauc | 1 | 0.7754 +/- 0.0000 | 0.7198 +/- 0.0000 | +| ogbg-molhiv | gen | rocauc | 1 | 0.7530 +/- 0.0000 | 0.7314 +/- 0.0000 | +| ogbg-molhiv | gin | rocauc | 1 | 0.8167 +/- 0.0000 | 0.7724 +/- 0.0000 | +| ogbg-molhiv | gine | rocauc | 1 | 0.7942 +/- 0.0000 | 0.7445 +/- 0.0000 | +| ogbg-molhiv | graphconv | rocauc | 1 | 0.7707 +/- 0.0000 | 0.7108 +/- 0.0000 | +| ogbg-molhiv | graphsage | rocauc | 1 | 0.7969 +/- 0.0000 | 0.7625 +/- 0.0000 | +| ogbg-molhiv | mf | rocauc | 1 | 0.7845 +/- 0.0000 | 0.7074 +/- 0.0000 | +| ogbg-molhiv | pna | rocauc | 1 | 0.7780 +/- 0.0000 | 0.7648 +/- 0.0000 | +| ogbg-molhiv | resgated | rocauc | 1 | 0.8144 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molhiv | sgc | rocauc | 1 | 0.7479 +/- 0.0000 | 0.7019 +/- 0.0000 | +| ogbg-molhiv | tag | rocauc | 1 | 0.7528 +/- 0.0000 | 0.7255 +/- 0.0000 | +| ogbg-molhiv | transformer | rocauc | 1 | 0.7617 +/- 0.0000 | 0.7547 +/- 0.0000 | + +Delta vs matching classic +| task | backbone | compute | metric | n | val score (delta) | test score (delta) | steps | +| --- | --- | --- | --- | --- | --- | --- | --- | +| ogbg-molhiv | appnp | fixed-rrog | rocauc | 1 | 0.7203 (-0.0471) | 0.6825 (-0.0175) | | +| ogbg-molhiv | arma | fixed-rrog | rocauc | 1 | 0.7926 (0.0054) | 0.7318 (0.0021) | | +| ogbg-molhiv | cheb | fixed-rrog | rocauc | 1 | 0.7735 (-0.0096) | 0.7426 (0.0144) | | +| ogbg-molhiv | film | fixed-rrog | rocauc | 1 | 0.7633 (-0.0288) | 0.7728 (-0.0114) | | +| ogbg-molhiv | gatv2 | fixed-rrog | rocauc | 1 | 0.7835 (0.0001) | 0.7466 (-0.0096) | | +| ogbg-molhiv | gcn | fixed-rrog | rocauc | 1 | 0.7455 (-0.0300) | 0.7483 (0.0285) | | +| ogbg-molhiv | gen | fixed-rrog | rocauc | 1 | 0.8128 (0.0598) | 0.7631 (0.0318) | | +| ogbg-molhiv | gin | fixed-rrog | rocauc | 1 | 0.7524 (-0.0644) | 0.7324 (-0.0400) | | +| ogbg-molhiv | gine | fixed-rrog | rocauc | 1 | 0.7575 (-0.0368) | 0.7401 (-0.0044) | | +| ogbg-molhiv | graphconv | fixed-rrog | rocauc | 1 | 0.7713 (0.0006) | 0.6979 (-0.0129) | | +| ogbg-molhiv | graphsage | fixed-rrog | rocauc | 1 | 0.7587 (-0.0382) | 0.7641 (0.0016) | | +| ogbg-molhiv | mf | fixed-rrog | rocauc | 1 | 0.7931 (0.0085) | 0.7217 (0.0143) | | +| ogbg-molhiv | pna | fixed-rrog | rocauc | 1 | 0.7890 (0.0111) | 0.7630 (-0.0018) | | +| ogbg-molhiv | resgated | fixed-rrog | rocauc | 1 | 0.8174 (0.0030) | 0.7055 (-0.0187) | | +| ogbg-molhiv | sgc | fixed-rrog | rocauc | 1 | 0.7482 (0.0003) | 0.7177 (0.0158) | | +| ogbg-molhiv | tag | fixed-rrog | rocauc | 1 | 0.7804 (0.0276) | 0.7352 (0.0096) | | +| ogbg-molhiv | transformer | fixed-rrog | rocauc | 1 | 0.8088 (0.0471) | 0.7413 (-0.0134) | | diff --git a/logs/ogbg-molhiv_T1_ns3_s0.log b/logs/ogbg-molhiv_T1_ns3_s0.log new file mode 100644 index 0000000..a4dc30e --- /dev/null +++ b/logs/ogbg-molhiv_T1_ns3_s0.log @@ -0,0 +1,626 @@ +[skip] runs/ogbg-molhiv_gin_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=gin compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gin --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:0 +ep10 val_rocauc=0.52613 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.70545 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.65789 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.77100 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.75591 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.74447 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.75031 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.73179 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.74630 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.74027 halt=0.00 train_steps=3.00 +[ogbg-molhiv_gin_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.7710048010973936} test={'rocauc': 0.7667761061434172} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gin_fixed-rrog_T1_ns3_h128_e100_s0.json +[skip] runs/ogbg-molhiv_gine_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=gine compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gine --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:0 +ep10 val_rocauc=0.60417 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.71514 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.71708 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.73860 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.73481 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.73761 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.72236 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.74896 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.74260 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.74183 halt=0.00 train_steps=3.00 +[ogbg-molhiv_gine_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=80 val={'rocauc': 0.7489589457182049} test={'rocauc': 0.7375634909905561} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gine_fixed-rrog_T1_ns3_h128_e100_s0.json +[skip] runs/ogbg-molhiv_gcn_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=gcn compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gcn --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:0 +ep10 val_rocauc=0.64381 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.76352 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.75232 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.77157 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.72431 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.78334 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.76257 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.75355 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.76158 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.75779 halt=0.00 train_steps=3.00 +[ogbg-molhiv_gcn_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=60 val={'rocauc': 0.783344356261023} test={'rocauc': 0.7447787713165569} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json +[skip] runs/ogbg-molhiv_graphsage_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=graphsage compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view graphsage --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:0 +ep10 val_rocauc=0.67776 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.74009 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.69741 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.77888 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.78935 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.76325 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.75591 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.72551 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.71822 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.71852 halt=0.00 train_steps=3.00 +[ogbg-molhiv_graphsage_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rocauc': 0.7893457280031354} test={'rocauc': 0.7632959307827497} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json +[skip] runs/ogbg-molhiv_gatv2_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=gatv2 compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gatv2 --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:0 +ep10 val_rocauc=0.64010 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.76351 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.80490 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.75482 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.78361 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.78926 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.75524 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.77222 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.76119 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.76813 halt=0.00 train_steps=3.00 +[ogbg-molhiv_gatv2_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.8049003037428963} test={'rocauc': 0.7485679522586377} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json +[skip] runs/ogbg-molhiv_graphconv_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=graphconv compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view graphconv --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:0 +ep10 val_rocauc=0.68284 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.75036 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.73015 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.78168 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.77547 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75932 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.77169 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.76077 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.75885 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.75807 halt=0.00 train_steps=3.00 +[ogbg-molhiv_graphconv_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.7816847932588673} test={'rocauc': 0.7492632148168176} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json +[skip] runs/ogbg-molhiv_transformer_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=transformer compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view transformer --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:0 +ep10 val_rocauc=0.71048 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.73061 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.78382 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.76229 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.78076 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.77954 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.76771 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.76045 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.75987 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.76094 halt=0.00 train_steps=3.00 +[ogbg-molhiv_transformer_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.7838158926121889} test={'rocauc': 0.7647501883002762} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json +[skip] runs/ogbg-molhiv_pna_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=pna compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view pna --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:0 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.73911 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.65293 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.76153 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.73555 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.72598 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.80966 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.76538 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.77175 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.76773 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.76248 halt=0.00 train_steps=3.00 +[ogbg-molhiv_pna_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=60 val={'rocauc': 0.8096554722712129} test={'rocauc': 0.7601633867011722} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_pna_fixed-rrog_T1_ns3_h128_e100_s0.json +[skip] runs/ogbg-molhiv_gen_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=gen compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gen --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:0 +ep10 val_rocauc=0.73991 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.75281 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.66395 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.75387 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.77401 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.77070 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.73017 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.72701 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.73952 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.73520 halt=0.00 train_steps=3.00 +[ogbg-molhiv_gen_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rocauc': 0.77400548696845} test={'rocauc': 0.7589563336487767} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gen_fixed-rrog_T1_ns3_h128_e100_s0.json +[skip] runs/ogbg-molhiv_film_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=film compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view film --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:0 +ep10 val_rocauc=0.66456 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.77269 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.77029 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.82515 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.71021 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.80563 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.78091 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.76824 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.77147 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.75765 halt=0.00 train_steps=3.00 +[ogbg-molhiv_film_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.8251457475994514} test={'rocauc': 0.7725487166611946} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_film_fixed-rrog_T1_ns3_h128_e100_s0.json +[skip] runs/ogbg-molhiv_resgated_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=resgated compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view resgated --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:0 +ep10 val_rocauc=0.72860 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.72892 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.76794 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.78591 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.79226 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.76919 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.78373 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.78924 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.78751 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.78266 halt=0.00 train_steps=3.00 +[ogbg-molhiv_resgated_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rocauc': 0.7922576180678031} test={'rocauc': 0.7226559029722475} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json +[skip] runs/ogbg-molhiv_tag_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=tag compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view tag --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:0 +ep10 val_rocauc=0.59326 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.69148 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.65895 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.65750 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.76568 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75549 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.76344 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.76911 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.77170 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.76987 halt=0.00 train_steps=3.00 +[ogbg-molhiv_tag_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=90 val={'rocauc': 0.7717029198510681} test={'rocauc': 0.7181154522103554} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_tag_fixed-rrog_T1_ns3_h128_e100_s0.json +[skip] runs/ogbg-molhiv_sgc_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=sgc compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view sgc --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:0 +ep10 val_rocauc=0.70493 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.73664 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.72784 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.75185 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.72864 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75657 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.76280 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.76591 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.75411 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.75739 halt=0.00 train_steps=3.00 +[ogbg-molhiv_sgc_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=80 val={'rocauc': 0.7659097589653145} test={'rocauc': 0.7135769327333474} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json +[skip] runs/ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=cheb compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view cheb --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:0 +ep10 val_rocauc=0.75264 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.76719 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.74289 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.79468 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.76474 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.76252 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.76949 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.75856 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.75231 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.75098 halt=0.00 train_steps=3.00 +[ogbg-molhiv_cheb_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.794682662159514} test={'rocauc': 0.7290194866644778} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json +[skip] runs/ogbg-molhiv_arma_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=arma compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view arma --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:0 +ep10 val_rocauc=0.68967 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.73124 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.74889 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.77770 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.77862 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.79564 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.76844 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.76816 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.77160 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.76284 halt=0.00 train_steps=3.00 +[ogbg-molhiv_arma_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=60 val={'rocauc': 0.7956441064079952} test={'rocauc': 0.6966917089939937} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_arma_fixed-rrog_T1_ns3_h128_e100_s0.json +[skip] runs/ogbg-molhiv_mf_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=mf compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view mf --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:0 +ep10 val_rocauc=0.68258 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.74430 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.75018 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.76723 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.77540 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.74952 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.75421 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.75108 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.75275 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.75041 halt=0.00 train_steps=3.00 +[ogbg-molhiv_mf_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rocauc': 0.7754017244757985} test={'rocauc': 0.7114583132157826} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_mf_fixed-rrog_T1_ns3_h128_e100_s0.json +[skip] runs/ogbg-molhiv_appnp_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molhiv view=appnp compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view appnp --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:0 +ep10 val_rocauc=0.71241 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.69902 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.75349 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.70339 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.74383 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75732 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.72123 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.71581 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.71400 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.71511 halt=0.00 train_steps=3.00 +[ogbg-molhiv_appnp_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=60 val={'rocauc': 0.7573179992161474} test={'rocauc': 0.7228548253152822} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json + +Classic baseline: task x backbone +| task | backbone | metric | n | val | test | +| --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | rocauc | 1 | 0.6564 +/- 0.0000 | 0.7423 +/- 0.0000 | +| ogbg-molbace | arma | rocauc | 1 | 0.6923 +/- 0.0000 | 0.7839 +/- 0.0000 | +| ogbg-molbace | cheb | rocauc | 1 | 0.7267 +/- 0.0000 | 0.7969 +/- 0.0000 | +| ogbg-molbace | film | rocauc | 1 | 0.6703 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molbace | gatv2 | rocauc | 1 | 0.7029 +/- 0.0000 | 0.7400 +/- 0.0000 | +| ogbg-molbace | gcn | rocauc | 1 | 0.6381 +/- 0.0000 | 0.7393 +/- 0.0000 | +| ogbg-molbace | gen | rocauc | 1 | 0.7128 +/- 0.0000 | 0.7326 +/- 0.0000 | +| ogbg-molbace | gin | rocauc | 1 | 0.6520 +/- 0.0000 | 0.7336 +/- 0.0000 | +| ogbg-molbace | gine | rocauc | 1 | 0.6641 +/- 0.0000 | 0.7454 +/- 0.0000 | +| ogbg-molbace | graphconv | rocauc | 1 | 0.7311 +/- 0.0000 | 0.8035 +/- 0.0000 | +| ogbg-molbace | graphsage | rocauc | 1 | 0.6758 +/- 0.0000 | 0.7759 +/- 0.0000 | +| ogbg-molbace | mf | rocauc | 1 | 0.7421 +/- 0.0000 | 0.7760 +/- 0.0000 | +| ogbg-molbace | pna | rocauc | 1 | 0.7516 +/- 0.0000 | 0.6912 +/- 0.0000 | +| ogbg-molbace | resgated | rocauc | 1 | 0.7172 +/- 0.0000 | 0.7877 +/- 0.0000 | +| ogbg-molbace | sgc | rocauc | 1 | 0.6575 +/- 0.0000 | 0.6966 +/- 0.0000 | +| ogbg-molbace | tag | rocauc | 1 | 0.7084 +/- 0.0000 | 0.7345 +/- 0.0000 | +| ogbg-molbace | transformer | rocauc | 1 | 0.6663 +/- 0.0000 | 0.7364 +/- 0.0000 | +| ogbg-molbbbp | appnp | rocauc | 1 | 0.9147 +/- 0.0000 | 0.6388 +/- 0.0000 | +| ogbg-molbbbp | arma | rocauc | 1 | 0.9367 +/- 0.0000 | 0.6651 +/- 0.0000 | +| ogbg-molbbbp | cheb | rocauc | 1 | 0.9452 +/- 0.0000 | 0.6514 +/- 0.0000 | +| ogbg-molbbbp | film | rocauc | 1 | 0.9285 +/- 0.0000 | 0.6300 +/- 0.0000 | +| ogbg-molbbbp | gatv2 | rocauc | 1 | 0.9347 +/- 0.0000 | 0.6324 +/- 0.0000 | +| ogbg-molbbbp | gcn | rocauc | 1 | 0.9386 +/- 0.0000 | 0.6679 +/- 0.0000 | +| ogbg-molbbbp | gen | rocauc | 1 | 0.9549 +/- 0.0000 | 0.6775 +/- 0.0000 | +| ogbg-molbbbp | gin | rocauc | 1 | 0.9251 +/- 0.0000 | 0.5670 +/- 0.0000 | +| ogbg-molbbbp | gine | rocauc | 1 | 0.9324 +/- 0.0000 | 0.6160 +/- 0.0000 | +| ogbg-molbbbp | graphconv | rocauc | 1 | 0.9268 +/- 0.0000 | 0.5900 +/- 0.0000 | +| ogbg-molbbbp | graphsage | rocauc | 1 | 0.9483 +/- 0.0000 | 0.6288 +/- 0.0000 | +| ogbg-molbbbp | mf | rocauc | 1 | 0.9395 +/- 0.0000 | 0.6365 +/- 0.0000 | +| ogbg-molbbbp | pna | rocauc | 1 | 0.9554 +/- 0.0000 | 0.6418 +/- 0.0000 | +| ogbg-molbbbp | resgated | rocauc | 1 | 0.9183 +/- 0.0000 | 0.6626 +/- 0.0000 | +| ogbg-molbbbp | sgc | rocauc | 1 | 0.9300 +/- 0.0000 | 0.6239 +/- 0.0000 | +| ogbg-molbbbp | tag | rocauc | 1 | 0.9476 +/- 0.0000 | 0.6100 +/- 0.0000 | +| ogbg-molbbbp | transformer | rocauc | 1 | 0.9495 +/- 0.0000 | 0.6156 +/- 0.0000 | +| ogbg-molclintox | appnp | rocauc | 1 | 0.8516 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | arma | rocauc | 1 | 0.9463 +/- 0.0000 | 0.8678 +/- 0.0000 | +| ogbg-molclintox | cheb | rocauc | 1 | 0.8928 +/- 0.0000 | 0.9152 +/- 0.0000 | +| ogbg-molclintox | film | rocauc | 1 | 0.9048 +/- 0.0000 | 0.7731 +/- 0.0000 | +| ogbg-molclintox | gatv2 | rocauc | 1 | 0.9515 +/- 0.0000 | 0.8493 +/- 0.0000 | +| ogbg-molclintox | gcn | rocauc | 1 | 0.9318 +/- 0.0000 | 0.8932 +/- 0.0000 | +| ogbg-molclintox | gen | rocauc | 1 | 0.9820 +/- 0.0000 | 0.8128 +/- 0.0000 | +| ogbg-molclintox | gin | rocauc | 1 | 0.9547 +/- 0.0000 | 0.8586 +/- 0.0000 | +| ogbg-molclintox | gine | rocauc | 1 | 0.9353 +/- 0.0000 | 0.8869 +/- 0.0000 | +| ogbg-molclintox | graphconv | rocauc | 1 | 0.8917 +/- 0.0000 | 0.8501 +/- 0.0000 | +| ogbg-molclintox | graphsage | rocauc | 1 | 0.9143 +/- 0.0000 | 0.8882 +/- 0.0000 | +| ogbg-molclintox | mf | rocauc | 1 | 0.9252 +/- 0.0000 | 0.8370 +/- 0.0000 | +| ogbg-molclintox | pna | rocauc | 1 | 0.9286 +/- 0.0000 | 0.8603 +/- 0.0000 | +| ogbg-molclintox | resgated | rocauc | 1 | 0.9244 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | sgc | rocauc | 1 | 0.9195 +/- 0.0000 | 0.8986 +/- 0.0000 | +| ogbg-molclintox | tag | rocauc | 1 | 0.9237 +/- 0.0000 | 0.7998 +/- 0.0000 | +| ogbg-molclintox | transformer | rocauc | 1 | 0.9271 +/- 0.0000 | 0.8764 +/- 0.0000 | +| ogbg-molesol | appnp | rmse | 1 | 1.6083 +/- 0.0000 | 1.5212 +/- 0.0000 | +| ogbg-molesol | arma | rmse | 1 | 1.0195 +/- 0.0000 | 1.0666 +/- 0.0000 | +| ogbg-molesol | cheb | rmse | 1 | 0.9650 +/- 0.0000 | 0.8722 +/- 0.0000 | +| ogbg-molesol | film | rmse | 1 | 1.0718 +/- 0.0000 | 1.2896 +/- 0.0000 | +| ogbg-molesol | gatv2 | rmse | 1 | 1.0368 +/- 0.0000 | 0.9878 +/- 0.0000 | +| ogbg-molesol | gcn | rmse | 1 | 1.0409 +/- 0.0000 | 1.1161 +/- 0.0000 | +| ogbg-molesol | gen | rmse | 1 | 1.0089 +/- 0.0000 | 0.8762 +/- 0.0000 | +| ogbg-molesol | gin | rmse | 1 | 1.0187 +/- 0.0000 | 0.9900 +/- 0.0000 | +| ogbg-molesol | gine | rmse | 1 | 1.0286 +/- 0.0000 | 1.0807 +/- 0.0000 | +| ogbg-molesol | graphconv | rmse | 1 | 0.9741 +/- 0.0000 | 0.9732 +/- 0.0000 | +| ogbg-molesol | graphsage | rmse | 1 | 0.9680 +/- 0.0000 | 1.0038 +/- 0.0000 | +| ogbg-molesol | mf | rmse | 1 | 1.1494 +/- 0.0000 | 1.0639 +/- 0.0000 | +| ogbg-molesol | pna | rmse | 1 | 0.9116 +/- 0.0000 | 0.9153 +/- 0.0000 | +| ogbg-molesol | resgated | rmse | 1 | 0.9492 +/- 0.0000 | 0.8908 +/- 0.0000 | +| ogbg-molesol | sgc | rmse | 1 | 1.0617 +/- 0.0000 | 0.9780 +/- 0.0000 | +| ogbg-molesol | tag | rmse | 1 | 0.9323 +/- 0.0000 | 0.9678 +/- 0.0000 | +| ogbg-molesol | transformer | rmse | 1 | 0.9398 +/- 0.0000 | 0.9492 +/- 0.0000 | +| ogbg-molfreesolv | appnp | rmse | 1 | 6.0462 +/- 0.0000 | 4.6478 +/- 0.0000 | +| ogbg-molfreesolv | arma | rmse | 1 | 4.2662 +/- 0.0000 | 2.9769 +/- 0.0000 | +| ogbg-molfreesolv | cheb | rmse | 1 | 2.9481 +/- 0.0000 | 2.2431 +/- 0.0000 | +| ogbg-molfreesolv | film | rmse | 1 | 3.1546 +/- 0.0000 | 2.9581 +/- 0.0000 | +| ogbg-molfreesolv | gatv2 | rmse | 1 | 4.2086 +/- 0.0000 | 2.7368 +/- 0.0000 | +| ogbg-molfreesolv | gcn | rmse | 1 | 3.7172 +/- 0.0000 | 2.4851 +/- 0.0000 | +| ogbg-molfreesolv | gen | rmse | 1 | 3.9998 +/- 0.0000 | 2.5588 +/- 0.0000 | +| ogbg-molfreesolv | gin | rmse | 1 | 4.0190 +/- 0.0000 | 3.4898 +/- 0.0000 | +| ogbg-molfreesolv | gine | rmse | 1 | 3.2961 +/- 0.0000 | 3.1442 +/- 0.0000 | +| ogbg-molfreesolv | graphconv | rmse | 1 | 2.5314 +/- 0.0000 | 2.7953 +/- 0.0000 | +| ogbg-molfreesolv | graphsage | rmse | 1 | 3.5022 +/- 0.0000 | 2.2977 +/- 0.0000 | +| ogbg-molfreesolv | mf | rmse | 1 | 2.7374 +/- 0.0000 | 2.8885 +/- 0.0000 | +| ogbg-molfreesolv | pna | rmse | 1 | 2.3625 +/- 0.0000 | 2.2610 +/- 0.0000 | +| ogbg-molfreesolv | resgated | rmse | 1 | 2.4772 +/- 0.0000 | 2.0041 +/- 0.0000 | +| ogbg-molfreesolv | sgc | rmse | 1 | 3.9147 +/- 0.0000 | 2.4146 +/- 0.0000 | +| ogbg-molfreesolv | tag | rmse | 1 | 2.6874 +/- 0.0000 | 2.3826 +/- 0.0000 | +| ogbg-molfreesolv | transformer | rmse | 1 | 4.0942 +/- 0.0000 | 2.3205 +/- 0.0000 | +| ogbg-molhiv | appnp | rocauc | 1 | 0.7675 +/- 0.0000 | 0.7000 +/- 0.0000 | +| ogbg-molhiv | arma | rocauc | 1 | 0.7872 +/- 0.0000 | 0.7296 +/- 0.0000 | +| ogbg-molhiv | cheb | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7282 +/- 0.0000 | +| ogbg-molhiv | film | rocauc | 1 | 0.7922 +/- 0.0000 | 0.7842 +/- 0.0000 | +| ogbg-molhiv | gatv2 | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7563 +/- 0.0000 | +| ogbg-molhiv | gcn | rocauc | 1 | 0.7754 +/- 0.0000 | 0.7198 +/- 0.0000 | +| ogbg-molhiv | gen | rocauc | 1 | 0.7530 +/- 0.0000 | 0.7314 +/- 0.0000 | +| ogbg-molhiv | gin | rocauc | 1 | 0.8167 +/- 0.0000 | 0.7724 +/- 0.0000 | +| ogbg-molhiv | gine | rocauc | 1 | 0.7942 +/- 0.0000 | 0.7445 +/- 0.0000 | +| ogbg-molhiv | graphconv | rocauc | 1 | 0.7707 +/- 0.0000 | 0.7108 +/- 0.0000 | +| ogbg-molhiv | graphsage | rocauc | 1 | 0.7969 +/- 0.0000 | 0.7625 +/- 0.0000 | +| ogbg-molhiv | mf | rocauc | 1 | 0.7845 +/- 0.0000 | 0.7074 +/- 0.0000 | +| ogbg-molhiv | pna | rocauc | 1 | 0.7780 +/- 0.0000 | 0.7648 +/- 0.0000 | +| ogbg-molhiv | resgated | rocauc | 1 | 0.8144 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molhiv | sgc | rocauc | 1 | 0.7479 +/- 0.0000 | 0.7019 +/- 0.0000 | +| ogbg-molhiv | tag | rocauc | 1 | 0.7528 +/- 0.0000 | 0.7255 +/- 0.0000 | +| ogbg-molhiv | transformer | rocauc | 1 | 0.7617 +/- 0.0000 | 0.7547 +/- 0.0000 | +| ogbg-mollipo | appnp | rmse | 1 | 0.9015 +/- 0.0000 | 0.9070 +/- 0.0000 | +| ogbg-mollipo | arma | rmse | 1 | 0.7325 +/- 0.0000 | 0.7295 +/- 0.0000 | +| ogbg-mollipo | cheb | rmse | 1 | 0.7188 +/- 0.0000 | 0.7180 +/- 0.0000 | +| ogbg-mollipo | film | rmse | 1 | 0.7620 +/- 0.0000 | 0.7371 +/- 0.0000 | +| ogbg-mollipo | gatv2 | rmse | 1 | 0.6865 +/- 0.0000 | 0.7308 +/- 0.0000 | +| ogbg-mollipo | gcn | rmse | 1 | 0.7379 +/- 0.0000 | 0.7828 +/- 0.0000 | +| ogbg-mollipo | gen | rmse | 1 | 0.7046 +/- 0.0000 | 0.7379 +/- 0.0000 | +| ogbg-mollipo | gin | rmse | 1 | 0.6854 +/- 0.0000 | 0.7390 +/- 0.0000 | +| ogbg-mollipo | gine | rmse | 1 | 0.6615 +/- 0.0000 | 0.7341 +/- 0.0000 | +| ogbg-mollipo | graphconv | rmse | 1 | 0.7178 +/- 0.0000 | 0.7297 +/- 0.0000 | +| ogbg-mollipo | graphsage | rmse | 1 | 0.7239 +/- 0.0000 | 0.7783 +/- 0.0000 | +| ogbg-mollipo | mf | rmse | 1 | 0.7129 +/- 0.0000 | 0.7405 +/- 0.0000 | +| ogbg-mollipo | pna | rmse | 1 | 0.7179 +/- 0.0000 | 0.7749 +/- 0.0000 | +| ogbg-mollipo | resgated | rmse | 1 | 0.6721 +/- 0.0000 | 0.7270 +/- 0.0000 | +| ogbg-mollipo | sgc | rmse | 1 | 0.7505 +/- 0.0000 | 0.8176 +/- 0.0000 | +| ogbg-mollipo | tag | rmse | 1 | 0.6692 +/- 0.0000 | 0.7227 +/- 0.0000 | +| ogbg-mollipo | transformer | rmse | 1 | 0.6810 +/- 0.0000 | 0.7346 +/- 0.0000 | +| ogbg-molsider | appnp | rocauc | 1 | 0.5886 +/- 0.0000 | 0.6004 +/- 0.0000 | +| ogbg-molsider | arma | rocauc | 1 | 0.6273 +/- 0.0000 | 0.6159 +/- 0.0000 | +| ogbg-molsider | cheb | rocauc | 1 | 0.6237 +/- 0.0000 | 0.6033 +/- 0.0000 | +| ogbg-molsider | film | rocauc | 1 | 0.6024 +/- 0.0000 | 0.5898 +/- 0.0000 | +| ogbg-molsider | gatv2 | rocauc | 1 | 0.6071 +/- 0.0000 | 0.6013 +/- 0.0000 | +| ogbg-molsider | gcn | rocauc | 1 | 0.6293 +/- 0.0000 | 0.6086 +/- 0.0000 | +| ogbg-molsider | gen | rocauc | 1 | 0.6519 +/- 0.0000 | 0.5854 +/- 0.0000 | +| ogbg-molsider | gin | rocauc | 1 | 0.6225 +/- 0.0000 | 0.5748 +/- 0.0000 | +| ogbg-molsider | gine | rocauc | 1 | 0.6327 +/- 0.0000 | 0.5495 +/- 0.0000 | +| ogbg-molsider | graphconv | rocauc | 1 | 0.5921 +/- 0.0000 | 0.6151 +/- 0.0000 | +| ogbg-molsider | graphsage | rocauc | 1 | 0.6217 +/- 0.0000 | 0.5807 +/- 0.0000 | +| ogbg-molsider | mf | rocauc | 1 | 0.6202 +/- 0.0000 | 0.5861 +/- 0.0000 | +| ogbg-molsider | pna | rocauc | 1 | 0.6219 +/- 0.0000 | 0.5965 +/- 0.0000 | +| ogbg-molsider | resgated | rocauc | 1 | 0.6209 +/- 0.0000 | 0.5910 +/- 0.0000 | +| ogbg-molsider | sgc | rocauc | 1 | 0.6174 +/- 0.0000 | 0.6043 +/- 0.0000 | +| ogbg-molsider | tag | rocauc | 1 | 0.6439 +/- 0.0000 | 0.6143 +/- 0.0000 | +| ogbg-molsider | transformer | rocauc | 1 | 0.6160 +/- 0.0000 | 0.5980 +/- 0.0000 | +| ogbg-moltox21 | appnp | rocauc | 1 | 0.7255 +/- 0.0000 | 0.7158 +/- 0.0000 | +| ogbg-moltox21 | arma | rocauc | 1 | 0.7799 +/- 0.0000 | 0.7223 +/- 0.0000 | +| ogbg-moltox21 | cheb | rocauc | 1 | 0.7834 +/- 0.0000 | 0.7301 +/- 0.0000 | +| ogbg-moltox21 | film | rocauc | 1 | 0.7702 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gatv2 | rocauc | 1 | 0.7627 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gcn | rocauc | 1 | 0.7580 +/- 0.0000 | 0.7171 +/- 0.0000 | +| ogbg-moltox21 | gen | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7444 +/- 0.0000 | +| ogbg-moltox21 | gin | rocauc | 1 | 0.7690 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-moltox21 | gine | rocauc | 1 | 0.7744 +/- 0.0000 | 0.7328 +/- 0.0000 | +| ogbg-moltox21 | graphconv | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7147 +/- 0.0000 | +| ogbg-moltox21 | graphsage | rocauc | 1 | 0.7709 +/- 0.0000 | 0.7196 +/- 0.0000 | +| ogbg-moltox21 | mf | rocauc | 1 | 0.7773 +/- 0.0000 | 0.7281 +/- 0.0000 | +| ogbg-moltox21 | pna | rocauc | 1 | 0.7660 +/- 0.0000 | 0.6946 +/- 0.0000 | +| ogbg-moltox21 | resgated | rocauc | 1 | 0.7950 +/- 0.0000 | 0.7275 +/- 0.0000 | +| ogbg-moltox21 | sgc | rocauc | 1 | 0.7611 +/- 0.0000 | 0.7240 +/- 0.0000 | +| ogbg-moltox21 | tag | rocauc | 1 | 0.7866 +/- 0.0000 | 0.7416 +/- 0.0000 | +| ogbg-moltox21 | transformer | rocauc | 1 | 0.7656 +/- 0.0000 | 0.7309 +/- 0.0000 | + +Delta vs matching classic +| task | backbone | compute | metric | n | val score (delta) | test score (delta) | steps | +| --- | --- | --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7168 (0.0604) | 0.7209 (-0.0214) | | +| ogbg-molbace | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7179 (0.0256) | 0.7672 (-0.0167) | | +| ogbg-molbace | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7114 (-0.0154) | 0.7533 (-0.0436) | | +| ogbg-molbace | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6652 (-0.0051) | 0.7242 (0.0000) | | +| ogbg-molbace | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7026 (-0.0004) | 0.7519 (0.0118) | | +| ogbg-molbace | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6374 (-0.0007) | 0.7733 (0.0339) | | +| ogbg-molbace | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6894 (-0.0234) | 0.7449 (0.0123) | | +| ogbg-molbace | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6538 (0.0018) | 0.7169 (-0.0167) | | +| ogbg-molbace | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6685 (0.0044) | 0.6994 (-0.0461) | | +| ogbg-molbace | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7462 (0.0150) | 0.7983 (-0.0052) | | +| ogbg-molbace | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6703 (-0.0055) | 0.7119 (-0.0640) | | +| ogbg-molbace | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7234 (-0.0187) | 0.7684 (-0.0077) | | +| ogbg-molbace | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7037 (-0.0480) | 0.7967 (0.1055) | | +| ogbg-molbace | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6912 (-0.0260) | 0.7465 (-0.0412) | | +| ogbg-molbace | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6454 (-0.0121) | 0.7727 (0.0762) | | +| ogbg-molbace | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7355 (0.0271) | 0.6806 (-0.0539) | | +| ogbg-molbace | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6982 (0.0319) | 0.7487 (0.0123) | | +| ogbg-molbbbp | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9360 (0.0213) | 0.6073 (-0.0314) | | +| ogbg-molbbbp | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9415 (0.0048) | 0.6635 (-0.0016) | | +| ogbg-molbbbp | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9278 (-0.0174) | 0.6659 (0.0145) | | +| ogbg-molbbbp | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9400 (0.0115) | 0.6323 (0.0023) | | +| ogbg-molbbbp | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9356 (0.0009) | 0.6560 (0.0235) | | +| ogbg-molbbbp | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9417 (0.0031) | 0.6017 (-0.0663) | | +| ogbg-molbbbp | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9429 (-0.0119) | 0.6037 (-0.0738) | | +| ogbg-molbbbp | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9526 (0.0275) | 0.5932 (0.0261) | | +| ogbg-molbbbp | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9421 (0.0098) | 0.6976 (0.0816) | | +| ogbg-molbbbp | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9337 (0.0069) | 0.6518 (0.0618) | | +| ogbg-molbbbp | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9502 (0.0019) | 0.5934 (-0.0354) | | +| ogbg-molbbbp | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9488 (0.0094) | 0.6481 (0.0116) | | +| ogbg-molbbbp | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9585 (0.0031) | 0.6682 (0.0264) | | +| ogbg-molbbbp | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9535 (0.0352) | 0.5839 (-0.0787) | | +| ogbg-molbbbp | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9285 (-0.0015) | 0.6454 (0.0215) | | +| ogbg-molbbbp | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9459 (-0.0017) | 0.6420 (0.0320) | | +| ogbg-molbbbp | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9355 (-0.0140) | 0.6221 (0.0065) | | +| ogbg-molclintox | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9029 (0.0513) | 0.8898 (-0.0286) | | +| ogbg-molclintox | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9135 (-0.0328) | 0.8863 (0.0185) | | +| ogbg-molclintox | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8816 (-0.0112) | 0.8982 (-0.0170) | | +| ogbg-molclintox | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9454 (0.0406) | 0.8430 (0.0699) | | +| ogbg-molclintox | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9351 (-0.0164) | 0.8328 (-0.0164) | | +| ogbg-molclintox | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9097 (-0.0221) | 0.8792 (-0.0140) | | +| ogbg-molclintox | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9399 (-0.0421) | 0.8194 (0.0066) | | +| ogbg-molclintox | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9164 (-0.0383) | 0.8788 (0.0202) | | +| ogbg-molclintox | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9225 (-0.0127) | 0.8840 (-0.0030) | | +| ogbg-molclintox | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8494 (-0.0424) | 0.8186 (-0.0316) | | +| ogbg-molclintox | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9579 (0.0436) | 0.8664 (-0.0217) | | +| ogbg-molclintox | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9147 (-0.0104) | 0.8047 (-0.0323) | | +| ogbg-molclintox | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9064 (-0.0222) | 0.8735 (0.0132) | | +| ogbg-molclintox | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9055 (-0.0188) | 0.8979 (-0.0205) | | +| ogbg-molclintox | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9220 (0.0025) | 0.9054 (0.0068) | | +| ogbg-molclintox | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9183 (-0.0054) | 0.8433 (0.0435) | | +| ogbg-molclintox | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9322 (0.0051) | 0.8522 (-0.0242) | | +| ogbg-molesol | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 1.4196 (0.1887) | 1.4929 (0.0284) | | +| ogbg-molesol | arma | fixed-rrog-T1-ns3 | rmse | 1 | 1.0034 (0.0160) | 1.1272 (-0.0606) | | +| ogbg-molesol | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 0.9199 (0.0451) | 0.8841 (-0.0118) | | +| ogbg-molesol | film | fixed-rrog-T1-ns3 | rmse | 1 | 1.0196 (0.0521) | 1.0849 (0.2047) | | +| ogbg-molesol | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 1.0018 (0.0350) | 0.9780 (0.0098) | | +| ogbg-molesol | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 0.9591 (0.0818) | 0.9305 (0.1856) | | +| ogbg-molesol | gen | fixed-rrog-T1-ns3 | rmse | 1 | 1.0027 (0.0062) | 0.9206 (-0.0444) | | +| ogbg-molesol | gin | fixed-rrog-T1-ns3 | rmse | 1 | 0.9647 (0.0540) | 1.0798 (-0.0899) | | +| ogbg-molesol | gine | fixed-rrog-T1-ns3 | rmse | 1 | 1.0581 (-0.0295) | 1.0951 (-0.0144) | | +| ogbg-molesol | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 1.0048 (-0.0307) | 0.9968 (-0.0236) | | +| ogbg-molesol | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 0.9934 (-0.0254) | 1.0794 (-0.0757) | | +| ogbg-molesol | mf | fixed-rrog-T1-ns3 | rmse | 1 | 1.0553 (0.0942) | 1.0368 (0.0271) | | +| ogbg-molesol | pna | fixed-rrog-T1-ns3 | rmse | 1 | 0.9841 (-0.0725) | 0.9092 (0.0060) | | +| ogbg-molesol | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 0.9873 (-0.0382) | 0.8825 (0.0083) | | +| ogbg-molesol | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 1.0129 (0.0488) | 0.9373 (0.0407) | | +| ogbg-molesol | tag | fixed-rrog-T1-ns3 | rmse | 1 | 0.9036 (0.0288) | 0.9462 (0.0215) | | +| ogbg-molesol | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 0.9841 (-0.0443) | 1.0004 (-0.0512) | | +| ogbg-molfreesolv | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 5.5593 (0.4869) | 3.6549 (0.9928) | | +| ogbg-molfreesolv | arma | fixed-rrog-T1-ns3 | rmse | 1 | 5.0683 (-0.8021) | 3.6823 (-0.7053) | | +| ogbg-molfreesolv | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 3.0142 (-0.0662) | 2.2399 (0.0032) | | +| ogbg-molfreesolv | film | fixed-rrog-T1-ns3 | rmse | 1 | 3.2952 (-0.1406) | 3.3042 (-0.3460) | | +| ogbg-molfreesolv | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 3.9984 (0.2103) | 2.5966 (0.1403) | | +| ogbg-molfreesolv | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 3.5888 (0.1285) | 2.4444 (0.0407) | | +| ogbg-molfreesolv | gen | fixed-rrog-T1-ns3 | rmse | 1 | 4.3009 (-0.3011) | 2.9063 (-0.3476) | | +| ogbg-molfreesolv | gin | fixed-rrog-T1-ns3 | rmse | 1 | 3.9743 (0.0447) | 3.4292 (0.0607) | | +| ogbg-molfreesolv | gine | fixed-rrog-T1-ns3 | rmse | 1 | 4.4468 (-1.1508) | 3.7405 (-0.5963) | | +| ogbg-molfreesolv | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 2.9106 (-0.3792) | 3.1429 (-0.3476) | | +| ogbg-molfreesolv | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 3.7380 (-0.2358) | 2.1931 (0.1046) | | +| ogbg-molfreesolv | mf | fixed-rrog-T1-ns3 | rmse | 1 | 2.5060 (0.2313) | 3.1892 (-0.3007) | | +| ogbg-molfreesolv | pna | fixed-rrog-T1-ns3 | rmse | 1 | 3.3334 (-0.9708) | 2.4279 (-0.1669) | | +| ogbg-molfreesolv | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 3.0920 (-0.6148) | 2.0244 (-0.0203) | | +| ogbg-molfreesolv | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 3.9261 (-0.0114) | 2.4887 (-0.0741) | | +| ogbg-molfreesolv | tag | fixed-rrog-T1-ns3 | rmse | 1 | 2.7359 (-0.0486) | 2.0588 (0.3237) | | +| ogbg-molfreesolv | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 4.4180 (-0.3237) | 2.4325 (-0.1120) | | +| ogbg-molhiv | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7573 (-0.0102) | 0.7229 (0.0229) | | +| ogbg-molhiv | appnp | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7203 (-0.0471) | 0.6825 (-0.0175) | | +| ogbg-molhiv | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7956 (0.0084) | 0.6967 (-0.0329) | | +| ogbg-molhiv | arma | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7926 (0.0054) | 0.7318 (0.0021) | | +| ogbg-molhiv | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7947 (0.0116) | 0.7290 (0.0008) | | +| ogbg-molhiv | cheb | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7735 (-0.0096) | 0.7426 (0.0144) | | +| ogbg-molhiv | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8251 (0.0330) | 0.7725 (-0.0117) | | +| ogbg-molhiv | film | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7633 (-0.0288) | 0.7728 (-0.0114) | | +| ogbg-molhiv | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8049 (0.0214) | 0.7486 (-0.0077) | | +| ogbg-molhiv | gatv2 | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7835 (0.0001) | 0.7466 (-0.0096) | | +| ogbg-molhiv | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7833 (0.0079) | 0.7448 (0.0250) | | +| ogbg-molhiv | gcn | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7455 (-0.0300) | 0.7483 (0.0285) | | +| ogbg-molhiv | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7740 (0.0210) | 0.7590 (0.0276) | | +| ogbg-molhiv | gen | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8128 (0.0598) | 0.7631 (0.0318) | | +| ogbg-molhiv | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0457) | 0.7668 (-0.0056) | | +| ogbg-molhiv | gin | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7524 (-0.0644) | 0.7324 (-0.0400) | | +| ogbg-molhiv | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7490 (-0.0453) | 0.7376 (-0.0070) | | +| ogbg-molhiv | gine | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7575 (-0.0368) | 0.7401 (-0.0044) | | +| ogbg-molhiv | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7817 (0.0110) | 0.7493 (0.0385) | | +| ogbg-molhiv | graphconv | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7713 (0.0006) | 0.6979 (-0.0129) | | +| ogbg-molhiv | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7893 (-0.0075) | 0.7633 (0.0008) | | +| ogbg-molhiv | graphsage | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7587 (-0.0382) | 0.7641 (0.0016) | | +| ogbg-molhiv | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7754 (-0.0091) | 0.7115 (0.0041) | | +| ogbg-molhiv | mf | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7931 (0.0085) | 0.7217 (0.0143) | | +| ogbg-molhiv | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8097 (0.0317) | 0.7602 (-0.0046) | | +| ogbg-molhiv | pna | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7890 (0.0111) | 0.7630 (-0.0018) | | +| ogbg-molhiv | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7923 (-0.0221) | 0.7227 (-0.0015) | | +| ogbg-molhiv | resgated | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8174 (0.0030) | 0.7055 (-0.0187) | | +| ogbg-molhiv | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7659 (0.0181) | 0.7136 (0.0117) | | +| ogbg-molhiv | sgc | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7482 (0.0003) | 0.7177 (0.0158) | | +| ogbg-molhiv | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7717 (0.0189) | 0.7181 (-0.0074) | | +| ogbg-molhiv | tag | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7804 (0.0276) | 0.7352 (0.0096) | | +| ogbg-molhiv | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7838 (0.0221) | 0.7648 (0.0100) | | +| ogbg-molhiv | transformer | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8088 (0.0471) | 0.7413 (-0.0134) | | +| ogbg-mollipo | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 0.8393 (0.0622) | 0.9174 (-0.0104) | | +| ogbg-mollipo | arma | fixed-rrog-T1-ns3 | rmse | 1 | 0.7173 (0.0152) | 0.7548 (-0.0253) | | +| ogbg-mollipo | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 0.6990 (0.0198) | 0.7132 (0.0048) | | +| ogbg-mollipo | film | fixed-rrog-T1-ns3 | rmse | 1 | 0.8122 (-0.0502) | 0.7353 (0.0018) | | +| ogbg-mollipo | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 0.7080 (-0.0215) | 0.7334 (-0.0026) | | +| ogbg-mollipo | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 0.7730 (-0.0351) | 0.7759 (0.0069) | | +| ogbg-mollipo | gen | fixed-rrog-T1-ns3 | rmse | 1 | 0.6594 (0.0452) | 0.7456 (-0.0077) | | +| ogbg-mollipo | gin | fixed-rrog-T1-ns3 | rmse | 1 | 0.6749 (0.0105) | 0.7073 (0.0317) | | +| ogbg-mollipo | gine | fixed-rrog-T1-ns3 | rmse | 1 | 0.7168 (-0.0553) | 0.7316 (0.0025) | | +| ogbg-mollipo | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 0.7372 (-0.0195) | 0.7396 (-0.0099) | | +| ogbg-mollipo | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 0.7184 (0.0055) | 0.7720 (0.0063) | | +| ogbg-mollipo | mf | fixed-rrog-T1-ns3 | rmse | 1 | 0.7050 (0.0080) | 0.7101 (0.0304) | | +| ogbg-mollipo | pna | fixed-rrog-T1-ns3 | rmse | 1 | 0.7466 (-0.0287) | 0.7908 (-0.0159) | | +| ogbg-mollipo | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 0.6766 (-0.0046) | 0.7144 (0.0126) | | +| ogbg-mollipo | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 0.7537 (-0.0032) | 0.7490 (0.0685) | | +| ogbg-mollipo | tag | fixed-rrog-T1-ns3 | rmse | 1 | 0.6743 (-0.0052) | 0.7201 (0.0026) | | +| ogbg-mollipo | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 0.6688 (0.0121) | 0.7396 (-0.0050) | | +| ogbg-molsider | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.5938 (0.0051) | 0.5905 (-0.0099) | | +| ogbg-molsider | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6344 (0.0071) | 0.6141 (-0.0018) | | +| ogbg-molsider | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6263 (0.0026) | 0.6096 (0.0062) | | +| ogbg-molsider | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.5862 (-0.0162) | 0.5974 (0.0076) | | +| ogbg-molsider | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6462 (0.0391) | 0.6000 (-0.0013) | | +| ogbg-molsider | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6256 (-0.0037) | 0.6117 (0.0031) | | +| ogbg-molsider | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6345 (-0.0175) | 0.6053 (0.0199) | | +| ogbg-molsider | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6046 (-0.0179) | 0.6022 (0.0274) | | +| ogbg-molsider | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6151 (-0.0176) | 0.6150 (0.0655) | | +| ogbg-molsider | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6010 (0.0089) | 0.5963 (-0.0188) | | +| ogbg-molsider | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6232 (0.0015) | 0.5861 (0.0053) | | +| ogbg-molsider | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6190 (-0.0012) | 0.5983 (0.0122) | | +| ogbg-molsider | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6058 (-0.0161) | 0.5721 (-0.0243) | | +| ogbg-molsider | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6205 (-0.0005) | 0.5960 (0.0050) | | +| ogbg-molsider | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6151 (-0.0022) | 0.6417 (0.0375) | | +| ogbg-molsider | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6410 (-0.0028) | 0.6102 (-0.0041) | | +| ogbg-molsider | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6315 (0.0156) | 0.6190 (0.0210) | | +| ogbg-moltox21 | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7280 (0.0025) | 0.7154 (-0.0005) | | +| ogbg-moltox21 | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7771 (-0.0028) | 0.7209 (-0.0014) | | +| ogbg-moltox21 | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0125) | 0.7286 (-0.0015) | | +| ogbg-moltox21 | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7727 (0.0025) | 0.7369 (0.0209) | | +| ogbg-moltox21 | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7762 (0.0135) | 0.7303 (0.0143) | | +| ogbg-moltox21 | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7588 (0.0007) | 0.7230 (0.0059) | | +| ogbg-moltox21 | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7757 (-0.0077) | 0.7312 (-0.0132) | | +| ogbg-moltox21 | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7718 (0.0028) | 0.7237 (-0.0005) | | +| ogbg-moltox21 | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7622 (-0.0122) | 0.7193 (-0.0135) | | +| ogbg-moltox21 | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7820 (-0.0011) | 0.7313 (0.0166) | | +| ogbg-moltox21 | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7697 (-0.0012) | 0.7205 (0.0009) | | +| ogbg-moltox21 | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7695 (-0.0078) | 0.7279 (-0.0002) | | +| ogbg-moltox21 | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7745 (0.0085) | 0.7349 (0.0403) | | +| ogbg-moltox21 | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7887 (-0.0064) | 0.7380 (0.0104) | | +| ogbg-moltox21 | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7506 (-0.0105) | 0.7355 (0.0115) | | +| ogbg-moltox21 | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7839 (-0.0027) | 0.7342 (-0.0074) | | +| ogbg-moltox21 | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7761 (0.0105) | 0.7292 (-0.0018) | | diff --git a/logs/ogbg-molhiv_T1_ns3_s1.log b/logs/ogbg-molhiv_T1_ns3_s1.log new file mode 100644 index 0000000..7219078 --- /dev/null +++ b/logs/ogbg-molhiv_T1_ns3_s1.log @@ -0,0 +1,887 @@ +[run] ogbg-molhiv view=gin compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gin --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.67381 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.73250 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.78519 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.77910 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.78799 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.76695 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.76847 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.78886 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.78626 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.78340 halt=0.00 train_steps=1.00 +[ogbg-molhiv_gin_classic_T0_ns1_h128_e100_s1] best_ep=80 val={'rocauc': 0.7888619439545366} test={'rocauc': 0.7680604105911663} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gin_classic_T0_ns1_h128_e100_s1.json +[run] ogbg-molhiv view=gin compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gin --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.69850 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.74071 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.69786 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.75877 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.71941 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75137 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.78576 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.78905 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.79003 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.78834 halt=0.00 train_steps=3.00 +[ogbg-molhiv_gin_fixed-rrog_T1_ns3_h128_e100_s1] best_ep=90 val={'rocauc': 0.7900285371350186} test={'rocauc': 0.7325170435890999} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gin_fixed-rrog_T1_ns3_h128_e100_s1.json +[run] ogbg-molhiv view=gine compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gine --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.64062 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.69908 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.73367 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.76310 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.73530 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.76138 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.73755 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.73645 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.73763 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.72804 halt=0.00 train_steps=1.00 +[ogbg-molhiv_gine_classic_T0_ns1_h128_e100_s1] best_ep=40 val={'rocauc': 0.763098912404468} test={'rocauc': 0.7342204368566407} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gine_classic_T0_ns1_h128_e100_s1.json +[run] ogbg-molhiv view=gine compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gine --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.70912 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.67273 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.72222 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.73406 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.71632 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.73716 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.75690 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.75768 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.74671 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.75744 halt=0.00 train_steps=3.00 +[ogbg-molhiv_gine_fixed-rrog_T1_ns3_h128_e100_s1] best_ep=80 val={'rocauc': 0.7576823682147755} test={'rocauc': 0.7671121497132043} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gine_fixed-rrog_T1_ns3_h128_e100_s1.json +[run] ogbg-molhiv view=gcn compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gcn --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.65329 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.76273 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.76982 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.77496 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.73880 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.76063 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.76303 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.75600 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.75729 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.75968 halt=0.00 train_steps=1.00 +[ogbg-molhiv_gcn_classic_T0_ns1_h128_e100_s1] best_ep=40 val={'rocauc': 0.774963869292573} test={'rocauc': 0.7313544100890322} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gcn_classic_T0_ns1_h128_e100_s1.json +[run] ogbg-molhiv view=gcn compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gcn --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.62065 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.76118 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.78244 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.75010 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.79120 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.77060 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.77926 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.76151 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.76069 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.75905 halt=0.00 train_steps=3.00 +[ogbg-molhiv_gcn_fixed-rrog_T1_ns3_h128_e100_s1] best_ep=50 val={'rocauc': 0.7912043160885752} test={'rocauc': 0.7217501303617297} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gcn_fixed-rrog_T1_ns3_h128_e100_s1.json +[run] ogbg-molhiv view=graphsage compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view graphsage --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.73273 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.78605 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.77469 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.77753 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.77763 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.77741 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.77440 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.78128 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.77955 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.77872 halt=0.00 train_steps=1.00 +[ogbg-molhiv_graphsage_classic_T0_ns1_h128_e100_s1] best_ep=20 val={'rocauc': 0.7860541593180482} test={'rocauc': 0.7280480503679099} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_graphsage_classic_T0_ns1_h128_e100_s1.json +[run] ogbg-molhiv view=graphsage compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view graphsage --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.68881 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.78881 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.76629 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.77119 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.76368 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75186 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.76720 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.75454 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.75202 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.74874 halt=0.00 train_steps=3.00 +[ogbg-molhiv_graphsage_fixed-rrog_T1_ns3_h128_e100_s1] best_ep=20 val={'rocauc': 0.7888068293160886} test={'rocauc': 0.709044207110991} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_graphsage_fixed-rrog_T1_ns3_h128_e100_s1.json +[run] ogbg-molhiv view=gatv2 compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gatv2 --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.70967 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.77066 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.75373 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.76225 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.77558 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.75771 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.75023 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.75254 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.75438 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.75340 halt=0.00 train_steps=1.00 +[ogbg-molhiv_gatv2_classic_T0_ns1_h128_e100_s1] best_ep=50 val={'rocauc': 0.7755777851263962} test={'rocauc': 0.7039629965816258} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gatv2_classic_T0_ns1_h128_e100_s1.json +[run] ogbg-molhiv view=gatv2 compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gatv2 --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.66289 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.68912 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.71125 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.71398 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.71899 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.72711 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.73926 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.73382 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.73295 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.72817 halt=0.00 train_steps=3.00 +[ogbg-molhiv_gatv2_fixed-rrog_T1_ns3_h128_e100_s1] best_ep=70 val={'rocauc': 0.7392587693513621} test={'rocauc': 0.7076787886981208} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gatv2_fixed-rrog_T1_ns3_h128_e100_s1.json +[run] ogbg-molhiv view=graphconv compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view graphconv --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.73045 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.79112 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.78046 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.78181 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.75365 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.77726 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.77815 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.78157 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.78202 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.78072 halt=0.00 train_steps=1.00 +[ogbg-molhiv_graphconv_classic_T0_ns1_h128_e100_s1] best_ep=20 val={'rocauc': 0.7911185822065452} test={'rocauc': 0.7552501979567006} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_graphconv_classic_T0_ns1_h128_e100_s1.json +[run] ogbg-molhiv view=graphconv compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view graphconv --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.71173 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.77306 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.76716 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.77208 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.75010 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75761 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.74435 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.77844 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.75856 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.75935 halt=0.00 train_steps=3.00 +[ogbg-molhiv_graphconv_fixed-rrog_T1_ns3_h128_e100_s1] best_ep=80 val={'rocauc': 0.7784422153635117} test={'rocauc': 0.7098244462040595} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_graphconv_fixed-rrog_T1_ns3_h128_e100_s1.json +[run] ogbg-molhiv view=transformer compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view transformer --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.75635 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.72700 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.77672 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.76402 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.76397 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.76276 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.76204 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.73632 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.74906 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.74765 halt=0.00 train_steps=1.00 +[ogbg-molhiv_transformer_classic_T0_ns1_h128_e100_s1] best_ep=30 val={'rocauc': 0.7767152900254751} test={'rocauc': 0.7883891152783947} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_transformer_classic_T0_ns1_h128_e100_s1.json +[run] ogbg-molhiv view=transformer compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view transformer --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.74469 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.72637 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.76420 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.76498 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.73394 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75693 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.76513 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.73841 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.73758 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.73136 halt=0.00 train_steps=3.00 +[ogbg-molhiv_transformer_fixed-rrog_T1_ns3_h128_e100_s1] best_ep=70 val={'rocauc': 0.7651320301783265} test={'rocauc': 0.749757623747079} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_transformer_fixed-rrog_T1_ns3_h128_e100_s1.json +[run] ogbg-molhiv view=pna compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view pna --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.71222 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.77237 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.79382 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.79831 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.78984 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.79521 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.77282 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.77904 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.77221 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.77298 halt=0.00 train_steps=1.00 +[ogbg-molhiv_pna_classic_T0_ns1_h128_e100_s1] best_ep=40 val={'rocauc': 0.7983079805996471} test={'rocauc': 0.7485834025377083} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_pna_classic_T0_ns1_h128_e100_s1.json +[run] ogbg-molhiv view=pna compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view pna --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.66012 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.74263 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.68730 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.76946 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.78428 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.80766 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.85103 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.82721 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.80115 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.81327 halt=0.00 train_steps=3.00 +[ogbg-molhiv_pna_fixed-rrog_T1_ns3_h128_e100_s1] best_ep=70 val={'rocauc': 0.8510281941994904} test={'rocauc': 0.7524633538693293} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_pna_fixed-rrog_T1_ns3_h128_e100_s1.json +[run] ogbg-molhiv view=gen compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gen --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.70215 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.70943 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.72126 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.74237 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.75415 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.77710 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.77079 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.77663 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.77879 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.77747 halt=0.00 train_steps=1.00 +[ogbg-molhiv_gen_classic_T0_ns1_h128_e100_s1] best_ep=90 val={'rocauc': 0.7787851508916324} test={'rocauc': 0.7435079858629947} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gen_classic_T0_ns1_h128_e100_s1.json +[run] ogbg-molhiv view=gen compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gen --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.64967 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.70673 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.75758 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.73586 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.72948 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.73563 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.73531 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.73478 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.73802 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.73543 halt=0.00 train_steps=3.00 +[ogbg-molhiv_gen_fixed-rrog_T1_ns3_h128_e100_s1] best_ep=30 val={'rocauc': 0.7575843866353126} test={'rocauc': 0.7301454257517527} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gen_fixed-rrog_T1_ns3_h128_e100_s1.json +[run] ogbg-molhiv view=film compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view film --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.70298 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.73054 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.72688 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.73843 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.71422 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.71582 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.68800 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.70108 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.69239 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.69946 halt=0.00 train_steps=1.00 +[ogbg-molhiv_film_classic_T0_ns1_h128_e100_s1] best_ep=40 val={'rocauc': 0.7384259259259259} test={'rocauc': 0.7277853956237085} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_film_classic_T0_ns1_h128_e100_s1.json +[run] ogbg-molhiv view=film compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view film --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.57982 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.76051 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.75530 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.74002 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.73811 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.76883 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.77568 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.77672 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.76181 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.76335 halt=0.00 train_steps=3.00 +[ogbg-molhiv_film_fixed-rrog_T1_ns3_h128_e100_s1] best_ep=80 val={'rocauc': 0.7767214138741916} test={'rocauc': 0.721711504664053} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_film_fixed-rrog_T1_ns3_h128_e100_s1.json +[run] ogbg-molhiv view=resgated compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view resgated --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.72395 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.76516 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.75055 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.78604 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.78080 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.77578 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.76166 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.77023 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.75281 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.74789 halt=0.00 train_steps=1.00 +[ogbg-molhiv_resgated_classic_T0_ns1_h128_e100_s1] best_ep=40 val={'rocauc': 0.7860449735449736} test={'rocauc': 0.715921512582321} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_resgated_classic_T0_ns1_h128_e100_s1.json +[run] ogbg-molhiv view=resgated compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view resgated --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.72839 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.75459 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.72771 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.78256 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.81516 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75649 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.77860 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.76988 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.77731 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.77520 halt=0.00 train_steps=3.00 +[ogbg-molhiv_resgated_fixed-rrog_T1_ns3_h128_e100_s1] best_ep=50 val={'rocauc': 0.8151638741916519} test={'rocauc': 0.7581278124336122} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_resgated_fixed-rrog_T1_ns3_h128_e100_s1.json +[run] ogbg-molhiv view=tag compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view tag --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.58770 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.68145 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.72067 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.73392 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.70822 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.71426 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.70873 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.72983 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.72147 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.71378 halt=0.00 train_steps=1.00 +[ogbg-molhiv_tag_classic_T0_ns1_h128_e100_s1] best_ep=40 val={'rocauc': 0.7339157113462669} test={'rocauc': 0.7487765310260917} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_tag_classic_T0_ns1_h128_e100_s1.json +[run] ogbg-molhiv view=tag compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view tag --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.55144 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.60799 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.70607 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.69128 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.72045 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.74126 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.72293 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.71634 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.71546 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.72607 halt=0.00 train_steps=3.00 +[ogbg-molhiv_tag_fixed-rrog_T1_ns3_h128_e100_s1] best_ep=60 val={'rocauc': 0.7412612678816383} test={'rocauc': 0.7289634794028468} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_tag_fixed-rrog_T1_ns3_h128_e100_s1.json +[run] ogbg-molhiv view=sgc compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view sgc --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.72619 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.73283 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.76917 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.75675 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.76761 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.76763 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.75765 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.75903 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.75424 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.75210 halt=0.00 train_steps=1.00 +[ogbg-molhiv_sgc_classic_T0_ns1_h128_e100_s1] best_ep=30 val={'rocauc': 0.7691676464824613} test={'rocauc': 0.7100407501110487} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_sgc_classic_T0_ns1_h128_e100_s1.json +[run] ogbg-molhiv view=sgc compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view sgc --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.66342 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.66210 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.74188 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.68794 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.76040 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.74793 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.73677 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.75024 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.74898 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.74779 halt=0.00 train_steps=3.00 +[ogbg-molhiv_sgc_fixed-rrog_T1_ns3_h128_e100_s1] best_ep=50 val={'rocauc': 0.7603952331961592} test={'rocauc': 0.675208095946233} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_sgc_fixed-rrog_T1_ns3_h128_e100_s1.json +[run] ogbg-molhiv view=cheb compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view cheb --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.70465 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.74216 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.73979 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.75779 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.73594 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.73526 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.75417 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.73860 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.74738 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.74227 halt=0.00 train_steps=1.00 +[ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s1] best_ep=40 val={'rocauc': 0.7577895355673133} test={'rocauc': 0.7291006006295989} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s1.json +[run] ogbg-molhiv view=cheb compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view cheb --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.66118 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.68799 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.73086 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.76554 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.74577 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75891 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.73923 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.75111 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.75026 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.74760 halt=0.00 train_steps=3.00 +[ogbg-molhiv_cheb_fixed-rrog_T1_ns3_h128_e100_s1] best_ep=40 val={'rocauc': 0.7655423280423279} test={'rocauc': 0.7438594797118523} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_cheb_fixed-rrog_T1_ns3_h128_e100_s1.json +[run] ogbg-molhiv view=arma compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view arma --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.71067 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.74686 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.73423 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.76570 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.77661 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.73695 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.77359 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.76691 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.77045 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.77618 halt=0.00 train_steps=1.00 +[ogbg-molhiv_arma_classic_T0_ns1_h128_e100_s1] best_ep=50 val={'rocauc': 0.7766081226729374} test={'rocauc': 0.7197338689430077} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_arma_classic_T0_ns1_h128_e100_s1.json +[run] ogbg-molhiv view=arma compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view arma --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.67783 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.69752 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.73554 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.73143 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.75276 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75716 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.75640 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.75654 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.75214 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.75103 halt=0.00 train_steps=3.00 +[ogbg-molhiv_arma_fixed-rrog_T1_ns3_h128_e100_s1] best_ep=60 val={'rocauc': 0.7571649029982364} test={'rocauc': 0.6928774213484231} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_arma_fixed-rrog_T1_ns3_h128_e100_s1.json +[run] ogbg-molhiv view=mf compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view mf --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.74885 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.65990 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.73615 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.75659 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.75728 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.73114 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.73473 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.72317 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.72240 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.72247 halt=0.00 train_steps=1.00 +[ogbg-molhiv_mf_classic_T0_ns1_h128_e100_s1] best_ep=50 val={'rocauc': 0.757284318048207} test={'rocauc': 0.7282353850016416} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_mf_classic_T0_ns1_h128_e100_s1.json +[run] ogbg-molhiv view=mf compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view mf --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.77872 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.76027 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.76594 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.79620 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.77028 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.78464 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.77227 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.77065 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.74908 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.74528 halt=0.00 train_steps=3.00 +[ogbg-molhiv_mf_fixed-rrog_T1_ns3_h128_e100_s1] best_ep=40 val={'rocauc': 0.796195252792475} test={'rocauc': 0.7153228142683327} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_mf_fixed-rrog_T1_ns3_h128_e100_s1.json +[run] ogbg-molhiv view=appnp compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view appnp --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.67801 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.69347 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.68345 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.69070 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.64639 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.62556 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.62621 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.62966 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.63021 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.62319 halt=0.00 train_steps=1.00 +[ogbg-molhiv_appnp_classic_T0_ns1_h128_e100_s1] best_ep=20 val={'rocauc': 0.6934707524985303} test={'rocauc': 0.7044149172444427} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_appnp_classic_T0_ns1_h128_e100_s1.json +[run] ogbg-molhiv view=appnp compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view appnp --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 1 --device cuda:0 +ep10 val_rocauc=0.68888 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.74622 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.69872 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.70360 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.71557 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75122 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.73754 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.74075 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.73340 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.73030 halt=0.00 train_steps=3.00 +[ogbg-molhiv_appnp_fixed-rrog_T1_ns3_h128_e100_s1] best_ep=60 val={'rocauc': 0.75122170781893} test={'rocauc': 0.7448212595840012} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_appnp_fixed-rrog_T1_ns3_h128_e100_s1.json + +Classic baseline: task x backbone +| task | backbone | metric | n | val | test | +| --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | rocauc | 1 | 0.6564 +/- 0.0000 | 0.7423 +/- 0.0000 | +| ogbg-molbace | arma | rocauc | 1 | 0.6923 +/- 0.0000 | 0.7839 +/- 0.0000 | +| ogbg-molbace | cheb | rocauc | 1 | 0.7267 +/- 0.0000 | 0.7969 +/- 0.0000 | +| ogbg-molbace | film | rocauc | 1 | 0.6703 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molbace | gatv2 | rocauc | 1 | 0.7029 +/- 0.0000 | 0.7400 +/- 0.0000 | +| ogbg-molbace | gcn | rocauc | 1 | 0.6381 +/- 0.0000 | 0.7393 +/- 0.0000 | +| ogbg-molbace | gen | rocauc | 1 | 0.7128 +/- 0.0000 | 0.7326 +/- 0.0000 | +| ogbg-molbace | gin | rocauc | 1 | 0.6520 +/- 0.0000 | 0.7336 +/- 0.0000 | +| ogbg-molbace | gine | rocauc | 1 | 0.6641 +/- 0.0000 | 0.7454 +/- 0.0000 | +| ogbg-molbace | graphconv | rocauc | 1 | 0.7311 +/- 0.0000 | 0.8035 +/- 0.0000 | +| ogbg-molbace | graphsage | rocauc | 1 | 0.6758 +/- 0.0000 | 0.7759 +/- 0.0000 | +| ogbg-molbace | mf | rocauc | 1 | 0.7421 +/- 0.0000 | 0.7760 +/- 0.0000 | +| ogbg-molbace | pna | rocauc | 1 | 0.7516 +/- 0.0000 | 0.6912 +/- 0.0000 | +| ogbg-molbace | resgated | rocauc | 1 | 0.7172 +/- 0.0000 | 0.7877 +/- 0.0000 | +| ogbg-molbace | sgc | rocauc | 1 | 0.6575 +/- 0.0000 | 0.6966 +/- 0.0000 | +| ogbg-molbace | tag | rocauc | 1 | 0.7084 +/- 0.0000 | 0.7345 +/- 0.0000 | +| ogbg-molbace | transformer | rocauc | 1 | 0.6663 +/- 0.0000 | 0.7364 +/- 0.0000 | +| ogbg-molbbbp | appnp | rocauc | 1 | 0.9147 +/- 0.0000 | 0.6388 +/- 0.0000 | +| ogbg-molbbbp | arma | rocauc | 1 | 0.9367 +/- 0.0000 | 0.6651 +/- 0.0000 | +| ogbg-molbbbp | cheb | rocauc | 1 | 0.9452 +/- 0.0000 | 0.6514 +/- 0.0000 | +| ogbg-molbbbp | film | rocauc | 1 | 0.9285 +/- 0.0000 | 0.6300 +/- 0.0000 | +| ogbg-molbbbp | gatv2 | rocauc | 1 | 0.9347 +/- 0.0000 | 0.6324 +/- 0.0000 | +| ogbg-molbbbp | gcn | rocauc | 1 | 0.9386 +/- 0.0000 | 0.6679 +/- 0.0000 | +| ogbg-molbbbp | gen | rocauc | 1 | 0.9549 +/- 0.0000 | 0.6775 +/- 0.0000 | +| ogbg-molbbbp | gin | rocauc | 1 | 0.9251 +/- 0.0000 | 0.5670 +/- 0.0000 | +| ogbg-molbbbp | gine | rocauc | 1 | 0.9324 +/- 0.0000 | 0.6160 +/- 0.0000 | +| ogbg-molbbbp | graphconv | rocauc | 1 | 0.9268 +/- 0.0000 | 0.5900 +/- 0.0000 | +| ogbg-molbbbp | graphsage | rocauc | 1 | 0.9483 +/- 0.0000 | 0.6288 +/- 0.0000 | +| ogbg-molbbbp | mf | rocauc | 1 | 0.9395 +/- 0.0000 | 0.6365 +/- 0.0000 | +| ogbg-molbbbp | pna | rocauc | 1 | 0.9554 +/- 0.0000 | 0.6418 +/- 0.0000 | +| ogbg-molbbbp | resgated | rocauc | 1 | 0.9183 +/- 0.0000 | 0.6626 +/- 0.0000 | +| ogbg-molbbbp | sgc | rocauc | 1 | 0.9300 +/- 0.0000 | 0.6239 +/- 0.0000 | +| ogbg-molbbbp | tag | rocauc | 1 | 0.9476 +/- 0.0000 | 0.6100 +/- 0.0000 | +| ogbg-molbbbp | transformer | rocauc | 1 | 0.9495 +/- 0.0000 | 0.6156 +/- 0.0000 | +| ogbg-molclintox | appnp | rocauc | 1 | 0.8516 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | arma | rocauc | 1 | 0.9463 +/- 0.0000 | 0.8678 +/- 0.0000 | +| ogbg-molclintox | cheb | rocauc | 1 | 0.8928 +/- 0.0000 | 0.9152 +/- 0.0000 | +| ogbg-molclintox | film | rocauc | 1 | 0.9048 +/- 0.0000 | 0.7731 +/- 0.0000 | +| ogbg-molclintox | gatv2 | rocauc | 1 | 0.9515 +/- 0.0000 | 0.8493 +/- 0.0000 | +| ogbg-molclintox | gcn | rocauc | 1 | 0.9318 +/- 0.0000 | 0.8932 +/- 0.0000 | +| ogbg-molclintox | gen | rocauc | 1 | 0.9820 +/- 0.0000 | 0.8128 +/- 0.0000 | +| ogbg-molclintox | gin | rocauc | 1 | 0.9547 +/- 0.0000 | 0.8586 +/- 0.0000 | +| ogbg-molclintox | gine | rocauc | 1 | 0.9353 +/- 0.0000 | 0.8869 +/- 0.0000 | +| ogbg-molclintox | graphconv | rocauc | 1 | 0.8917 +/- 0.0000 | 0.8501 +/- 0.0000 | +| ogbg-molclintox | graphsage | rocauc | 1 | 0.9143 +/- 0.0000 | 0.8882 +/- 0.0000 | +| ogbg-molclintox | mf | rocauc | 1 | 0.9252 +/- 0.0000 | 0.8370 +/- 0.0000 | +| ogbg-molclintox | pna | rocauc | 1 | 0.9286 +/- 0.0000 | 0.8603 +/- 0.0000 | +| ogbg-molclintox | resgated | rocauc | 1 | 0.9244 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | sgc | rocauc | 1 | 0.9195 +/- 0.0000 | 0.8986 +/- 0.0000 | +| ogbg-molclintox | tag | rocauc | 1 | 0.9237 +/- 0.0000 | 0.7998 +/- 0.0000 | +| ogbg-molclintox | transformer | rocauc | 1 | 0.9271 +/- 0.0000 | 0.8764 +/- 0.0000 | +| ogbg-molesol | appnp | rmse | 1 | 1.6083 +/- 0.0000 | 1.5212 +/- 0.0000 | +| ogbg-molesol | arma | rmse | 1 | 1.0195 +/- 0.0000 | 1.0666 +/- 0.0000 | +| ogbg-molesol | cheb | rmse | 1 | 0.9650 +/- 0.0000 | 0.8722 +/- 0.0000 | +| ogbg-molesol | film | rmse | 1 | 1.0718 +/- 0.0000 | 1.2896 +/- 0.0000 | +| ogbg-molesol | gatv2 | rmse | 1 | 1.0368 +/- 0.0000 | 0.9878 +/- 0.0000 | +| ogbg-molesol | gcn | rmse | 1 | 1.0409 +/- 0.0000 | 1.1161 +/- 0.0000 | +| ogbg-molesol | gen | rmse | 1 | 1.0089 +/- 0.0000 | 0.8762 +/- 0.0000 | +| ogbg-molesol | gin | rmse | 1 | 1.0187 +/- 0.0000 | 0.9900 +/- 0.0000 | +| ogbg-molesol | gine | rmse | 1 | 1.0286 +/- 0.0000 | 1.0807 +/- 0.0000 | +| ogbg-molesol | graphconv | rmse | 1 | 0.9741 +/- 0.0000 | 0.9732 +/- 0.0000 | +| ogbg-molesol | graphsage | rmse | 1 | 0.9680 +/- 0.0000 | 1.0038 +/- 0.0000 | +| ogbg-molesol | mf | rmse | 1 | 1.1494 +/- 0.0000 | 1.0639 +/- 0.0000 | +| ogbg-molesol | pna | rmse | 1 | 0.9116 +/- 0.0000 | 0.9153 +/- 0.0000 | +| ogbg-molesol | resgated | rmse | 1 | 0.9492 +/- 0.0000 | 0.8908 +/- 0.0000 | +| ogbg-molesol | sgc | rmse | 1 | 1.0617 +/- 0.0000 | 0.9780 +/- 0.0000 | +| ogbg-molesol | tag | rmse | 1 | 0.9323 +/- 0.0000 | 0.9678 +/- 0.0000 | +| ogbg-molesol | transformer | rmse | 1 | 0.9398 +/- 0.0000 | 0.9492 +/- 0.0000 | +| ogbg-molfreesolv | appnp | rmse | 1 | 6.0462 +/- 0.0000 | 4.6478 +/- 0.0000 | +| ogbg-molfreesolv | arma | rmse | 1 | 4.2662 +/- 0.0000 | 2.9769 +/- 0.0000 | +| ogbg-molfreesolv | cheb | rmse | 1 | 2.9481 +/- 0.0000 | 2.2431 +/- 0.0000 | +| ogbg-molfreesolv | film | rmse | 1 | 3.1546 +/- 0.0000 | 2.9581 +/- 0.0000 | +| ogbg-molfreesolv | gatv2 | rmse | 1 | 4.2086 +/- 0.0000 | 2.7368 +/- 0.0000 | +| ogbg-molfreesolv | gcn | rmse | 1 | 3.7172 +/- 0.0000 | 2.4851 +/- 0.0000 | +| ogbg-molfreesolv | gen | rmse | 1 | 3.9998 +/- 0.0000 | 2.5588 +/- 0.0000 | +| ogbg-molfreesolv | gin | rmse | 1 | 4.0190 +/- 0.0000 | 3.4898 +/- 0.0000 | +| ogbg-molfreesolv | gine | rmse | 1 | 3.2961 +/- 0.0000 | 3.1442 +/- 0.0000 | +| ogbg-molfreesolv | graphconv | rmse | 1 | 2.5314 +/- 0.0000 | 2.7953 +/- 0.0000 | +| ogbg-molfreesolv | graphsage | rmse | 1 | 3.5022 +/- 0.0000 | 2.2977 +/- 0.0000 | +| ogbg-molfreesolv | mf | rmse | 1 | 2.7374 +/- 0.0000 | 2.8885 +/- 0.0000 | +| ogbg-molfreesolv | pna | rmse | 1 | 2.3625 +/- 0.0000 | 2.2610 +/- 0.0000 | +| ogbg-molfreesolv | resgated | rmse | 1 | 2.4772 +/- 0.0000 | 2.0041 +/- 0.0000 | +| ogbg-molfreesolv | sgc | rmse | 1 | 3.9147 +/- 0.0000 | 2.4146 +/- 0.0000 | +| ogbg-molfreesolv | tag | rmse | 1 | 2.6874 +/- 0.0000 | 2.3826 +/- 0.0000 | +| ogbg-molfreesolv | transformer | rmse | 1 | 4.0942 +/- 0.0000 | 2.3205 +/- 0.0000 | +| ogbg-molhiv | appnp | rocauc | 2 | 0.7305 +/- 0.0523 | 0.7022 +/- 0.0031 | +| ogbg-molhiv | arma | rocauc | 2 | 0.7819 +/- 0.0075 | 0.7247 +/- 0.0070 | +| ogbg-molhiv | cheb | rocauc | 2 | 0.7705 +/- 0.0179 | 0.7286 +/- 0.0007 | +| ogbg-molhiv | film | rocauc | 2 | 0.7653 +/- 0.0380 | 0.7560 +/- 0.0399 | +| ogbg-molhiv | gatv2 | rocauc | 2 | 0.7795 +/- 0.0056 | 0.7301 +/- 0.0370 | +| ogbg-molhiv | gcn | rocauc | 2 | 0.7752 +/- 0.0003 | 0.7256 +/- 0.0082 | +| ogbg-molhiv | gen | rocauc | 2 | 0.7659 +/- 0.0182 | 0.7374 +/- 0.0086 | +| ogbg-molhiv | gin | rocauc | 2 | 0.8028 +/- 0.0197 | 0.7702 +/- 0.0031 | +| ogbg-molhiv | gine | rocauc | 2 | 0.7787 +/- 0.0220 | 0.7394 +/- 0.0073 | +| ogbg-molhiv | graphconv | rocauc | 2 | 0.7809 +/- 0.0145 | 0.7330 +/- 0.0314 | +| ogbg-molhiv | graphsage | rocauc | 2 | 0.7915 +/- 0.0076 | 0.7453 +/- 0.0244 | +| ogbg-molhiv | mf | rocauc | 2 | 0.7709 +/- 0.0193 | 0.7178 +/- 0.0148 | +| ogbg-molhiv | pna | rocauc | 2 | 0.7881 +/- 0.0144 | 0.7567 +/- 0.0115 | +| ogbg-molhiv | resgated | rocauc | 2 | 0.8002 +/- 0.0200 | 0.7200 +/- 0.0058 | +| ogbg-molhiv | sgc | rocauc | 2 | 0.7585 +/- 0.0151 | 0.7060 +/- 0.0057 | +| ogbg-molhiv | tag | rocauc | 2 | 0.7434 +/- 0.0134 | 0.7372 +/- 0.0164 | +| ogbg-molhiv | transformer | rocauc | 2 | 0.7692 +/- 0.0106 | 0.7716 +/- 0.0238 | +| ogbg-mollipo | appnp | rmse | 1 | 0.9015 +/- 0.0000 | 0.9070 +/- 0.0000 | +| ogbg-mollipo | arma | rmse | 1 | 0.7325 +/- 0.0000 | 0.7295 +/- 0.0000 | +| ogbg-mollipo | cheb | rmse | 1 | 0.7188 +/- 0.0000 | 0.7180 +/- 0.0000 | +| ogbg-mollipo | film | rmse | 1 | 0.7620 +/- 0.0000 | 0.7371 +/- 0.0000 | +| ogbg-mollipo | gatv2 | rmse | 1 | 0.6865 +/- 0.0000 | 0.7308 +/- 0.0000 | +| ogbg-mollipo | gcn | rmse | 1 | 0.7379 +/- 0.0000 | 0.7828 +/- 0.0000 | +| ogbg-mollipo | gen | rmse | 1 | 0.7046 +/- 0.0000 | 0.7379 +/- 0.0000 | +| ogbg-mollipo | gin | rmse | 1 | 0.6854 +/- 0.0000 | 0.7390 +/- 0.0000 | +| ogbg-mollipo | gine | rmse | 1 | 0.6615 +/- 0.0000 | 0.7341 +/- 0.0000 | +| ogbg-mollipo | graphconv | rmse | 1 | 0.7178 +/- 0.0000 | 0.7297 +/- 0.0000 | +| ogbg-mollipo | graphsage | rmse | 1 | 0.7239 +/- 0.0000 | 0.7783 +/- 0.0000 | +| ogbg-mollipo | mf | rmse | 1 | 0.7129 +/- 0.0000 | 0.7405 +/- 0.0000 | +| ogbg-mollipo | pna | rmse | 1 | 0.7179 +/- 0.0000 | 0.7749 +/- 0.0000 | +| ogbg-mollipo | resgated | rmse | 1 | 0.6721 +/- 0.0000 | 0.7270 +/- 0.0000 | +| ogbg-mollipo | sgc | rmse | 1 | 0.7505 +/- 0.0000 | 0.8176 +/- 0.0000 | +| ogbg-mollipo | tag | rmse | 1 | 0.6692 +/- 0.0000 | 0.7227 +/- 0.0000 | +| ogbg-mollipo | transformer | rmse | 1 | 0.6810 +/- 0.0000 | 0.7346 +/- 0.0000 | +| ogbg-molsider | appnp | rocauc | 1 | 0.5886 +/- 0.0000 | 0.6004 +/- 0.0000 | +| ogbg-molsider | arma | rocauc | 1 | 0.6273 +/- 0.0000 | 0.6159 +/- 0.0000 | +| ogbg-molsider | cheb | rocauc | 1 | 0.6237 +/- 0.0000 | 0.6033 +/- 0.0000 | +| ogbg-molsider | film | rocauc | 1 | 0.6024 +/- 0.0000 | 0.5898 +/- 0.0000 | +| ogbg-molsider | gatv2 | rocauc | 1 | 0.6071 +/- 0.0000 | 0.6013 +/- 0.0000 | +| ogbg-molsider | gcn | rocauc | 1 | 0.6293 +/- 0.0000 | 0.6086 +/- 0.0000 | +| ogbg-molsider | gen | rocauc | 1 | 0.6519 +/- 0.0000 | 0.5854 +/- 0.0000 | +| ogbg-molsider | gin | rocauc | 1 | 0.6225 +/- 0.0000 | 0.5748 +/- 0.0000 | +| ogbg-molsider | gine | rocauc | 1 | 0.6327 +/- 0.0000 | 0.5495 +/- 0.0000 | +| ogbg-molsider | graphconv | rocauc | 1 | 0.5921 +/- 0.0000 | 0.6151 +/- 0.0000 | +| ogbg-molsider | graphsage | rocauc | 1 | 0.6217 +/- 0.0000 | 0.5807 +/- 0.0000 | +| ogbg-molsider | mf | rocauc | 1 | 0.6202 +/- 0.0000 | 0.5861 +/- 0.0000 | +| ogbg-molsider | pna | rocauc | 1 | 0.6219 +/- 0.0000 | 0.5965 +/- 0.0000 | +| ogbg-molsider | resgated | rocauc | 1 | 0.6209 +/- 0.0000 | 0.5910 +/- 0.0000 | +| ogbg-molsider | sgc | rocauc | 1 | 0.6174 +/- 0.0000 | 0.6043 +/- 0.0000 | +| ogbg-molsider | tag | rocauc | 1 | 0.6439 +/- 0.0000 | 0.6143 +/- 0.0000 | +| ogbg-molsider | transformer | rocauc | 1 | 0.6160 +/- 0.0000 | 0.5980 +/- 0.0000 | +| ogbg-moltox21 | appnp | rocauc | 1 | 0.7255 +/- 0.0000 | 0.7158 +/- 0.0000 | +| ogbg-moltox21 | arma | rocauc | 1 | 0.7799 +/- 0.0000 | 0.7223 +/- 0.0000 | +| ogbg-moltox21 | cheb | rocauc | 1 | 0.7834 +/- 0.0000 | 0.7301 +/- 0.0000 | +| ogbg-moltox21 | film | rocauc | 1 | 0.7702 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gatv2 | rocauc | 1 | 0.7627 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gcn | rocauc | 1 | 0.7580 +/- 0.0000 | 0.7171 +/- 0.0000 | +| ogbg-moltox21 | gen | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7444 +/- 0.0000 | +| ogbg-moltox21 | gin | rocauc | 1 | 0.7690 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-moltox21 | gine | rocauc | 1 | 0.7744 +/- 0.0000 | 0.7328 +/- 0.0000 | +| ogbg-moltox21 | graphconv | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7147 +/- 0.0000 | +| ogbg-moltox21 | graphsage | rocauc | 1 | 0.7709 +/- 0.0000 | 0.7196 +/- 0.0000 | +| ogbg-moltox21 | mf | rocauc | 1 | 0.7773 +/- 0.0000 | 0.7281 +/- 0.0000 | +| ogbg-moltox21 | pna | rocauc | 1 | 0.7660 +/- 0.0000 | 0.6946 +/- 0.0000 | +| ogbg-moltox21 | resgated | rocauc | 1 | 0.7950 +/- 0.0000 | 0.7275 +/- 0.0000 | +| ogbg-moltox21 | sgc | rocauc | 1 | 0.7611 +/- 0.0000 | 0.7240 +/- 0.0000 | +| ogbg-moltox21 | tag | rocauc | 1 | 0.7866 +/- 0.0000 | 0.7416 +/- 0.0000 | +| ogbg-moltox21 | transformer | rocauc | 1 | 0.7656 +/- 0.0000 | 0.7309 +/- 0.0000 | + +Delta vs matching classic +| task | backbone | compute | metric | n | val score (delta) | test score (delta) | steps | +| --- | --- | --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7168 (0.0604) | 0.7209 (-0.0214) | | +| ogbg-molbace | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7179 (0.0256) | 0.7672 (-0.0167) | | +| ogbg-molbace | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7114 (-0.0154) | 0.7533 (-0.0436) | | +| ogbg-molbace | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6652 (-0.0051) | 0.7242 (0.0000) | | +| ogbg-molbace | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7026 (-0.0004) | 0.7519 (0.0118) | | +| ogbg-molbace | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6374 (-0.0007) | 0.7733 (0.0339) | | +| ogbg-molbace | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6894 (-0.0234) | 0.7449 (0.0123) | | +| ogbg-molbace | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6538 (0.0018) | 0.7169 (-0.0167) | | +| ogbg-molbace | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6685 (0.0044) | 0.6994 (-0.0461) | | +| ogbg-molbace | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7462 (0.0150) | 0.7983 (-0.0052) | | +| ogbg-molbace | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6703 (-0.0055) | 0.7119 (-0.0640) | | +| ogbg-molbace | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7234 (-0.0187) | 0.7684 (-0.0077) | | +| ogbg-molbace | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7037 (-0.0480) | 0.7967 (0.1055) | | +| ogbg-molbace | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6912 (-0.0260) | 0.7465 (-0.0412) | | +| ogbg-molbace | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6454 (-0.0121) | 0.7727 (0.0762) | | +| ogbg-molbace | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7355 (0.0271) | 0.6806 (-0.0539) | | +| ogbg-molbace | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6982 (0.0319) | 0.7487 (0.0123) | | +| ogbg-molbbbp | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9360 (0.0213) | 0.6073 (-0.0314) | | +| ogbg-molbbbp | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9415 (0.0048) | 0.6635 (-0.0016) | | +| ogbg-molbbbp | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9278 (-0.0174) | 0.6659 (0.0145) | | +| ogbg-molbbbp | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9400 (0.0115) | 0.6323 (0.0023) | | +| ogbg-molbbbp | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9356 (0.0009) | 0.6560 (0.0235) | | +| ogbg-molbbbp | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9417 (0.0031) | 0.6017 (-0.0663) | | +| ogbg-molbbbp | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9429 (-0.0119) | 0.6037 (-0.0738) | | +| ogbg-molbbbp | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9526 (0.0275) | 0.5932 (0.0261) | | +| ogbg-molbbbp | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9421 (0.0098) | 0.6976 (0.0816) | | +| ogbg-molbbbp | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9337 (0.0069) | 0.6518 (0.0618) | | +| ogbg-molbbbp | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9502 (0.0019) | 0.5934 (-0.0354) | | +| ogbg-molbbbp | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9488 (0.0094) | 0.6481 (0.0116) | | +| ogbg-molbbbp | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9585 (0.0031) | 0.6682 (0.0264) | | +| ogbg-molbbbp | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9535 (0.0352) | 0.5839 (-0.0787) | | +| ogbg-molbbbp | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9285 (-0.0015) | 0.6454 (0.0215) | | +| ogbg-molbbbp | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9459 (-0.0017) | 0.6420 (0.0320) | | +| ogbg-molbbbp | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9355 (-0.0140) | 0.6221 (0.0065) | | +| ogbg-molclintox | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9029 (0.0513) | 0.8898 (-0.0286) | | +| ogbg-molclintox | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9135 (-0.0328) | 0.8863 (0.0185) | | +| ogbg-molclintox | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8816 (-0.0112) | 0.8982 (-0.0170) | | +| ogbg-molclintox | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9454 (0.0406) | 0.8430 (0.0699) | | +| ogbg-molclintox | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9351 (-0.0164) | 0.8328 (-0.0164) | | +| ogbg-molclintox | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9097 (-0.0221) | 0.8792 (-0.0140) | | +| ogbg-molclintox | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9399 (-0.0421) | 0.8194 (0.0066) | | +| ogbg-molclintox | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9164 (-0.0383) | 0.8788 (0.0202) | | +| ogbg-molclintox | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9225 (-0.0127) | 0.8840 (-0.0030) | | +| ogbg-molclintox | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8494 (-0.0424) | 0.8186 (-0.0316) | | +| ogbg-molclintox | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9579 (0.0436) | 0.8664 (-0.0217) | | +| ogbg-molclintox | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9147 (-0.0104) | 0.8047 (-0.0323) | | +| ogbg-molclintox | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9064 (-0.0222) | 0.8735 (0.0132) | | +| ogbg-molclintox | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9055 (-0.0188) | 0.8979 (-0.0205) | | +| ogbg-molclintox | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9220 (0.0025) | 0.9054 (0.0068) | | +| ogbg-molclintox | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9183 (-0.0054) | 0.8433 (0.0435) | | +| ogbg-molclintox | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9322 (0.0051) | 0.8522 (-0.0242) | | +| ogbg-molesol | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 1.4196 (0.1887) | 1.4929 (0.0284) | | +| ogbg-molesol | arma | fixed-rrog-T1-ns3 | rmse | 1 | 1.0034 (0.0160) | 1.1272 (-0.0606) | | +| ogbg-molesol | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 0.9199 (0.0451) | 0.8841 (-0.0118) | | +| ogbg-molesol | film | fixed-rrog-T1-ns3 | rmse | 1 | 1.0196 (0.0521) | 1.0849 (0.2047) | | +| ogbg-molesol | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 1.0018 (0.0350) | 0.9780 (0.0098) | | +| ogbg-molesol | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 0.9591 (0.0818) | 0.9305 (0.1856) | | +| ogbg-molesol | gen | fixed-rrog-T1-ns3 | rmse | 1 | 1.0027 (0.0062) | 0.9206 (-0.0444) | | +| ogbg-molesol | gin | fixed-rrog-T1-ns3 | rmse | 1 | 0.9647 (0.0540) | 1.0798 (-0.0899) | | +| ogbg-molesol | gine | fixed-rrog-T1-ns3 | rmse | 1 | 1.0581 (-0.0295) | 1.0951 (-0.0144) | | +| ogbg-molesol | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 1.0048 (-0.0307) | 0.9968 (-0.0236) | | +| ogbg-molesol | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 0.9934 (-0.0254) | 1.0794 (-0.0757) | | +| ogbg-molesol | mf | fixed-rrog-T1-ns3 | rmse | 1 | 1.0553 (0.0942) | 1.0368 (0.0271) | | +| ogbg-molesol | pna | fixed-rrog-T1-ns3 | rmse | 1 | 0.9841 (-0.0725) | 0.9092 (0.0060) | | +| ogbg-molesol | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 0.9873 (-0.0382) | 0.8825 (0.0083) | | +| ogbg-molesol | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 1.0129 (0.0488) | 0.9373 (0.0407) | | +| ogbg-molesol | tag | fixed-rrog-T1-ns3 | rmse | 1 | 0.9036 (0.0288) | 0.9462 (0.0215) | | +| ogbg-molesol | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 0.9841 (-0.0443) | 1.0004 (-0.0512) | | +| ogbg-molfreesolv | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 5.5593 (0.4869) | 3.6549 (0.9928) | | +| ogbg-molfreesolv | arma | fixed-rrog-T1-ns3 | rmse | 1 | 5.0683 (-0.8021) | 3.6823 (-0.7053) | | +| ogbg-molfreesolv | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 3.0142 (-0.0662) | 2.2399 (0.0032) | | +| ogbg-molfreesolv | film | fixed-rrog-T1-ns3 | rmse | 1 | 3.2952 (-0.1406) | 3.3042 (-0.3460) | | +| ogbg-molfreesolv | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 3.9984 (0.2103) | 2.5966 (0.1403) | | +| ogbg-molfreesolv | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 3.5888 (0.1285) | 2.4444 (0.0407) | | +| ogbg-molfreesolv | gen | fixed-rrog-T1-ns3 | rmse | 1 | 4.3009 (-0.3011) | 2.9063 (-0.3476) | | +| ogbg-molfreesolv | gin | fixed-rrog-T1-ns3 | rmse | 1 | 3.9743 (0.0447) | 3.4292 (0.0607) | | +| ogbg-molfreesolv | gine | fixed-rrog-T1-ns3 | rmse | 1 | 4.4468 (-1.1508) | 3.7405 (-0.5963) | | +| ogbg-molfreesolv | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 2.9106 (-0.3792) | 3.1429 (-0.3476) | | +| ogbg-molfreesolv | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 3.7380 (-0.2358) | 2.1931 (0.1046) | | +| ogbg-molfreesolv | mf | fixed-rrog-T1-ns3 | rmse | 1 | 2.5060 (0.2313) | 3.1892 (-0.3007) | | +| ogbg-molfreesolv | pna | fixed-rrog-T1-ns3 | rmse | 1 | 3.3334 (-0.9708) | 2.4279 (-0.1669) | | +| ogbg-molfreesolv | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 3.0920 (-0.6148) | 2.0244 (-0.0203) | | +| ogbg-molfreesolv | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 3.9261 (-0.0114) | 2.4887 (-0.0741) | | +| ogbg-molfreesolv | tag | fixed-rrog-T1-ns3 | rmse | 1 | 2.7359 (-0.0486) | 2.0588 (0.3237) | | +| ogbg-molfreesolv | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 4.4180 (-0.3237) | 2.4325 (-0.1120) | | +| ogbg-molhiv | appnp | fixed-rrog-T1-ns3 | rocauc | 2 | 0.7543 (0.0238) | 0.7338 (0.0316) | | +| ogbg-molhiv | appnp | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7203 (-0.0471) | 0.6825 (-0.0175) | | +| ogbg-molhiv | arma | fixed-rrog-T1-ns3 | rocauc | 2 | 0.7764 (-0.0055) | 0.6948 (-0.0299) | | +| ogbg-molhiv | arma | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7926 (0.0054) | 0.7318 (0.0021) | | +| ogbg-molhiv | cheb | fixed-rrog-T1-ns3 | rocauc | 2 | 0.7801 (0.0097) | 0.7364 (0.0078) | | +| ogbg-molhiv | cheb | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7735 (-0.0096) | 0.7426 (0.0144) | | +| ogbg-molhiv | film | fixed-rrog-T1-ns3 | rocauc | 2 | 0.8009 (0.0356) | 0.7471 (-0.0089) | | +| ogbg-molhiv | film | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7633 (-0.0288) | 0.7728 (-0.0114) | | +| ogbg-molhiv | gatv2 | fixed-rrog-T1-ns3 | rocauc | 2 | 0.7721 (-0.0074) | 0.7281 (-0.0020) | | +| ogbg-molhiv | gatv2 | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7835 (0.0001) | 0.7466 (-0.0096) | | +| ogbg-molhiv | gcn | fixed-rrog-T1-ns3 | rocauc | 2 | 0.7873 (0.0121) | 0.7333 (0.0077) | | +| ogbg-molhiv | gcn | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7455 (-0.0300) | 0.7483 (0.0285) | | +| ogbg-molhiv | gen | fixed-rrog-T1-ns3 | rocauc | 2 | 0.7658 (-0.0001) | 0.7446 (0.0071) | | +| ogbg-molhiv | gen | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8128 (0.0598) | 0.7631 (0.0318) | | +| ogbg-molhiv | gin | fixed-rrog-T1-ns3 | rocauc | 2 | 0.7805 (-0.0223) | 0.7496 (-0.0206) | | +| ogbg-molhiv | gin | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7524 (-0.0644) | 0.7324 (-0.0400) | | +| ogbg-molhiv | gine | fixed-rrog-T1-ns3 | rocauc | 2 | 0.7533 (-0.0254) | 0.7523 (0.0130) | | +| ogbg-molhiv | gine | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7575 (-0.0368) | 0.7401 (-0.0044) | | +| ogbg-molhiv | graphconv | fixed-rrog-T1-ns3 | rocauc | 2 | 0.7801 (-0.0008) | 0.7295 (-0.0035) | | +| ogbg-molhiv | graphconv | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7713 (0.0006) | 0.6979 (-0.0129) | | +| ogbg-molhiv | graphsage | fixed-rrog-T1-ns3 | rocauc | 2 | 0.7891 (-0.0024) | 0.7362 (-0.0091) | | +| ogbg-molhiv | graphsage | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7587 (-0.0382) | 0.7641 (0.0016) | | +| ogbg-molhiv | mf | fixed-rrog-T1-ns3 | rocauc | 2 | 0.7858 (0.0149) | 0.7134 (-0.0044) | | +| ogbg-molhiv | mf | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7931 (0.0085) | 0.7217 (0.0143) | | +| ogbg-molhiv | pna | fixed-rrog-T1-ns3 | rocauc | 2 | 0.8303 (0.0422) | 0.7563 (-0.0004) | | +| ogbg-molhiv | pna | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7890 (0.0111) | 0.7630 (-0.0018) | | +| ogbg-molhiv | resgated | fixed-rrog-T1-ns3 | rocauc | 2 | 0.8037 (0.0035) | 0.7404 (0.0203) | | +| ogbg-molhiv | resgated | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8174 (0.0030) | 0.7055 (-0.0187) | | +| ogbg-molhiv | sgc | fixed-rrog-T1-ns3 | rocauc | 2 | 0.7632 (0.0046) | 0.6944 (-0.0116) | | +| ogbg-molhiv | sgc | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7482 (0.0003) | 0.7177 (0.0158) | | +| ogbg-molhiv | tag | fixed-rrog-T1-ns3 | rocauc | 2 | 0.7565 (0.0131) | 0.7235 (-0.0136) | | +| ogbg-molhiv | tag | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7804 (0.0276) | 0.7352 (0.0096) | | +| ogbg-molhiv | transformer | fixed-rrog-T1-ns3 | rocauc | 2 | 0.7745 (0.0052) | 0.7573 (-0.0143) | | +| ogbg-molhiv | transformer | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8088 (0.0471) | 0.7413 (-0.0134) | | +| ogbg-mollipo | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 0.8393 (0.0622) | 0.9174 (-0.0104) | | +| ogbg-mollipo | arma | fixed-rrog-T1-ns3 | rmse | 1 | 0.7173 (0.0152) | 0.7548 (-0.0253) | | +| ogbg-mollipo | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 0.6990 (0.0198) | 0.7132 (0.0048) | | +| ogbg-mollipo | film | fixed-rrog-T1-ns3 | rmse | 1 | 0.8122 (-0.0502) | 0.7353 (0.0018) | | +| ogbg-mollipo | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 0.7080 (-0.0215) | 0.7334 (-0.0026) | | +| ogbg-mollipo | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 0.7730 (-0.0351) | 0.7759 (0.0069) | | +| ogbg-mollipo | gen | fixed-rrog-T1-ns3 | rmse | 1 | 0.6594 (0.0452) | 0.7456 (-0.0077) | | +| ogbg-mollipo | gin | fixed-rrog-T1-ns3 | rmse | 1 | 0.6749 (0.0105) | 0.7073 (0.0317) | | +| ogbg-mollipo | gine | fixed-rrog-T1-ns3 | rmse | 1 | 0.7168 (-0.0553) | 0.7316 (0.0025) | | +| ogbg-mollipo | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 0.7372 (-0.0195) | 0.7396 (-0.0099) | | +| ogbg-mollipo | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 0.7184 (0.0055) | 0.7720 (0.0063) | | +| ogbg-mollipo | mf | fixed-rrog-T1-ns3 | rmse | 1 | 0.7050 (0.0080) | 0.7101 (0.0304) | | +| ogbg-mollipo | pna | fixed-rrog-T1-ns3 | rmse | 1 | 0.7466 (-0.0287) | 0.7908 (-0.0159) | | +| ogbg-mollipo | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 0.6766 (-0.0046) | 0.7144 (0.0126) | | +| ogbg-mollipo | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 0.7537 (-0.0032) | 0.7490 (0.0685) | | +| ogbg-mollipo | tag | fixed-rrog-T1-ns3 | rmse | 1 | 0.6743 (-0.0052) | 0.7201 (0.0026) | | +| ogbg-mollipo | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 0.6688 (0.0121) | 0.7396 (-0.0050) | | +| ogbg-molsider | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.5938 (0.0051) | 0.5905 (-0.0099) | | +| ogbg-molsider | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6344 (0.0071) | 0.6141 (-0.0018) | | +| ogbg-molsider | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6263 (0.0026) | 0.6096 (0.0062) | | +| ogbg-molsider | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.5862 (-0.0162) | 0.5974 (0.0076) | | +| ogbg-molsider | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6462 (0.0391) | 0.6000 (-0.0013) | | +| ogbg-molsider | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6256 (-0.0037) | 0.6117 (0.0031) | | +| ogbg-molsider | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6345 (-0.0175) | 0.6053 (0.0199) | | +| ogbg-molsider | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6046 (-0.0179) | 0.6022 (0.0274) | | +| ogbg-molsider | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6151 (-0.0176) | 0.6150 (0.0655) | | +| ogbg-molsider | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6010 (0.0089) | 0.5963 (-0.0188) | | +| ogbg-molsider | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6232 (0.0015) | 0.5861 (0.0053) | | +| ogbg-molsider | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6190 (-0.0012) | 0.5983 (0.0122) | | +| ogbg-molsider | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6058 (-0.0161) | 0.5721 (-0.0243) | | +| ogbg-molsider | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6205 (-0.0005) | 0.5960 (0.0050) | | +| ogbg-molsider | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6151 (-0.0022) | 0.6417 (0.0375) | | +| ogbg-molsider | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6410 (-0.0028) | 0.6102 (-0.0041) | | +| ogbg-molsider | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6315 (0.0156) | 0.6190 (0.0210) | | +| ogbg-moltox21 | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7280 (0.0025) | 0.7154 (-0.0005) | | +| ogbg-moltox21 | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7771 (-0.0028) | 0.7209 (-0.0014) | | +| ogbg-moltox21 | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0125) | 0.7286 (-0.0015) | | +| ogbg-moltox21 | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7727 (0.0025) | 0.7369 (0.0209) | | +| ogbg-moltox21 | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7762 (0.0135) | 0.7303 (0.0143) | | +| ogbg-moltox21 | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7588 (0.0007) | 0.7230 (0.0059) | | +| ogbg-moltox21 | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7757 (-0.0077) | 0.7312 (-0.0132) | | +| ogbg-moltox21 | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7718 (0.0028) | 0.7237 (-0.0005) | | +| ogbg-moltox21 | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7622 (-0.0122) | 0.7193 (-0.0135) | | +| ogbg-moltox21 | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7820 (-0.0011) | 0.7313 (0.0166) | | +| ogbg-moltox21 | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7697 (-0.0012) | 0.7205 (0.0009) | | +| ogbg-moltox21 | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7695 (-0.0078) | 0.7279 (-0.0002) | | +| ogbg-moltox21 | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7745 (0.0085) | 0.7349 (0.0403) | | +| ogbg-moltox21 | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7887 (-0.0064) | 0.7380 (0.0104) | | +| ogbg-moltox21 | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7506 (-0.0105) | 0.7355 (0.0115) | | +| ogbg-moltox21 | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7839 (-0.0027) | 0.7342 (-0.0074) | | +| ogbg-moltox21 | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7761 (0.0105) | 0.7292 (-0.0018) | | diff --git a/logs/ogbg-molhiv_T1_ns3_s2.log b/logs/ogbg-molhiv_T1_ns3_s2.log new file mode 100644 index 0000000..106c985 --- /dev/null +++ b/logs/ogbg-molhiv_T1_ns3_s2.log @@ -0,0 +1,887 @@ +[run] ogbg-molhiv view=gin compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gin --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.77910 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.68080 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.77909 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.71704 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.80998 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.77192 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.76713 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.79266 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.78636 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.78319 halt=0.00 train_steps=1.00 +[ogbg-molhiv_gin_classic_T0_ns1_h128_e100_s2] best_ep=50 val={'rocauc': 0.8099769743288261} test={'rocauc': 0.7394638753162479} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gin_classic_T0_ns1_h128_e100_s2.json +[run] ogbg-molhiv view=gin compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gin --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.69602 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.69894 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.70698 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.75186 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.72072 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.74483 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.72026 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.70869 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.71792 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.71924 halt=0.00 train_steps=3.00 +[ogbg-molhiv_gin_fixed-rrog_T1_ns3_h128_e100_s2] best_ep=40 val={'rocauc': 0.7518616500097983} test={'rocauc': 0.7650823693002955} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gin_fixed-rrog_T1_ns3_h128_e100_s2.json +[run] ogbg-molhiv view=gine compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gine --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.66907 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.61855 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.71729 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.72027 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.77864 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.76000 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.77539 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.77798 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.77431 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.77560 halt=0.00 train_steps=1.00 +[ogbg-molhiv_gine_classic_T0_ns1_h128_e100_s2] best_ep=50 val={'rocauc': 0.7786351165980796} test={'rocauc': 0.7729069700071457} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gine_classic_T0_ns1_h128_e100_s2.json +[run] ogbg-molhiv view=gine compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gine --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.64088 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.68459 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.74306 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.74743 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.77208 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.73219 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.75738 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.78727 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.77279 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.77796 halt=0.00 train_steps=3.00 +[ogbg-molhiv_gine_fixed-rrog_T1_ns3_h128_e100_s2] best_ep=80 val={'rocauc': 0.7872697432882618} test={'rocauc': 0.7010158558488964} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gine_fixed-rrog_T1_ns3_h128_e100_s2.json +[run] ogbg-molhiv view=gcn compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gcn --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.70336 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.75167 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.77492 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.73994 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.74640 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.75726 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.74487 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.75292 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.74965 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.74658 halt=0.00 train_steps=1.00 +[ogbg-molhiv_gcn_classic_T0_ns1_h128_e100_s2] best_ep=30 val={'rocauc': 0.7749179404271997} test={'rocauc': 0.7569246219509841} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gcn_classic_T0_ns1_h128_e100_s2.json +[run] ogbg-molhiv view=gcn compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gcn --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.70962 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.75463 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.77414 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.76642 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.75963 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.76942 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.74167 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.72666 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.72509 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.71922 halt=0.00 train_steps=3.00 +[ogbg-molhiv_gcn_fixed-rrog_T1_ns3_h128_e100_s2] best_ep=30 val={'rocauc': 0.7741386806780326} test={'rocauc': 0.7494157863226405} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gcn_fixed-rrog_T1_ns3_h128_e100_s2.json +[run] ogbg-molhiv view=graphsage compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view graphsage --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.72128 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.72150 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.77123 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.77651 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.74654 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.75628 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.75618 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.74948 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.75841 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.76074 halt=0.00 train_steps=1.00 +[ogbg-molhiv_graphsage_classic_T0_ns1_h128_e100_s2] best_ep=40 val={'rocauc': 0.7765070791691162} test={'rocauc': 0.7610942660151799} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_graphsage_classic_T0_ns1_h128_e100_s2.json +[run] ogbg-molhiv view=graphsage compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view graphsage --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.66498 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.69523 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.67164 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.73673 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.76156 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75668 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.77984 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.77012 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.75963 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.76295 halt=0.00 train_steps=3.00 +[ogbg-molhiv_graphsage_fixed-rrog_T1_ns3_h128_e100_s2] best_ep=70 val={'rocauc': 0.7798445767195766} test={'rocauc': 0.7146430019892235} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_graphsage_fixed-rrog_T1_ns3_h128_e100_s2.json +[run] ogbg-molhiv view=gatv2 compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gatv2 --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.74744 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.79311 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.77594 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.79187 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.79288 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.76908 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.77367 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.76684 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.76183 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.76329 halt=0.00 train_steps=1.00 +[ogbg-molhiv_gatv2_classic_T0_ns1_h128_e100_s2] best_ep=20 val={'rocauc': 0.793114956888105} test={'rocauc': 0.7273817570829874} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gatv2_classic_T0_ns1_h128_e100_s2.json +[run] ogbg-molhiv view=gatv2 compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gatv2 --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.73573 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.68603 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.73567 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.75925 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.77616 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.73973 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.74499 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.73607 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.71758 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.72349 halt=0.00 train_steps=3.00 +[ogbg-molhiv_gatv2_fixed-rrog_T1_ns3_h128_e100_s2] best_ep=50 val={'rocauc': 0.7761641436409955} test={'rocauc': 0.724479035902586} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gatv2_fixed-rrog_T1_ns3_h128_e100_s2.json +[run] ogbg-molhiv view=graphconv compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view graphconv --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.63604 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.73148 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.70977 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.73509 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.70662 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.72783 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.73062 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.72194 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.72680 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.72343 halt=0.00 train_steps=1.00 +[ogbg-molhiv_graphconv_classic_T0_ns1_h128_e100_s2] best_ep=40 val={'rocauc': 0.7350884283754655} test={'rocauc': 0.7330423530775024} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_graphconv_classic_T0_ns1_h128_e100_s2.json +[run] ogbg-molhiv view=graphconv compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view graphconv --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.58868 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.69137 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.75022 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.75807 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.76651 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.74705 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.74788 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.75848 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.75069 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.74481 halt=0.00 train_steps=3.00 +[ogbg-molhiv_graphconv_fixed-rrog_T1_ns3_h128_e100_s2] best_ep=50 val={'rocauc': 0.7665068342151675} test={'rocauc': 0.7325112497344484} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_graphconv_fixed-rrog_T1_ns3_h128_e100_s2.json +[run] ogbg-molhiv view=transformer compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view transformer --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.69418 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.75507 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.76184 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.71591 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.72909 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.70901 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.71042 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.68719 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.67989 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.68265 halt=0.00 train_steps=1.00 +[ogbg-molhiv_transformer_classic_T0_ns1_h128_e100_s2] best_ep=30 val={'rocauc': 0.7618435234175974} test={'rocauc': 0.7711736418239055} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_transformer_classic_T0_ns1_h128_e100_s2.json +[run] ogbg-molhiv view=transformer compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view transformer --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.68567 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.72300 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.74784 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.80434 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.78556 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.78730 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.79940 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.79575 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.78924 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.79357 halt=0.00 train_steps=3.00 +[ogbg-molhiv_transformer_fixed-rrog_T1_ns3_h128_e100_s2] best_ep=40 val={'rocauc': 0.8043399715853421} test={'rocauc': 0.7765908959230575} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_transformer_fixed-rrog_T1_ns3_h128_e100_s2.json +[run] ogbg-molhiv view=pna compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view pna --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.74594 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.79111 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.75091 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.76502 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.80199 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.76990 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.80667 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.80482 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.79585 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.79374 halt=0.00 train_steps=1.00 +[ogbg-molhiv_pna_classic_T0_ns1_h128_e100_s2] best_ep=70 val={'rocauc': 0.8066731579463061} test={'rocauc': 0.7427663724676027} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_pna_classic_T0_ns1_h128_e100_s2.json +[run] ogbg-molhiv view=pna compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view pna --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.71548 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.76199 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.68047 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.73278 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.71305 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.69991 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.76066 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.78164 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.77666 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.77992 halt=0.00 train_steps=3.00 +[ogbg-molhiv_pna_fixed-rrog_T1_ns3_h128_e100_s2] best_ep=80 val={'rocauc': 0.7816358024691358} test={'rocauc': 0.7382085401417564} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_pna_fixed-rrog_T1_ns3_h128_e100_s2.json +[run] ogbg-molhiv view=gen compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gen --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.71900 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.71850 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.73399 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.74417 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.75591 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.73789 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.71291 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.72031 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.72306 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.72002 halt=0.00 train_steps=1.00 +[ogbg-molhiv_gen_classic_T0_ns1_h128_e100_s2] best_ep=50 val={'rocauc': 0.7559125759357241} test={'rocauc': 0.7565596091079395} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gen_classic_T0_ns1_h128_e100_s2.json +[run] ogbg-molhiv view=gen compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gen --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.71439 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.73103 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.74792 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.76761 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.69540 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.73725 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.69090 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.69355 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.68226 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.68966 halt=0.00 train_steps=3.00 +[ogbg-molhiv_gen_fixed-rrog_T1_ns3_h128_e100_s2] best_ep=40 val={'rocauc': 0.7676060650597687} test={'rocauc': 0.7570231174800596} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gen_fixed-rrog_T1_ns3_h128_e100_s2.json +[run] ogbg-molhiv view=film compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view film --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.77283 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.81397 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.79383 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.77754 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.82146 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.81612 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.77203 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.76887 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.76402 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.76533 halt=0.00 train_steps=1.00 +[ogbg-molhiv_film_classic_T0_ns1_h128_e100_s2] best_ep=50 val={'rocauc': 0.8214622525965118} test={'rocauc': 0.7396087216825356} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_film_classic_T0_ns1_h128_e100_s2.json +[run] ogbg-molhiv view=film compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view film --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.67108 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.78932 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.78154 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.79131 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.81350 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.81917 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.78007 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.77893 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.75079 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.75276 halt=0.00 train_steps=3.00 +[ogbg-molhiv_film_fixed-rrog_T1_ns3_h128_e100_s2] best_ep=60 val={'rocauc': 0.8191688712522045} test={'rocauc': 0.7626895073292261} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_film_fixed-rrog_T1_ns3_h128_e100_s2.json +[run] ogbg-molhiv view=resgated compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view resgated --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.78854 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.74972 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.73903 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.77422 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.77706 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.72024 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.74393 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.75405 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.74059 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.74289 halt=0.00 train_steps=1.00 +[ogbg-molhiv_resgated_classic_T0_ns1_h128_e100_s2] best_ep=10 val={'rocauc': 0.7885404418969234} test={'rocauc': 0.7547480638869041} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_resgated_classic_T0_ns1_h128_e100_s2.json +[run] ogbg-molhiv view=resgated compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view resgated --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.69411 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.76065 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.77693 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.79870 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.78910 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75895 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.78474 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.77994 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.78285 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.77767 halt=0.00 train_steps=3.00 +[ogbg-molhiv_resgated_fixed-rrog_T1_ns3_h128_e100_s2] best_ep=40 val={'rocauc': 0.7987029688418578} test={'rocauc': 0.7339867513856969} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_resgated_fixed-rrog_T1_ns3_h128_e100_s2.json +[run] ogbg-molhiv view=tag compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view tag --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.61027 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.71861 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.75958 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.74046 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.69530 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.70296 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.71476 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.72258 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.71211 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.71320 halt=0.00 train_steps=1.00 +[ogbg-molhiv_tag_classic_T0_ns1_h128_e100_s2] best_ep=30 val={'rocauc': 0.7595807613168722} test={'rocauc': 0.7552386102473976} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_tag_classic_T0_ns1_h128_e100_s2.json +[run] ogbg-molhiv view=tag compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view tag --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.62604 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.67819 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.68679 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.72056 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.74401 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.70643 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.75311 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.72758 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.72515 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.72985 halt=0.00 train_steps=3.00 +[ogbg-molhiv_tag_fixed-rrog_T1_ns3_h128_e100_s2] best_ep=70 val={'rocauc': 0.753107853223594} test={'rocauc': 0.7545375538345662} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_tag_fixed-rrog_T1_ns3_h128_e100_s2.json +[run] ogbg-molhiv view=sgc compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view sgc --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.69093 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.75296 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.76698 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.79015 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.78157 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.78165 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.78587 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.79278 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.78484 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.78554 halt=0.00 train_steps=1.00 +[ogbg-molhiv_sgc_classic_T0_ns1_h128_e100_s2] best_ep=80 val={'rocauc': 0.7927750832843425} test={'rocauc': 0.6994457212383398} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_sgc_classic_T0_ns1_h128_e100_s2.json +[run] ogbg-molhiv view=sgc compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view sgc --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.70901 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.76657 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.74446 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.72625 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.73923 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.70795 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.73050 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.73530 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.73443 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.73660 halt=0.00 train_steps=3.00 +[ogbg-molhiv_sgc_fixed-rrog_T1_ns3_h128_e100_s2] best_ep=20 val={'rocauc': 0.7665741965510485} test={'rocauc': 0.7427122964908555} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_sgc_fixed-rrog_T1_ns3_h128_e100_s2.json +[run] ogbg-molhiv view=cheb compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view cheb --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.70804 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.76515 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.77213 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.78377 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.78207 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.73918 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.77829 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.79878 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.78798 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.78464 halt=0.00 train_steps=1.00 +[ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s2] best_ep=80 val={'rocauc': 0.7987825788751715} test={'rocauc': 0.7219181521466231} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s2.json +[run] ogbg-molhiv view=cheb compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view cheb --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.67440 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.75268 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.79662 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.77504 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.71671 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.80921 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.78234 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.77931 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.75698 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.75325 halt=0.00 train_steps=3.00 +[ogbg-molhiv_cheb_fixed-rrog_T1_ns3_h128_e100_s2] best_ep=60 val={'rocauc': 0.8092084313149128} test={'rocauc': 0.7313505475192645} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_cheb_fixed-rrog_T1_ns3_h128_e100_s2.json +[run] ogbg-molhiv view=arma compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view arma --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.67692 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.77171 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.76832 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.77600 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.73930 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.75954 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.73086 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.74455 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.74178 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.74695 halt=0.00 train_steps=1.00 +[ogbg-molhiv_arma_classic_T0_ns1_h128_e100_s2] best_ep=40 val={'rocauc': 0.7759957378012934} test={'rocauc': 0.7694818362656676} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_arma_classic_T0_ns1_h128_e100_s2.json +[run] ogbg-molhiv view=arma compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view arma --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.64424 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.76852 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.75258 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.79405 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.79238 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.77023 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.75347 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.74261 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.74637 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.74914 halt=0.00 train_steps=3.00 +[ogbg-molhiv_arma_fixed-rrog_T1_ns3_h128_e100_s2] best_ep=40 val={'rocauc': 0.7940457818930041} test={'rocauc': 0.7463856003399061} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_arma_fixed-rrog_T1_ns3_h128_e100_s2.json +[run] ogbg-molhiv view=mf compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view mf --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.75488 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.77128 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.74323 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.77356 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.74760 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.73409 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.73934 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.73559 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.73172 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.72801 halt=0.00 train_steps=1.00 +[ogbg-molhiv_mf_classic_T0_ns1_h128_e100_s2] best_ep=40 val={'rocauc': 0.7735645698608662} test={'rocauc': 0.769927963073833} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_mf_classic_T0_ns1_h128_e100_s2.json +[run] ogbg-molhiv view=mf compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view mf --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.74171 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.77634 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.74648 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.74111 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.76637 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.73727 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.74356 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.71162 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.70819 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.69720 halt=0.00 train_steps=3.00 +[ogbg-molhiv_mf_fixed-rrog_T1_ns3_h128_e100_s2] best_ep=20 val={'rocauc': 0.7763417352537723} test={'rocauc': 0.7111811738349525} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_mf_fixed-rrog_T1_ns3_h128_e100_s2.json +[run] ogbg-molhiv view=appnp compute=classic T=0 ns=1 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view appnp --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.71340 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.72133 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.68051 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.64824 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.64804 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.63197 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.61975 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.63096 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.63419 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.62975 halt=0.00 train_steps=1.00 +[ogbg-molhiv_appnp_classic_T0_ns1_h128_e100_s2] best_ep=20 val={'rocauc': 0.7213342641583382} test={'rocauc': 0.690191004075011} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_appnp_classic_T0_ns1_h128_e100_s2.json +[run] ogbg-molhiv view=appnp compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view appnp --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 2 --device cuda:0 +ep10 val_rocauc=0.70306 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.76196 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.72487 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.69525 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.72798 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.72291 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.74016 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.74633 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.75092 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.75032 halt=0.00 train_steps=3.00 +[ogbg-molhiv_appnp_fixed-rrog_T1_ns3_h128_e100_s2] best_ep=20 val={'rocauc': 0.7619568146188516} test={'rocauc': 0.72329708955368} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_appnp_fixed-rrog_T1_ns3_h128_e100_s2.json + +Classic baseline: task x backbone +| task | backbone | metric | n | val | test | +| --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | rocauc | 1 | 0.6564 +/- 0.0000 | 0.7423 +/- 0.0000 | +| ogbg-molbace | arma | rocauc | 1 | 0.6923 +/- 0.0000 | 0.7839 +/- 0.0000 | +| ogbg-molbace | cheb | rocauc | 1 | 0.7267 +/- 0.0000 | 0.7969 +/- 0.0000 | +| ogbg-molbace | film | rocauc | 1 | 0.6703 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molbace | gatv2 | rocauc | 1 | 0.7029 +/- 0.0000 | 0.7400 +/- 0.0000 | +| ogbg-molbace | gcn | rocauc | 1 | 0.6381 +/- 0.0000 | 0.7393 +/- 0.0000 | +| ogbg-molbace | gen | rocauc | 1 | 0.7128 +/- 0.0000 | 0.7326 +/- 0.0000 | +| ogbg-molbace | gin | rocauc | 1 | 0.6520 +/- 0.0000 | 0.7336 +/- 0.0000 | +| ogbg-molbace | gine | rocauc | 1 | 0.6641 +/- 0.0000 | 0.7454 +/- 0.0000 | +| ogbg-molbace | graphconv | rocauc | 1 | 0.7311 +/- 0.0000 | 0.8035 +/- 0.0000 | +| ogbg-molbace | graphsage | rocauc | 1 | 0.6758 +/- 0.0000 | 0.7759 +/- 0.0000 | +| ogbg-molbace | mf | rocauc | 1 | 0.7421 +/- 0.0000 | 0.7760 +/- 0.0000 | +| ogbg-molbace | pna | rocauc | 1 | 0.7516 +/- 0.0000 | 0.6912 +/- 0.0000 | +| ogbg-molbace | resgated | rocauc | 1 | 0.7172 +/- 0.0000 | 0.7877 +/- 0.0000 | +| ogbg-molbace | sgc | rocauc | 1 | 0.6575 +/- 0.0000 | 0.6966 +/- 0.0000 | +| ogbg-molbace | tag | rocauc | 1 | 0.7084 +/- 0.0000 | 0.7345 +/- 0.0000 | +| ogbg-molbace | transformer | rocauc | 1 | 0.6663 +/- 0.0000 | 0.7364 +/- 0.0000 | +| ogbg-molbbbp | appnp | rocauc | 1 | 0.9147 +/- 0.0000 | 0.6388 +/- 0.0000 | +| ogbg-molbbbp | arma | rocauc | 1 | 0.9367 +/- 0.0000 | 0.6651 +/- 0.0000 | +| ogbg-molbbbp | cheb | rocauc | 1 | 0.9452 +/- 0.0000 | 0.6514 +/- 0.0000 | +| ogbg-molbbbp | film | rocauc | 1 | 0.9285 +/- 0.0000 | 0.6300 +/- 0.0000 | +| ogbg-molbbbp | gatv2 | rocauc | 1 | 0.9347 +/- 0.0000 | 0.6324 +/- 0.0000 | +| ogbg-molbbbp | gcn | rocauc | 1 | 0.9386 +/- 0.0000 | 0.6679 +/- 0.0000 | +| ogbg-molbbbp | gen | rocauc | 1 | 0.9549 +/- 0.0000 | 0.6775 +/- 0.0000 | +| ogbg-molbbbp | gin | rocauc | 1 | 0.9251 +/- 0.0000 | 0.5670 +/- 0.0000 | +| ogbg-molbbbp | gine | rocauc | 1 | 0.9324 +/- 0.0000 | 0.6160 +/- 0.0000 | +| ogbg-molbbbp | graphconv | rocauc | 1 | 0.9268 +/- 0.0000 | 0.5900 +/- 0.0000 | +| ogbg-molbbbp | graphsage | rocauc | 1 | 0.9483 +/- 0.0000 | 0.6288 +/- 0.0000 | +| ogbg-molbbbp | mf | rocauc | 1 | 0.9395 +/- 0.0000 | 0.6365 +/- 0.0000 | +| ogbg-molbbbp | pna | rocauc | 1 | 0.9554 +/- 0.0000 | 0.6418 +/- 0.0000 | +| ogbg-molbbbp | resgated | rocauc | 1 | 0.9183 +/- 0.0000 | 0.6626 +/- 0.0000 | +| ogbg-molbbbp | sgc | rocauc | 1 | 0.9300 +/- 0.0000 | 0.6239 +/- 0.0000 | +| ogbg-molbbbp | tag | rocauc | 1 | 0.9476 +/- 0.0000 | 0.6100 +/- 0.0000 | +| ogbg-molbbbp | transformer | rocauc | 1 | 0.9495 +/- 0.0000 | 0.6156 +/- 0.0000 | +| ogbg-molclintox | appnp | rocauc | 1 | 0.8516 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | arma | rocauc | 1 | 0.9463 +/- 0.0000 | 0.8678 +/- 0.0000 | +| ogbg-molclintox | cheb | rocauc | 1 | 0.8928 +/- 0.0000 | 0.9152 +/- 0.0000 | +| ogbg-molclintox | film | rocauc | 1 | 0.9048 +/- 0.0000 | 0.7731 +/- 0.0000 | +| ogbg-molclintox | gatv2 | rocauc | 1 | 0.9515 +/- 0.0000 | 0.8493 +/- 0.0000 | +| ogbg-molclintox | gcn | rocauc | 1 | 0.9318 +/- 0.0000 | 0.8932 +/- 0.0000 | +| ogbg-molclintox | gen | rocauc | 1 | 0.9820 +/- 0.0000 | 0.8128 +/- 0.0000 | +| ogbg-molclintox | gin | rocauc | 1 | 0.9547 +/- 0.0000 | 0.8586 +/- 0.0000 | +| ogbg-molclintox | gine | rocauc | 1 | 0.9353 +/- 0.0000 | 0.8869 +/- 0.0000 | +| ogbg-molclintox | graphconv | rocauc | 1 | 0.8917 +/- 0.0000 | 0.8501 +/- 0.0000 | +| ogbg-molclintox | graphsage | rocauc | 1 | 0.9143 +/- 0.0000 | 0.8882 +/- 0.0000 | +| ogbg-molclintox | mf | rocauc | 1 | 0.9252 +/- 0.0000 | 0.8370 +/- 0.0000 | +| ogbg-molclintox | pna | rocauc | 1 | 0.9286 +/- 0.0000 | 0.8603 +/- 0.0000 | +| ogbg-molclintox | resgated | rocauc | 1 | 0.9244 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | sgc | rocauc | 1 | 0.9195 +/- 0.0000 | 0.8986 +/- 0.0000 | +| ogbg-molclintox | tag | rocauc | 1 | 0.9237 +/- 0.0000 | 0.7998 +/- 0.0000 | +| ogbg-molclintox | transformer | rocauc | 1 | 0.9271 +/- 0.0000 | 0.8764 +/- 0.0000 | +| ogbg-molesol | appnp | rmse | 1 | 1.6083 +/- 0.0000 | 1.5212 +/- 0.0000 | +| ogbg-molesol | arma | rmse | 1 | 1.0195 +/- 0.0000 | 1.0666 +/- 0.0000 | +| ogbg-molesol | cheb | rmse | 1 | 0.9650 +/- 0.0000 | 0.8722 +/- 0.0000 | +| ogbg-molesol | film | rmse | 1 | 1.0718 +/- 0.0000 | 1.2896 +/- 0.0000 | +| ogbg-molesol | gatv2 | rmse | 1 | 1.0368 +/- 0.0000 | 0.9878 +/- 0.0000 | +| ogbg-molesol | gcn | rmse | 1 | 1.0409 +/- 0.0000 | 1.1161 +/- 0.0000 | +| ogbg-molesol | gen | rmse | 1 | 1.0089 +/- 0.0000 | 0.8762 +/- 0.0000 | +| ogbg-molesol | gin | rmse | 1 | 1.0187 +/- 0.0000 | 0.9900 +/- 0.0000 | +| ogbg-molesol | gine | rmse | 1 | 1.0286 +/- 0.0000 | 1.0807 +/- 0.0000 | +| ogbg-molesol | graphconv | rmse | 1 | 0.9741 +/- 0.0000 | 0.9732 +/- 0.0000 | +| ogbg-molesol | graphsage | rmse | 1 | 0.9680 +/- 0.0000 | 1.0038 +/- 0.0000 | +| ogbg-molesol | mf | rmse | 1 | 1.1494 +/- 0.0000 | 1.0639 +/- 0.0000 | +| ogbg-molesol | pna | rmse | 1 | 0.9116 +/- 0.0000 | 0.9153 +/- 0.0000 | +| ogbg-molesol | resgated | rmse | 1 | 0.9492 +/- 0.0000 | 0.8908 +/- 0.0000 | +| ogbg-molesol | sgc | rmse | 1 | 1.0617 +/- 0.0000 | 0.9780 +/- 0.0000 | +| ogbg-molesol | tag | rmse | 1 | 0.9323 +/- 0.0000 | 0.9678 +/- 0.0000 | +| ogbg-molesol | transformer | rmse | 1 | 0.9398 +/- 0.0000 | 0.9492 +/- 0.0000 | +| ogbg-molfreesolv | appnp | rmse | 1 | 6.0462 +/- 0.0000 | 4.6478 +/- 0.0000 | +| ogbg-molfreesolv | arma | rmse | 1 | 4.2662 +/- 0.0000 | 2.9769 +/- 0.0000 | +| ogbg-molfreesolv | cheb | rmse | 1 | 2.9481 +/- 0.0000 | 2.2431 +/- 0.0000 | +| ogbg-molfreesolv | film | rmse | 1 | 3.1546 +/- 0.0000 | 2.9581 +/- 0.0000 | +| ogbg-molfreesolv | gatv2 | rmse | 1 | 4.2086 +/- 0.0000 | 2.7368 +/- 0.0000 | +| ogbg-molfreesolv | gcn | rmse | 1 | 3.7172 +/- 0.0000 | 2.4851 +/- 0.0000 | +| ogbg-molfreesolv | gen | rmse | 1 | 3.9998 +/- 0.0000 | 2.5588 +/- 0.0000 | +| ogbg-molfreesolv | gin | rmse | 1 | 4.0190 +/- 0.0000 | 3.4898 +/- 0.0000 | +| ogbg-molfreesolv | gine | rmse | 1 | 3.2961 +/- 0.0000 | 3.1442 +/- 0.0000 | +| ogbg-molfreesolv | graphconv | rmse | 1 | 2.5314 +/- 0.0000 | 2.7953 +/- 0.0000 | +| ogbg-molfreesolv | graphsage | rmse | 1 | 3.5022 +/- 0.0000 | 2.2977 +/- 0.0000 | +| ogbg-molfreesolv | mf | rmse | 1 | 2.7374 +/- 0.0000 | 2.8885 +/- 0.0000 | +| ogbg-molfreesolv | pna | rmse | 1 | 2.3625 +/- 0.0000 | 2.2610 +/- 0.0000 | +| ogbg-molfreesolv | resgated | rmse | 1 | 2.4772 +/- 0.0000 | 2.0041 +/- 0.0000 | +| ogbg-molfreesolv | sgc | rmse | 1 | 3.9147 +/- 0.0000 | 2.4146 +/- 0.0000 | +| ogbg-molfreesolv | tag | rmse | 1 | 2.6874 +/- 0.0000 | 2.3826 +/- 0.0000 | +| ogbg-molfreesolv | transformer | rmse | 1 | 4.0942 +/- 0.0000 | 2.3205 +/- 0.0000 | +| ogbg-molhiv | appnp | rocauc | 3 | 0.7274 +/- 0.0374 | 0.6982 +/- 0.0073 | +| ogbg-molhiv | arma | rocauc | 3 | 0.7799 +/- 0.0063 | 0.7396 +/- 0.0263 | +| ogbg-molhiv | cheb | rocauc | 3 | 0.7799 +/- 0.0207 | 0.7264 +/- 0.0039 | +| ogbg-molhiv | film | rocauc | 3 | 0.7840 +/- 0.0421 | 0.7505 +/- 0.0298 | +| ogbg-molhiv | gatv2 | rocauc | 3 | 0.7841 +/- 0.0088 | 0.7292 +/- 0.0262 | +| ogbg-molhiv | gcn | rocauc | 3 | 0.7751 +/- 0.0003 | 0.7360 +/- 0.0190 | +| ogbg-molhiv | gen | rocauc | 3 | 0.7626 +/- 0.0141 | 0.7438 +/- 0.0126 | +| ogbg-molhiv | gin | rocauc | 3 | 0.8052 +/- 0.0145 | 0.7600 +/- 0.0179 | +| ogbg-molhiv | gine | rocauc | 3 | 0.7787 +/- 0.0156 | 0.7505 +/- 0.0200 | +| ogbg-molhiv | graphconv | rocauc | 3 | 0.7656 +/- 0.0284 | 0.7330 +/- 0.0222 | +| ogbg-molhiv | graphsage | rocauc | 3 | 0.7865 +/- 0.0102 | 0.7506 +/- 0.0195 | +| ogbg-molhiv | mf | rocauc | 3 | 0.7718 +/- 0.0137 | 0.7352 +/- 0.0319 | +| ogbg-molhiv | pna | rocauc | 3 | 0.7943 +/- 0.0148 | 0.7520 +/- 0.0114 | +| ogbg-molhiv | resgated | rocauc | 3 | 0.7963 +/- 0.0157 | 0.7316 +/- 0.0205 | +| ogbg-molhiv | sgc | rocauc | 3 | 0.7699 +/- 0.0225 | 0.7038 +/- 0.0055 | +| ogbg-molhiv | tag | rocauc | 3 | 0.7488 +/- 0.0133 | 0.7432 +/- 0.0156 | +| ogbg-molhiv | transformer | rocauc | 3 | 0.7668 +/- 0.0086 | 0.7714 +/- 0.0168 | +| ogbg-mollipo | appnp | rmse | 1 | 0.9015 +/- 0.0000 | 0.9070 +/- 0.0000 | +| ogbg-mollipo | arma | rmse | 1 | 0.7325 +/- 0.0000 | 0.7295 +/- 0.0000 | +| ogbg-mollipo | cheb | rmse | 1 | 0.7188 +/- 0.0000 | 0.7180 +/- 0.0000 | +| ogbg-mollipo | film | rmse | 1 | 0.7620 +/- 0.0000 | 0.7371 +/- 0.0000 | +| ogbg-mollipo | gatv2 | rmse | 1 | 0.6865 +/- 0.0000 | 0.7308 +/- 0.0000 | +| ogbg-mollipo | gcn | rmse | 1 | 0.7379 +/- 0.0000 | 0.7828 +/- 0.0000 | +| ogbg-mollipo | gen | rmse | 1 | 0.7046 +/- 0.0000 | 0.7379 +/- 0.0000 | +| ogbg-mollipo | gin | rmse | 1 | 0.6854 +/- 0.0000 | 0.7390 +/- 0.0000 | +| ogbg-mollipo | gine | rmse | 1 | 0.6615 +/- 0.0000 | 0.7341 +/- 0.0000 | +| ogbg-mollipo | graphconv | rmse | 1 | 0.7178 +/- 0.0000 | 0.7297 +/- 0.0000 | +| ogbg-mollipo | graphsage | rmse | 1 | 0.7239 +/- 0.0000 | 0.7783 +/- 0.0000 | +| ogbg-mollipo | mf | rmse | 1 | 0.7129 +/- 0.0000 | 0.7405 +/- 0.0000 | +| ogbg-mollipo | pna | rmse | 1 | 0.7179 +/- 0.0000 | 0.7749 +/- 0.0000 | +| ogbg-mollipo | resgated | rmse | 1 | 0.6721 +/- 0.0000 | 0.7270 +/- 0.0000 | +| ogbg-mollipo | sgc | rmse | 1 | 0.7505 +/- 0.0000 | 0.8176 +/- 0.0000 | +| ogbg-mollipo | tag | rmse | 1 | 0.6692 +/- 0.0000 | 0.7227 +/- 0.0000 | +| ogbg-mollipo | transformer | rmse | 1 | 0.6810 +/- 0.0000 | 0.7346 +/- 0.0000 | +| ogbg-molsider | appnp | rocauc | 1 | 0.5886 +/- 0.0000 | 0.6004 +/- 0.0000 | +| ogbg-molsider | arma | rocauc | 1 | 0.6273 +/- 0.0000 | 0.6159 +/- 0.0000 | +| ogbg-molsider | cheb | rocauc | 1 | 0.6237 +/- 0.0000 | 0.6033 +/- 0.0000 | +| ogbg-molsider | film | rocauc | 1 | 0.6024 +/- 0.0000 | 0.5898 +/- 0.0000 | +| ogbg-molsider | gatv2 | rocauc | 1 | 0.6071 +/- 0.0000 | 0.6013 +/- 0.0000 | +| ogbg-molsider | gcn | rocauc | 1 | 0.6293 +/- 0.0000 | 0.6086 +/- 0.0000 | +| ogbg-molsider | gen | rocauc | 1 | 0.6519 +/- 0.0000 | 0.5854 +/- 0.0000 | +| ogbg-molsider | gin | rocauc | 1 | 0.6225 +/- 0.0000 | 0.5748 +/- 0.0000 | +| ogbg-molsider | gine | rocauc | 1 | 0.6327 +/- 0.0000 | 0.5495 +/- 0.0000 | +| ogbg-molsider | graphconv | rocauc | 1 | 0.5921 +/- 0.0000 | 0.6151 +/- 0.0000 | +| ogbg-molsider | graphsage | rocauc | 1 | 0.6217 +/- 0.0000 | 0.5807 +/- 0.0000 | +| ogbg-molsider | mf | rocauc | 1 | 0.6202 +/- 0.0000 | 0.5861 +/- 0.0000 | +| ogbg-molsider | pna | rocauc | 1 | 0.6219 +/- 0.0000 | 0.5965 +/- 0.0000 | +| ogbg-molsider | resgated | rocauc | 1 | 0.6209 +/- 0.0000 | 0.5910 +/- 0.0000 | +| ogbg-molsider | sgc | rocauc | 1 | 0.6174 +/- 0.0000 | 0.6043 +/- 0.0000 | +| ogbg-molsider | tag | rocauc | 1 | 0.6439 +/- 0.0000 | 0.6143 +/- 0.0000 | +| ogbg-molsider | transformer | rocauc | 1 | 0.6160 +/- 0.0000 | 0.5980 +/- 0.0000 | +| ogbg-moltox21 | appnp | rocauc | 1 | 0.7255 +/- 0.0000 | 0.7158 +/- 0.0000 | +| ogbg-moltox21 | arma | rocauc | 1 | 0.7799 +/- 0.0000 | 0.7223 +/- 0.0000 | +| ogbg-moltox21 | cheb | rocauc | 1 | 0.7834 +/- 0.0000 | 0.7301 +/- 0.0000 | +| ogbg-moltox21 | film | rocauc | 1 | 0.7702 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gatv2 | rocauc | 1 | 0.7627 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gcn | rocauc | 1 | 0.7580 +/- 0.0000 | 0.7171 +/- 0.0000 | +| ogbg-moltox21 | gen | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7444 +/- 0.0000 | +| ogbg-moltox21 | gin | rocauc | 1 | 0.7690 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-moltox21 | gine | rocauc | 1 | 0.7744 +/- 0.0000 | 0.7328 +/- 0.0000 | +| ogbg-moltox21 | graphconv | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7147 +/- 0.0000 | +| ogbg-moltox21 | graphsage | rocauc | 1 | 0.7709 +/- 0.0000 | 0.7196 +/- 0.0000 | +| ogbg-moltox21 | mf | rocauc | 1 | 0.7773 +/- 0.0000 | 0.7281 +/- 0.0000 | +| ogbg-moltox21 | pna | rocauc | 1 | 0.7660 +/- 0.0000 | 0.6946 +/- 0.0000 | +| ogbg-moltox21 | resgated | rocauc | 1 | 0.7950 +/- 0.0000 | 0.7275 +/- 0.0000 | +| ogbg-moltox21 | sgc | rocauc | 1 | 0.7611 +/- 0.0000 | 0.7240 +/- 0.0000 | +| ogbg-moltox21 | tag | rocauc | 1 | 0.7866 +/- 0.0000 | 0.7416 +/- 0.0000 | +| ogbg-moltox21 | transformer | rocauc | 1 | 0.7656 +/- 0.0000 | 0.7309 +/- 0.0000 | + +Delta vs matching classic +| task | backbone | compute | metric | n | val score (delta) | test score (delta) | steps | +| --- | --- | --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7168 (0.0604) | 0.7209 (-0.0214) | | +| ogbg-molbace | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7179 (0.0256) | 0.7672 (-0.0167) | | +| ogbg-molbace | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7114 (-0.0154) | 0.7533 (-0.0436) | | +| ogbg-molbace | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6652 (-0.0051) | 0.7242 (0.0000) | | +| ogbg-molbace | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7026 (-0.0004) | 0.7519 (0.0118) | | +| ogbg-molbace | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6374 (-0.0007) | 0.7733 (0.0339) | | +| ogbg-molbace | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6894 (-0.0234) | 0.7449 (0.0123) | | +| ogbg-molbace | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6538 (0.0018) | 0.7169 (-0.0167) | | +| ogbg-molbace | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6685 (0.0044) | 0.6994 (-0.0461) | | +| ogbg-molbace | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7462 (0.0150) | 0.7983 (-0.0052) | | +| ogbg-molbace | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6703 (-0.0055) | 0.7119 (-0.0640) | | +| ogbg-molbace | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7234 (-0.0187) | 0.7684 (-0.0077) | | +| ogbg-molbace | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7037 (-0.0480) | 0.7967 (0.1055) | | +| ogbg-molbace | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6912 (-0.0260) | 0.7465 (-0.0412) | | +| ogbg-molbace | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6454 (-0.0121) | 0.7727 (0.0762) | | +| ogbg-molbace | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7355 (0.0271) | 0.6806 (-0.0539) | | +| ogbg-molbace | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6982 (0.0319) | 0.7487 (0.0123) | | +| ogbg-molbbbp | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9360 (0.0213) | 0.6073 (-0.0314) | | +| ogbg-molbbbp | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9415 (0.0048) | 0.6635 (-0.0016) | | +| ogbg-molbbbp | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9278 (-0.0174) | 0.6659 (0.0145) | | +| ogbg-molbbbp | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9400 (0.0115) | 0.6323 (0.0023) | | +| ogbg-molbbbp | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9356 (0.0009) | 0.6560 (0.0235) | | +| ogbg-molbbbp | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9417 (0.0031) | 0.6017 (-0.0663) | | +| ogbg-molbbbp | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9429 (-0.0119) | 0.6037 (-0.0738) | | +| ogbg-molbbbp | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9526 (0.0275) | 0.5932 (0.0261) | | +| ogbg-molbbbp | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9421 (0.0098) | 0.6976 (0.0816) | | +| ogbg-molbbbp | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9337 (0.0069) | 0.6518 (0.0618) | | +| ogbg-molbbbp | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9502 (0.0019) | 0.5934 (-0.0354) | | +| ogbg-molbbbp | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9488 (0.0094) | 0.6481 (0.0116) | | +| ogbg-molbbbp | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9585 (0.0031) | 0.6682 (0.0264) | | +| ogbg-molbbbp | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9535 (0.0352) | 0.5839 (-0.0787) | | +| ogbg-molbbbp | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9285 (-0.0015) | 0.6454 (0.0215) | | +| ogbg-molbbbp | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9459 (-0.0017) | 0.6420 (0.0320) | | +| ogbg-molbbbp | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9355 (-0.0140) | 0.6221 (0.0065) | | +| ogbg-molclintox | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9029 (0.0513) | 0.8898 (-0.0286) | | +| ogbg-molclintox | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9135 (-0.0328) | 0.8863 (0.0185) | | +| ogbg-molclintox | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8816 (-0.0112) | 0.8982 (-0.0170) | | +| ogbg-molclintox | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9454 (0.0406) | 0.8430 (0.0699) | | +| ogbg-molclintox | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9351 (-0.0164) | 0.8328 (-0.0164) | | +| ogbg-molclintox | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9097 (-0.0221) | 0.8792 (-0.0140) | | +| ogbg-molclintox | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9399 (-0.0421) | 0.8194 (0.0066) | | +| ogbg-molclintox | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9164 (-0.0383) | 0.8788 (0.0202) | | +| ogbg-molclintox | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9225 (-0.0127) | 0.8840 (-0.0030) | | +| ogbg-molclintox | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8494 (-0.0424) | 0.8186 (-0.0316) | | +| ogbg-molclintox | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9579 (0.0436) | 0.8664 (-0.0217) | | +| ogbg-molclintox | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9147 (-0.0104) | 0.8047 (-0.0323) | | +| ogbg-molclintox | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9064 (-0.0222) | 0.8735 (0.0132) | | +| ogbg-molclintox | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9055 (-0.0188) | 0.8979 (-0.0205) | | +| ogbg-molclintox | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9220 (0.0025) | 0.9054 (0.0068) | | +| ogbg-molclintox | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9183 (-0.0054) | 0.8433 (0.0435) | | +| ogbg-molclintox | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9322 (0.0051) | 0.8522 (-0.0242) | | +| ogbg-molesol | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 1.4196 (0.1887) | 1.4929 (0.0284) | | +| ogbg-molesol | arma | fixed-rrog-T1-ns3 | rmse | 1 | 1.0034 (0.0160) | 1.1272 (-0.0606) | | +| ogbg-molesol | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 0.9199 (0.0451) | 0.8841 (-0.0118) | | +| ogbg-molesol | film | fixed-rrog-T1-ns3 | rmse | 1 | 1.0196 (0.0521) | 1.0849 (0.2047) | | +| ogbg-molesol | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 1.0018 (0.0350) | 0.9780 (0.0098) | | +| ogbg-molesol | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 0.9591 (0.0818) | 0.9305 (0.1856) | | +| ogbg-molesol | gen | fixed-rrog-T1-ns3 | rmse | 1 | 1.0027 (0.0062) | 0.9206 (-0.0444) | | +| ogbg-molesol | gin | fixed-rrog-T1-ns3 | rmse | 1 | 0.9647 (0.0540) | 1.0798 (-0.0899) | | +| ogbg-molesol | gine | fixed-rrog-T1-ns3 | rmse | 1 | 1.0581 (-0.0295) | 1.0951 (-0.0144) | | +| ogbg-molesol | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 1.0048 (-0.0307) | 0.9968 (-0.0236) | | +| ogbg-molesol | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 0.9934 (-0.0254) | 1.0794 (-0.0757) | | +| ogbg-molesol | mf | fixed-rrog-T1-ns3 | rmse | 1 | 1.0553 (0.0942) | 1.0368 (0.0271) | | +| ogbg-molesol | pna | fixed-rrog-T1-ns3 | rmse | 1 | 0.9841 (-0.0725) | 0.9092 (0.0060) | | +| ogbg-molesol | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 0.9873 (-0.0382) | 0.8825 (0.0083) | | +| ogbg-molesol | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 1.0129 (0.0488) | 0.9373 (0.0407) | | +| ogbg-molesol | tag | fixed-rrog-T1-ns3 | rmse | 1 | 0.9036 (0.0288) | 0.9462 (0.0215) | | +| ogbg-molesol | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 0.9841 (-0.0443) | 1.0004 (-0.0512) | | +| ogbg-molfreesolv | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 5.5593 (0.4869) | 3.6549 (0.9928) | | +| ogbg-molfreesolv | arma | fixed-rrog-T1-ns3 | rmse | 1 | 5.0683 (-0.8021) | 3.6823 (-0.7053) | | +| ogbg-molfreesolv | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 3.0142 (-0.0662) | 2.2399 (0.0032) | | +| ogbg-molfreesolv | film | fixed-rrog-T1-ns3 | rmse | 1 | 3.2952 (-0.1406) | 3.3042 (-0.3460) | | +| ogbg-molfreesolv | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 3.9984 (0.2103) | 2.5966 (0.1403) | | +| ogbg-molfreesolv | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 3.5888 (0.1285) | 2.4444 (0.0407) | | +| ogbg-molfreesolv | gen | fixed-rrog-T1-ns3 | rmse | 1 | 4.3009 (-0.3011) | 2.9063 (-0.3476) | | +| ogbg-molfreesolv | gin | fixed-rrog-T1-ns3 | rmse | 1 | 3.9743 (0.0447) | 3.4292 (0.0607) | | +| ogbg-molfreesolv | gine | fixed-rrog-T1-ns3 | rmse | 1 | 4.4468 (-1.1508) | 3.7405 (-0.5963) | | +| ogbg-molfreesolv | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 2.9106 (-0.3792) | 3.1429 (-0.3476) | | +| ogbg-molfreesolv | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 3.7380 (-0.2358) | 2.1931 (0.1046) | | +| ogbg-molfreesolv | mf | fixed-rrog-T1-ns3 | rmse | 1 | 2.5060 (0.2313) | 3.1892 (-0.3007) | | +| ogbg-molfreesolv | pna | fixed-rrog-T1-ns3 | rmse | 1 | 3.3334 (-0.9708) | 2.4279 (-0.1669) | | +| ogbg-molfreesolv | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 3.0920 (-0.6148) | 2.0244 (-0.0203) | | +| ogbg-molfreesolv | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 3.9261 (-0.0114) | 2.4887 (-0.0741) | | +| ogbg-molfreesolv | tag | fixed-rrog-T1-ns3 | rmse | 1 | 2.7359 (-0.0486) | 2.0588 (0.3237) | | +| ogbg-molfreesolv | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 4.4180 (-0.3237) | 2.4325 (-0.1120) | | +| ogbg-molhiv | appnp | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7568 (0.0294) | 0.7303 (0.0321) | | +| ogbg-molhiv | appnp | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7203 (-0.0471) | 0.6825 (-0.0175) | | +| ogbg-molhiv | arma | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7823 (0.0023) | 0.7120 (-0.0276) | | +| ogbg-molhiv | arma | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7926 (0.0054) | 0.7318 (0.0021) | | +| ogbg-molhiv | cheb | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7898 (0.0099) | 0.7347 (0.0083) | | +| ogbg-molhiv | cheb | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7735 (-0.0096) | 0.7426 (0.0144) | | +| ogbg-molhiv | film | fixed-rrog-T1-ns3 | rocauc | 3 | 0.8070 (0.0230) | 0.7523 (0.0018) | | +| ogbg-molhiv | film | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7633 (-0.0288) | 0.7728 (-0.0114) | | +| ogbg-molhiv | gatv2 | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7734 (-0.0106) | 0.7269 (-0.0023) | | +| ogbg-molhiv | gatv2 | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7835 (0.0001) | 0.7466 (-0.0096) | | +| ogbg-molhiv | gcn | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7829 (0.0078) | 0.7386 (0.0026) | | +| ogbg-molhiv | gcn | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7455 (-0.0300) | 0.7483 (0.0285) | | +| ogbg-molhiv | gen | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7664 (0.0038) | 0.7487 (0.0049) | | +| ogbg-molhiv | gen | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8128 (0.0598) | 0.7631 (0.0318) | | +| ogbg-molhiv | gin | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7710 (-0.0342) | 0.7548 (-0.0052) | | +| ogbg-molhiv | gin | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7524 (-0.0644) | 0.7324 (-0.0400) | | +| ogbg-molhiv | gine | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7646 (-0.0140) | 0.7352 (-0.0153) | | +| ogbg-molhiv | gine | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7575 (-0.0368) | 0.7401 (-0.0044) | | +| ogbg-molhiv | graphconv | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7755 (0.0099) | 0.7305 (-0.0025) | | +| ogbg-molhiv | graphconv | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7713 (0.0006) | 0.6979 (-0.0129) | | +| ogbg-molhiv | graphsage | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7860 (-0.0005) | 0.7290 (-0.0216) | | +| ogbg-molhiv | graphsage | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7587 (-0.0382) | 0.7641 (0.0016) | | +| ogbg-molhiv | mf | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7826 (0.0109) | 0.7127 (-0.0225) | | +| ogbg-molhiv | mf | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7931 (0.0085) | 0.7217 (0.0143) | | +| ogbg-molhiv | pna | fixed-rrog-T1-ns3 | rocauc | 3 | 0.8141 (0.0198) | 0.7503 (-0.0018) | | +| ogbg-molhiv | pna | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7890 (0.0111) | 0.7630 (-0.0018) | | +| ogbg-molhiv | resgated | fixed-rrog-T1-ns3 | rocauc | 3 | 0.8020 (0.0057) | 0.7383 (0.0066) | | +| ogbg-molhiv | resgated | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8174 (0.0030) | 0.7055 (-0.0187) | | +| ogbg-molhiv | sgc | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7643 (-0.0056) | 0.7105 (0.0067) | | +| ogbg-molhiv | sgc | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7482 (0.0003) | 0.7177 (0.0158) | | +| ogbg-molhiv | tag | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7554 (0.0066) | 0.7339 (-0.0093) | | +| ogbg-molhiv | tag | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7804 (0.0276) | 0.7352 (0.0096) | | +| ogbg-molhiv | transformer | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7844 (0.0177) | 0.7637 (-0.0077) | | +| ogbg-molhiv | transformer | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8088 (0.0471) | 0.7413 (-0.0134) | | +| ogbg-mollipo | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 0.8393 (0.0622) | 0.9174 (-0.0104) | | +| ogbg-mollipo | arma | fixed-rrog-T1-ns3 | rmse | 1 | 0.7173 (0.0152) | 0.7548 (-0.0253) | | +| ogbg-mollipo | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 0.6990 (0.0198) | 0.7132 (0.0048) | | +| ogbg-mollipo | film | fixed-rrog-T1-ns3 | rmse | 1 | 0.8122 (-0.0502) | 0.7353 (0.0018) | | +| ogbg-mollipo | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 0.7080 (-0.0215) | 0.7334 (-0.0026) | | +| ogbg-mollipo | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 0.7730 (-0.0351) | 0.7759 (0.0069) | | +| ogbg-mollipo | gen | fixed-rrog-T1-ns3 | rmse | 1 | 0.6594 (0.0452) | 0.7456 (-0.0077) | | +| ogbg-mollipo | gin | fixed-rrog-T1-ns3 | rmse | 1 | 0.6749 (0.0105) | 0.7073 (0.0317) | | +| ogbg-mollipo | gine | fixed-rrog-T1-ns3 | rmse | 1 | 0.7168 (-0.0553) | 0.7316 (0.0025) | | +| ogbg-mollipo | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 0.7372 (-0.0195) | 0.7396 (-0.0099) | | +| ogbg-mollipo | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 0.7184 (0.0055) | 0.7720 (0.0063) | | +| ogbg-mollipo | mf | fixed-rrog-T1-ns3 | rmse | 1 | 0.7050 (0.0080) | 0.7101 (0.0304) | | +| ogbg-mollipo | pna | fixed-rrog-T1-ns3 | rmse | 1 | 0.7466 (-0.0287) | 0.7908 (-0.0159) | | +| ogbg-mollipo | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 0.6766 (-0.0046) | 0.7144 (0.0126) | | +| ogbg-mollipo | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 0.7537 (-0.0032) | 0.7490 (0.0685) | | +| ogbg-mollipo | tag | fixed-rrog-T1-ns3 | rmse | 1 | 0.6743 (-0.0052) | 0.7201 (0.0026) | | +| ogbg-mollipo | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 0.6688 (0.0121) | 0.7396 (-0.0050) | | +| ogbg-molsider | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.5938 (0.0051) | 0.5905 (-0.0099) | | +| ogbg-molsider | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6344 (0.0071) | 0.6141 (-0.0018) | | +| ogbg-molsider | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6263 (0.0026) | 0.6096 (0.0062) | | +| ogbg-molsider | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.5862 (-0.0162) | 0.5974 (0.0076) | | +| ogbg-molsider | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6462 (0.0391) | 0.6000 (-0.0013) | | +| ogbg-molsider | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6256 (-0.0037) | 0.6117 (0.0031) | | +| ogbg-molsider | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6345 (-0.0175) | 0.6053 (0.0199) | | +| ogbg-molsider | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6046 (-0.0179) | 0.6022 (0.0274) | | +| ogbg-molsider | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6151 (-0.0176) | 0.6150 (0.0655) | | +| ogbg-molsider | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6010 (0.0089) | 0.5963 (-0.0188) | | +| ogbg-molsider | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6232 (0.0015) | 0.5861 (0.0053) | | +| ogbg-molsider | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6190 (-0.0012) | 0.5983 (0.0122) | | +| ogbg-molsider | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6058 (-0.0161) | 0.5721 (-0.0243) | | +| ogbg-molsider | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6205 (-0.0005) | 0.5960 (0.0050) | | +| ogbg-molsider | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6151 (-0.0022) | 0.6417 (0.0375) | | +| ogbg-molsider | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6410 (-0.0028) | 0.6102 (-0.0041) | | +| ogbg-molsider | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6315 (0.0156) | 0.6190 (0.0210) | | +| ogbg-moltox21 | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7280 (0.0025) | 0.7154 (-0.0005) | | +| ogbg-moltox21 | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7771 (-0.0028) | 0.7209 (-0.0014) | | +| ogbg-moltox21 | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0125) | 0.7286 (-0.0015) | | +| ogbg-moltox21 | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7727 (0.0025) | 0.7369 (0.0209) | | +| ogbg-moltox21 | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7762 (0.0135) | 0.7303 (0.0143) | | +| ogbg-moltox21 | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7588 (0.0007) | 0.7230 (0.0059) | | +| ogbg-moltox21 | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7757 (-0.0077) | 0.7312 (-0.0132) | | +| ogbg-moltox21 | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7718 (0.0028) | 0.7237 (-0.0005) | | +| ogbg-moltox21 | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7622 (-0.0122) | 0.7193 (-0.0135) | | +| ogbg-moltox21 | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7820 (-0.0011) | 0.7313 (0.0166) | | +| ogbg-moltox21 | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7697 (-0.0012) | 0.7205 (0.0009) | | +| ogbg-moltox21 | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7695 (-0.0078) | 0.7279 (-0.0002) | | +| ogbg-moltox21 | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7745 (0.0085) | 0.7349 (0.0403) | | +| ogbg-moltox21 | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7887 (-0.0064) | 0.7380 (0.0104) | | +| ogbg-moltox21 | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7506 (-0.0105) | 0.7355 (0.0115) | | +| ogbg-moltox21 | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7839 (-0.0027) | 0.7342 (-0.0074) | | +| ogbg-moltox21 | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7761 (0.0105) | 0.7292 (-0.0018) | | diff --git a/logs/ogbg-molhiv_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log b/logs/ogbg-molhiv_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log new file mode 100644 index 0000000..2b050b1 --- /dev/null +++ b/logs/ogbg-molhiv_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log @@ -0,0 +1,152 @@ +[run] ogbg-molhiv view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.57684 val_adapt_rocauc=0.58405 adapt_steps=2.00 halt=0.47 train_steps=1.59 +ep20 val_rocauc=0.60452 val_adapt_rocauc=0.59144 adapt_steps=2.01 halt=0.47 train_steps=1.59 +ep30 val_rocauc=0.71542 val_adapt_rocauc=0.72246 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep40 val_rocauc=0.70211 val_adapt_rocauc=0.68285 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep50 val_rocauc=0.59821 val_adapt_rocauc=0.72487 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep60 val_rocauc=0.64796 val_adapt_rocauc=0.71730 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep70 val_rocauc=0.70277 val_adapt_rocauc=0.73025 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep80 val_rocauc=0.68902 val_adapt_rocauc=0.72341 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep90 val_rocauc=0.72762 val_adapt_rocauc=0.74793 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.74125 val_adapt_rocauc=0.75760 adapt_steps=2.00 halt=0.48 train_steps=1.57 +[ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.7412490201842054} test={'rocauc': 0.7254234342107805} adaptive={'rocauc': 0.7567005929044593} steps=2.00024313153416 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.67913 val_adapt_rocauc=0.65745 adapt_steps=2.00 halt=0.47 train_steps=1.60 +ep20 val_rocauc=0.53086 val_adapt_rocauc=0.70728 adapt_steps=2.02 halt=0.47 train_steps=1.59 +ep30 val_rocauc=0.73614 val_adapt_rocauc=0.73784 adapt_steps=2.04 halt=0.48 train_steps=1.57 +ep40 val_rocauc=0.74062 val_adapt_rocauc=0.74468 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep50 val_rocauc=0.64917 val_adapt_rocauc=0.74024 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep60 val_rocauc=0.74111 val_adapt_rocauc=0.74943 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep70 val_rocauc=0.69073 val_adapt_rocauc=0.75506 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep80 val_rocauc=0.75837 val_adapt_rocauc=0.74771 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep90 val_rocauc=0.77126 val_adapt_rocauc=0.75543 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.76237 val_adapt_rocauc=0.74920 adapt_steps=2.00 halt=0.48 train_steps=1.57 +[ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rocauc': 0.7712620027434841} test={'rocauc': 0.7476081036713725} adaptive={'rocauc': 0.7387782691824871} steps=2.012156576707999 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.56968 val_adapt_rocauc=0.68573 adapt_steps=2.01 halt=0.47 train_steps=1.60 +ep20 val_rocauc=0.65960 val_adapt_rocauc=0.64533 adapt_steps=2.00 halt=0.47 train_steps=1.59 +ep30 val_rocauc=0.73782 val_adapt_rocauc=0.74603 adapt_steps=2.03 halt=0.48 train_steps=1.57 +ep40 val_rocauc=0.70390 val_adapt_rocauc=0.72870 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep50 val_rocauc=0.68717 val_adapt_rocauc=0.73036 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep60 val_rocauc=0.68431 val_adapt_rocauc=0.72508 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep70 val_rocauc=0.69653 val_adapt_rocauc=0.73800 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep80 val_rocauc=0.70493 val_adapt_rocauc=0.74137 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep90 val_rocauc=0.69423 val_adapt_rocauc=0.73412 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.69464 val_adapt_rocauc=0.74486 adapt_steps=2.00 halt=0.48 train_steps=1.57 +[ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rocauc': 0.7378227268273565} test={'rocauc': 0.7035709457502076} adaptive={'rocauc': 0.724386334228162} steps=2.0269876002917577 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.64438 val_adapt_rocauc=0.62773 adapt_steps=2.01 halt=0.47 train_steps=1.60 +ep20 val_rocauc=0.64326 val_adapt_rocauc=0.64524 adapt_steps=2.01 halt=0.47 train_steps=1.61 +ep30 val_rocauc=0.68766 val_adapt_rocauc=0.66943 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep40 val_rocauc=0.63871 val_adapt_rocauc=0.72422 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep50 val_rocauc=0.63257 val_adapt_rocauc=0.73165 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep60 val_rocauc=0.68678 val_adapt_rocauc=0.75939 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep70 val_rocauc=0.73265 val_adapt_rocauc=0.76437 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep80 val_rocauc=0.71019 val_adapt_rocauc=0.75081 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep90 val_rocauc=0.71181 val_adapt_rocauc=0.75327 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.72871 val_adapt_rocauc=0.76052 adapt_steps=2.00 halt=0.48 train_steps=1.57 +[ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.7326450127376054} test={'rocauc': 0.759611039224396} adaptive={'rocauc': 0.7786419204696885} steps=2.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.62212 val_adapt_rocauc=0.62817 adapt_steps=2.01 halt=0.47 train_steps=1.60 +ep20 val_rocauc=0.61445 val_adapt_rocauc=0.69759 adapt_steps=2.00 halt=0.47 train_steps=1.59 +ep30 val_rocauc=0.68557 val_adapt_rocauc=0.71732 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep40 val_rocauc=0.47925 val_adapt_rocauc=0.71316 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep50 val_rocauc=0.61766 val_adapt_rocauc=0.69094 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep60 val_rocauc=0.73183 val_adapt_rocauc=0.73302 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep70 val_rocauc=0.72858 val_adapt_rocauc=0.73825 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep80 val_rocauc=0.74850 val_adapt_rocauc=0.74077 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep90 val_rocauc=0.73303 val_adapt_rocauc=0.74217 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.73150 val_adapt_rocauc=0.73659 adapt_steps=2.00 halt=0.48 train_steps=1.57 +[ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.7484965951401137} test={'rocauc': 0.722140249908264} adaptive={'rocauc': 0.7285405280132873} steps=2.00024313153416 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.70638 val_adapt_rocauc=0.68842 adapt_steps=2.01 halt=0.47 train_steps=1.60 +ep20 val_rocauc=0.64695 val_adapt_rocauc=0.67193 adapt_steps=2.00 halt=0.47 train_steps=1.59 +ep30 val_rocauc=0.71509 val_adapt_rocauc=0.75189 adapt_steps=2.01 halt=0.48 train_steps=1.58 +ep40 val_rocauc=0.65625 val_adapt_rocauc=0.68931 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep50 val_rocauc=0.73236 val_adapt_rocauc=0.74043 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep60 val_rocauc=0.68610 val_adapt_rocauc=0.70942 adapt_steps=2.01 halt=0.48 train_steps=1.58 +ep70 val_rocauc=0.71282 val_adapt_rocauc=0.71800 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep80 val_rocauc=0.70420 val_adapt_rocauc=0.71488 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep90 val_rocauc=0.71668 val_adapt_rocauc=0.72406 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.71284 val_adapt_rocauc=0.72607 adapt_steps=2.00 halt=0.48 train_steps=1.57 +[ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=50 val={'rocauc': 0.7323571918479326} test={'rocauc': 0.7487070047702736} adaptive={'rocauc': 0.7287433129260897} steps=2.0063214198881596 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=pna compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view pna --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.52661 val_adapt_rocauc=0.57540 adapt_steps=2.02 halt=0.47 train_steps=1.60 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.53124 val_adapt_rocauc=0.54271 adapt_steps=2.00 halt=0.48 train_steps=1.58 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.64086 val_adapt_rocauc=0.71386 adapt_steps=2.00 halt=0.48 train_steps=1.57 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.66964 val_adapt_rocauc=0.69129 adapt_steps=2.00 halt=0.48 train_steps=1.58 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.63916 val_adapt_rocauc=0.69673 adapt_steps=2.00 halt=0.48 train_steps=1.57 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.73238 val_adapt_rocauc=0.74287 adapt_steps=2.00 halt=0.48 train_steps=1.57 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.73849 val_adapt_rocauc=0.76782 adapt_steps=2.00 halt=0.48 train_steps=1.57 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.72881 val_adapt_rocauc=0.78390 adapt_steps=2.00 halt=0.48 train_steps=1.57 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.73387 val_adapt_rocauc=0.77480 adapt_steps=2.00 halt=0.48 train_steps=1.57 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.73341 val_adapt_rocauc=0.77625 adapt_steps=2.00 halt=0.48 train_steps=1.57 +[ogbg-molhiv_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.7384932882618068} test={'rocauc': 0.7185075030417737} adaptive={'rocauc': 0.7421078043222156} steps=2.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=resgated compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view resgated --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.50096 val_adapt_rocauc=0.63103 adapt_steps=2.00 halt=0.47 train_steps=1.60 +ep20 val_rocauc=0.65405 val_adapt_rocauc=0.70279 adapt_steps=2.00 halt=0.47 train_steps=1.58 +ep30 val_rocauc=0.68276 val_adapt_rocauc=0.65325 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep40 val_rocauc=0.80097 val_adapt_rocauc=0.78965 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep50 val_rocauc=0.77943 val_adapt_rocauc=0.71584 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep60 val_rocauc=0.77564 val_adapt_rocauc=0.75634 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep70 val_rocauc=0.77493 val_adapt_rocauc=0.78545 adapt_steps=2.00 halt=0.48 train_steps=1.58 +ep80 val_rocauc=0.77393 val_adapt_rocauc=0.77547 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep90 val_rocauc=0.76533 val_adapt_rocauc=0.76729 adapt_steps=2.00 halt=0.48 train_steps=1.57 +ep100 val_rocauc=0.76010 val_adapt_rocauc=0.76356 adapt_steps=2.00 halt=0.48 train_steps=1.57 +[ogbg-molhiv_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=40 val={'rocauc': 0.8009657309425828} test={'rocauc': 0.7787017903010873} adaptive={'rocauc': 0.7875702504876494} steps=2.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json diff --git a/logs/ogbg-molhiv_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log b/logs/ogbg-molhiv_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log new file mode 100644 index 0000000..ff2e7a5 --- /dev/null +++ b/logs/ogbg-molhiv_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log @@ -0,0 +1,278 @@ +[run] ogbg-molhiv view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.50465 val_adapt_rocauc=0.51605 adapt_steps=2.17 halt=0.44 train_steps=1.86 +ep20 val_rocauc=0.68965 val_adapt_rocauc=0.70338 adapt_steps=2.05 halt=0.43 train_steps=1.93 +ep30 val_rocauc=0.74705 val_adapt_rocauc=0.71674 adapt_steps=2.16 halt=0.44 train_steps=1.88 +ep40 val_rocauc=0.66882 val_adapt_rocauc=0.69730 adapt_steps=2.23 halt=0.44 train_steps=1.90 +ep50 val_rocauc=0.69645 val_adapt_rocauc=0.75311 adapt_steps=2.17 halt=0.44 train_steps=1.88 +ep60 val_rocauc=0.72560 val_adapt_rocauc=0.75246 adapt_steps=2.12 halt=0.44 train_steps=1.87 +ep70 val_rocauc=0.73678 val_adapt_rocauc=0.76610 adapt_steps=2.13 halt=0.44 train_steps=1.86 +ep80 val_rocauc=0.73638 val_adapt_rocauc=0.77730 adapt_steps=2.07 halt=0.44 train_steps=1.85 +ep90 val_rocauc=0.76228 val_adapt_rocauc=0.78163 adapt_steps=2.11 halt=0.44 train_steps=1.85 +ep100 val_rocauc=0.75586 val_adapt_rocauc=0.78034 adapt_steps=2.10 halt=0.44 train_steps=1.85 +[ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rocauc': 0.7622844405251813} test={'rocauc': 0.728463276617934} adaptive={'rocauc': 0.7414685490256668} steps=2.1835643082907854 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=gine compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gine --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.69659 val_adapt_rocauc=0.67019 adapt_steps=2.27 halt=0.43 train_steps=1.91 +ep20 val_rocauc=0.71128 val_adapt_rocauc=0.74182 adapt_steps=2.25 halt=0.44 train_steps=1.90 +ep30 val_rocauc=0.71784 val_adapt_rocauc=0.71432 adapt_steps=2.09 halt=0.43 train_steps=1.92 +ep40 val_rocauc=0.57809 val_adapt_rocauc=0.61863 adapt_steps=2.07 halt=0.43 train_steps=1.95 +ep50 val_rocauc=0.71898 val_adapt_rocauc=0.72970 adapt_steps=2.15 halt=0.44 train_steps=1.90 +ep60 val_rocauc=0.74272 val_adapt_rocauc=0.75436 adapt_steps=2.17 halt=0.44 train_steps=1.91 +ep70 val_rocauc=0.64453 val_adapt_rocauc=0.67305 adapt_steps=2.09 halt=0.43 train_steps=1.92 +ep80 val_rocauc=0.66148 val_adapt_rocauc=0.71639 adapt_steps=2.11 halt=0.44 train_steps=1.89 +ep90 val_rocauc=0.68795 val_adapt_rocauc=0.73859 adapt_steps=2.10 halt=0.44 train_steps=1.89 +ep100 val_rocauc=0.69479 val_adapt_rocauc=0.73030 adapt_steps=2.10 halt=0.44 train_steps=1.88 +[ogbg-molhiv_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.7427218058005095} test={'rocauc': 0.7216728789663763} adaptive={'rocauc': 0.7219567778442999} steps=2.1913445173839046 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.65285 val_adapt_rocauc=0.67983 adapt_steps=2.17 halt=0.43 train_steps=1.95 +ep20 val_rocauc=0.63964 val_adapt_rocauc=0.67770 adapt_steps=2.12 halt=0.43 train_steps=1.91 +ep30 val_rocauc=0.70439 val_adapt_rocauc=0.72607 adapt_steps=2.28 halt=0.43 train_steps=1.93 +ep40 val_rocauc=0.67857 val_adapt_rocauc=0.67646 adapt_steps=2.09 halt=0.44 train_steps=1.90 +ep50 val_rocauc=0.66299 val_adapt_rocauc=0.70493 adapt_steps=2.10 halt=0.44 train_steps=1.89 +ep60 val_rocauc=0.72309 val_adapt_rocauc=0.75250 adapt_steps=2.10 halt=0.43 train_steps=1.91 +ep70 val_rocauc=0.69147 val_adapt_rocauc=0.71552 adapt_steps=2.06 halt=0.44 train_steps=1.88 +ep80 val_rocauc=0.75410 val_adapt_rocauc=0.76395 adapt_steps=2.12 halt=0.44 train_steps=1.88 +ep90 val_rocauc=0.76238 val_adapt_rocauc=0.75313 adapt_steps=2.09 halt=0.44 train_steps=1.85 +ep100 val_rocauc=0.76521 val_adapt_rocauc=0.75985 adapt_steps=2.09 halt=0.44 train_steps=1.87 +[ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.76521164021164} test={'rocauc': 0.7279630738330211} adaptive={'rocauc': 0.7195040460418316} steps=2.1412594213469487 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=graphsage compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view graphsage --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.60161 val_adapt_rocauc=0.64669 adapt_steps=2.08 halt=0.43 train_steps=1.92 +ep20 val_rocauc=0.71865 val_adapt_rocauc=0.72325 adapt_steps=2.51 halt=0.43 train_steps=1.95 +ep30 val_rocauc=0.72758 val_adapt_rocauc=0.72496 adapt_steps=2.13 halt=0.43 train_steps=1.95 +ep40 val_rocauc=0.75529 val_adapt_rocauc=0.73154 adapt_steps=2.08 halt=0.43 train_steps=1.93 +ep50 val_rocauc=0.74199 val_adapt_rocauc=0.74141 adapt_steps=2.12 halt=0.43 train_steps=1.96 +ep60 val_rocauc=0.70099 val_adapt_rocauc=0.73010 adapt_steps=2.10 halt=0.43 train_steps=1.95 +ep70 val_rocauc=0.76185 val_adapt_rocauc=0.77202 adapt_steps=2.10 halt=0.44 train_steps=1.91 +ep80 val_rocauc=0.77242 val_adapt_rocauc=0.76566 adapt_steps=2.14 halt=0.44 train_steps=1.91 +ep90 val_rocauc=0.75081 val_adapt_rocauc=0.75828 adapt_steps=2.14 halt=0.44 train_steps=1.90 +ep100 val_rocauc=0.74508 val_adapt_rocauc=0.74839 adapt_steps=2.13 halt=0.44 train_steps=1.90 +[ogbg-molhiv_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.7724224720752498} test={'rocauc': 0.7540721141775624} adaptive={'rocauc': 0.7493028061569362} steps=2.225382932166302 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=gatv2 compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gatv2 --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.63791 val_adapt_rocauc=0.65941 adapt_steps=2.16 halt=0.44 train_steps=1.86 +ep20 val_rocauc=0.65958 val_adapt_rocauc=0.68114 adapt_steps=2.14 halt=0.43 train_steps=1.98 +ep30 val_rocauc=0.70813 val_adapt_rocauc=0.71648 adapt_steps=2.10 halt=0.44 train_steps=1.91 +ep40 val_rocauc=0.71160 val_adapt_rocauc=0.71489 adapt_steps=2.12 halt=0.43 train_steps=1.92 +ep50 val_rocauc=0.74629 val_adapt_rocauc=0.72922 adapt_steps=2.12 halt=0.43 train_steps=1.93 +ep60 val_rocauc=0.77221 val_adapt_rocauc=0.77362 adapt_steps=2.10 halt=0.44 train_steps=1.91 +ep70 val_rocauc=0.73550 val_adapt_rocauc=0.75380 adapt_steps=2.22 halt=0.43 train_steps=1.96 +ep80 val_rocauc=0.75176 val_adapt_rocauc=0.76963 adapt_steps=2.17 halt=0.43 train_steps=1.95 +ep90 val_rocauc=0.77064 val_adapt_rocauc=0.77482 adapt_steps=2.17 halt=0.44 train_steps=1.89 +ep100 val_rocauc=0.77092 val_adapt_rocauc=0.77462 adapt_steps=2.15 halt=0.44 train_steps=1.89 +[ogbg-molhiv_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.7722111992945326} test={'rocauc': 0.7005330346279379} adaptive={'rocauc': 0.7209988605419185} steps=2.161196207148067 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.62286 val_adapt_rocauc=0.63631 adapt_steps=2.12 halt=0.43 train_steps=1.92 +ep20 val_rocauc=0.50681 val_adapt_rocauc=0.62452 adapt_steps=2.03 halt=0.44 train_steps=1.88 +ep30 val_rocauc=0.71981 val_adapt_rocauc=0.71587 adapt_steps=2.12 halt=0.44 train_steps=1.92 +ep40 val_rocauc=0.63676 val_adapt_rocauc=0.69827 adapt_steps=2.10 halt=0.44 train_steps=1.89 +ep50 val_rocauc=0.71987 val_adapt_rocauc=0.71579 adapt_steps=2.10 halt=0.43 train_steps=1.95 +ep60 val_rocauc=0.77652 val_adapt_rocauc=0.77421 adapt_steps=2.13 halt=0.43 train_steps=1.94 +ep70 val_rocauc=0.73578 val_adapt_rocauc=0.73905 adapt_steps=2.14 halt=0.44 train_steps=1.90 +ep80 val_rocauc=0.77909 val_adapt_rocauc=0.77380 adapt_steps=2.21 halt=0.43 train_steps=1.93 +ep90 val_rocauc=0.77284 val_adapt_rocauc=0.76992 adapt_steps=2.20 halt=0.43 train_steps=1.95 +ep100 val_rocauc=0.75856 val_adapt_rocauc=0.75794 adapt_steps=2.19 halt=0.43 train_steps=1.95 +[ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.7790944052518126} test={'rocauc': 0.7510651036134339} adaptive={'rocauc': 0.7493443287819387} steps=2.2287867736445417 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=transformer compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view transformer --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.69482 val_adapt_rocauc=0.69337 adapt_steps=2.09 halt=0.43 train_steps=1.95 +ep20 val_rocauc=0.69048 val_adapt_rocauc=0.68828 adapt_steps=2.11 halt=0.43 train_steps=1.92 +ep30 val_rocauc=0.70734 val_adapt_rocauc=0.68263 adapt_steps=2.08 halt=0.43 train_steps=1.96 +ep40 val_rocauc=0.75896 val_adapt_rocauc=0.75541 adapt_steps=2.17 halt=0.43 train_steps=1.96 +ep50 val_rocauc=0.63094 val_adapt_rocauc=0.71781 adapt_steps=2.15 halt=0.43 train_steps=2.00 +ep60 val_rocauc=0.78134 val_adapt_rocauc=0.78253 adapt_steps=2.15 halt=0.43 train_steps=1.95 +ep70 val_rocauc=0.74767 val_adapt_rocauc=0.77658 adapt_steps=2.14 halt=0.43 train_steps=1.93 +ep80 val_rocauc=0.75221 val_adapt_rocauc=0.76723 adapt_steps=2.19 halt=0.43 train_steps=1.98 +ep90 val_rocauc=0.73516 val_adapt_rocauc=0.74942 adapt_steps=2.14 halt=0.43 train_steps=1.92 +ep100 val_rocauc=0.74673 val_adapt_rocauc=0.75054 adapt_steps=2.13 halt=0.44 train_steps=1.91 +[ogbg-molhiv_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.7813418577307466} test={'rocauc': 0.7294279534174086} adaptive={'rocauc': 0.7396338283860252} steps=2.215171407731583 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=pna compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view pna --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.65392 val_adapt_rocauc=0.65972 adapt_steps=2.26 halt=0.45 train_steps=1.76 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.70167 val_adapt_rocauc=0.73359 adapt_steps=2.14 halt=0.45 train_steps=1.83 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.57289 val_adapt_rocauc=0.60013 adapt_steps=2.02 halt=0.45 train_steps=1.83 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.74876 val_adapt_rocauc=0.72038 adapt_steps=2.03 halt=0.44 train_steps=1.89 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.69108 val_adapt_rocauc=0.72229 adapt_steps=2.11 halt=0.43 train_steps=1.92 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.69969 val_adapt_rocauc=0.70883 adapt_steps=2.12 halt=0.44 train_steps=1.89 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.72681 val_adapt_rocauc=0.77015 adapt_steps=2.16 halt=0.43 train_steps=1.93 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.74562 val_adapt_rocauc=0.77410 adapt_steps=2.13 halt=0.43 train_steps=1.92 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.71370 val_adapt_rocauc=0.78801 adapt_steps=2.16 halt=0.44 train_steps=1.90 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.71775 val_adapt_rocauc=0.78617 adapt_steps=2.14 halt=0.44 train_steps=1.89 +[ogbg-molhiv_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=40 val={'rocauc': 0.7487599206349206} test={'rocauc': 0.6730373317368046} adaptive={'rocauc': 0.6877382722725429} steps=2.0588378312667155 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=gen compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gen --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.58244 val_adapt_rocauc=0.62459 adapt_steps=2.17 halt=0.43 train_steps=1.95 +ep20 val_rocauc=0.65886 val_adapt_rocauc=0.66235 adapt_steps=2.06 halt=0.44 train_steps=1.89 +ep30 val_rocauc=0.69707 val_adapt_rocauc=0.69637 adapt_steps=2.06 halt=0.44 train_steps=1.92 +ep40 val_rocauc=0.73515 val_adapt_rocauc=0.77200 adapt_steps=2.17 halt=0.44 train_steps=1.91 +ep50 val_rocauc=0.72530 val_adapt_rocauc=0.75137 adapt_steps=2.12 halt=0.43 train_steps=1.97 +ep60 val_rocauc=0.69888 val_adapt_rocauc=0.73379 adapt_steps=2.09 halt=0.43 train_steps=1.98 +ep70 val_rocauc=0.71051 val_adapt_rocauc=0.74897 adapt_steps=2.12 halt=0.43 train_steps=1.94 +ep80 val_rocauc=0.76901 val_adapt_rocauc=0.77657 adapt_steps=2.10 halt=0.43 train_steps=1.93 +ep90 val_rocauc=0.73056 val_adapt_rocauc=0.76530 adapt_steps=2.11 halt=0.44 train_steps=1.92 +ep100 val_rocauc=0.73376 val_adapt_rocauc=0.75580 adapt_steps=2.13 halt=0.43 train_steps=1.93 +[ogbg-molhiv_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.769011488340192} test={'rocauc': 0.7434075590490352} adaptive={'rocauc': 0.7426736707931786} steps=2.178215414539266 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=film compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view film --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.60803 val_adapt_rocauc=0.69045 adapt_steps=2.06 halt=0.47 train_steps=1.67 +ep20 val_rocauc=0.64308 val_adapt_rocauc=0.78621 adapt_steps=2.01 halt=0.45 train_steps=1.79 +ep30 val_rocauc=0.74069 val_adapt_rocauc=0.75513 adapt_steps=2.21 halt=0.45 train_steps=1.83 +ep40 val_rocauc=0.75046 val_adapt_rocauc=0.78035 adapt_steps=2.23 halt=0.43 train_steps=1.93 +ep50 val_rocauc=0.71486 val_adapt_rocauc=0.75589 adapt_steps=2.34 halt=0.43 train_steps=2.01 +ep60 val_rocauc=0.77074 val_adapt_rocauc=0.80191 adapt_steps=2.10 halt=0.43 train_steps=1.99 +ep70 val_rocauc=0.78228 val_adapt_rocauc=0.80466 adapt_steps=2.21 halt=0.43 train_steps=1.97 +ep80 val_rocauc=0.81468 val_adapt_rocauc=0.81506 adapt_steps=2.13 halt=0.43 train_steps=1.96 +ep90 val_rocauc=0.81502 val_adapt_rocauc=0.81015 adapt_steps=2.14 halt=0.43 train_steps=1.95 +ep100 val_rocauc=0.81203 val_adapt_rocauc=0.80753 adapt_steps=2.11 halt=0.43 train_steps=1.95 +[ogbg-molhiv_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rocauc': 0.8150199637468156} test={'rocauc': 0.7415303501419496} adaptive={'rocauc': 0.7291546766063463} steps=2.2144420131291027 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=resgated compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view resgated --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.57563 val_adapt_rocauc=0.57248 adapt_steps=2.08 halt=0.43 train_steps=1.96 +ep20 val_rocauc=0.68901 val_adapt_rocauc=0.69659 adapt_steps=2.07 halt=0.43 train_steps=1.97 +ep30 val_rocauc=0.72785 val_adapt_rocauc=0.73945 adapt_steps=2.17 halt=0.43 train_steps=1.95 +ep40 val_rocauc=0.80307 val_adapt_rocauc=0.79528 adapt_steps=2.10 halt=0.43 train_steps=1.93 +ep50 val_rocauc=0.74046 val_adapt_rocauc=0.74882 adapt_steps=2.15 halt=0.43 train_steps=1.96 +ep60 val_rocauc=0.76188 val_adapt_rocauc=0.76877 adapt_steps=2.13 halt=0.43 train_steps=1.95 +ep70 val_rocauc=0.74584 val_adapt_rocauc=0.74880 adapt_steps=2.14 halt=0.43 train_steps=1.99 +ep80 val_rocauc=0.72576 val_adapt_rocauc=0.72937 adapt_steps=2.09 halt=0.43 train_steps=1.95 +ep90 val_rocauc=0.72962 val_adapt_rocauc=0.72854 adapt_steps=2.17 halt=0.43 train_steps=1.98 +ep100 val_rocauc=0.73262 val_adapt_rocauc=0.73243 adapt_steps=2.13 halt=0.43 train_steps=1.97 +[ogbg-molhiv_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=40 val={'rocauc': 0.8030723349010386} test={'rocauc': 0.7502983835145524} adaptive={'rocauc': 0.7566658297765504} steps=2.2205203014831025 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.55912 val_adapt_rocauc=0.62342 adapt_steps=2.04 halt=0.43 train_steps=1.90 +ep20 val_rocauc=0.68402 val_adapt_rocauc=0.67609 adapt_steps=2.15 halt=0.44 train_steps=1.84 +ep30 val_rocauc=0.70234 val_adapt_rocauc=0.71080 adapt_steps=2.18 halt=0.44 train_steps=1.90 +ep40 val_rocauc=0.71746 val_adapt_rocauc=0.70275 adapt_steps=2.42 halt=0.44 train_steps=1.86 +ep50 val_rocauc=0.74377 val_adapt_rocauc=0.74631 adapt_steps=2.14 halt=0.44 train_steps=1.90 +ep60 val_rocauc=0.68302 val_adapt_rocauc=0.74882 adapt_steps=2.18 halt=0.44 train_steps=1.91 +ep70 val_rocauc=0.70337 val_adapt_rocauc=0.73207 adapt_steps=2.09 halt=0.44 train_steps=1.90 +ep80 val_rocauc=0.75679 val_adapt_rocauc=0.76447 adapt_steps=2.14 halt=0.44 train_steps=1.90 +ep90 val_rocauc=0.74719 val_adapt_rocauc=0.76515 adapt_steps=2.12 halt=0.44 train_steps=1.88 +ep100 val_rocauc=0.74130 val_adapt_rocauc=0.75597 adapt_steps=2.12 halt=0.44 train_steps=1.89 +[ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.7567852243778168} test={'rocauc': 0.7480619556190734} adaptive={'rocauc': 0.7477104617702157} steps=2.225869195234622 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.62000 val_adapt_rocauc=0.63880 adapt_steps=2.22 halt=0.44 train_steps=1.89 +ep20 val_rocauc=0.59820 val_adapt_rocauc=0.61098 adapt_steps=2.16 halt=0.44 train_steps=1.89 +ep30 val_rocauc=0.67764 val_adapt_rocauc=0.68890 adapt_steps=2.08 halt=0.44 train_steps=1.86 +ep40 val_rocauc=0.66809 val_adapt_rocauc=0.66128 adapt_steps=2.09 halt=0.44 train_steps=1.89 +ep50 val_rocauc=0.73528 val_adapt_rocauc=0.71478 adapt_steps=2.09 halt=0.44 train_steps=1.91 +ep60 val_rocauc=0.69053 val_adapt_rocauc=0.68013 adapt_steps=2.16 halt=0.44 train_steps=1.89 +ep70 val_rocauc=0.68528 val_adapt_rocauc=0.72841 adapt_steps=2.10 halt=0.44 train_steps=1.89 +ep80 val_rocauc=0.68138 val_adapt_rocauc=0.69448 adapt_steps=2.11 halt=0.44 train_steps=1.88 +ep90 val_rocauc=0.68754 val_adapt_rocauc=0.69915 adapt_steps=2.12 halt=0.43 train_steps=1.93 +ep100 val_rocauc=0.69254 val_adapt_rocauc=0.70377 adapt_steps=2.12 halt=0.44 train_steps=1.88 +[ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=50 val={'rocauc': 0.7352782676856752} test={'rocauc': 0.6961702620753587} adaptive={'rocauc': 0.7016995306977732} steps=2.0795040116703136 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=cheb compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view cheb --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.63285 val_adapt_rocauc=0.63797 adapt_steps=2.09 halt=0.43 train_steps=1.94 +ep20 val_rocauc=0.59546 val_adapt_rocauc=0.62621 adapt_steps=2.09 halt=0.43 train_steps=1.94 +ep30 val_rocauc=0.64157 val_adapt_rocauc=0.64537 adapt_steps=2.07 halt=0.43 train_steps=1.95 +ep40 val_rocauc=0.78253 val_adapt_rocauc=0.79697 adapt_steps=2.21 halt=0.43 train_steps=1.94 +ep50 val_rocauc=0.78099 val_adapt_rocauc=0.78545 adapt_steps=2.23 halt=0.42 train_steps=2.02 +ep60 val_rocauc=0.75496 val_adapt_rocauc=0.75580 adapt_steps=2.16 halt=0.43 train_steps=1.92 +ep70 val_rocauc=0.76923 val_adapt_rocauc=0.76459 adapt_steps=2.17 halt=0.43 train_steps=1.94 +ep80 val_rocauc=0.75888 val_adapt_rocauc=0.75674 adapt_steps=2.10 halt=0.45 train_steps=1.83 +ep90 val_rocauc=0.73937 val_adapt_rocauc=0.73410 adapt_steps=2.10 halt=0.45 train_steps=1.77 +ep100 val_rocauc=0.71941 val_adapt_rocauc=0.71715 adapt_steps=2.07 halt=0.46 train_steps=1.74 +[ogbg-molhiv_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=40 val={'rocauc': 0.7825329463060945} test={'rocauc': 0.7205932907163135} adaptive={'rocauc': 0.7218775951640628} steps=2.2939460247994163 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=arma compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view arma --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.58405 val_adapt_rocauc=0.62652 adapt_steps=2.13 halt=0.44 train_steps=1.87 +ep20 val_rocauc=0.63653 val_adapt_rocauc=0.65469 adapt_steps=2.04 halt=0.44 train_steps=1.83 +ep30 val_rocauc=0.68206 val_adapt_rocauc=0.66472 adapt_steps=2.09 halt=0.44 train_steps=1.85 +ep40 val_rocauc=0.73261 val_adapt_rocauc=0.71919 adapt_steps=2.08 halt=0.44 train_steps=1.82 +ep50 val_rocauc=0.76797 val_adapt_rocauc=0.79653 adapt_steps=2.13 halt=0.44 train_steps=1.86 +ep60 val_rocauc=0.74831 val_adapt_rocauc=0.72643 adapt_steps=2.04 halt=0.45 train_steps=1.77 +ep70 val_rocauc=0.73358 val_adapt_rocauc=0.77502 adapt_steps=2.03 halt=0.46 train_steps=1.73 +ep80 val_rocauc=0.77783 val_adapt_rocauc=0.77223 adapt_steps=2.06 halt=0.45 train_steps=1.75 +ep90 val_rocauc=0.78442 val_adapt_rocauc=0.76721 adapt_steps=2.05 halt=0.46 train_steps=1.71 +ep100 val_rocauc=0.78612 val_adapt_rocauc=0.76507 adapt_steps=2.06 halt=0.46 train_steps=1.73 +[ogbg-molhiv_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.7861153978052127} test={'rocauc': 0.7306939106587612} adaptive={'rocauc': 0.7378782904266208} steps=2.085825431558473 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=mf compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view mf --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.65109 val_adapt_rocauc=0.65071 adapt_steps=2.09 halt=0.43 train_steps=1.91 +ep20 val_rocauc=0.66377 val_adapt_rocauc=0.70133 adapt_steps=2.15 halt=0.43 train_steps=1.92 +ep30 val_rocauc=0.69912 val_adapt_rocauc=0.72873 adapt_steps=2.15 halt=0.43 train_steps=1.91 +ep40 val_rocauc=0.75265 val_adapt_rocauc=0.77675 adapt_steps=2.15 halt=0.43 train_steps=1.95 +ep50 val_rocauc=0.71979 val_adapt_rocauc=0.76668 adapt_steps=2.10 halt=0.45 train_steps=1.82 +ep60 val_rocauc=0.78688 val_adapt_rocauc=0.78537 adapt_steps=2.27 halt=0.44 train_steps=1.89 +ep70 val_rocauc=0.80465 val_adapt_rocauc=0.78273 adapt_steps=2.15 halt=0.43 train_steps=1.93 +ep80 val_rocauc=0.77804 val_adapt_rocauc=0.78100 adapt_steps=2.15 halt=0.43 train_steps=1.94 +ep90 val_rocauc=0.76305 val_adapt_rocauc=0.77873 adapt_steps=2.18 halt=0.44 train_steps=1.91 +ep100 val_rocauc=0.76926 val_adapt_rocauc=0.78354 adapt_steps=2.14 halt=0.44 train_steps=1.90 +[ogbg-molhiv_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.8046522878698804} test={'rocauc': 0.7416423646652118} adaptive={'rocauc': 0.7333127329612392} steps=2.1964502796012644 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molhiv view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.62676 val_adapt_rocauc=0.67960 adapt_steps=2.09 halt=0.44 train_steps=1.87 +ep20 val_rocauc=0.65528 val_adapt_rocauc=0.72533 adapt_steps=2.03 halt=0.44 train_steps=1.88 +ep30 val_rocauc=0.72398 val_adapt_rocauc=0.73609 adapt_steps=2.22 halt=0.43 train_steps=1.92 +ep40 val_rocauc=0.67653 val_adapt_rocauc=0.71372 adapt_steps=2.12 halt=0.44 train_steps=1.88 +ep50 val_rocauc=0.72748 val_adapt_rocauc=0.72608 adapt_steps=2.14 halt=0.44 train_steps=1.90 +ep60 val_rocauc=0.69598 val_adapt_rocauc=0.70466 adapt_steps=2.12 halt=0.44 train_steps=1.87 +ep70 val_rocauc=0.73788 val_adapt_rocauc=0.71230 adapt_steps=2.10 halt=0.44 train_steps=1.88 +ep80 val_rocauc=0.72564 val_adapt_rocauc=0.74313 adapt_steps=2.06 halt=0.45 train_steps=1.82 +ep90 val_rocauc=0.73463 val_adapt_rocauc=0.75132 adapt_steps=2.07 halt=0.45 train_steps=1.78 +ep100 val_rocauc=0.72183 val_adapt_rocauc=0.73975 adapt_steps=2.05 halt=0.45 train_steps=1.76 +[ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.7378778414658045} test={'rocauc': 0.6883099325981575} adaptive={'rocauc': 0.7290619749319223} steps=2.102358375881352 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json diff --git a/logs/ogbg-molhiv_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_e100_s0.log b/logs/ogbg-molhiv_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_e100_s0.log new file mode 100644 index 0000000..6d7faad --- /dev/null +++ b/logs/ogbg-molhiv_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_e100_s0.log @@ -0,0 +1,84 @@ +[run] ogbg-molhiv view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.37199 val_adapt_rocauc=0.37199 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep20 val_rocauc=0.52284 val_adapt_rocauc=0.52284 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.50000 val_adapt_rocauc=0.50000 adapt_steps=8.00 halt=0.12 train_steps=4.51 +ep40 val_rocauc=0.73429 val_adapt_rocauc=0.74357 adapt_steps=2.21 halt=0.46 train_steps=1.66 +ep50 val_rocauc=0.74990 val_adapt_rocauc=0.74007 adapt_steps=2.03 halt=0.45 train_steps=1.79 +ep60 val_rocauc=0.73691 val_adapt_rocauc=0.72381 adapt_steps=2.07 halt=0.45 train_steps=1.77 +ep70 val_rocauc=0.77428 val_adapt_rocauc=0.77133 adapt_steps=2.06 halt=0.45 train_steps=1.83 +ep80 val_rocauc=0.76305 val_adapt_rocauc=0.78219 adapt_steps=2.08 halt=0.45 train_steps=1.83 +ep90 val_rocauc=0.75803 val_adapt_rocauc=0.74196 adapt_steps=2.08 halt=0.45 train_steps=1.81 +ep100 val_rocauc=0.75552 val_adapt_rocauc=0.75433 adapt_steps=2.07 halt=0.45 train_steps=1.83 +[ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=70 val={'rocauc': 0.774284122085048} test={'rocauc': 0.6994457212383399} adaptive={'rocauc': 0.6907394889820196} steps=2.0816921954777534 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molhiv view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.61849 val_adapt_rocauc=0.61849 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep20 val_rocauc=0.67236 val_adapt_rocauc=0.67236 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.55443 val_adapt_rocauc=0.55443 adapt_steps=8.00 halt=0.12 train_steps=4.51 +ep40 val_rocauc=0.67669 val_adapt_rocauc=0.68572 adapt_steps=2.04 halt=0.45 train_steps=1.71 +ep50 val_rocauc=0.71379 val_adapt_rocauc=0.74036 adapt_steps=2.05 halt=0.45 train_steps=1.81 +ep60 val_rocauc=0.68323 val_adapt_rocauc=0.73792 adapt_steps=2.07 halt=0.44 train_steps=1.83 +ep70 val_rocauc=0.68205 val_adapt_rocauc=0.70493 adapt_steps=2.07 halt=0.44 train_steps=1.87 +ep80 val_rocauc=0.74377 val_adapt_rocauc=0.75284 adapt_steps=2.09 halt=0.44 train_steps=1.90 +ep90 val_rocauc=0.70841 val_adapt_rocauc=0.73329 adapt_steps=2.08 halt=0.44 train_steps=1.88 +ep100 val_rocauc=0.72274 val_adapt_rocauc=0.73310 adapt_steps=2.10 halt=0.44 train_steps=1.90 +[ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=80 val={'rocauc': 0.7437720458553793} test={'rocauc': 0.7537553834566137} adaptive={'rocauc': 0.7804708472546787} steps=2.135910527595429 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molhiv view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.58438 val_adapt_rocauc=0.58438 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep20 val_rocauc=0.61779 val_adapt_rocauc=0.61779 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.50074 val_adapt_rocauc=0.50074 adapt_steps=8.00 halt=0.12 train_steps=4.51 +ep40 val_rocauc=0.54256 val_adapt_rocauc=0.63047 adapt_steps=2.04 halt=0.46 train_steps=1.69 +ep50 val_rocauc=0.72845 val_adapt_rocauc=0.69057 adapt_steps=2.09 halt=0.45 train_steps=1.76 +ep60 val_rocauc=0.65977 val_adapt_rocauc=0.67932 adapt_steps=2.10 halt=0.45 train_steps=1.79 +ep70 val_rocauc=0.70633 val_adapt_rocauc=0.71830 adapt_steps=2.06 halt=0.44 train_steps=1.83 +ep80 val_rocauc=0.67811 val_adapt_rocauc=0.73880 adapt_steps=2.06 halt=0.45 train_steps=1.81 +ep90 val_rocauc=0.73965 val_adapt_rocauc=0.75724 adapt_steps=2.10 halt=0.45 train_steps=1.83 +ep100 val_rocauc=0.72724 val_adapt_rocauc=0.75658 adapt_steps=2.08 halt=0.45 train_steps=1.82 +[ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=90 val={'rocauc': 0.7396537575935725} test={'rocauc': 0.7500666293284923} adaptive={'rocauc': 0.7314046234960119} steps=2.136883053732069 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molhiv view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.56478 val_adapt_rocauc=0.56478 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep20 val_rocauc=0.54631 val_adapt_rocauc=0.54631 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.50000 val_adapt_rocauc=0.50000 adapt_steps=8.00 halt=0.12 train_steps=4.51 +ep40 val_rocauc=0.67990 val_adapt_rocauc=0.67585 adapt_steps=2.01 halt=0.47 train_steps=1.63 +ep50 val_rocauc=0.65561 val_adapt_rocauc=0.69113 adapt_steps=2.15 halt=0.44 train_steps=1.89 +ep60 val_rocauc=0.72984 val_adapt_rocauc=0.71413 adapt_steps=2.29 halt=0.44 train_steps=1.90 +ep70 val_rocauc=0.70342 val_adapt_rocauc=0.72345 adapt_steps=2.11 halt=0.44 train_steps=1.90 +ep80 val_rocauc=0.71017 val_adapt_rocauc=0.70042 adapt_steps=2.07 halt=0.44 train_steps=1.84 +ep90 val_rocauc=0.71672 val_adapt_rocauc=0.71984 adapt_steps=2.12 halt=0.44 train_steps=1.83 +ep100 val_rocauc=0.71364 val_adapt_rocauc=0.71268 adapt_steps=2.08 halt=0.44 train_steps=1.84 +[ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=60 val={'rocauc': 0.7298433519498334} test={'rocauc': 0.6791286042604143} adaptive={'rocauc': 0.7162469340852469} steps=2.4831023583758816 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molhiv view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.67715 val_adapt_rocauc=0.67715 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep20 val_rocauc=0.50236 val_adapt_rocauc=0.50236 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.50000 val_adapt_rocauc=0.50000 adapt_steps=8.00 halt=0.12 train_steps=4.51 +ep40 val_rocauc=0.73049 val_adapt_rocauc=0.72163 adapt_steps=2.04 halt=0.45 train_steps=1.72 +ep50 val_rocauc=0.70399 val_adapt_rocauc=0.70432 adapt_steps=2.04 halt=0.44 train_steps=1.84 +ep60 val_rocauc=0.74930 val_adapt_rocauc=0.75474 adapt_steps=2.05 halt=0.44 train_steps=1.83 +ep70 val_rocauc=0.73212 val_adapt_rocauc=0.76013 adapt_steps=2.09 halt=0.44 train_steps=1.83 +ep80 val_rocauc=0.75377 val_adapt_rocauc=0.76654 adapt_steps=2.07 halt=0.45 train_steps=1.81 +ep90 val_rocauc=0.75301 val_adapt_rocauc=0.77432 adapt_steps=2.10 halt=0.45 train_steps=1.82 +ep100 val_rocauc=0.73251 val_adapt_rocauc=0.78027 adapt_steps=2.07 halt=0.45 train_steps=1.82 +[ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=80 val={'rocauc': 0.7537722908093278} test={'rocauc': 0.7703277390447865} adaptive={'rocauc': 0.764460495567701} steps=2.0678336980306344 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molhiv view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.67201 val_adapt_rocauc=0.67201 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep20 val_rocauc=0.62233 val_adapt_rocauc=0.62233 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.65638 val_adapt_rocauc=0.65638 adapt_steps=8.00 halt=0.12 train_steps=4.51 +ep40 val_rocauc=0.72057 val_adapt_rocauc=0.68850 adapt_steps=2.16 halt=0.44 train_steps=1.89 +ep50 val_rocauc=0.70843 val_adapt_rocauc=0.70940 adapt_steps=2.15 halt=0.44 train_steps=1.85 +ep60 val_rocauc=0.64904 val_adapt_rocauc=0.64008 adapt_steps=2.15 halt=0.44 train_steps=1.90 +ep70 val_rocauc=0.65729 val_adapt_rocauc=0.64703 adapt_steps=2.09 halt=0.44 train_steps=1.85 +ep80 val_rocauc=0.68292 val_adapt_rocauc=0.68777 adapt_steps=2.09 halt=0.44 train_steps=1.85 +ep90 val_rocauc=0.69379 val_adapt_rocauc=0.68351 adapt_steps=2.09 halt=0.44 train_steps=1.84 +ep100 val_rocauc=0.68502 val_adapt_rocauc=0.67506 adapt_steps=2.09 halt=0.45 train_steps=1.81 +[ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=40 val={'rocauc': 0.720568783068783} test={'rocauc': 0.7274165202108962} adaptive={'rocauc': 0.747511539427181} steps=2.2569900316070997 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json diff --git a/logs/ogbg-mollipo_0.log b/logs/ogbg-mollipo_0.log new file mode 100644 index 0000000..e90fc69 --- /dev/null +++ b/logs/ogbg-mollipo_0.log @@ -0,0 +1,828 @@ +[run] ogbg-mollipo view=gin compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view gin --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/lipophilicity.zip +
0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 553.30it/s] +Processing... +Extracting /orion/u/oscarwan/rrog-gnn-runner/data/ogb/lipophilicity.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/4200 [00:00<?, ?it/s]
100%|██████████| 4200/4200 [00:00<00:00, 163946.74it/s] +Converting graphs into PyG objects... +
0%| | 0/4200 [00:00<?, ?it/s]
100%|██████████| 4200/4200 [00:00<00:00, 93692.57it/s] +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/ogb/graphproppred/dataset_pyg.py:158: UserWarning: The given NumPy array is not writable, and PyTorch does not support non-writable tensors. This means writing to this tensor will result in undefined behavior. You may want to copy the array to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at /pytorch/torch/csrc/utils/tensor_numpy.cpp:203.) + g.y = torch.from_numpy(graph_label[i]).view(1,-1).to(torch.float32) +Done! +Saving... +ep10 val_rmse=1.44219 halt=0.00 train_steps=1.00 +ep20 val_rmse=1.12619 halt=0.00 train_steps=1.00 +ep30 val_rmse=0.83179 halt=0.00 train_steps=1.00 +ep40 val_rmse=0.74595 halt=0.00 train_steps=1.00 +ep50 val_rmse=0.80877 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.82527 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.68539 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.69580 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.69460 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.69261 halt=0.00 train_steps=1.00 +[ogbg-mollipo_gin_classic_T0_ns1_h128_e100_s0] best_ep=70 val={'rmse': np.float32(0.68539107)} test={'rmse': np.float32(0.73898196)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_gin_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-mollipo view=gin compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view gin --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=0.96097 halt=0.00 train_steps=3.00 +ep20 val_rmse=0.84203 halt=0.00 train_steps=3.00 +ep30 val_rmse=0.76113 halt=0.00 train_steps=3.00 +ep40 val_rmse=0.90551 halt=0.00 train_steps=3.00 +ep50 val_rmse=0.74823 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.83854 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.71586 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.71676 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.68411 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.67485 halt=0.00 train_steps=3.00 +[ogbg-mollipo_gin_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=100 val={'rmse': np.float32(0.67485154)} test={'rmse': np.float32(0.70725757)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_gin_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-mollipo view=gine compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view gine --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.22610 halt=0.00 train_steps=1.00 +ep20 val_rmse=0.78705 halt=0.00 train_steps=1.00 +ep30 val_rmse=1.00198 halt=0.00 train_steps=1.00 +ep40 val_rmse=0.73826 halt=0.00 train_steps=1.00 +ep50 val_rmse=0.71839 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.75031 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.69282 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.67751 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.66306 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.66147 halt=0.00 train_steps=1.00 +[ogbg-mollipo_gine_classic_T0_ns1_h128_e100_s0] best_ep=100 val={'rmse': np.float32(0.6614736)} test={'rmse': np.float32(0.7341322)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_gine_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-mollipo view=gine compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view gine --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.12481 halt=0.00 train_steps=3.00 +ep20 val_rmse=0.90842 halt=0.00 train_steps=3.00 +ep30 val_rmse=0.89875 halt=0.00 train_steps=3.00 +ep40 val_rmse=0.79273 halt=0.00 train_steps=3.00 +ep50 val_rmse=0.75853 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.76110 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.74986 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.71676 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.72387 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.71945 halt=0.00 train_steps=3.00 +[ogbg-mollipo_gine_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=80 val={'rmse': np.float32(0.71676475)} test={'rmse': np.float32(0.7315849)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_gine_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-mollipo view=gcn compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view gcn --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.00691 halt=0.00 train_steps=1.00 +ep20 val_rmse=0.81827 halt=0.00 train_steps=1.00 +ep30 val_rmse=1.14313 halt=0.00 train_steps=1.00 +ep40 val_rmse=0.86043 halt=0.00 train_steps=1.00 +ep50 val_rmse=0.79331 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.77473 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.74328 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.73790 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.74719 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.74553 halt=0.00 train_steps=1.00 +[ogbg-mollipo_gcn_classic_T0_ns1_h128_e100_s0] best_ep=80 val={'rmse': np.float32(0.7378985)} test={'rmse': np.float32(0.7828146)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_gcn_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-mollipo view=gcn compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view gcn --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=0.90662 halt=0.00 train_steps=3.00 +ep20 val_rmse=0.86193 halt=0.00 train_steps=3.00 +ep30 val_rmse=0.85537 halt=0.00 train_steps=3.00 +ep40 val_rmse=0.80778 halt=0.00 train_steps=3.00 +ep50 val_rmse=0.79127 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.77302 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.78860 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.78109 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.77706 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.77598 halt=0.00 train_steps=3.00 +[ogbg-mollipo_gcn_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=60 val={'rmse': np.float32(0.77302194)} test={'rmse': np.float32(0.7758825)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-mollipo view=graphsage compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view graphsage --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=0.81719 halt=0.00 train_steps=1.00 +ep20 val_rmse=0.93272 halt=0.00 train_steps=1.00 +ep30 val_rmse=0.73208 halt=0.00 train_steps=1.00 +ep40 val_rmse=0.74760 halt=0.00 train_steps=1.00 +ep50 val_rmse=0.75607 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.79079 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.72866 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.72390 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.73953 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.72610 halt=0.00 train_steps=1.00 +[ogbg-mollipo_graphsage_classic_T0_ns1_h128_e100_s0] best_ep=80 val={'rmse': np.float32(0.7239026)} test={'rmse': np.float32(0.77830356)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_graphsage_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-mollipo view=graphsage compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view graphsage --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=0.98259 halt=0.00 train_steps=3.00 +ep20 val_rmse=0.85573 halt=0.00 train_steps=3.00 +ep30 val_rmse=0.75527 halt=0.00 train_steps=3.00 +ep40 val_rmse=0.71839 halt=0.00 train_steps=3.00 +ep50 val_rmse=0.81340 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.72794 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.74447 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.74239 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.75862 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.74740 halt=0.00 train_steps=3.00 +[ogbg-mollipo_graphsage_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rmse': np.float32(0.7183915)} test={'rmse': np.float32(0.7720211)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-mollipo view=gatv2 compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view gatv2 --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=0.82356 halt=0.00 train_steps=1.00 +ep20 val_rmse=0.74744 halt=0.00 train_steps=1.00 +ep30 val_rmse=0.81665 halt=0.00 train_steps=1.00 +ep40 val_rmse=0.68648 halt=0.00 train_steps=1.00 +ep50 val_rmse=0.68822 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.75184 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.69034 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.68654 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.69914 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.69418 halt=0.00 train_steps=1.00 +[ogbg-mollipo_gatv2_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rmse': np.float32(0.6864759)} test={'rmse': np.float32(0.7307591)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_gatv2_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-mollipo view=gatv2 compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view gatv2 --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=0.93766 halt=0.00 train_steps=3.00 +ep20 val_rmse=0.80926 halt=0.00 train_steps=3.00 +ep30 val_rmse=0.78557 halt=0.00 train_steps=3.00 +ep40 val_rmse=0.79170 halt=0.00 train_steps=3.00 +ep50 val_rmse=0.73680 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.72259 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.72328 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.71219 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.70799 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.70977 halt=0.00 train_steps=3.00 +[ogbg-mollipo_gatv2_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=90 val={'rmse': np.float32(0.7079874)} test={'rmse': np.float32(0.7334003)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-mollipo view=graphconv compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view graphconv --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.09036 halt=0.00 train_steps=1.00 +ep20 val_rmse=0.86879 halt=0.00 train_steps=1.00 +ep30 val_rmse=0.76083 halt=0.00 train_steps=1.00 +ep40 val_rmse=0.75326 halt=0.00 train_steps=1.00 +ep50 val_rmse=0.76542 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.71961 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.75535 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.73062 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.72027 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.71776 halt=0.00 train_steps=1.00 +[ogbg-mollipo_graphconv_classic_T0_ns1_h128_e100_s0] best_ep=100 val={'rmse': np.float32(0.71776384)} test={'rmse': np.float32(0.72967345)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_graphconv_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-mollipo view=graphconv compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view graphconv --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=0.88607 halt=0.00 train_steps=3.00 +ep20 val_rmse=0.97478 halt=0.00 train_steps=3.00 +ep30 val_rmse=0.85444 halt=0.00 train_steps=3.00 +ep40 val_rmse=0.79351 halt=0.00 train_steps=3.00 +ep50 val_rmse=0.77852 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.76438 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.77003 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.73724 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.75021 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.74325 halt=0.00 train_steps=3.00 +[ogbg-mollipo_graphconv_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=80 val={'rmse': np.float32(0.7372442)} test={'rmse': np.float32(0.7395755)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-mollipo view=transformer compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view transformer --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.21823 halt=0.00 train_steps=1.00 +ep20 val_rmse=0.86985 halt=0.00 train_steps=1.00 +ep30 val_rmse=0.76973 halt=0.00 train_steps=1.00 +ep40 val_rmse=0.77144 halt=0.00 train_steps=1.00 +ep50 val_rmse=0.68606 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.72351 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.72069 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.68095 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.68682 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.68128 halt=0.00 train_steps=1.00 +[ogbg-mollipo_transformer_classic_T0_ns1_h128_e100_s0] best_ep=80 val={'rmse': np.float32(0.68095195)} test={'rmse': np.float32(0.7346181)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_transformer_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-mollipo view=transformer compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view transformer --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.16083 halt=0.00 train_steps=3.00 +ep20 val_rmse=0.81056 halt=0.00 train_steps=3.00 +ep30 val_rmse=0.74514 halt=0.00 train_steps=3.00 +ep40 val_rmse=0.74416 halt=0.00 train_steps=3.00 +ep50 val_rmse=0.70391 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.67918 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.68572 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.68195 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.66882 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.67099 halt=0.00 train_steps=3.00 +[ogbg-mollipo_transformer_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=90 val={'rmse': np.float32(0.6688173)} test={'rmse': np.float32(0.739605)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-mollipo view=pna compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view pna --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rmse=0.83343 halt=0.00 train_steps=1.00 +ep20 val_rmse=1.16403 halt=0.00 train_steps=1.00 +ep30 val_rmse=0.80225 halt=0.00 train_steps=1.00 +ep40 val_rmse=0.92289 halt=0.00 train_steps=1.00 +ep50 val_rmse=0.78616 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.75145 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.71792 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.77899 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.72670 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.72765 halt=0.00 train_steps=1.00 +[ogbg-mollipo_pna_classic_T0_ns1_h128_e100_s0] best_ep=70 val={'rmse': np.float32(0.7179175)} test={'rmse': np.float32(0.7749425)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_pna_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-mollipo view=pna compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view pna --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rmse=1.26267 halt=0.00 train_steps=3.00 +ep20 val_rmse=0.86750 halt=0.00 train_steps=3.00 +ep30 val_rmse=1.20236 halt=0.00 train_steps=3.00 +ep40 val_rmse=0.84242 halt=0.00 train_steps=3.00 +ep50 val_rmse=1.01859 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.81805 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.76567 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.78532 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.74657 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.75037 halt=0.00 train_steps=3.00 +[ogbg-mollipo_pna_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=90 val={'rmse': np.float32(0.74657387)} test={'rmse': np.float32(0.79080063)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_pna_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-mollipo view=gen compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view gen --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=0.88033 halt=0.00 train_steps=1.00 +ep20 val_rmse=0.86416 halt=0.00 train_steps=1.00 +ep30 val_rmse=0.71604 halt=0.00 train_steps=1.00 +ep40 val_rmse=0.74136 halt=0.00 train_steps=1.00 +ep50 val_rmse=0.72750 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.72323 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.70463 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.71580 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.72020 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.72490 halt=0.00 train_steps=1.00 +[ogbg-mollipo_gen_classic_T0_ns1_h128_e100_s0] best_ep=70 val={'rmse': np.float32(0.7046298)} test={'rmse': np.float32(0.73787534)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_gen_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-mollipo view=gen compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view gen --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=0.91516 halt=0.00 train_steps=3.00 +ep20 val_rmse=0.75993 halt=0.00 train_steps=3.00 +ep30 val_rmse=0.76272 halt=0.00 train_steps=3.00 +ep40 val_rmse=0.71611 halt=0.00 train_steps=3.00 +ep50 val_rmse=0.69283 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.67951 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.68466 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.66161 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.65941 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.66038 halt=0.00 train_steps=3.00 +[ogbg-mollipo_gen_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=90 val={'rmse': np.float32(0.659409)} test={'rmse': np.float32(0.7455868)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_gen_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-mollipo view=film compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view film --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.15311 halt=0.00 train_steps=1.00 +ep20 val_rmse=0.86404 halt=0.00 train_steps=1.00 +ep30 val_rmse=0.87620 halt=0.00 train_steps=1.00 +ep40 val_rmse=0.85424 halt=0.00 train_steps=1.00 +ep50 val_rmse=0.78557 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.80674 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.77620 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.76441 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.76459 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.76204 halt=0.00 train_steps=1.00 +[ogbg-mollipo_film_classic_T0_ns1_h128_e100_s0] best_ep=100 val={'rmse': np.float32(0.76203656)} test={'rmse': np.float32(0.73708737)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_film_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-mollipo view=film compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view film --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.04378 halt=0.00 train_steps=3.00 +ep20 val_rmse=1.07263 halt=0.00 train_steps=3.00 +ep30 val_rmse=1.03795 halt=0.00 train_steps=3.00 +ep40 val_rmse=0.93977 halt=0.00 train_steps=3.00 +ep50 val_rmse=0.86991 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.86678 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.89066 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.81220 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.81562 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.81609 halt=0.00 train_steps=3.00 +[ogbg-mollipo_film_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=80 val={'rmse': np.float32(0.81220156)} test={'rmse': np.float32(0.7353014)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_film_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-mollipo view=resgated compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view resgated --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=0.80940 halt=0.00 train_steps=1.00 +ep20 val_rmse=0.95162 halt=0.00 train_steps=1.00 +ep30 val_rmse=0.82970 halt=0.00 train_steps=1.00 +ep40 val_rmse=0.68267 halt=0.00 train_steps=1.00 +ep50 val_rmse=0.67650 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.77591 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.67205 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.69964 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.67652 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.67709 halt=0.00 train_steps=1.00 +[ogbg-mollipo_resgated_classic_T0_ns1_h128_e100_s0] best_ep=70 val={'rmse': np.float32(0.67205405)} test={'rmse': np.float32(0.7270413)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_resgated_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-mollipo view=resgated compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view resgated --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=0.86604 halt=0.00 train_steps=3.00 +ep20 val_rmse=0.90509 halt=0.00 train_steps=3.00 +ep30 val_rmse=0.84402 halt=0.00 train_steps=3.00 +ep40 val_rmse=0.78208 halt=0.00 train_steps=3.00 +ep50 val_rmse=0.71021 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.69761 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.67663 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.69813 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.69587 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.69198 halt=0.00 train_steps=3.00 +[ogbg-mollipo_resgated_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=70 val={'rmse': np.float32(0.67663383)} test={'rmse': np.float32(0.7144216)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-mollipo view=tag compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view tag --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=0.83020 halt=0.00 train_steps=1.00 +ep20 val_rmse=0.79246 halt=0.00 train_steps=1.00 +ep30 val_rmse=1.02107 halt=0.00 train_steps=1.00 +ep40 val_rmse=0.68975 halt=0.00 train_steps=1.00 +ep50 val_rmse=0.71873 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.68152 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.67573 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.68061 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.66915 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.67219 halt=0.00 train_steps=1.00 +[ogbg-mollipo_tag_classic_T0_ns1_h128_e100_s0] best_ep=90 val={'rmse': np.float32(0.66915077)} test={'rmse': np.float32(0.72267145)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_tag_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-mollipo view=tag compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view tag --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.00532 halt=0.00 train_steps=3.00 +ep20 val_rmse=0.85526 halt=0.00 train_steps=3.00 +ep30 val_rmse=0.75036 halt=0.00 train_steps=3.00 +ep40 val_rmse=0.77780 halt=0.00 train_steps=3.00 +ep50 val_rmse=0.71127 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.70010 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.71614 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.70210 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.67431 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.67720 halt=0.00 train_steps=3.00 +[ogbg-mollipo_tag_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=90 val={'rmse': np.float32(0.6743125)} test={'rmse': np.float32(0.7200687)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_tag_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-mollipo view=sgc compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view sgc --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=0.82047 halt=0.00 train_steps=1.00 +ep20 val_rmse=0.87298 halt=0.00 train_steps=1.00 +ep30 val_rmse=0.89161 halt=0.00 train_steps=1.00 +ep40 val_rmse=0.97082 halt=0.00 train_steps=1.00 +ep50 val_rmse=0.75920 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.77458 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.75046 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.76128 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.75428 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.75227 halt=0.00 train_steps=1.00 +[ogbg-mollipo_sgc_classic_T0_ns1_h128_e100_s0] best_ep=70 val={'rmse': np.float32(0.75045776)} test={'rmse': np.float32(0.81755584)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_sgc_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-mollipo view=sgc compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view sgc --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.11783 halt=0.00 train_steps=3.00 +ep20 val_rmse=0.90775 halt=0.00 train_steps=3.00 +ep30 val_rmse=0.82430 halt=0.00 train_steps=3.00 +ep40 val_rmse=0.79161 halt=0.00 train_steps=3.00 +ep50 val_rmse=0.75791 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.77323 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.77519 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.76194 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.75368 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.76065 halt=0.00 train_steps=3.00 +[ogbg-mollipo_sgc_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=90 val={'rmse': np.float32(0.75368446)} test={'rmse': np.float32(0.74901825)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-mollipo view=cheb compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view cheb --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=0.94203 halt=0.00 train_steps=1.00 +ep20 val_rmse=0.87526 halt=0.00 train_steps=1.00 +ep30 val_rmse=0.79816 halt=0.00 train_steps=1.00 +ep40 val_rmse=0.77105 halt=0.00 train_steps=1.00 +ep50 val_rmse=0.75290 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.74494 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.75526 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.71994 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.71881 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.72252 halt=0.00 train_steps=1.00 +[ogbg-mollipo_cheb_classic_T0_ns1_h128_e100_s0] best_ep=90 val={'rmse': np.float32(0.7188114)} test={'rmse': np.float32(0.7179735)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_cheb_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-mollipo view=cheb compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view cheb --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=0.97792 halt=0.00 train_steps=3.00 +ep20 val_rmse=0.86852 halt=0.00 train_steps=3.00 +ep30 val_rmse=0.75930 halt=0.00 train_steps=3.00 +ep40 val_rmse=0.71146 halt=0.00 train_steps=3.00 +ep50 val_rmse=0.70679 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.70359 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.71828 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.69905 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.70087 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.70229 halt=0.00 train_steps=3.00 +[ogbg-mollipo_cheb_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=80 val={'rmse': np.float32(0.69904804)} test={'rmse': np.float32(0.7132058)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-mollipo view=arma compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view arma --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=0.89066 halt=0.00 train_steps=1.00 +ep20 val_rmse=0.92272 halt=0.00 train_steps=1.00 +ep30 val_rmse=0.78896 halt=0.00 train_steps=1.00 +ep40 val_rmse=0.77896 halt=0.00 train_steps=1.00 +ep50 val_rmse=0.76699 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.73378 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.76016 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.73247 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.73693 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.73897 halt=0.00 train_steps=1.00 +[ogbg-mollipo_arma_classic_T0_ns1_h128_e100_s0] best_ep=80 val={'rmse': np.float32(0.7324716)} test={'rmse': np.float32(0.7294971)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_arma_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-mollipo view=arma compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view arma --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=0.87327 halt=0.00 train_steps=3.00 +ep20 val_rmse=1.01970 halt=0.00 train_steps=3.00 +ep30 val_rmse=0.79921 halt=0.00 train_steps=3.00 +ep40 val_rmse=0.71944 halt=0.00 train_steps=3.00 +ep50 val_rmse=0.71726 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.76737 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.73058 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.76078 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.73802 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.73781 halt=0.00 train_steps=3.00 +[ogbg-mollipo_arma_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rmse': np.float32(0.71726096)} test={'rmse': np.float32(0.75476235)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_arma_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-mollipo view=mf compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view mf --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=0.86162 halt=0.00 train_steps=1.00 +ep20 val_rmse=0.85789 halt=0.00 train_steps=1.00 +ep30 val_rmse=0.73809 halt=0.00 train_steps=1.00 +ep40 val_rmse=0.74146 halt=0.00 train_steps=1.00 +ep50 val_rmse=0.71292 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.73395 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.73997 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.73043 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.73206 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.73301 halt=0.00 train_steps=1.00 +[ogbg-mollipo_mf_classic_T0_ns1_h128_e100_s0] best_ep=50 val={'rmse': np.float32(0.7129222)} test={'rmse': np.float32(0.7404879)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_mf_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-mollipo view=mf compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view mf --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=0.81723 halt=0.00 train_steps=3.00 +ep20 val_rmse=0.80122 halt=0.00 train_steps=3.00 +ep30 val_rmse=0.77347 halt=0.00 train_steps=3.00 +ep40 val_rmse=0.77796 halt=0.00 train_steps=3.00 +ep50 val_rmse=0.73664 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.72824 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.71114 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.72520 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.70653 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.70497 halt=0.00 train_steps=3.00 +[ogbg-mollipo_mf_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=100 val={'rmse': np.float32(0.7049702)} test={'rmse': np.float32(0.7100952)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_mf_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-mollipo view=appnp compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view appnp --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.14396 halt=0.00 train_steps=1.00 +ep20 val_rmse=1.07213 halt=0.00 train_steps=1.00 +ep30 val_rmse=0.97016 halt=0.00 train_steps=1.00 +ep40 val_rmse=1.05400 halt=0.00 train_steps=1.00 +ep50 val_rmse=1.05925 halt=0.00 train_steps=1.00 +ep60 val_rmse=0.93170 halt=0.00 train_steps=1.00 +ep70 val_rmse=0.90754 halt=0.00 train_steps=1.00 +ep80 val_rmse=0.90773 halt=0.00 train_steps=1.00 +ep90 val_rmse=0.91195 halt=0.00 train_steps=1.00 +ep100 val_rmse=0.90148 halt=0.00 train_steps=1.00 +[ogbg-mollipo_appnp_classic_T0_ns1_h128_e100_s0] best_ep=100 val={'rmse': np.float32(0.901481)} test={'rmse': np.float32(0.9070075)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_appnp_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-mollipo view=appnp compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view appnp --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rmse=1.03741 halt=0.00 train_steps=3.00 +ep20 val_rmse=0.92784 halt=0.00 train_steps=3.00 +ep30 val_rmse=0.99124 halt=0.00 train_steps=3.00 +ep40 val_rmse=0.90729 halt=0.00 train_steps=3.00 +ep50 val_rmse=0.87637 halt=0.00 train_steps=3.00 +ep60 val_rmse=0.86910 halt=0.00 train_steps=3.00 +ep70 val_rmse=0.83926 halt=0.00 train_steps=3.00 +ep80 val_rmse=0.87004 halt=0.00 train_steps=3.00 +ep90 val_rmse=0.85671 halt=0.00 train_steps=3.00 +ep100 val_rmse=0.85874 halt=0.00 train_steps=3.00 +[ogbg-mollipo_appnp_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=70 val={'rmse': np.float32(0.8392647)} test={'rmse': np.float32(0.917393)} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json + +Classic baseline: task x backbone +| task | backbone | metric | n | val | test | +| --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | rocauc | 1 | 0.6564 +/- 0.0000 | 0.7423 +/- 0.0000 | +| ogbg-molbace | arma | rocauc | 1 | 0.6923 +/- 0.0000 | 0.7839 +/- 0.0000 | +| ogbg-molbace | cheb | rocauc | 1 | 0.7267 +/- 0.0000 | 0.7969 +/- 0.0000 | +| ogbg-molbace | film | rocauc | 1 | 0.6703 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molbace | gatv2 | rocauc | 1 | 0.7029 +/- 0.0000 | 0.7400 +/- 0.0000 | +| ogbg-molbace | gcn | rocauc | 1 | 0.6381 +/- 0.0000 | 0.7393 +/- 0.0000 | +| ogbg-molbace | gen | rocauc | 1 | 0.7128 +/- 0.0000 | 0.7326 +/- 0.0000 | +| ogbg-molbace | gin | rocauc | 1 | 0.6520 +/- 0.0000 | 0.7336 +/- 0.0000 | +| ogbg-molbace | gine | rocauc | 1 | 0.6641 +/- 0.0000 | 0.7454 +/- 0.0000 | +| ogbg-molbace | graphconv | rocauc | 1 | 0.7311 +/- 0.0000 | 0.8035 +/- 0.0000 | +| ogbg-molbace | graphsage | rocauc | 1 | 0.6758 +/- 0.0000 | 0.7759 +/- 0.0000 | +| ogbg-molbace | mf | rocauc | 1 | 0.7421 +/- 0.0000 | 0.7760 +/- 0.0000 | +| ogbg-molbace | pna | rocauc | 1 | 0.7516 +/- 0.0000 | 0.6912 +/- 0.0000 | +| ogbg-molbace | resgated | rocauc | 1 | 0.7172 +/- 0.0000 | 0.7877 +/- 0.0000 | +| ogbg-molbace | sgc | rocauc | 1 | 0.6575 +/- 0.0000 | 0.6966 +/- 0.0000 | +| ogbg-molbace | tag | rocauc | 1 | 0.7084 +/- 0.0000 | 0.7345 +/- 0.0000 | +| ogbg-molbace | transformer | rocauc | 1 | 0.6663 +/- 0.0000 | 0.7364 +/- 0.0000 | +| ogbg-molbbbp | appnp | rocauc | 1 | 0.9147 +/- 0.0000 | 0.6388 +/- 0.0000 | +| ogbg-molbbbp | arma | rocauc | 1 | 0.9367 +/- 0.0000 | 0.6651 +/- 0.0000 | +| ogbg-molbbbp | cheb | rocauc | 1 | 0.9452 +/- 0.0000 | 0.6514 +/- 0.0000 | +| ogbg-molbbbp | film | rocauc | 1 | 0.9285 +/- 0.0000 | 0.6300 +/- 0.0000 | +| ogbg-molbbbp | gatv2 | rocauc | 1 | 0.9347 +/- 0.0000 | 0.6324 +/- 0.0000 | +| ogbg-molbbbp | gcn | rocauc | 1 | 0.9386 +/- 0.0000 | 0.6679 +/- 0.0000 | +| ogbg-molbbbp | gen | rocauc | 1 | 0.9549 +/- 0.0000 | 0.6775 +/- 0.0000 | +| ogbg-molbbbp | gin | rocauc | 1 | 0.9251 +/- 0.0000 | 0.5670 +/- 0.0000 | +| ogbg-molbbbp | gine | rocauc | 1 | 0.9324 +/- 0.0000 | 0.6160 +/- 0.0000 | +| ogbg-molbbbp | graphconv | rocauc | 1 | 0.9268 +/- 0.0000 | 0.5900 +/- 0.0000 | +| ogbg-molbbbp | graphsage | rocauc | 1 | 0.9483 +/- 0.0000 | 0.6288 +/- 0.0000 | +| ogbg-molbbbp | mf | rocauc | 1 | 0.9395 +/- 0.0000 | 0.6365 +/- 0.0000 | +| ogbg-molbbbp | pna | rocauc | 1 | 0.9554 +/- 0.0000 | 0.6418 +/- 0.0000 | +| ogbg-molbbbp | resgated | rocauc | 1 | 0.9183 +/- 0.0000 | 0.6626 +/- 0.0000 | +| ogbg-molbbbp | sgc | rocauc | 1 | 0.9300 +/- 0.0000 | 0.6239 +/- 0.0000 | +| ogbg-molbbbp | tag | rocauc | 1 | 0.9476 +/- 0.0000 | 0.6100 +/- 0.0000 | +| ogbg-molbbbp | transformer | rocauc | 1 | 0.9495 +/- 0.0000 | 0.6156 +/- 0.0000 | +| ogbg-molclintox | appnp | rocauc | 1 | 0.8516 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | arma | rocauc | 1 | 0.9463 +/- 0.0000 | 0.8678 +/- 0.0000 | +| ogbg-molclintox | cheb | rocauc | 1 | 0.8928 +/- 0.0000 | 0.9152 +/- 0.0000 | +| ogbg-molclintox | film | rocauc | 1 | 0.9048 +/- 0.0000 | 0.7731 +/- 0.0000 | +| ogbg-molclintox | gatv2 | rocauc | 1 | 0.9515 +/- 0.0000 | 0.8493 +/- 0.0000 | +| ogbg-molclintox | gcn | rocauc | 1 | 0.9318 +/- 0.0000 | 0.8932 +/- 0.0000 | +| ogbg-molclintox | gen | rocauc | 1 | 0.9820 +/- 0.0000 | 0.8128 +/- 0.0000 | +| ogbg-molclintox | gin | rocauc | 1 | 0.9547 +/- 0.0000 | 0.8586 +/- 0.0000 | +| ogbg-molclintox | gine | rocauc | 1 | 0.9353 +/- 0.0000 | 0.8869 +/- 0.0000 | +| ogbg-molclintox | graphconv | rocauc | 1 | 0.8917 +/- 0.0000 | 0.8501 +/- 0.0000 | +| ogbg-molclintox | graphsage | rocauc | 1 | 0.9143 +/- 0.0000 | 0.8882 +/- 0.0000 | +| ogbg-molclintox | mf | rocauc | 1 | 0.9252 +/- 0.0000 | 0.8370 +/- 0.0000 | +| ogbg-molclintox | pna | rocauc | 1 | 0.9286 +/- 0.0000 | 0.8603 +/- 0.0000 | +| ogbg-molclintox | resgated | rocauc | 1 | 0.9244 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | sgc | rocauc | 1 | 0.9195 +/- 0.0000 | 0.8986 +/- 0.0000 | +| ogbg-molclintox | tag | rocauc | 1 | 0.9237 +/- 0.0000 | 0.7998 +/- 0.0000 | +| ogbg-molclintox | transformer | rocauc | 1 | 0.9271 +/- 0.0000 | 0.8764 +/- 0.0000 | +| ogbg-molesol | appnp | rmse | 1 | 1.6083 +/- 0.0000 | 1.5212 +/- 0.0000 | +| ogbg-molesol | arma | rmse | 1 | 1.0195 +/- 0.0000 | 1.0666 +/- 0.0000 | +| ogbg-molesol | cheb | rmse | 1 | 0.9650 +/- 0.0000 | 0.8722 +/- 0.0000 | +| ogbg-molesol | film | rmse | 1 | 1.0718 +/- 0.0000 | 1.2896 +/- 0.0000 | +| ogbg-molesol | gatv2 | rmse | 1 | 1.0368 +/- 0.0000 | 0.9878 +/- 0.0000 | +| ogbg-molesol | gcn | rmse | 1 | 1.0409 +/- 0.0000 | 1.1161 +/- 0.0000 | +| ogbg-molesol | gen | rmse | 1 | 1.0089 +/- 0.0000 | 0.8762 +/- 0.0000 | +| ogbg-molesol | gin | rmse | 1 | 1.0187 +/- 0.0000 | 0.9900 +/- 0.0000 | +| ogbg-molesol | gine | rmse | 1 | 1.0286 +/- 0.0000 | 1.0807 +/- 0.0000 | +| ogbg-molesol | graphconv | rmse | 1 | 0.9741 +/- 0.0000 | 0.9732 +/- 0.0000 | +| ogbg-molesol | graphsage | rmse | 1 | 0.9680 +/- 0.0000 | 1.0038 +/- 0.0000 | +| ogbg-molesol | mf | rmse | 1 | 1.1494 +/- 0.0000 | 1.0639 +/- 0.0000 | +| ogbg-molesol | pna | rmse | 1 | 0.9116 +/- 0.0000 | 0.9153 +/- 0.0000 | +| ogbg-molesol | resgated | rmse | 1 | 0.9492 +/- 0.0000 | 0.8908 +/- 0.0000 | +| ogbg-molesol | sgc | rmse | 1 | 1.0617 +/- 0.0000 | 0.9780 +/- 0.0000 | +| ogbg-molesol | tag | rmse | 1 | 0.9323 +/- 0.0000 | 0.9678 +/- 0.0000 | +| ogbg-molesol | transformer | rmse | 1 | 0.9398 +/- 0.0000 | 0.9492 +/- 0.0000 | +| ogbg-molfreesolv | appnp | rmse | 1 | 6.0462 +/- 0.0000 | 4.6478 +/- 0.0000 | +| ogbg-molfreesolv | arma | rmse | 1 | 4.2662 +/- 0.0000 | 2.9769 +/- 0.0000 | +| ogbg-molfreesolv | cheb | rmse | 1 | 2.9481 +/- 0.0000 | 2.2431 +/- 0.0000 | +| ogbg-molfreesolv | film | rmse | 1 | 3.1546 +/- 0.0000 | 2.9581 +/- 0.0000 | +| ogbg-molfreesolv | gatv2 | rmse | 1 | 4.2086 +/- 0.0000 | 2.7368 +/- 0.0000 | +| ogbg-molfreesolv | gcn | rmse | 1 | 3.7172 +/- 0.0000 | 2.4851 +/- 0.0000 | +| ogbg-molfreesolv | gen | rmse | 1 | 3.9998 +/- 0.0000 | 2.5588 +/- 0.0000 | +| ogbg-molfreesolv | gin | rmse | 1 | 4.0190 +/- 0.0000 | 3.4898 +/- 0.0000 | +| ogbg-molfreesolv | gine | rmse | 1 | 3.2961 +/- 0.0000 | 3.1442 +/- 0.0000 | +| ogbg-molfreesolv | graphconv | rmse | 1 | 2.5314 +/- 0.0000 | 2.7953 +/- 0.0000 | +| ogbg-molfreesolv | graphsage | rmse | 1 | 3.5022 +/- 0.0000 | 2.2977 +/- 0.0000 | +| ogbg-molfreesolv | mf | rmse | 1 | 2.7374 +/- 0.0000 | 2.8885 +/- 0.0000 | +| ogbg-molfreesolv | pna | rmse | 1 | 2.3625 +/- 0.0000 | 2.2610 +/- 0.0000 | +| ogbg-molfreesolv | resgated | rmse | 1 | 2.4772 +/- 0.0000 | 2.0041 +/- 0.0000 | +| ogbg-molfreesolv | sgc | rmse | 1 | 3.9147 +/- 0.0000 | 2.4146 +/- 0.0000 | +| ogbg-molfreesolv | tag | rmse | 1 | 2.6874 +/- 0.0000 | 2.3826 +/- 0.0000 | +| ogbg-molfreesolv | transformer | rmse | 1 | 4.0942 +/- 0.0000 | 2.3205 +/- 0.0000 | +| ogbg-molhiv | appnp | rocauc | 1 | 0.7675 +/- 0.0000 | 0.7000 +/- 0.0000 | +| ogbg-molhiv | arma | rocauc | 1 | 0.7872 +/- 0.0000 | 0.7296 +/- 0.0000 | +| ogbg-molhiv | cheb | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7282 +/- 0.0000 | +| ogbg-molhiv | film | rocauc | 1 | 0.7922 +/- 0.0000 | 0.7842 +/- 0.0000 | +| ogbg-molhiv | gatv2 | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7563 +/- 0.0000 | +| ogbg-molhiv | gcn | rocauc | 1 | 0.7754 +/- 0.0000 | 0.7198 +/- 0.0000 | +| ogbg-molhiv | gen | rocauc | 1 | 0.7530 +/- 0.0000 | 0.7314 +/- 0.0000 | +| ogbg-molhiv | gin | rocauc | 1 | 0.8167 +/- 0.0000 | 0.7724 +/- 0.0000 | +| ogbg-molhiv | gine | rocauc | 1 | 0.7942 +/- 0.0000 | 0.7445 +/- 0.0000 | +| ogbg-molhiv | graphconv | rocauc | 1 | 0.7707 +/- 0.0000 | 0.7108 +/- 0.0000 | +| ogbg-molhiv | graphsage | rocauc | 1 | 0.7969 +/- 0.0000 | 0.7625 +/- 0.0000 | +| ogbg-molhiv | mf | rocauc | 1 | 0.7845 +/- 0.0000 | 0.7074 +/- 0.0000 | +| ogbg-molhiv | pna | rocauc | 1 | 0.7780 +/- 0.0000 | 0.7648 +/- 0.0000 | +| ogbg-molhiv | resgated | rocauc | 1 | 0.8144 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molhiv | sgc | rocauc | 1 | 0.7479 +/- 0.0000 | 0.7019 +/- 0.0000 | +| ogbg-molhiv | tag | rocauc | 1 | 0.7528 +/- 0.0000 | 0.7255 +/- 0.0000 | +| ogbg-molhiv | transformer | rocauc | 1 | 0.7617 +/- 0.0000 | 0.7547 +/- 0.0000 | +| ogbg-mollipo | appnp | rmse | 1 | 0.9015 +/- 0.0000 | 0.9070 +/- 0.0000 | +| ogbg-mollipo | arma | rmse | 1 | 0.7325 +/- 0.0000 | 0.7295 +/- 0.0000 | +| ogbg-mollipo | cheb | rmse | 1 | 0.7188 +/- 0.0000 | 0.7180 +/- 0.0000 | +| ogbg-mollipo | film | rmse | 1 | 0.7620 +/- 0.0000 | 0.7371 +/- 0.0000 | +| ogbg-mollipo | gatv2 | rmse | 1 | 0.6865 +/- 0.0000 | 0.7308 +/- 0.0000 | +| ogbg-mollipo | gcn | rmse | 1 | 0.7379 +/- 0.0000 | 0.7828 +/- 0.0000 | +| ogbg-mollipo | gen | rmse | 1 | 0.7046 +/- 0.0000 | 0.7379 +/- 0.0000 | +| ogbg-mollipo | gin | rmse | 1 | 0.6854 +/- 0.0000 | 0.7390 +/- 0.0000 | +| ogbg-mollipo | gine | rmse | 1 | 0.6615 +/- 0.0000 | 0.7341 +/- 0.0000 | +| ogbg-mollipo | graphconv | rmse | 1 | 0.7178 +/- 0.0000 | 0.7297 +/- 0.0000 | +| ogbg-mollipo | graphsage | rmse | 1 | 0.7239 +/- 0.0000 | 0.7783 +/- 0.0000 | +| ogbg-mollipo | mf | rmse | 1 | 0.7129 +/- 0.0000 | 0.7405 +/- 0.0000 | +| ogbg-mollipo | pna | rmse | 1 | 0.7179 +/- 0.0000 | 0.7749 +/- 0.0000 | +| ogbg-mollipo | resgated | rmse | 1 | 0.6721 +/- 0.0000 | 0.7270 +/- 0.0000 | +| ogbg-mollipo | sgc | rmse | 1 | 0.7505 +/- 0.0000 | 0.8176 +/- 0.0000 | +| ogbg-mollipo | tag | rmse | 1 | 0.6692 +/- 0.0000 | 0.7227 +/- 0.0000 | +| ogbg-mollipo | transformer | rmse | 1 | 0.6810 +/- 0.0000 | 0.7346 +/- 0.0000 | +| ogbg-molsider | appnp | rocauc | 1 | 0.5886 +/- 0.0000 | 0.6004 +/- 0.0000 | +| ogbg-molsider | arma | rocauc | 1 | 0.6273 +/- 0.0000 | 0.6159 +/- 0.0000 | +| ogbg-molsider | cheb | rocauc | 1 | 0.6237 +/- 0.0000 | 0.6033 +/- 0.0000 | +| ogbg-molsider | film | rocauc | 1 | 0.6024 +/- 0.0000 | 0.5898 +/- 0.0000 | +| ogbg-molsider | gatv2 | rocauc | 1 | 0.6071 +/- 0.0000 | 0.6013 +/- 0.0000 | +| ogbg-molsider | gcn | rocauc | 1 | 0.6293 +/- 0.0000 | 0.6086 +/- 0.0000 | +| ogbg-molsider | gen | rocauc | 1 | 0.6519 +/- 0.0000 | 0.5854 +/- 0.0000 | +| ogbg-molsider | gin | rocauc | 1 | 0.6225 +/- 0.0000 | 0.5748 +/- 0.0000 | +| ogbg-molsider | gine | rocauc | 1 | 0.6327 +/- 0.0000 | 0.5495 +/- 0.0000 | +| ogbg-molsider | graphconv | rocauc | 1 | 0.5921 +/- 0.0000 | 0.6151 +/- 0.0000 | +| ogbg-molsider | graphsage | rocauc | 1 | 0.6217 +/- 0.0000 | 0.5807 +/- 0.0000 | +| ogbg-molsider | mf | rocauc | 1 | 0.6202 +/- 0.0000 | 0.5861 +/- 0.0000 | +| ogbg-molsider | pna | rocauc | 1 | 0.6219 +/- 0.0000 | 0.5965 +/- 0.0000 | +| ogbg-molsider | resgated | rocauc | 1 | 0.6209 +/- 0.0000 | 0.5910 +/- 0.0000 | +| ogbg-molsider | sgc | rocauc | 1 | 0.6174 +/- 0.0000 | 0.6043 +/- 0.0000 | +| ogbg-molsider | tag | rocauc | 1 | 0.6439 +/- 0.0000 | 0.6143 +/- 0.0000 | +| ogbg-molsider | transformer | rocauc | 1 | 0.6160 +/- 0.0000 | 0.5980 +/- 0.0000 | +| ogbg-moltox21 | appnp | rocauc | 1 | 0.7255 +/- 0.0000 | 0.7158 +/- 0.0000 | +| ogbg-moltox21 | arma | rocauc | 1 | 0.7799 +/- 0.0000 | 0.7223 +/- 0.0000 | +| ogbg-moltox21 | cheb | rocauc | 1 | 0.7834 +/- 0.0000 | 0.7301 +/- 0.0000 | +| ogbg-moltox21 | film | rocauc | 1 | 0.7702 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gatv2 | rocauc | 1 | 0.7627 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gcn | rocauc | 1 | 0.7580 +/- 0.0000 | 0.7171 +/- 0.0000 | +| ogbg-moltox21 | gen | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7444 +/- 0.0000 | +| ogbg-moltox21 | gin | rocauc | 1 | 0.7690 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-moltox21 | gine | rocauc | 1 | 0.7744 +/- 0.0000 | 0.7328 +/- 0.0000 | +| ogbg-moltox21 | graphconv | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7147 +/- 0.0000 | +| ogbg-moltox21 | graphsage | rocauc | 1 | 0.7709 +/- 0.0000 | 0.7196 +/- 0.0000 | +| ogbg-moltox21 | mf | rocauc | 1 | 0.7773 +/- 0.0000 | 0.7281 +/- 0.0000 | +| ogbg-moltox21 | pna | rocauc | 1 | 0.7660 +/- 0.0000 | 0.6946 +/- 0.0000 | +| ogbg-moltox21 | resgated | rocauc | 1 | 0.7950 +/- 0.0000 | 0.7275 +/- 0.0000 | +| ogbg-moltox21 | sgc | rocauc | 1 | 0.7611 +/- 0.0000 | 0.7240 +/- 0.0000 | +| ogbg-moltox21 | tag | rocauc | 1 | 0.7866 +/- 0.0000 | 0.7416 +/- 0.0000 | +| ogbg-moltox21 | transformer | rocauc | 1 | 0.7656 +/- 0.0000 | 0.7309 +/- 0.0000 | + +Delta vs matching classic +| task | backbone | compute | metric | n | val score (delta) | test score (delta) | steps | +| --- | --- | --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7168 (0.0604) | 0.7209 (-0.0214) | | +| ogbg-molbace | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7179 (0.0256) | 0.7672 (-0.0167) | | +| ogbg-molbace | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7114 (-0.0154) | 0.7533 (-0.0436) | | +| ogbg-molbace | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6652 (-0.0051) | 0.7242 (0.0000) | | +| ogbg-molbace | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7026 (-0.0004) | 0.7519 (0.0118) | | +| ogbg-molbace | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6374 (-0.0007) | 0.7733 (0.0339) | | +| ogbg-molbace | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6894 (-0.0234) | 0.7449 (0.0123) | | +| ogbg-molbace | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6538 (0.0018) | 0.7169 (-0.0167) | | +| ogbg-molbace | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6685 (0.0044) | 0.6994 (-0.0461) | | +| ogbg-molbace | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7462 (0.0150) | 0.7983 (-0.0052) | | +| ogbg-molbace | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6703 (-0.0055) | 0.7119 (-0.0640) | | +| ogbg-molbace | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7234 (-0.0187) | 0.7684 (-0.0077) | | +| ogbg-molbace | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7037 (-0.0480) | 0.7967 (0.1055) | | +| ogbg-molbace | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6912 (-0.0260) | 0.7465 (-0.0412) | | +| ogbg-molbace | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6454 (-0.0121) | 0.7727 (0.0762) | | +| ogbg-molbace | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7355 (0.0271) | 0.6806 (-0.0539) | | +| ogbg-molbace | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6982 (0.0319) | 0.7487 (0.0123) | | +| ogbg-molbbbp | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9360 (0.0213) | 0.6073 (-0.0314) | | +| ogbg-molbbbp | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9415 (0.0048) | 0.6635 (-0.0016) | | +| ogbg-molbbbp | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9278 (-0.0174) | 0.6659 (0.0145) | | +| ogbg-molbbbp | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9400 (0.0115) | 0.6323 (0.0023) | | +| ogbg-molbbbp | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9356 (0.0009) | 0.6560 (0.0235) | | +| ogbg-molbbbp | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9417 (0.0031) | 0.6017 (-0.0663) | | +| ogbg-molbbbp | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9429 (-0.0119) | 0.6037 (-0.0738) | | +| ogbg-molbbbp | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9526 (0.0275) | 0.5932 (0.0261) | | +| ogbg-molbbbp | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9421 (0.0098) | 0.6976 (0.0816) | | +| ogbg-molbbbp | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9337 (0.0069) | 0.6518 (0.0618) | | +| ogbg-molbbbp | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9502 (0.0019) | 0.5934 (-0.0354) | | +| ogbg-molbbbp | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9488 (0.0094) | 0.6481 (0.0116) | | +| ogbg-molbbbp | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9585 (0.0031) | 0.6682 (0.0264) | | +| ogbg-molbbbp | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9535 (0.0352) | 0.5839 (-0.0787) | | +| ogbg-molbbbp | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9285 (-0.0015) | 0.6454 (0.0215) | | +| ogbg-molbbbp | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9459 (-0.0017) | 0.6420 (0.0320) | | +| ogbg-molbbbp | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9355 (-0.0140) | 0.6221 (0.0065) | | +| ogbg-molclintox | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9029 (0.0513) | 0.8898 (-0.0286) | | +| ogbg-molclintox | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9135 (-0.0328) | 0.8863 (0.0185) | | +| ogbg-molclintox | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8816 (-0.0112) | 0.8982 (-0.0170) | | +| ogbg-molclintox | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9454 (0.0406) | 0.8430 (0.0699) | | +| ogbg-molclintox | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9351 (-0.0164) | 0.8328 (-0.0164) | | +| ogbg-molclintox | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9097 (-0.0221) | 0.8792 (-0.0140) | | +| ogbg-molclintox | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9399 (-0.0421) | 0.8194 (0.0066) | | +| ogbg-molclintox | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9164 (-0.0383) | 0.8788 (0.0202) | | +| ogbg-molclintox | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9225 (-0.0127) | 0.8840 (-0.0030) | | +| ogbg-molclintox | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8494 (-0.0424) | 0.8186 (-0.0316) | | +| ogbg-molclintox | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9579 (0.0436) | 0.8664 (-0.0217) | | +| ogbg-molclintox | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9147 (-0.0104) | 0.8047 (-0.0323) | | +| ogbg-molclintox | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9064 (-0.0222) | 0.8735 (0.0132) | | +| ogbg-molclintox | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9055 (-0.0188) | 0.8979 (-0.0205) | | +| ogbg-molclintox | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9220 (0.0025) | 0.9054 (0.0068) | | +| ogbg-molclintox | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9183 (-0.0054) | 0.8433 (0.0435) | | +| ogbg-molclintox | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9322 (0.0051) | 0.8522 (-0.0242) | | +| ogbg-molesol | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 1.4196 (0.1887) | 1.4929 (0.0284) | | +| ogbg-molesol | arma | fixed-rrog-T1-ns3 | rmse | 1 | 1.0034 (0.0160) | 1.1272 (-0.0606) | | +| ogbg-molesol | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 0.9199 (0.0451) | 0.8841 (-0.0118) | | +| ogbg-molesol | film | fixed-rrog-T1-ns3 | rmse | 1 | 1.0196 (0.0521) | 1.0849 (0.2047) | | +| ogbg-molesol | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 1.0018 (0.0350) | 0.9780 (0.0098) | | +| ogbg-molesol | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 0.9591 (0.0818) | 0.9305 (0.1856) | | +| ogbg-molesol | gen | fixed-rrog-T1-ns3 | rmse | 1 | 1.0027 (0.0062) | 0.9206 (-0.0444) | | +| ogbg-molesol | gin | fixed-rrog-T1-ns3 | rmse | 1 | 0.9647 (0.0540) | 1.0798 (-0.0899) | | +| ogbg-molesol | gine | fixed-rrog-T1-ns3 | rmse | 1 | 1.0581 (-0.0295) | 1.0951 (-0.0144) | | +| ogbg-molesol | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 1.0048 (-0.0307) | 0.9968 (-0.0236) | | +| ogbg-molesol | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 0.9934 (-0.0254) | 1.0794 (-0.0757) | | +| ogbg-molesol | mf | fixed-rrog-T1-ns3 | rmse | 1 | 1.0553 (0.0942) | 1.0368 (0.0271) | | +| ogbg-molesol | pna | fixed-rrog-T1-ns3 | rmse | 1 | 0.9841 (-0.0725) | 0.9092 (0.0060) | | +| ogbg-molesol | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 0.9873 (-0.0382) | 0.8825 (0.0083) | | +| ogbg-molesol | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 1.0129 (0.0488) | 0.9373 (0.0407) | | +| ogbg-molesol | tag | fixed-rrog-T1-ns3 | rmse | 1 | 0.9036 (0.0288) | 0.9462 (0.0215) | | +| ogbg-molesol | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 0.9841 (-0.0443) | 1.0004 (-0.0512) | | +| ogbg-molfreesolv | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 5.5593 (0.4869) | 3.6549 (0.9928) | | +| ogbg-molfreesolv | arma | fixed-rrog-T1-ns3 | rmse | 1 | 5.0683 (-0.8021) | 3.6823 (-0.7053) | | +| ogbg-molfreesolv | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 3.0142 (-0.0662) | 2.2399 (0.0032) | | +| ogbg-molfreesolv | film | fixed-rrog-T1-ns3 | rmse | 1 | 3.2952 (-0.1406) | 3.3042 (-0.3460) | | +| ogbg-molfreesolv | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 3.9984 (0.2103) | 2.5966 (0.1403) | | +| ogbg-molfreesolv | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 3.5888 (0.1285) | 2.4444 (0.0407) | | +| ogbg-molfreesolv | gen | fixed-rrog-T1-ns3 | rmse | 1 | 4.3009 (-0.3011) | 2.9063 (-0.3476) | | +| ogbg-molfreesolv | gin | fixed-rrog-T1-ns3 | rmse | 1 | 3.9743 (0.0447) | 3.4292 (0.0607) | | +| ogbg-molfreesolv | gine | fixed-rrog-T1-ns3 | rmse | 1 | 4.4468 (-1.1508) | 3.7405 (-0.5963) | | +| ogbg-molfreesolv | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 2.9106 (-0.3792) | 3.1429 (-0.3476) | | +| ogbg-molfreesolv | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 3.7380 (-0.2358) | 2.1931 (0.1046) | | +| ogbg-molfreesolv | mf | fixed-rrog-T1-ns3 | rmse | 1 | 2.5060 (0.2313) | 3.1892 (-0.3007) | | +| ogbg-molfreesolv | pna | fixed-rrog-T1-ns3 | rmse | 1 | 3.3334 (-0.9708) | 2.4279 (-0.1669) | | +| ogbg-molfreesolv | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 3.0920 (-0.6148) | 2.0244 (-0.0203) | | +| ogbg-molfreesolv | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 3.9261 (-0.0114) | 2.4887 (-0.0741) | | +| ogbg-molfreesolv | tag | fixed-rrog-T1-ns3 | rmse | 1 | 2.7359 (-0.0486) | 2.0588 (0.3237) | | +| ogbg-molfreesolv | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 4.4180 (-0.3237) | 2.4325 (-0.1120) | | +| ogbg-molhiv | appnp | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7203 (-0.0471) | 0.6825 (-0.0175) | | +| ogbg-molhiv | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7956 (0.0084) | 0.6967 (-0.0329) | | +| ogbg-molhiv | arma | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7926 (0.0054) | 0.7318 (0.0021) | | +| ogbg-molhiv | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7947 (0.0116) | 0.7290 (0.0008) | | +| ogbg-molhiv | cheb | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7735 (-0.0096) | 0.7426 (0.0144) | | +| ogbg-molhiv | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8251 (0.0330) | 0.7725 (-0.0117) | | +| ogbg-molhiv | film | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7633 (-0.0288) | 0.7728 (-0.0114) | | +| ogbg-molhiv | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8049 (0.0214) | 0.7486 (-0.0077) | | +| ogbg-molhiv | gatv2 | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7835 (0.0001) | 0.7466 (-0.0096) | | +| ogbg-molhiv | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7833 (0.0079) | 0.7448 (0.0250) | | +| ogbg-molhiv | gcn | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7455 (-0.0300) | 0.7483 (0.0285) | | +| ogbg-molhiv | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7740 (0.0210) | 0.7590 (0.0276) | | +| ogbg-molhiv | gen | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8128 (0.0598) | 0.7631 (0.0318) | | +| ogbg-molhiv | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0457) | 0.7668 (-0.0056) | | +| ogbg-molhiv | gin | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7524 (-0.0644) | 0.7324 (-0.0400) | | +| ogbg-molhiv | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7490 (-0.0453) | 0.7376 (-0.0070) | | +| ogbg-molhiv | gine | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7575 (-0.0368) | 0.7401 (-0.0044) | | +| ogbg-molhiv | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7817 (0.0110) | 0.7493 (0.0385) | | +| ogbg-molhiv | graphconv | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7713 (0.0006) | 0.6979 (-0.0129) | | +| ogbg-molhiv | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7893 (-0.0075) | 0.7633 (0.0008) | | +| ogbg-molhiv | graphsage | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7587 (-0.0382) | 0.7641 (0.0016) | | +| ogbg-molhiv | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7754 (-0.0091) | 0.7115 (0.0041) | | +| ogbg-molhiv | mf | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7931 (0.0085) | 0.7217 (0.0143) | | +| ogbg-molhiv | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8097 (0.0317) | 0.7602 (-0.0046) | | +| ogbg-molhiv | pna | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7890 (0.0111) | 0.7630 (-0.0018) | | +| ogbg-molhiv | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7923 (-0.0221) | 0.7227 (-0.0015) | | +| ogbg-molhiv | resgated | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8174 (0.0030) | 0.7055 (-0.0187) | | +| ogbg-molhiv | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7659 (0.0181) | 0.7136 (0.0117) | | +| ogbg-molhiv | sgc | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7482 (0.0003) | 0.7177 (0.0158) | | +| ogbg-molhiv | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7717 (0.0189) | 0.7181 (-0.0074) | | +| ogbg-molhiv | tag | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7804 (0.0276) | 0.7352 (0.0096) | | +| ogbg-molhiv | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7838 (0.0221) | 0.7648 (0.0100) | | +| ogbg-molhiv | transformer | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8088 (0.0471) | 0.7413 (-0.0134) | | +| ogbg-mollipo | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 0.8393 (0.0622) | 0.9174 (-0.0104) | | +| ogbg-mollipo | arma | fixed-rrog-T1-ns3 | rmse | 1 | 0.7173 (0.0152) | 0.7548 (-0.0253) | | +| ogbg-mollipo | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 0.6990 (0.0198) | 0.7132 (0.0048) | | +| ogbg-mollipo | film | fixed-rrog-T1-ns3 | rmse | 1 | 0.8122 (-0.0502) | 0.7353 (0.0018) | | +| ogbg-mollipo | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 0.7080 (-0.0215) | 0.7334 (-0.0026) | | +| ogbg-mollipo | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 0.7730 (-0.0351) | 0.7759 (0.0069) | | +| ogbg-mollipo | gen | fixed-rrog-T1-ns3 | rmse | 1 | 0.6594 (0.0452) | 0.7456 (-0.0077) | | +| ogbg-mollipo | gin | fixed-rrog-T1-ns3 | rmse | 1 | 0.6749 (0.0105) | 0.7073 (0.0317) | | +| ogbg-mollipo | gine | fixed-rrog-T1-ns3 | rmse | 1 | 0.7168 (-0.0553) | 0.7316 (0.0025) | | +| ogbg-mollipo | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 0.7372 (-0.0195) | 0.7396 (-0.0099) | | +| ogbg-mollipo | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 0.7184 (0.0055) | 0.7720 (0.0063) | | +| ogbg-mollipo | mf | fixed-rrog-T1-ns3 | rmse | 1 | 0.7050 (0.0080) | 0.7101 (0.0304) | | +| ogbg-mollipo | pna | fixed-rrog-T1-ns3 | rmse | 1 | 0.7466 (-0.0287) | 0.7908 (-0.0159) | | +| ogbg-mollipo | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 0.6766 (-0.0046) | 0.7144 (0.0126) | | +| ogbg-mollipo | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 0.7537 (-0.0032) | 0.7490 (0.0685) | | +| ogbg-mollipo | tag | fixed-rrog-T1-ns3 | rmse | 1 | 0.6743 (-0.0052) | 0.7201 (0.0026) | | +| ogbg-mollipo | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 0.6688 (0.0121) | 0.7396 (-0.0050) | | +| ogbg-molsider | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.5938 (0.0051) | 0.5905 (-0.0099) | | +| ogbg-molsider | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6344 (0.0071) | 0.6141 (-0.0018) | | +| ogbg-molsider | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6263 (0.0026) | 0.6096 (0.0062) | | +| ogbg-molsider | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.5862 (-0.0162) | 0.5974 (0.0076) | | +| ogbg-molsider | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6462 (0.0391) | 0.6000 (-0.0013) | | +| ogbg-molsider | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6256 (-0.0037) | 0.6117 (0.0031) | | +| ogbg-molsider | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6345 (-0.0175) | 0.6053 (0.0199) | | +| ogbg-molsider | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6046 (-0.0179) | 0.6022 (0.0274) | | +| ogbg-molsider | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6151 (-0.0176) | 0.6150 (0.0655) | | +| ogbg-molsider | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6010 (0.0089) | 0.5963 (-0.0188) | | +| ogbg-molsider | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6232 (0.0015) | 0.5861 (0.0053) | | +| ogbg-molsider | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6190 (-0.0012) | 0.5983 (0.0122) | | +| ogbg-molsider | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6058 (-0.0161) | 0.5721 (-0.0243) | | +| ogbg-molsider | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6205 (-0.0005) | 0.5960 (0.0050) | | +| ogbg-molsider | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6151 (-0.0022) | 0.6417 (0.0375) | | +| ogbg-molsider | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6410 (-0.0028) | 0.6102 (-0.0041) | | +| ogbg-molsider | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6315 (0.0156) | 0.6190 (0.0210) | | +| ogbg-moltox21 | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7280 (0.0025) | 0.7154 (-0.0005) | | +| ogbg-moltox21 | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7771 (-0.0028) | 0.7209 (-0.0014) | | +| ogbg-moltox21 | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0125) | 0.7286 (-0.0015) | | +| ogbg-moltox21 | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7727 (0.0025) | 0.7369 (0.0209) | | +| ogbg-moltox21 | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7762 (0.0135) | 0.7303 (0.0143) | | +| ogbg-moltox21 | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7588 (0.0007) | 0.7230 (0.0059) | | +| ogbg-moltox21 | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7757 (-0.0077) | 0.7312 (-0.0132) | | +| ogbg-moltox21 | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7718 (0.0028) | 0.7237 (-0.0005) | | +| ogbg-moltox21 | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7622 (-0.0122) | 0.7193 (-0.0135) | | +| ogbg-moltox21 | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7820 (-0.0011) | 0.7313 (0.0166) | | +| ogbg-moltox21 | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7697 (-0.0012) | 0.7205 (0.0009) | | +| ogbg-moltox21 | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7695 (-0.0078) | 0.7279 (-0.0002) | | +| ogbg-moltox21 | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7745 (0.0085) | 0.7349 (0.0403) | | +| ogbg-moltox21 | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7887 (-0.0064) | 0.7380 (0.0104) | | +| ogbg-moltox21 | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7506 (-0.0105) | 0.7355 (0.0115) | | +| ogbg-moltox21 | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7839 (-0.0027) | 0.7342 (-0.0074) | | +| ogbg-moltox21 | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7761 (0.0105) | 0.7292 (-0.0018) | | diff --git a/logs/ogbg-mollipo_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log b/logs/ogbg-mollipo_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log new file mode 100644 index 0000000..d6e2617 --- /dev/null +++ b/logs/ogbg-mollipo_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log @@ -0,0 +1,242 @@ +[run] ogbg-mollipo view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=1.27165 val_adapt_rmse=1.16086 adapt_steps=5.19 halt=0.18 train_steps=4.00 +ep20 val_rmse=1.51709 val_adapt_rmse=1.16539 adapt_steps=5.08 halt=0.19 train_steps=3.67 +ep30 val_rmse=3.96000 val_adapt_rmse=2.88970 adapt_steps=4.23 halt=0.21 train_steps=3.41 +ep40 val_rmse=1.45958 val_adapt_rmse=1.27486 adapt_steps=6.80 halt=0.17 train_steps=3.91 +ep50 val_rmse=1.62306 val_adapt_rmse=1.21914 adapt_steps=3.90 halt=0.21 train_steps=3.43 +ep60 val_rmse=0.96105 val_adapt_rmse=0.88005 adapt_steps=3.28 halt=0.29 train_steps=2.74 +ep70 val_rmse=0.93501 val_adapt_rmse=0.81324 adapt_steps=2.69 halt=0.29 train_steps=2.70 +ep80 val_rmse=0.92098 val_adapt_rmse=0.82825 adapt_steps=2.68 halt=0.33 train_steps=2.45 +ep90 val_rmse=0.91291 val_adapt_rmse=0.76874 adapt_steps=2.81 halt=0.36 train_steps=2.21 +ep100 val_rmse=0.88727 val_adapt_rmse=0.77048 adapt_steps=2.72 halt=0.36 train_steps=2.25 +[ogbg-mollipo_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rmse': np.float32(0.88727427)} test={'rmse': np.float32(1.0246027)} adaptive={'rmse': np.float32(0.86185706)} steps=2.5404761904761903 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-mollipo view=gine compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view gine --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=1.40935 val_adapt_rmse=1.37490 adapt_steps=6.02 halt=0.16 train_steps=3.96 +ep20 val_rmse=1.87982 val_adapt_rmse=1.47829 adapt_steps=5.06 halt=0.19 train_steps=3.73 +ep30 val_rmse=1.00892 val_adapt_rmse=0.95657 adapt_steps=4.83 halt=0.24 train_steps=3.32 +ep40 val_rmse=1.92570 val_adapt_rmse=1.26685 adapt_steps=4.02 halt=0.23 train_steps=3.29 +ep50 val_rmse=0.89318 val_adapt_rmse=0.84550 adapt_steps=4.34 halt=0.21 train_steps=3.32 +ep60 val_rmse=0.95712 val_adapt_rmse=0.82385 adapt_steps=3.63 halt=0.29 train_steps=2.75 +ep70 val_rmse=0.99810 val_adapt_rmse=0.83945 adapt_steps=3.09 halt=0.30 train_steps=2.58 +ep80 val_rmse=0.93375 val_adapt_rmse=0.78058 adapt_steps=2.90 halt=0.34 train_steps=2.41 +ep90 val_rmse=0.87733 val_adapt_rmse=0.75005 adapt_steps=2.50 halt=0.36 train_steps=2.25 +ep100 val_rmse=0.89479 val_adapt_rmse=0.75851 adapt_steps=2.63 halt=0.37 train_steps=2.22 +[ogbg-mollipo_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rmse': np.float32(0.87732804)} test={'rmse': np.float32(0.9709947)} adaptive={'rmse': np.float32(0.82210046)} steps=2.395238095238095 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-mollipo view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=1.21491 val_adapt_rmse=1.09189 adapt_steps=6.06 halt=0.20 train_steps=3.72 +ep20 val_rmse=0.94709 val_adapt_rmse=0.88665 adapt_steps=4.28 halt=0.20 train_steps=3.65 +ep30 val_rmse=1.53588 val_adapt_rmse=1.21575 adapt_steps=5.26 halt=0.23 train_steps=3.20 +ep40 val_rmse=1.16658 val_adapt_rmse=0.91900 adapt_steps=2.85 halt=0.29 train_steps=2.66 +ep50 val_rmse=1.44945 val_adapt_rmse=0.92876 adapt_steps=3.54 halt=0.28 train_steps=2.66 +ep60 val_rmse=1.13499 val_adapt_rmse=0.82488 adapt_steps=2.63 halt=0.38 train_steps=2.07 +ep70 val_rmse=0.91036 val_adapt_rmse=0.73458 adapt_steps=2.57 halt=0.41 train_steps=1.95 +ep80 val_rmse=1.03989 val_adapt_rmse=0.75262 adapt_steps=2.41 halt=0.42 train_steps=1.81 +ep90 val_rmse=0.94022 val_adapt_rmse=0.73763 adapt_steps=2.20 halt=0.44 train_steps=1.74 +ep100 val_rmse=0.93598 val_adapt_rmse=0.74143 adapt_steps=2.24 halt=0.44 train_steps=1.75 +[ogbg-mollipo_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rmse': np.float32(0.91035604)} test={'rmse': np.float32(0.9299253)} adaptive={'rmse': np.float32(0.80096245)} steps=2.4785714285714286 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-mollipo view=graphsage compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view graphsage --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=1.07418 val_adapt_rmse=0.96580 adapt_steps=5.63 halt=0.17 train_steps=4.01 +ep20 val_rmse=1.90831 val_adapt_rmse=1.30970 adapt_steps=4.28 halt=0.20 train_steps=3.73 +ep30 val_rmse=1.69953 val_adapt_rmse=1.09305 adapt_steps=3.80 halt=0.28 train_steps=2.82 +ep40 val_rmse=1.27229 val_adapt_rmse=0.92711 adapt_steps=3.40 halt=0.32 train_steps=2.51 +ep50 val_rmse=1.35372 val_adapt_rmse=0.91724 adapt_steps=2.40 halt=0.37 train_steps=2.18 +ep60 val_rmse=1.15361 val_adapt_rmse=0.77828 adapt_steps=2.54 halt=0.37 train_steps=2.12 +ep70 val_rmse=1.14055 val_adapt_rmse=0.76690 adapt_steps=2.25 halt=0.40 train_steps=1.94 +ep80 val_rmse=1.12685 val_adapt_rmse=0.76632 adapt_steps=2.16 halt=0.42 train_steps=1.82 +ep90 val_rmse=1.16042 val_adapt_rmse=0.74041 adapt_steps=2.18 halt=0.43 train_steps=1.75 +ep100 val_rmse=1.14354 val_adapt_rmse=0.74383 adapt_steps=2.17 halt=0.44 train_steps=1.72 +[ogbg-mollipo_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=10 val={'rmse': np.float32(1.0741799)} test={'rmse': np.float32(1.1165451)} adaptive={'rmse': np.float32(0.9747765)} steps=5.461904761904762 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-mollipo view=gatv2 compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view gatv2 --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=1.08473 val_adapt_rmse=1.00704 adapt_steps=4.76 halt=0.23 train_steps=3.42 +ep20 val_rmse=1.22357 val_adapt_rmse=1.10102 adapt_steps=5.70 halt=0.18 train_steps=3.84 +ep30 val_rmse=1.41681 val_adapt_rmse=1.07035 adapt_steps=3.46 halt=0.24 train_steps=3.17 +ep40 val_rmse=1.58552 val_adapt_rmse=1.03190 adapt_steps=3.37 halt=0.32 train_steps=2.55 +ep50 val_rmse=0.95944 val_adapt_rmse=0.79974 adapt_steps=4.35 halt=0.32 train_steps=2.42 +ep60 val_rmse=0.88782 val_adapt_rmse=0.74478 adapt_steps=2.66 halt=0.36 train_steps=2.22 +ep70 val_rmse=0.88373 val_adapt_rmse=0.74463 adapt_steps=2.40 halt=0.41 train_steps=1.95 +ep80 val_rmse=0.89006 val_adapt_rmse=0.73390 adapt_steps=2.38 halt=0.41 train_steps=1.89 +ep90 val_rmse=0.93277 val_adapt_rmse=0.72185 adapt_steps=2.30 halt=0.44 train_steps=1.78 +ep100 val_rmse=0.89800 val_adapt_rmse=0.71467 adapt_steps=2.27 halt=0.44 train_steps=1.75 +[ogbg-mollipo_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rmse': np.float32(0.88372606)} test={'rmse': np.float32(0.9250613)} adaptive={'rmse': np.float32(0.79357445)} steps=2.2928571428571427 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-mollipo view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=1.53265 val_adapt_rmse=1.42937 adapt_steps=6.60 halt=0.17 train_steps=3.92 +ep20 val_rmse=1.29141 val_adapt_rmse=0.99349 adapt_steps=4.15 halt=0.19 train_steps=3.62 +ep30 val_rmse=1.13429 val_adapt_rmse=0.86465 adapt_steps=3.24 halt=0.24 train_steps=3.34 +ep40 val_rmse=1.92000 val_adapt_rmse=1.25179 adapt_steps=3.38 halt=0.31 train_steps=2.61 +ep50 val_rmse=1.34785 val_adapt_rmse=0.94338 adapt_steps=3.02 halt=0.37 train_steps=2.19 +ep60 val_rmse=1.07604 val_adapt_rmse=0.77996 adapt_steps=2.36 halt=0.39 train_steps=1.97 +ep70 val_rmse=1.03247 val_adapt_rmse=0.74302 adapt_steps=2.47 halt=0.39 train_steps=1.97 +ep80 val_rmse=1.07814 val_adapt_rmse=0.77095 adapt_steps=2.34 halt=0.43 train_steps=1.78 +ep90 val_rmse=0.98119 val_adapt_rmse=0.74076 adapt_steps=2.20 halt=0.44 train_steps=1.73 +ep100 val_rmse=0.96236 val_adapt_rmse=0.73650 adapt_steps=2.20 halt=0.44 train_steps=1.71 +[ogbg-mollipo_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rmse': np.float32(0.96235555)} test={'rmse': np.float32(0.9985843)} adaptive={'rmse': np.float32(0.76624817)} steps=2.123809523809524 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-mollipo view=transformer compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view transformer --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=2.42198 val_adapt_rmse=1.36438 adapt_steps=3.38 halt=0.21 train_steps=3.54 +ep20 val_rmse=1.25519 val_adapt_rmse=0.94352 adapt_steps=3.34 halt=0.23 train_steps=3.29 +ep30 val_rmse=0.88739 val_adapt_rmse=0.77527 adapt_steps=3.58 halt=0.29 train_steps=2.79 +ep40 val_rmse=0.94143 val_adapt_rmse=0.72441 adapt_steps=2.57 halt=0.36 train_steps=2.34 +ep50 val_rmse=1.17491 val_adapt_rmse=0.78578 adapt_steps=2.60 halt=0.39 train_steps=1.98 +ep60 val_rmse=1.07281 val_adapt_rmse=0.74421 adapt_steps=2.29 halt=0.42 train_steps=1.87 +ep70 val_rmse=0.86657 val_adapt_rmse=0.73868 adapt_steps=2.39 halt=0.43 train_steps=1.77 +ep80 val_rmse=1.02592 val_adapt_rmse=0.70370 adapt_steps=2.29 halt=0.45 train_steps=1.68 +ep90 val_rmse=0.92289 val_adapt_rmse=0.68310 adapt_steps=2.12 halt=0.45 train_steps=1.67 +ep100 val_rmse=0.96157 val_adapt_rmse=0.68717 adapt_steps=2.11 halt=0.45 train_steps=1.66 +[ogbg-mollipo_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rmse': np.float32(0.8665701)} test={'rmse': np.float32(0.8929515)} adaptive={'rmse': np.float32(0.7886162)} steps=2.316666666666667 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-mollipo view=pna compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view pna --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rmse=1.28346 val_adapt_rmse=1.19172 adapt_steps=7.30 halt=0.17 train_steps=4.01 +ep20 val_rmse=1.19132 val_adapt_rmse=1.15026 adapt_steps=5.02 halt=0.16 train_steps=4.12 +ep30 val_rmse=1.24669 val_adapt_rmse=1.23446 adapt_steps=7.86 halt=0.17 train_steps=3.95 +ep40 val_rmse=1.09641 val_adapt_rmse=1.01818 adapt_steps=6.98 halt=0.17 train_steps=3.91 +ep50 val_rmse=1.74926 val_adapt_rmse=1.34685 adapt_steps=6.52 halt=0.19 train_steps=3.68 +ep60 val_rmse=1.01835 val_adapt_rmse=1.01362 adapt_steps=7.48 halt=0.19 train_steps=3.73 +ep70 val_rmse=0.91474 val_adapt_rmse=0.86541 adapt_steps=4.82 halt=0.22 train_steps=3.43 +ep80 val_rmse=1.25632 val_adapt_rmse=0.98700 adapt_steps=3.31 halt=0.29 train_steps=2.85 +ep90 val_rmse=1.07636 val_adapt_rmse=0.88479 adapt_steps=3.19 halt=0.30 train_steps=2.75 +ep100 val_rmse=0.96630 val_adapt_rmse=0.82440 adapt_steps=3.11 halt=0.32 train_steps=2.60 +[ogbg-mollipo_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rmse': np.float32(0.91474026)} test={'rmse': np.float32(0.92669034)} adaptive={'rmse': np.float32(0.87501276)} steps=4.614285714285714 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-mollipo view=gen compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view gen --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=1.86424 val_adapt_rmse=1.27606 adapt_steps=3.81 halt=0.18 train_steps=4.03 +ep20 val_rmse=1.04319 val_adapt_rmse=1.04292 adapt_steps=7.96 halt=0.22 train_steps=3.37 +ep30 val_rmse=0.92998 val_adapt_rmse=0.93388 adapt_steps=4.37 halt=0.24 train_steps=3.26 +ep40 val_rmse=1.51121 val_adapt_rmse=1.15834 adapt_steps=4.63 halt=0.23 train_steps=3.36 +ep50 val_rmse=0.96101 val_adapt_rmse=0.84809 adapt_steps=3.66 halt=0.26 train_steps=3.06 +ep60 val_rmse=1.14213 val_adapt_rmse=1.05520 adapt_steps=3.24 halt=0.28 train_steps=2.91 +ep70 val_rmse=0.93218 val_adapt_rmse=0.81774 adapt_steps=3.45 halt=0.33 train_steps=2.58 +ep80 val_rmse=0.95239 val_adapt_rmse=0.77677 adapt_steps=2.99 halt=0.35 train_steps=2.34 +ep90 val_rmse=0.93136 val_adapt_rmse=0.76093 adapt_steps=2.85 halt=0.36 train_steps=2.30 +ep100 val_rmse=0.93118 val_adapt_rmse=0.76794 adapt_steps=2.76 halt=0.36 train_steps=2.30 +[ogbg-mollipo_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rmse': np.float32(0.9299843)} test={'rmse': np.float32(0.9385538)} adaptive={'rmse': np.float32(0.9375044)} steps=4.252380952380952 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-mollipo view=film compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view film --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=1.88452 val_adapt_rmse=1.87707 adapt_steps=7.73 halt=0.15 train_steps=4.10 +ep20 val_rmse=1.09441 val_adapt_rmse=1.07942 adapt_steps=4.85 halt=0.16 train_steps=4.14 +ep30 val_rmse=1.46053 val_adapt_rmse=1.45161 adapt_steps=6.21 halt=0.18 train_steps=3.76 +ep40 val_rmse=1.06170 val_adapt_rmse=1.01696 adapt_steps=6.72 halt=0.19 train_steps=3.72 +ep50 val_rmse=1.10540 val_adapt_rmse=0.99523 adapt_steps=4.06 halt=0.22 train_steps=3.40 +ep60 val_rmse=1.28399 val_adapt_rmse=1.00615 adapt_steps=3.50 halt=0.25 train_steps=2.98 +ep70 val_rmse=0.98637 val_adapt_rmse=0.86637 adapt_steps=3.27 halt=0.28 train_steps=2.68 +ep80 val_rmse=1.05416 val_adapt_rmse=0.83985 adapt_steps=3.08 halt=0.33 train_steps=2.34 +ep90 val_rmse=1.01988 val_adapt_rmse=0.82922 adapt_steps=2.91 halt=0.34 train_steps=2.30 +ep100 val_rmse=1.01144 val_adapt_rmse=0.82713 adapt_steps=2.86 halt=0.35 train_steps=2.21 +[ogbg-mollipo_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rmse': np.float32(0.9863713)} test={'rmse': np.float32(0.97120994)} adaptive={'rmse': np.float32(0.8344992)} steps=3.211904761904762 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-mollipo view=resgated compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view resgated --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=1.34779 val_adapt_rmse=0.93483 adapt_steps=4.54 halt=0.20 train_steps=3.73 +ep20 val_rmse=1.15086 val_adapt_rmse=0.84117 adapt_steps=3.96 halt=0.23 train_steps=3.41 +ep30 val_rmse=1.08380 val_adapt_rmse=0.86139 adapt_steps=3.40 halt=0.31 train_steps=2.63 +ep40 val_rmse=1.24278 val_adapt_rmse=1.00814 adapt_steps=2.49 halt=0.35 train_steps=2.27 +ep50 val_rmse=0.85133 val_adapt_rmse=0.72631 adapt_steps=2.55 halt=0.35 train_steps=2.27 +ep60 val_rmse=0.84346 val_adapt_rmse=0.71899 adapt_steps=2.54 halt=0.39 train_steps=2.02 +ep70 val_rmse=0.83666 val_adapt_rmse=0.72927 adapt_steps=2.23 halt=0.43 train_steps=1.81 +ep80 val_rmse=0.83940 val_adapt_rmse=0.68725 adapt_steps=2.22 halt=0.45 train_steps=1.70 +ep90 val_rmse=0.86161 val_adapt_rmse=0.68760 adapt_steps=2.14 halt=0.45 train_steps=1.67 +ep100 val_rmse=0.83073 val_adapt_rmse=0.67974 adapt_steps=2.15 halt=0.46 train_steps=1.66 +[ogbg-mollipo_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rmse': np.float32(0.8307315)} test={'rmse': np.float32(0.88247204)} adaptive={'rmse': np.float32(0.7250288)} steps=2.1166666666666667 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-mollipo view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=1.43440 val_adapt_rmse=1.35579 adapt_steps=6.75 halt=0.16 train_steps=4.16 +ep20 val_rmse=1.18041 val_adapt_rmse=1.01839 adapt_steps=4.81 halt=0.23 train_steps=3.30 +ep30 val_rmse=1.33342 val_adapt_rmse=1.19676 adapt_steps=4.62 halt=0.24 train_steps=3.29 +ep40 val_rmse=1.14385 val_adapt_rmse=0.94329 adapt_steps=3.83 halt=0.30 train_steps=2.73 +ep50 val_rmse=0.98573 val_adapt_rmse=0.81495 adapt_steps=3.43 halt=0.29 train_steps=2.84 +ep60 val_rmse=1.09272 val_adapt_rmse=0.87901 adapt_steps=3.29 halt=0.35 train_steps=2.31 +ep70 val_rmse=0.98565 val_adapt_rmse=0.80267 adapt_steps=2.66 halt=0.37 train_steps=2.19 +ep80 val_rmse=0.90149 val_adapt_rmse=0.75615 adapt_steps=2.45 halt=0.38 train_steps=2.15 +ep90 val_rmse=0.86151 val_adapt_rmse=0.74536 adapt_steps=2.43 halt=0.39 train_steps=2.05 +ep100 val_rmse=0.86321 val_adapt_rmse=0.74945 adapt_steps=2.36 halt=0.40 train_steps=2.01 +[ogbg-mollipo_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rmse': np.float32(0.86150765)} test={'rmse': np.float32(0.9196055)} adaptive={'rmse': np.float32(0.80384284)} steps=2.35 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-mollipo view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=1.56494 val_adapt_rmse=1.41555 adapt_steps=7.49 halt=0.17 train_steps=3.92 +ep20 val_rmse=2.31785 val_adapt_rmse=1.61681 adapt_steps=4.02 halt=0.21 train_steps=3.49 +ep30 val_rmse=1.08211 val_adapt_rmse=1.00973 adapt_steps=3.67 halt=0.27 train_steps=3.19 +ep40 val_rmse=1.31061 val_adapt_rmse=0.94954 adapt_steps=3.96 halt=0.26 train_steps=2.95 +ep50 val_rmse=1.32023 val_adapt_rmse=0.95793 adapt_steps=3.31 halt=0.26 train_steps=2.99 +ep60 val_rmse=1.03568 val_adapt_rmse=0.85814 adapt_steps=3.84 halt=0.33 train_steps=2.48 +ep70 val_rmse=1.04043 val_adapt_rmse=0.80950 adapt_steps=2.95 halt=0.33 train_steps=2.40 +ep80 val_rmse=0.91964 val_adapt_rmse=0.75463 adapt_steps=2.46 halt=0.39 train_steps=2.06 +ep90 val_rmse=1.05229 val_adapt_rmse=0.75106 adapt_steps=2.40 halt=0.40 train_steps=1.98 +ep100 val_rmse=0.99474 val_adapt_rmse=0.76454 adapt_steps=2.36 halt=0.40 train_steps=1.96 +[ogbg-mollipo_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rmse': np.float32(0.9196411)} test={'rmse': np.float32(1.0144817)} adaptive={'rmse': np.float32(0.84780806)} steps=2.3452380952380953 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-mollipo view=cheb compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view cheb --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=1.42499 val_adapt_rmse=1.05416 adapt_steps=3.42 halt=0.19 train_steps=3.92 +ep20 val_rmse=1.07841 val_adapt_rmse=0.88516 adapt_steps=3.39 halt=0.32 train_steps=2.56 +ep30 val_rmse=1.03923 val_adapt_rmse=0.87261 adapt_steps=4.42 halt=0.31 train_steps=2.51 +ep40 val_rmse=1.21034 val_adapt_rmse=0.82150 adapt_steps=2.78 halt=0.33 train_steps=2.51 +ep50 val_rmse=1.11343 val_adapt_rmse=0.92757 adapt_steps=2.13 halt=0.42 train_steps=1.90 +ep60 val_rmse=0.96797 val_adapt_rmse=0.88460 adapt_steps=2.27 halt=0.43 train_steps=1.82 +ep70 val_rmse=0.81329 val_adapt_rmse=0.73885 adapt_steps=2.09 halt=0.44 train_steps=1.74 +ep80 val_rmse=0.79543 val_adapt_rmse=0.73836 adapt_steps=2.12 halt=0.45 train_steps=1.70 +ep90 val_rmse=0.74588 val_adapt_rmse=0.70559 adapt_steps=2.05 halt=0.46 train_steps=1.64 +ep100 val_rmse=0.75996 val_adapt_rmse=0.71414 adapt_steps=2.04 halt=0.47 train_steps=1.61 +[ogbg-mollipo_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rmse': np.float32(0.74587685)} test={'rmse': np.float32(0.80546176)} adaptive={'rmse': np.float32(0.74045366)} steps=2.033333333333333 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-mollipo view=arma compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view arma --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=108.34754 val_adapt_rmse=108.19418 adapt_steps=6.18 halt=0.21 train_steps=3.49 +ep20 val_rmse=2266.93286 val_adapt_rmse=2266.91235 adapt_steps=4.57 halt=0.23 train_steps=3.37 +ep30 val_rmse=2111.57764 val_adapt_rmse=2111.54224 adapt_steps=3.60 halt=0.26 train_steps=3.07 +ep40 val_rmse=108348.03906 val_adapt_rmse=108348.01562 adapt_steps=3.31 halt=0.31 train_steps=2.56 +ep50 val_rmse=182760.04688 val_adapt_rmse=182759.93750 adapt_steps=3.01 halt=0.35 train_steps=2.25 +ep60 val_rmse=164947.39062 val_adapt_rmse=164947.28125 adapt_steps=3.77 halt=0.34 train_steps=2.36 +ep70 val_rmse=15163.92676 val_adapt_rmse=15163.80664 adapt_steps=2.50 halt=0.41 train_steps=1.95 +ep80 val_rmse=25785.35156 val_adapt_rmse=25785.21094 adapt_steps=2.29 halt=0.40 train_steps=1.97 +ep90 val_rmse=17197.17773 val_adapt_rmse=17197.09961 adapt_steps=2.17 halt=0.44 train_steps=1.78 +ep100 val_rmse=18469.90625 val_adapt_rmse=18469.83008 adapt_steps=2.14 halt=0.44 train_steps=1.76 +[ogbg-mollipo_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=10 val={'rmse': np.float32(108.34754)} test={'rmse': np.float32(1.5814604)} adaptive={'rmse': np.float32(1.2714993)} steps=6.019047619047619 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-mollipo view=mf compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view mf --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=1.22657 val_adapt_rmse=1.19078 adapt_steps=6.04 halt=0.16 train_steps=4.01 +ep20 val_rmse=1.00560 val_adapt_rmse=0.97855 adapt_steps=4.33 halt=0.23 train_steps=3.33 +ep30 val_rmse=1.42232 val_adapt_rmse=1.00428 adapt_steps=3.31 halt=0.28 train_steps=2.89 +ep40 val_rmse=1.33162 val_adapt_rmse=0.99679 adapt_steps=3.43 halt=0.32 train_steps=2.59 +ep50 val_rmse=1.29004 val_adapt_rmse=0.84554 adapt_steps=3.06 halt=0.35 train_steps=2.23 +ep60 val_rmse=1.26334 val_adapt_rmse=0.87993 adapt_steps=2.58 halt=0.40 train_steps=2.00 +ep70 val_rmse=1.29285 val_adapt_rmse=0.77047 adapt_steps=2.37 halt=0.41 train_steps=1.92 +ep80 val_rmse=1.30170 val_adapt_rmse=0.73633 adapt_steps=2.18 halt=0.42 train_steps=1.83 +ep90 val_rmse=1.13537 val_adapt_rmse=0.75800 adapt_steps=2.15 halt=0.44 train_steps=1.74 +ep100 val_rmse=1.07797 val_adapt_rmse=0.75675 adapt_steps=2.15 halt=0.44 train_steps=1.75 +[ogbg-mollipo_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=20 val={'rmse': np.float32(1.005599)} test={'rmse': np.float32(0.98203164)} adaptive={'rmse': np.float32(0.9414124)} steps=4.321428571428571 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-mollipo view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-mollipo --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rmse=1.16326 val_adapt_rmse=1.09274 adapt_steps=5.73 halt=0.21 train_steps=3.61 +ep20 val_rmse=2.63258 val_adapt_rmse=1.56333 adapt_steps=4.45 halt=0.24 train_steps=3.16 +ep30 val_rmse=1.78657 val_adapt_rmse=1.24891 adapt_steps=4.25 halt=0.27 train_steps=3.00 +ep40 val_rmse=1.38779 val_adapt_rmse=1.02154 adapt_steps=2.87 halt=0.32 train_steps=2.53 +ep50 val_rmse=1.18581 val_adapt_rmse=0.83394 adapt_steps=2.96 halt=0.34 train_steps=2.37 +ep60 val_rmse=1.45301 val_adapt_rmse=0.94618 adapt_steps=2.93 halt=0.35 train_steps=2.25 +ep70 val_rmse=1.13892 val_adapt_rmse=0.85011 adapt_steps=2.33 halt=0.43 train_steps=1.82 +ep80 val_rmse=1.14148 val_adapt_rmse=0.83007 adapt_steps=2.34 halt=0.43 train_steps=1.77 +ep90 val_rmse=1.20479 val_adapt_rmse=0.82034 adapt_steps=2.19 halt=0.46 train_steps=1.65 +ep100 val_rmse=1.18848 val_adapt_rmse=0.81683 adapt_steps=2.25 halt=0.45 train_steps=1.66 +[ogbg-mollipo_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rmse': np.float32(1.1389227)} test={'rmse': np.float32(1.0732719)} adaptive={'rmse': np.float32(0.83319956)} steps=2.2404761904761905 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-mollipo_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json diff --git a/logs/ogbg-molsider_0.log b/logs/ogbg-molsider_0.log new file mode 100644 index 0000000..0b371dd --- /dev/null +++ b/logs/ogbg-molsider_0.log @@ -0,0 +1,791 @@ +[run] ogbg-molsider view=gin compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gin --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/sider.zip +
0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 1028.52it/s] +Processing... +Extracting /orion/u/oscarwan/rrog-gnn-runner/data/ogb/sider.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/1427 [00:00<?, ?it/s]
100%|██████████| 1427/1427 [00:00<00:00, 150127.22it/s] +Converting graphs into PyG objects... +
0%| | 0/1427 [00:00<?, ?it/s]
100%|██████████| 1427/1427 [00:00<00:00, 92956.32it/s] +Done! +Saving... +ep10 val_rocauc=0.59998 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.59649 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.60635 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.60066 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.62251 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.59834 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.61516 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.61770 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.61353 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.61284 halt=0.00 train_steps=1.00 +[ogbg-molsider_gin_classic_T0_ns1_h128_e100_s0] best_ep=50 val={'rocauc': 0.6225119550298882} test={'rocauc': 0.5748427490288601} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_gin_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molsider view=gin compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gin --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.55926 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.57865 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.59569 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.60464 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.60342 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.60306 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.59942 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.59515 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.59567 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.59471 halt=0.00 train_steps=3.00 +[ogbg-molsider_gin_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.6046415841313262} test={'rocauc': 0.6022262654061706} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_gin_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molsider view=gine compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gine --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.57210 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.60097 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.63266 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.60286 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.63200 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.61688 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.61584 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.61124 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.61384 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.61372 halt=0.00 train_steps=1.00 +[ogbg-molsider_gine_classic_T0_ns1_h128_e100_s0] best_ep=30 val={'rocauc': 0.6326628393175155} test={'rocauc': 0.5494595931506057} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_gine_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molsider view=gine compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gine --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.57630 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.57665 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.61413 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.60975 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.60021 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.60710 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.61292 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.61510 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.61014 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.61216 halt=0.00 train_steps=3.00 +[ogbg-molsider_gine_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=80 val={'rocauc': 0.6151020149803161} test={'rocauc': 0.6150033205476824} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_gine_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molsider view=gcn compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gcn --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.61091 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.61064 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.61573 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.61813 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.62650 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.62929 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.62581 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.62136 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.62459 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.62346 halt=0.00 train_steps=1.00 +[ogbg-molsider_gcn_classic_T0_ns1_h128_e100_s0] best_ep=60 val={'rocauc': 0.6292912980815916} test={'rocauc': 0.6086409341357526} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_gcn_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molsider view=gcn compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gcn --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.60191 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.61249 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.61906 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.62066 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.62557 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.61451 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.60594 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.59722 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.59952 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.59795 halt=0.00 train_steps=3.00 +[ogbg-molsider_gcn_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rocauc': 0.6255728102145075} test={'rocauc': 0.6117391432513807} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molsider view=graphsage compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view graphsage --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.58674 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.58094 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.60485 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.61084 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.61680 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.61895 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.62174 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.61558 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.61656 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.61703 halt=0.00 train_steps=1.00 +[ogbg-molsider_graphsage_classic_T0_ns1_h128_e100_s0] best_ep=70 val={'rocauc': 0.621744356636161} test={'rocauc': 0.5807259430259354} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_graphsage_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molsider view=graphsage compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view graphsage --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.56277 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.59348 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.61719 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.61687 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.61698 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.61652 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.62323 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.61811 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.62049 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.62090 halt=0.00 train_steps=3.00 +[ogbg-molsider_graphsage_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=70 val={'rocauc': 0.62323063286361} test={'rocauc': 0.5860528009903617} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molsider view=gatv2 compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gatv2 --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.58304 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.57852 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.59416 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.59244 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.60712 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.60425 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.59828 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.60123 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.59888 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.59847 halt=0.00 train_steps=1.00 +[ogbg-molsider_gatv2_classic_T0_ns1_h128_e100_s0] best_ep=50 val={'rocauc': 0.6071193037623003} test={'rocauc': 0.6013146804327355} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_gatv2_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molsider view=gatv2 compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gatv2 --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.60054 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.64196 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.64053 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.62910 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.64482 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.63459 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.64623 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.64575 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.64370 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.64299 halt=0.00 train_steps=3.00 +[ogbg-molsider_gatv2_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=70 val={'rocauc': 0.6462276348941932} test={'rocauc': 0.6000090607166413} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molsider view=graphconv compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view graphconv --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.55570 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.56965 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.58316 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.58130 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.59132 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.58874 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.59208 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.59036 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.59140 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.59058 halt=0.00 train_steps=1.00 +[ogbg-molsider_graphconv_classic_T0_ns1_h128_e100_s0] best_ep=70 val={'rocauc': 0.5920839065175088} test={'rocauc': 0.6151152605717433} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_graphconv_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molsider view=graphconv compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view graphconv --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.58918 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.58796 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.56951 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.59408 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.60103 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.59308 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.59720 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.60063 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.59957 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.59797 halt=0.00 train_steps=3.00 +[ogbg-molsider_graphconv_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rocauc': 0.6010260045148574} test={'rocauc': 0.5962935439480032} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molsider view=transformer compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view transformer --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.58334 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.59636 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.59459 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.60645 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.61370 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.61596 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.61576 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.61199 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.61222 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.61204 halt=0.00 train_steps=1.00 +[ogbg-molsider_transformer_classic_T0_ns1_h128_e100_s0] best_ep=60 val={'rocauc': 0.6159576666835939} test={'rocauc': 0.5979944408282211} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_transformer_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molsider view=transformer compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view transformer --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.56667 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.61114 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.63153 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.62209 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.62301 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.62593 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.63126 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.62696 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.62548 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.62739 halt=0.00 train_steps=3.00 +[ogbg-molsider_transformer_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.6315255937485902} test={'rocauc': 0.6190391448308609} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molsider view=pna compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view pna --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.55982 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.59234 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.61111 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.58299 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.60685 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.62185 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.60470 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.61194 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.61402 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.61464 halt=0.00 train_steps=1.00 +[ogbg-molsider_pna_classic_T0_ns1_h128_e100_s0] best_ep=60 val={'rocauc': 0.6218537848171463} test={'rocauc': 0.5964761418261523} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_pna_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molsider view=pna compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view pna --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.54779 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.60243 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.58203 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.60096 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.59878 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.60578 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.58584 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.58530 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.58392 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.58777 halt=0.00 train_steps=3.00 +[ogbg-molsider_pna_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=60 val={'rocauc': 0.6057840094519997} test={'rocauc': 0.5721280929989979} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_pna_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molsider view=gen compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gen --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.60840 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.63552 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.63952 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.62215 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.64615 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.65194 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.63873 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.63856 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.63452 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.63538 halt=0.00 train_steps=1.00 +[ogbg-molsider_gen_classic_T0_ns1_h128_e100_s0] best_ep=60 val={'rocauc': 0.6519400080762945} test={'rocauc': 0.5853709823208472} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_gen_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molsider view=gen compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gen --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.59093 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.62954 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.63446 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.60170 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.62382 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.62117 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.62097 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.61863 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.62028 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.61721 halt=0.00 train_steps=3.00 +[ogbg-molsider_gen_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.634456224198147} test={'rocauc': 0.6052572461025753} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_gen_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molsider view=film compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view film --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.56261 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.59192 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.57198 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.60244 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.59915 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.59471 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.59074 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.58910 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.58985 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.58862 halt=0.00 train_steps=1.00 +[ogbg-molsider_film_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rocauc': 0.6024369569728498} test={'rocauc': 0.5898473664808705} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_film_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molsider view=film compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view film --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.51731 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.52320 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.53502 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.56129 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.56964 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.56673 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.57611 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.58625 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.58365 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.58428 halt=0.00 train_steps=3.00 +[ogbg-molsider_film_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=80 val={'rocauc': 0.5862480936504801} test={'rocauc': 0.5974246609585021} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_film_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molsider view=resgated compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view resgated --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.58052 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.58176 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.61682 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.62095 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.61876 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.61691 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.60859 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.61184 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.61061 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.61120 halt=0.00 train_steps=1.00 +[ogbg-molsider_resgated_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rocauc': 0.6209450264359846} test={'rocauc': 0.5910349402024013} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_resgated_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molsider view=resgated compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view resgated --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.57253 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.59538 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.58400 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.59174 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.60608 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.61153 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.62045 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.61194 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.61006 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.61185 halt=0.00 train_steps=3.00 +[ogbg-molsider_resgated_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=70 val={'rocauc': 0.6204543981100222} test={'rocauc': 0.5960257361986486} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molsider view=tag compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view tag --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.60321 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.59623 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.61421 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.60999 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.62420 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.64385 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.63472 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.63479 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.63731 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.63690 halt=0.00 train_steps=1.00 +[ogbg-molsider_tag_classic_T0_ns1_h128_e100_s0] best_ep=60 val={'rocauc': 0.6438543175768482} test={'rocauc': 0.6143146363395369} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_tag_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molsider view=tag compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view tag --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.59832 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.60583 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.64103 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.62028 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.60728 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.59256 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.61016 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.61088 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.60864 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.60813 halt=0.00 train_steps=3.00 +[ogbg-molsider_tag_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.6410300955419639} test={'rocauc': 0.6101942928754263} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_tag_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molsider view=sgc compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view sgc --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.59227 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.61737 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.61472 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.59858 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.60533 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.60972 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.60069 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.59499 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.59580 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.59745 halt=0.00 train_steps=1.00 +[ogbg-molsider_sgc_classic_T0_ns1_h128_e100_s0] best_ep=20 val={'rocauc': 0.6173711459877224} test={'rocauc': 0.6042590538050838} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_sgc_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molsider view=sgc compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view sgc --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.61330 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.61513 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.61384 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.57702 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.57664 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.58877 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.59580 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.58773 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.59049 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.58891 halt=0.00 train_steps=3.00 +[ogbg-molsider_sgc_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=20 val={'rocauc': 0.6151272572948054} test={'rocauc': 0.6417135077812745} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molsider view=cheb compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view cheb --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.60224 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.62375 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.60603 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.61966 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.61314 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.61864 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.61346 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.61142 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.61044 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.60962 halt=0.00 train_steps=1.00 +[ogbg-molsider_cheb_classic_T0_ns1_h128_e100_s0] best_ep=20 val={'rocauc': 0.6237482002412537} test={'rocauc': 0.6033376509930031} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_cheb_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molsider view=cheb compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view cheb --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.61499 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.60610 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.62630 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.61510 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.61589 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.61747 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.61544 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.61255 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.61285 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.61380 halt=0.00 train_steps=3.00 +[ogbg-molsider_cheb_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.626299014853098} test={'rocauc': 0.609583177772403} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molsider view=arma compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view arma --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.59751 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.61701 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.61715 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.61968 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.61175 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.61134 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.62727 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.62541 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.62276 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.62386 halt=0.00 train_steps=1.00 +[ogbg-molsider_arma_classic_T0_ns1_h128_e100_s0] best_ep=70 val={'rocauc': 0.627268343131736} test={'rocauc': 0.6158698228431547} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_arma_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molsider view=arma compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view arma --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.63436 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.63097 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.61695 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.61548 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.62918 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.61098 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.62615 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.61707 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.61543 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.61589 halt=0.00 train_steps=3.00 +[ogbg-molsider_arma_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=10 val={'rocauc': 0.634361816858312} test={'rocauc': 0.6140829013811058} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_arma_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molsider view=mf compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view mf --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.59801 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.60524 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.61935 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.61784 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.62023 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.61158 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.60329 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.60474 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.60661 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.60496 halt=0.00 train_steps=1.00 +[ogbg-molsider_mf_classic_T0_ns1_h128_e100_s0] best_ep=50 val={'rocauc': 0.6202255900567958} test={'rocauc': 0.586091595334005} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_mf_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molsider view=mf compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view mf --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.61285 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.61899 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.59711 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.59241 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.59907 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.59999 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.60594 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.61000 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.60699 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.60725 halt=0.00 train_steps=3.00 +[ogbg-molsider_mf_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=20 val={'rocauc': 0.6189914567323086} test={'rocauc': 0.598312638550014} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_mf_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-molsider view=appnp compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view appnp --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.53840 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.56523 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.57212 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.58346 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.58830 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.58548 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.58753 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.58862 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.58825 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.58828 halt=0.00 train_steps=1.00 +[ogbg-molsider_appnp_classic_T0_ns1_h128_e100_s0] best_ep=80 val={'rocauc': 0.5886184927786781} test={'rocauc': 0.6003864841212386} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_appnp_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-molsider view=appnp compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view appnp --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.54410 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.56171 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.58622 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.59376 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.58304 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.58067 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.57910 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.57938 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.57906 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.58071 halt=0.00 train_steps=3.00 +[ogbg-molsider_appnp_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=40 val={'rocauc': 0.5937589012949048} test={'rocauc': 0.5905116380584287} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json + +Classic baseline: task x backbone +| task | backbone | metric | n | val | test | +| --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | rocauc | 1 | 0.6564 +/- 0.0000 | 0.7423 +/- 0.0000 | +| ogbg-molbace | arma | rocauc | 1 | 0.6923 +/- 0.0000 | 0.7839 +/- 0.0000 | +| ogbg-molbace | cheb | rocauc | 1 | 0.7267 +/- 0.0000 | 0.7969 +/- 0.0000 | +| ogbg-molbace | film | rocauc | 1 | 0.6703 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molbace | gatv2 | rocauc | 1 | 0.7029 +/- 0.0000 | 0.7400 +/- 0.0000 | +| ogbg-molbace | gcn | rocauc | 1 | 0.6381 +/- 0.0000 | 0.7393 +/- 0.0000 | +| ogbg-molbace | gen | rocauc | 1 | 0.7128 +/- 0.0000 | 0.7326 +/- 0.0000 | +| ogbg-molbace | gin | rocauc | 1 | 0.6520 +/- 0.0000 | 0.7336 +/- 0.0000 | +| ogbg-molbace | gine | rocauc | 1 | 0.6641 +/- 0.0000 | 0.7454 +/- 0.0000 | +| ogbg-molbace | graphconv | rocauc | 1 | 0.7311 +/- 0.0000 | 0.8035 +/- 0.0000 | +| ogbg-molbace | graphsage | rocauc | 1 | 0.6758 +/- 0.0000 | 0.7759 +/- 0.0000 | +| ogbg-molbace | mf | rocauc | 1 | 0.7421 +/- 0.0000 | 0.7760 +/- 0.0000 | +| ogbg-molbace | pna | rocauc | 1 | 0.7516 +/- 0.0000 | 0.6912 +/- 0.0000 | +| ogbg-molbace | resgated | rocauc | 1 | 0.7172 +/- 0.0000 | 0.7877 +/- 0.0000 | +| ogbg-molbace | sgc | rocauc | 1 | 0.6575 +/- 0.0000 | 0.6966 +/- 0.0000 | +| ogbg-molbace | tag | rocauc | 1 | 0.7084 +/- 0.0000 | 0.7345 +/- 0.0000 | +| ogbg-molbace | transformer | rocauc | 1 | 0.6663 +/- 0.0000 | 0.7364 +/- 0.0000 | +| ogbg-molbbbp | appnp | rocauc | 1 | 0.9147 +/- 0.0000 | 0.6388 +/- 0.0000 | +| ogbg-molbbbp | arma | rocauc | 1 | 0.9367 +/- 0.0000 | 0.6651 +/- 0.0000 | +| ogbg-molbbbp | cheb | rocauc | 1 | 0.9452 +/- 0.0000 | 0.6514 +/- 0.0000 | +| ogbg-molbbbp | film | rocauc | 1 | 0.9285 +/- 0.0000 | 0.6300 +/- 0.0000 | +| ogbg-molbbbp | gatv2 | rocauc | 1 | 0.9347 +/- 0.0000 | 0.6324 +/- 0.0000 | +| ogbg-molbbbp | gcn | rocauc | 1 | 0.9386 +/- 0.0000 | 0.6679 +/- 0.0000 | +| ogbg-molbbbp | gen | rocauc | 1 | 0.9549 +/- 0.0000 | 0.6775 +/- 0.0000 | +| ogbg-molbbbp | gin | rocauc | 1 | 0.9251 +/- 0.0000 | 0.5670 +/- 0.0000 | +| ogbg-molbbbp | gine | rocauc | 1 | 0.9324 +/- 0.0000 | 0.6160 +/- 0.0000 | +| ogbg-molbbbp | graphconv | rocauc | 1 | 0.9268 +/- 0.0000 | 0.5900 +/- 0.0000 | +| ogbg-molbbbp | graphsage | rocauc | 1 | 0.9483 +/- 0.0000 | 0.6288 +/- 0.0000 | +| ogbg-molbbbp | mf | rocauc | 1 | 0.9395 +/- 0.0000 | 0.6365 +/- 0.0000 | +| ogbg-molbbbp | pna | rocauc | 1 | 0.9554 +/- 0.0000 | 0.6418 +/- 0.0000 | +| ogbg-molbbbp | resgated | rocauc | 1 | 0.9183 +/- 0.0000 | 0.6626 +/- 0.0000 | +| ogbg-molbbbp | sgc | rocauc | 1 | 0.9300 +/- 0.0000 | 0.6239 +/- 0.0000 | +| ogbg-molbbbp | tag | rocauc | 1 | 0.9476 +/- 0.0000 | 0.6100 +/- 0.0000 | +| ogbg-molbbbp | transformer | rocauc | 1 | 0.9495 +/- 0.0000 | 0.6156 +/- 0.0000 | +| ogbg-molclintox | appnp | rocauc | 1 | 0.8516 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | arma | rocauc | 1 | 0.9463 +/- 0.0000 | 0.8678 +/- 0.0000 | +| ogbg-molclintox | cheb | rocauc | 1 | 0.8928 +/- 0.0000 | 0.9152 +/- 0.0000 | +| ogbg-molclintox | film | rocauc | 1 | 0.9048 +/- 0.0000 | 0.7731 +/- 0.0000 | +| ogbg-molclintox | gatv2 | rocauc | 1 | 0.9515 +/- 0.0000 | 0.8493 +/- 0.0000 | +| ogbg-molclintox | gcn | rocauc | 1 | 0.9318 +/- 0.0000 | 0.8932 +/- 0.0000 | +| ogbg-molclintox | gen | rocauc | 1 | 0.9820 +/- 0.0000 | 0.8128 +/- 0.0000 | +| ogbg-molclintox | gin | rocauc | 1 | 0.9547 +/- 0.0000 | 0.8586 +/- 0.0000 | +| ogbg-molclintox | gine | rocauc | 1 | 0.9353 +/- 0.0000 | 0.8869 +/- 0.0000 | +| ogbg-molclintox | graphconv | rocauc | 1 | 0.8917 +/- 0.0000 | 0.8501 +/- 0.0000 | +| ogbg-molclintox | graphsage | rocauc | 1 | 0.9143 +/- 0.0000 | 0.8882 +/- 0.0000 | +| ogbg-molclintox | mf | rocauc | 1 | 0.9252 +/- 0.0000 | 0.8370 +/- 0.0000 | +| ogbg-molclintox | pna | rocauc | 1 | 0.9286 +/- 0.0000 | 0.8603 +/- 0.0000 | +| ogbg-molclintox | resgated | rocauc | 1 | 0.9244 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | sgc | rocauc | 1 | 0.9195 +/- 0.0000 | 0.8986 +/- 0.0000 | +| ogbg-molclintox | tag | rocauc | 1 | 0.9237 +/- 0.0000 | 0.7998 +/- 0.0000 | +| ogbg-molclintox | transformer | rocauc | 1 | 0.9271 +/- 0.0000 | 0.8764 +/- 0.0000 | +| ogbg-molhiv | appnp | rocauc | 1 | 0.7675 +/- 0.0000 | 0.7000 +/- 0.0000 | +| ogbg-molhiv | arma | rocauc | 1 | 0.7872 +/- 0.0000 | 0.7296 +/- 0.0000 | +| ogbg-molhiv | cheb | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7282 +/- 0.0000 | +| ogbg-molhiv | film | rocauc | 1 | 0.7922 +/- 0.0000 | 0.7842 +/- 0.0000 | +| ogbg-molhiv | gatv2 | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7563 +/- 0.0000 | +| ogbg-molhiv | gcn | rocauc | 1 | 0.7754 +/- 0.0000 | 0.7198 +/- 0.0000 | +| ogbg-molhiv | gen | rocauc | 1 | 0.7530 +/- 0.0000 | 0.7314 +/- 0.0000 | +| ogbg-molhiv | gin | rocauc | 1 | 0.8167 +/- 0.0000 | 0.7724 +/- 0.0000 | +| ogbg-molhiv | gine | rocauc | 1 | 0.7942 +/- 0.0000 | 0.7445 +/- 0.0000 | +| ogbg-molhiv | graphconv | rocauc | 1 | 0.7707 +/- 0.0000 | 0.7108 +/- 0.0000 | +| ogbg-molhiv | graphsage | rocauc | 1 | 0.7969 +/- 0.0000 | 0.7625 +/- 0.0000 | +| ogbg-molhiv | mf | rocauc | 1 | 0.7845 +/- 0.0000 | 0.7074 +/- 0.0000 | +| ogbg-molhiv | pna | rocauc | 1 | 0.7780 +/- 0.0000 | 0.7648 +/- 0.0000 | +| ogbg-molhiv | resgated | rocauc | 1 | 0.8144 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molhiv | sgc | rocauc | 1 | 0.7479 +/- 0.0000 | 0.7019 +/- 0.0000 | +| ogbg-molhiv | tag | rocauc | 1 | 0.7528 +/- 0.0000 | 0.7255 +/- 0.0000 | +| ogbg-molhiv | transformer | rocauc | 1 | 0.7617 +/- 0.0000 | 0.7547 +/- 0.0000 | +| ogbg-molsider | appnp | rocauc | 1 | 0.5886 +/- 0.0000 | 0.6004 +/- 0.0000 | +| ogbg-molsider | arma | rocauc | 1 | 0.6273 +/- 0.0000 | 0.6159 +/- 0.0000 | +| ogbg-molsider | cheb | rocauc | 1 | 0.6237 +/- 0.0000 | 0.6033 +/- 0.0000 | +| ogbg-molsider | film | rocauc | 1 | 0.6024 +/- 0.0000 | 0.5898 +/- 0.0000 | +| ogbg-molsider | gatv2 | rocauc | 1 | 0.6071 +/- 0.0000 | 0.6013 +/- 0.0000 | +| ogbg-molsider | gcn | rocauc | 1 | 0.6293 +/- 0.0000 | 0.6086 +/- 0.0000 | +| ogbg-molsider | gen | rocauc | 1 | 0.6519 +/- 0.0000 | 0.5854 +/- 0.0000 | +| ogbg-molsider | gin | rocauc | 1 | 0.6225 +/- 0.0000 | 0.5748 +/- 0.0000 | +| ogbg-molsider | gine | rocauc | 1 | 0.6327 +/- 0.0000 | 0.5495 +/- 0.0000 | +| ogbg-molsider | graphconv | rocauc | 1 | 0.5921 +/- 0.0000 | 0.6151 +/- 0.0000 | +| ogbg-molsider | graphsage | rocauc | 1 | 0.6217 +/- 0.0000 | 0.5807 +/- 0.0000 | +| ogbg-molsider | mf | rocauc | 1 | 0.6202 +/- 0.0000 | 0.5861 +/- 0.0000 | +| ogbg-molsider | pna | rocauc | 1 | 0.6219 +/- 0.0000 | 0.5965 +/- 0.0000 | +| ogbg-molsider | resgated | rocauc | 1 | 0.6209 +/- 0.0000 | 0.5910 +/- 0.0000 | +| ogbg-molsider | sgc | rocauc | 1 | 0.6174 +/- 0.0000 | 0.6043 +/- 0.0000 | +| ogbg-molsider | tag | rocauc | 1 | 0.6439 +/- 0.0000 | 0.6143 +/- 0.0000 | +| ogbg-molsider | transformer | rocauc | 1 | 0.6160 +/- 0.0000 | 0.5980 +/- 0.0000 | +| ogbg-moltox21 | appnp | rocauc | 1 | 0.7255 +/- 0.0000 | 0.7158 +/- 0.0000 | +| ogbg-moltox21 | arma | rocauc | 1 | 0.7799 +/- 0.0000 | 0.7223 +/- 0.0000 | +| ogbg-moltox21 | cheb | rocauc | 1 | 0.7834 +/- 0.0000 | 0.7301 +/- 0.0000 | +| ogbg-moltox21 | film | rocauc | 1 | 0.7702 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gatv2 | rocauc | 1 | 0.7627 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gcn | rocauc | 1 | 0.7580 +/- 0.0000 | 0.7171 +/- 0.0000 | +| ogbg-moltox21 | gen | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7444 +/- 0.0000 | +| ogbg-moltox21 | gin | rocauc | 1 | 0.7690 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-moltox21 | gine | rocauc | 1 | 0.7744 +/- 0.0000 | 0.7328 +/- 0.0000 | +| ogbg-moltox21 | graphconv | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7147 +/- 0.0000 | +| ogbg-moltox21 | graphsage | rocauc | 1 | 0.7709 +/- 0.0000 | 0.7196 +/- 0.0000 | +| ogbg-moltox21 | mf | rocauc | 1 | 0.7773 +/- 0.0000 | 0.7281 +/- 0.0000 | +| ogbg-moltox21 | pna | rocauc | 1 | 0.7660 +/- 0.0000 | 0.6946 +/- 0.0000 | +| ogbg-moltox21 | resgated | rocauc | 1 | 0.7950 +/- 0.0000 | 0.7275 +/- 0.0000 | +| ogbg-moltox21 | sgc | rocauc | 1 | 0.7611 +/- 0.0000 | 0.7240 +/- 0.0000 | +| ogbg-moltox21 | tag | rocauc | 1 | 0.7866 +/- 0.0000 | 0.7416 +/- 0.0000 | +| ogbg-moltox21 | transformer | rocauc | 1 | 0.7656 +/- 0.0000 | 0.7309 +/- 0.0000 | + +Delta vs matching classic +| task | backbone | compute | metric | n | val score (delta) | test score (delta) | steps | +| --- | --- | --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7168 (0.0604) | 0.7209 (-0.0214) | | +| ogbg-molbace | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7179 (0.0256) | 0.7672 (-0.0167) | | +| ogbg-molbace | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7114 (-0.0154) | 0.7533 (-0.0436) | | +| ogbg-molbace | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6652 (-0.0051) | 0.7242 (0.0000) | | +| ogbg-molbace | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7026 (-0.0004) | 0.7519 (0.0118) | | +| ogbg-molbace | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6374 (-0.0007) | 0.7733 (0.0339) | | +| ogbg-molbace | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6894 (-0.0234) | 0.7449 (0.0123) | | +| ogbg-molbace | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6538 (0.0018) | 0.7169 (-0.0167) | | +| ogbg-molbace | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6685 (0.0044) | 0.6994 (-0.0461) | | +| ogbg-molbace | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7462 (0.0150) | 0.7983 (-0.0052) | | +| ogbg-molbace | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6703 (-0.0055) | 0.7119 (-0.0640) | | +| ogbg-molbace | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7234 (-0.0187) | 0.7684 (-0.0077) | | +| ogbg-molbace | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7037 (-0.0480) | 0.7967 (0.1055) | | +| ogbg-molbace | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6912 (-0.0260) | 0.7465 (-0.0412) | | +| ogbg-molbace | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6454 (-0.0121) | 0.7727 (0.0762) | | +| ogbg-molbace | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7355 (0.0271) | 0.6806 (-0.0539) | | +| ogbg-molbace | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6982 (0.0319) | 0.7487 (0.0123) | | +| ogbg-molbbbp | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9360 (0.0213) | 0.6073 (-0.0314) | | +| ogbg-molbbbp | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9415 (0.0048) | 0.6635 (-0.0016) | | +| ogbg-molbbbp | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9278 (-0.0174) | 0.6659 (0.0145) | | +| ogbg-molbbbp | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9400 (0.0115) | 0.6323 (0.0023) | | +| ogbg-molbbbp | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9356 (0.0009) | 0.6560 (0.0235) | | +| ogbg-molbbbp | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9417 (0.0031) | 0.6017 (-0.0663) | | +| ogbg-molbbbp | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9429 (-0.0119) | 0.6037 (-0.0738) | | +| ogbg-molbbbp | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9526 (0.0275) | 0.5932 (0.0261) | | +| ogbg-molbbbp | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9421 (0.0098) | 0.6976 (0.0816) | | +| ogbg-molbbbp | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9337 (0.0069) | 0.6518 (0.0618) | | +| ogbg-molbbbp | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9502 (0.0019) | 0.5934 (-0.0354) | | +| ogbg-molbbbp | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9488 (0.0094) | 0.6481 (0.0116) | | +| ogbg-molbbbp | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9585 (0.0031) | 0.6682 (0.0264) | | +| ogbg-molbbbp | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9535 (0.0352) | 0.5839 (-0.0787) | | +| ogbg-molbbbp | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9285 (-0.0015) | 0.6454 (0.0215) | | +| ogbg-molbbbp | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9459 (-0.0017) | 0.6420 (0.0320) | | +| ogbg-molbbbp | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9355 (-0.0140) | 0.6221 (0.0065) | | +| ogbg-molclintox | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9029 (0.0513) | 0.8898 (-0.0286) | | +| ogbg-molclintox | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9135 (-0.0328) | 0.8863 (0.0185) | | +| ogbg-molclintox | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8816 (-0.0112) | 0.8982 (-0.0170) | | +| ogbg-molclintox | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9454 (0.0406) | 0.8430 (0.0699) | | +| ogbg-molclintox | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9351 (-0.0164) | 0.8328 (-0.0164) | | +| ogbg-molclintox | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9097 (-0.0221) | 0.8792 (-0.0140) | | +| ogbg-molclintox | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9399 (-0.0421) | 0.8194 (0.0066) | | +| ogbg-molclintox | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9164 (-0.0383) | 0.8788 (0.0202) | | +| ogbg-molclintox | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9225 (-0.0127) | 0.8840 (-0.0030) | | +| ogbg-molclintox | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8494 (-0.0424) | 0.8186 (-0.0316) | | +| ogbg-molclintox | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9579 (0.0436) | 0.8664 (-0.0217) | | +| ogbg-molclintox | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9147 (-0.0104) | 0.8047 (-0.0323) | | +| ogbg-molclintox | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9064 (-0.0222) | 0.8735 (0.0132) | | +| ogbg-molclintox | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9055 (-0.0188) | 0.8979 (-0.0205) | | +| ogbg-molclintox | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9220 (0.0025) | 0.9054 (0.0068) | | +| ogbg-molclintox | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9183 (-0.0054) | 0.8433 (0.0435) | | +| ogbg-molclintox | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9322 (0.0051) | 0.8522 (-0.0242) | | +| ogbg-molhiv | appnp | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7203 (-0.0471) | 0.6825 (-0.0175) | | +| ogbg-molhiv | arma | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7926 (0.0054) | 0.7318 (0.0021) | | +| ogbg-molhiv | cheb | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7735 (-0.0096) | 0.7426 (0.0144) | | +| ogbg-molhiv | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8251 (0.0330) | 0.7725 (-0.0117) | | +| ogbg-molhiv | film | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7633 (-0.0288) | 0.7728 (-0.0114) | | +| ogbg-molhiv | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8049 (0.0214) | 0.7486 (-0.0077) | | +| ogbg-molhiv | gatv2 | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7835 (0.0001) | 0.7466 (-0.0096) | | +| ogbg-molhiv | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7833 (0.0079) | 0.7448 (0.0250) | | +| ogbg-molhiv | gcn | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7455 (-0.0300) | 0.7483 (0.0285) | | +| ogbg-molhiv | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7740 (0.0210) | 0.7590 (0.0276) | | +| ogbg-molhiv | gen | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8128 (0.0598) | 0.7631 (0.0318) | | +| ogbg-molhiv | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0457) | 0.7668 (-0.0056) | | +| ogbg-molhiv | gin | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7524 (-0.0644) | 0.7324 (-0.0400) | | +| ogbg-molhiv | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7490 (-0.0453) | 0.7376 (-0.0070) | | +| ogbg-molhiv | gine | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7575 (-0.0368) | 0.7401 (-0.0044) | | +| ogbg-molhiv | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7817 (0.0110) | 0.7493 (0.0385) | | +| ogbg-molhiv | graphconv | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7713 (0.0006) | 0.6979 (-0.0129) | | +| ogbg-molhiv | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7893 (-0.0075) | 0.7633 (0.0008) | | +| ogbg-molhiv | graphsage | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7587 (-0.0382) | 0.7641 (0.0016) | | +| ogbg-molhiv | mf | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7931 (0.0085) | 0.7217 (0.0143) | | +| ogbg-molhiv | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8097 (0.0317) | 0.7602 (-0.0046) | | +| ogbg-molhiv | pna | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7890 (0.0111) | 0.7630 (-0.0018) | | +| ogbg-molhiv | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7923 (-0.0221) | 0.7227 (-0.0015) | | +| ogbg-molhiv | resgated | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8174 (0.0030) | 0.7055 (-0.0187) | | +| ogbg-molhiv | sgc | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7482 (0.0003) | 0.7177 (0.0158) | | +| ogbg-molhiv | tag | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7804 (0.0276) | 0.7352 (0.0096) | | +| ogbg-molhiv | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7838 (0.0221) | 0.7648 (0.0100) | | +| ogbg-molhiv | transformer | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8088 (0.0471) | 0.7413 (-0.0134) | | +| ogbg-molsider | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.5938 (0.0051) | 0.5905 (-0.0099) | | +| ogbg-molsider | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6344 (0.0071) | 0.6141 (-0.0018) | | +| ogbg-molsider | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6263 (0.0026) | 0.6096 (0.0062) | | +| ogbg-molsider | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.5862 (-0.0162) | 0.5974 (0.0076) | | +| ogbg-molsider | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6462 (0.0391) | 0.6000 (-0.0013) | | +| ogbg-molsider | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6256 (-0.0037) | 0.6117 (0.0031) | | +| ogbg-molsider | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6345 (-0.0175) | 0.6053 (0.0199) | | +| ogbg-molsider | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6046 (-0.0179) | 0.6022 (0.0274) | | +| ogbg-molsider | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6151 (-0.0176) | 0.6150 (0.0655) | | +| ogbg-molsider | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6010 (0.0089) | 0.5963 (-0.0188) | | +| ogbg-molsider | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6232 (0.0015) | 0.5861 (0.0053) | | +| ogbg-molsider | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6190 (-0.0012) | 0.5983 (0.0122) | | +| ogbg-molsider | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6058 (-0.0161) | 0.5721 (-0.0243) | | +| ogbg-molsider | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6205 (-0.0005) | 0.5960 (0.0050) | | +| ogbg-molsider | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6151 (-0.0022) | 0.6417 (0.0375) | | +| ogbg-molsider | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6410 (-0.0028) | 0.6102 (-0.0041) | | +| ogbg-molsider | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6315 (0.0156) | 0.6190 (0.0210) | | +| ogbg-moltox21 | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7280 (0.0025) | 0.7154 (-0.0005) | | +| ogbg-moltox21 | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7771 (-0.0028) | 0.7209 (-0.0014) | | +| ogbg-moltox21 | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0125) | 0.7286 (-0.0015) | | +| ogbg-moltox21 | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7727 (0.0025) | 0.7369 (0.0209) | | +| ogbg-moltox21 | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7762 (0.0135) | 0.7303 (0.0143) | | +| ogbg-moltox21 | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7588 (0.0007) | 0.7230 (0.0059) | | +| ogbg-moltox21 | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7757 (-0.0077) | 0.7312 (-0.0132) | | +| ogbg-moltox21 | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7718 (0.0028) | 0.7237 (-0.0005) | | +| ogbg-moltox21 | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7622 (-0.0122) | 0.7193 (-0.0135) | | +| ogbg-moltox21 | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7820 (-0.0011) | 0.7313 (0.0166) | | +| ogbg-moltox21 | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7697 (-0.0012) | 0.7205 (0.0009) | | +| ogbg-moltox21 | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7695 (-0.0078) | 0.7279 (-0.0002) | | +| ogbg-moltox21 | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7745 (0.0085) | 0.7349 (0.0403) | | +| ogbg-moltox21 | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7887 (-0.0064) | 0.7380 (0.0104) | | +| ogbg-moltox21 | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7506 (-0.0105) | 0.7355 (0.0115) | | +| ogbg-moltox21 | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7839 (-0.0027) | 0.7342 (-0.0074) | | +| ogbg-moltox21 | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7761 (0.0105) | 0.7292 (-0.0018) | | diff --git a/logs/ogbg-molsider_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log b/logs/ogbg-molsider_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log new file mode 100644 index 0000000..491290e --- /dev/null +++ b/logs/ogbg-molsider_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log @@ -0,0 +1,164 @@ +[run] ogbg-molsider view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/sider.zip +
0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 3.84it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 3.84it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 7.68it/s] +Processing... +Extracting /home/yurenh2/rrog-gnn-runner/data/ogb/sider.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/1427 [00:00<?, ?it/s]
100%|██████████| 1427/1427 [00:00<00:00, 157159.75it/s] +Converting graphs into PyG objects... +
0%| | 0/1427 [00:00<?, ?it/s]
100%|██████████| 1427/1427 [00:00<00:00, 79093.89it/s] +Done! +Saving... +ep10 val_rocauc=0.51600 val_adapt_rocauc=0.51600 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.54994 val_adapt_rocauc=0.54994 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.53576 val_adapt_rocauc=0.53552 adapt_steps=7.83 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.55033 val_adapt_rocauc=0.55033 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.55437 val_adapt_rocauc=0.55437 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.60254 val_adapt_rocauc=0.60254 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.58756 val_adapt_rocauc=0.58756 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.60754 val_adapt_rocauc=0.60754 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.59698 val_adapt_rocauc=0.59698 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep100 val_rocauc=0.59673 val_adapt_rocauc=0.59673 adapt_steps=8.00 halt=0.12 train_steps=4.50 +[ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.6075447846476244} test={'rocauc': 0.5810477512085702} adaptive={'rocauc': 0.5810477512085702} steps=8.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.54584 val_adapt_rocauc=0.54577 adapt_steps=7.98 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.58611 val_adapt_rocauc=0.58611 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.59127 val_adapt_rocauc=0.59127 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.57511 val_adapt_rocauc=0.57438 adapt_steps=7.84 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.58186 val_adapt_rocauc=0.58186 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.56772 val_adapt_rocauc=0.56772 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.59297 val_adapt_rocauc=0.59297 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep80 val_rocauc=0.62339 val_adapt_rocauc=0.62339 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep90 val_rocauc=0.62819 val_adapt_rocauc=0.62813 adapt_steps=7.90 halt=0.12 train_steps=4.50 +ep100 val_rocauc=0.63343 val_adapt_rocauc=0.63420 adapt_steps=7.97 halt=0.12 train_steps=4.50 +[ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.6334288171779305} test={'rocauc': 0.6299766632454395} adaptive={'rocauc': 0.6305843217920319} steps=7.909090909090909 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.50898 val_adapt_rocauc=0.50898 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.53439 val_adapt_rocauc=0.53439 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.55399 val_adapt_rocauc=0.55399 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.51743 val_adapt_rocauc=0.51743 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.56124 val_adapt_rocauc=0.56124 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.58333 val_adapt_rocauc=0.58333 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.58471 val_adapt_rocauc=0.58471 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep80 val_rocauc=0.59340 val_adapt_rocauc=0.59340 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.59796 val_adapt_rocauc=0.59796 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep100 val_rocauc=0.59492 val_adapt_rocauc=0.59492 adapt_steps=8.00 halt=0.12 train_steps=4.49 +[ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rocauc': 0.5979570667859507} test={'rocauc': 0.6336766486024191} adaptive={'rocauc': 0.6336766486024191} steps=8.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.52583 val_adapt_rocauc=0.52583 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.57520 val_adapt_rocauc=0.57520 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.52761 val_adapt_rocauc=0.52761 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.53501 val_adapt_rocauc=0.53501 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.54257 val_adapt_rocauc=0.54257 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.53427 val_adapt_rocauc=0.53427 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.57027 val_adapt_rocauc=0.57027 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.57984 val_adapt_rocauc=0.57984 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.59046 val_adapt_rocauc=0.59046 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep100 val_rocauc=0.58588 val_adapt_rocauc=0.58588 adapt_steps=8.00 halt=0.12 train_steps=4.50 +[ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rocauc': 0.5904624057788478} test={'rocauc': 0.621622401806624} adaptive={'rocauc': 0.621622401806624} steps=8.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.52148 val_adapt_rocauc=0.52148 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.53383 val_adapt_rocauc=0.53359 adapt_steps=7.96 halt=0.12 train_steps=4.49 +ep30 val_rocauc=0.54880 val_adapt_rocauc=0.54880 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.59286 val_adapt_rocauc=0.59286 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.59415 val_adapt_rocauc=0.59415 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.60132 val_adapt_rocauc=0.60132 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.58871 val_adapt_rocauc=0.58871 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.60004 val_adapt_rocauc=0.60006 adapt_steps=7.99 halt=0.12 train_steps=4.49 +ep90 val_rocauc=0.61690 val_adapt_rocauc=0.61690 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep100 val_rocauc=0.62234 val_adapt_rocauc=0.62234 adapt_steps=8.00 halt=0.12 train_steps=4.50 +[ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.6223441276640819} test={'rocauc': 0.622244619371397} adaptive={'rocauc': 0.622244619371397} steps=8.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.50469 val_adapt_rocauc=0.50469 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.55043 val_adapt_rocauc=0.55043 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.56343 val_adapt_rocauc=0.56343 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep40 val_rocauc=0.56853 val_adapt_rocauc=0.56838 adapt_steps=7.95 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.56311 val_adapt_rocauc=0.56311 adapt_steps=8.00 halt=0.12 train_steps=4.48 +ep60 val_rocauc=0.57671 val_adapt_rocauc=0.57673 adapt_steps=7.99 halt=0.12 train_steps=4.49 +ep70 val_rocauc=0.58004 val_adapt_rocauc=0.57740 adapt_steps=7.78 halt=0.12 train_steps=4.49 +ep80 val_rocauc=0.59036 val_adapt_rocauc=0.58962 adapt_steps=7.92 halt=0.12 train_steps=4.48 +ep90 val_rocauc=0.59131 val_adapt_rocauc=0.59135 adapt_steps=7.94 halt=0.12 train_steps=4.48 +ep100 val_rocauc=0.59335 val_adapt_rocauc=0.59096 adapt_steps=7.85 halt=0.13 train_steps=4.48 +[ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.593345692093345} test={'rocauc': 0.5966615384995925} adaptive={'rocauc': 0.5964163493356076} steps=7.888111888111888 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=pna compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view pna --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.51332 val_adapt_rocauc=0.51332 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.49872 val_adapt_rocauc=0.49872 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.52439 val_adapt_rocauc=0.52439 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.51652 val_adapt_rocauc=0.51652 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.54453 val_adapt_rocauc=0.54453 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.56613 val_adapt_rocauc=0.56613 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.58698 val_adapt_rocauc=0.58698 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.56911 val_adapt_rocauc=0.56911 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.57175 val_adapt_rocauc=0.57175 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.58106 val_adapt_rocauc=0.58106 adapt_steps=8.00 halt=0.12 train_steps=4.50 +[ogbg-molsider_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.5869831648034167} test={'rocauc': 0.5961753244813196} adaptive={'rocauc': 0.5962142801036087} steps=7.958041958041958 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=resgated compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view resgated --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.51655 val_adapt_rocauc=0.51655 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.53764 val_adapt_rocauc=0.53764 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep30 val_rocauc=0.58175 val_adapt_rocauc=0.58175 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.57301 val_adapt_rocauc=0.57301 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.56615 val_adapt_rocauc=0.56615 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.58257 val_adapt_rocauc=0.58257 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.59759 val_adapt_rocauc=0.59759 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.62601 val_adapt_rocauc=0.62601 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.61042 val_adapt_rocauc=0.61042 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep100 val_rocauc=0.61180 val_adapt_rocauc=0.61180 adapt_steps=8.00 halt=0.12 train_steps=4.50 +[ogbg-molsider_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.6260140078552355} test={'rocauc': 0.6259436225287444} adaptive={'rocauc': 0.6259436225287444} steps=8.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json diff --git a/logs/ogbg-molsider_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log b/logs/ogbg-molsider_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log new file mode 100644 index 0000000..68adc15 --- /dev/null +++ b/logs/ogbg-molsider_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log @@ -0,0 +1,278 @@ +[run] ogbg-molsider view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.52242 val_adapt_rocauc=0.52242 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.57120 val_adapt_rocauc=0.57031 adapt_steps=7.99 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.52140 val_adapt_rocauc=0.52140 adapt_steps=8.00 halt=0.12 train_steps=4.45 +ep40 val_rocauc=0.54349 val_adapt_rocauc=0.54351 adapt_steps=7.93 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.52355 val_adapt_rocauc=0.52355 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.57651 val_adapt_rocauc=0.57763 adapt_steps=7.97 halt=0.12 train_steps=4.47 +ep70 val_rocauc=0.59417 val_adapt_rocauc=0.59417 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.57162 val_adapt_rocauc=0.57204 adapt_steps=7.96 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.58977 val_adapt_rocauc=0.58977 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep100 val_rocauc=0.59364 val_adapt_rocauc=0.59378 adapt_steps=7.99 halt=0.12 train_steps=4.50 +[ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.5941723817458207} test={'rocauc': 0.5949106211087469} adaptive={'rocauc': 0.5949106211087469} steps=8.0 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=gine compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gine --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.52714 val_adapt_rocauc=0.52714 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.53410 val_adapt_rocauc=0.53410 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.55999 val_adapt_rocauc=0.55999 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.58039 val_adapt_rocauc=0.58039 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.59855 val_adapt_rocauc=0.59871 adapt_steps=7.99 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.58511 val_adapt_rocauc=0.58521 adapt_steps=7.98 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.58872 val_adapt_rocauc=0.58872 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.59935 val_adapt_rocauc=0.59935 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.60537 val_adapt_rocauc=0.60495 adapt_steps=7.96 halt=0.12 train_steps=4.47 +ep100 val_rocauc=0.61174 val_adapt_rocauc=0.61174 adapt_steps=8.00 halt=0.12 train_steps=4.50 +[ogbg-molsider_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.6117392254931898} test={'rocauc': 0.6143023355631505} adaptive={'rocauc': 0.6147815453760646} steps=7.958041958041958 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.53639 val_adapt_rocauc=0.53639 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.54446 val_adapt_rocauc=0.54446 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.56844 val_adapt_rocauc=0.56844 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.59523 val_adapt_rocauc=0.59523 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.58925 val_adapt_rocauc=0.58925 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.61196 val_adapt_rocauc=0.60952 adapt_steps=7.48 halt=0.13 train_steps=4.43 +ep70 val_rocauc=0.60679 val_adapt_rocauc=0.60935 adapt_steps=7.81 halt=0.12 train_steps=4.49 +ep80 val_rocauc=0.62425 val_adapt_rocauc=0.62328 adapt_steps=7.92 halt=0.12 train_steps=4.49 +ep90 val_rocauc=0.63455 val_adapt_rocauc=0.63464 adapt_steps=7.98 halt=0.12 train_steps=4.50 +ep100 val_rocauc=0.63261 val_adapt_rocauc=0.63316 adapt_steps=7.90 halt=0.13 train_steps=4.48 +[ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rocauc': 0.634553246023819} test={'rocauc': 0.6445134528927392} adaptive={'rocauc': 0.644509359822436} steps=7.93006993006993 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=graphsage compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view graphsage --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.53993 val_adapt_rocauc=0.53993 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.51721 val_adapt_rocauc=0.51820 adapt_steps=7.81 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.57455 val_adapt_rocauc=0.57455 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.54410 val_adapt_rocauc=0.54400 adapt_steps=7.98 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.57426 val_adapt_rocauc=0.57426 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.57583 val_adapt_rocauc=0.57668 adapt_steps=7.83 halt=0.12 train_steps=4.49 +ep70 val_rocauc=0.57077 val_adapt_rocauc=0.57333 adapt_steps=7.81 halt=0.13 train_steps=4.46 +ep80 val_rocauc=0.60329 val_adapt_rocauc=0.60324 adapt_steps=7.98 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.60080 val_adapt_rocauc=0.60075 adapt_steps=7.99 halt=0.12 train_steps=4.48 +ep100 val_rocauc=0.61496 val_adapt_rocauc=0.61461 adapt_steps=7.97 halt=0.13 train_steps=4.48 +[ogbg-molsider_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.6149561902831908} test={'rocauc': 0.6082036653138152} adaptive={'rocauc': 0.6072637395395359} steps=7.923076923076923 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=gatv2 compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gatv2 --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.51326 val_adapt_rocauc=0.51326 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.53070 val_adapt_rocauc=0.53070 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.52081 val_adapt_rocauc=0.52081 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.53950 val_adapt_rocauc=0.53893 adapt_steps=7.83 halt=0.12 train_steps=4.47 +ep50 val_rocauc=0.55260 val_adapt_rocauc=0.55337 adapt_steps=7.90 halt=0.12 train_steps=4.48 +ep60 val_rocauc=0.55241 val_adapt_rocauc=0.55241 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.56511 val_adapt_rocauc=0.56511 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.56634 val_adapt_rocauc=0.56626 adapt_steps=7.99 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.57675 val_adapt_rocauc=0.57675 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep100 val_rocauc=0.57777 val_adapt_rocauc=0.57777 adapt_steps=8.00 halt=0.12 train_steps=4.49 +[ogbg-molsider_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.5777678714357024} test={'rocauc': 0.6337321824820535} adaptive={'rocauc': 0.6339582691134998} steps=7.958041958041958 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.53249 val_adapt_rocauc=0.52907 adapt_steps=7.41 halt=0.12 train_steps=4.47 +ep20 val_rocauc=0.53857 val_adapt_rocauc=0.53838 adapt_steps=7.96 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.55430 val_adapt_rocauc=0.55430 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.55775 val_adapt_rocauc=0.55775 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.53048 val_adapt_rocauc=0.53048 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.58757 val_adapt_rocauc=0.58768 adapt_steps=7.99 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.58127 val_adapt_rocauc=0.58127 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.58969 val_adapt_rocauc=0.58958 adapt_steps=7.97 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.59525 val_adapt_rocauc=0.59512 adapt_steps=7.94 halt=0.13 train_steps=4.44 +ep100 val_rocauc=0.61397 val_adapt_rocauc=0.61302 adapt_steps=7.97 halt=0.12 train_steps=4.45 +[ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.6139745501285409} test={'rocauc': 0.6068834635828694} adaptive={'rocauc': 0.6064255172013142} steps=7.916083916083916 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=transformer compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view transformer --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.53954 val_adapt_rocauc=0.53954 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.54449 val_adapt_rocauc=0.54449 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.58517 val_adapt_rocauc=0.58517 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.57396 val_adapt_rocauc=0.57671 adapt_steps=7.88 halt=0.12 train_steps=4.45 +ep50 val_rocauc=0.58068 val_adapt_rocauc=0.58068 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.60139 val_adapt_rocauc=0.60139 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep70 val_rocauc=0.61355 val_adapt_rocauc=0.61355 adapt_steps=8.00 halt=0.12 train_steps=4.45 +ep80 val_rocauc=0.57128 val_adapt_rocauc=0.57180 adapt_steps=7.95 halt=0.12 train_steps=4.48 +ep90 val_rocauc=0.62410 val_adapt_rocauc=0.62410 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep100 val_rocauc=0.62875 val_adapt_rocauc=0.62875 adapt_steps=8.00 halt=0.12 train_steps=4.50 +[ogbg-molsider_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.6287543036419472} test={'rocauc': 0.621503855814713} adaptive={'rocauc': 0.6212391169096168} steps=7.951048951048951 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=pna compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view pna --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.53705 val_adapt_rocauc=0.53705 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.49938 val_adapt_rocauc=0.49938 adapt_steps=8.00 halt=0.12 train_steps=4.43 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.50914 val_adapt_rocauc=0.50914 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.52533 val_adapt_rocauc=0.52533 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.56368 val_adapt_rocauc=0.56368 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.58102 val_adapt_rocauc=0.58102 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.55427 val_adapt_rocauc=0.55427 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.56861 val_adapt_rocauc=0.56861 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.54785 val_adapt_rocauc=0.54785 adapt_steps=8.00 halt=0.12 train_steps=4.50 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.56012 val_adapt_rocauc=0.56012 adapt_steps=8.00 halt=0.12 train_steps=4.50 +[ogbg-molsider_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.5810212759423172} test={'rocauc': 0.5397701280540309} adaptive={'rocauc': 0.5397701280540309} steps=8.0 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=gen compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gen --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.52015 val_adapt_rocauc=0.51409 adapt_steps=7.45 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.56979 val_adapt_rocauc=0.56338 adapt_steps=7.21 halt=0.13 train_steps=4.43 +ep30 val_rocauc=0.57163 val_adapt_rocauc=0.57163 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.50300 val_adapt_rocauc=0.50300 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.55048 val_adapt_rocauc=0.55135 adapt_steps=7.97 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.55929 val_adapt_rocauc=0.55929 adapt_steps=8.00 halt=0.13 train_steps=4.50 +ep70 val_rocauc=0.61128 val_adapt_rocauc=0.61133 adapt_steps=7.96 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.61143 val_adapt_rocauc=0.61143 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.59636 val_adapt_rocauc=0.59635 adapt_steps=7.96 halt=0.12 train_steps=4.50 +ep100 val_rocauc=0.59800 val_adapt_rocauc=0.59800 adapt_steps=8.00 halt=0.12 train_steps=4.49 +[ogbg-molsider_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.6114344272964439} test={'rocauc': 0.6071293608886619} adaptive={'rocauc': 0.6071293608886619} steps=8.0 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=film compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view film --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.50663 val_adapt_rocauc=0.50663 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.53836 val_adapt_rocauc=0.53836 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.54072 val_adapt_rocauc=0.54072 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep40 val_rocauc=0.52242 val_adapt_rocauc=0.52242 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.52826 val_adapt_rocauc=0.52826 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.52041 val_adapt_rocauc=0.52041 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.53993 val_adapt_rocauc=0.53993 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.52758 val_adapt_rocauc=0.52758 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.53864 val_adapt_rocauc=0.53864 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep100 val_rocauc=0.54079 val_adapt_rocauc=0.54079 adapt_steps=8.00 halt=0.12 train_steps=4.50 +[ogbg-molsider_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.5407876481859505} test={'rocauc': 0.5825278400429263} adaptive={'rocauc': 0.5825278400429263} steps=8.0 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=resgated compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view resgated --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.51625 val_adapt_rocauc=0.51625 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.55876 val_adapt_rocauc=0.55876 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.58353 val_adapt_rocauc=0.58374 adapt_steps=7.99 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.59270 val_adapt_rocauc=0.59269 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.59117 val_adapt_rocauc=0.59117 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.59394 val_adapt_rocauc=0.59559 adapt_steps=7.96 halt=0.12 train_steps=4.48 +ep70 val_rocauc=0.57628 val_adapt_rocauc=0.57628 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.59810 val_adapt_rocauc=0.59810 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.59935 val_adapt_rocauc=0.59919 adapt_steps=7.96 halt=0.12 train_steps=4.48 +ep100 val_rocauc=0.60973 val_adapt_rocauc=0.60972 adapt_steps=7.97 halt=0.12 train_steps=4.48 +[ogbg-molsider_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.609727680398977} test={'rocauc': 0.6245839801623748} adaptive={'rocauc': 0.624652550767547} steps=7.951048951048951 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.53875 val_adapt_rocauc=0.53875 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.55745 val_adapt_rocauc=0.55745 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep30 val_rocauc=0.52523 val_adapt_rocauc=0.52508 adapt_steps=7.99 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.57020 val_adapt_rocauc=0.57005 adapt_steps=7.99 halt=0.12 train_steps=4.43 +ep50 val_rocauc=0.57818 val_adapt_rocauc=0.57818 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.58430 val_adapt_rocauc=0.58478 adapt_steps=7.88 halt=0.13 train_steps=4.46 +ep70 val_rocauc=0.62524 val_adapt_rocauc=0.62524 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep80 val_rocauc=0.58782 val_adapt_rocauc=0.58782 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.63291 val_adapt_rocauc=0.63291 adapt_steps=8.00 halt=0.13 train_steps=4.50 +ep100 val_rocauc=0.63016 val_adapt_rocauc=0.63032 adapt_steps=7.97 halt=0.13 train_steps=4.47 +[ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rocauc': 0.6329113613630306} test={'rocauc': 0.6060675375955825} adaptive={'rocauc': 0.6066839663477379} steps=7.909090909090909 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.51769 val_adapt_rocauc=0.51769 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.54554 val_adapt_rocauc=0.54554 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.52433 val_adapt_rocauc=0.52433 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.54839 val_adapt_rocauc=0.54757 adapt_steps=7.82 halt=0.12 train_steps=4.40 +ep50 val_rocauc=0.56667 val_adapt_rocauc=0.56667 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.56001 val_adapt_rocauc=0.56001 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.56325 val_adapt_rocauc=0.56263 adapt_steps=7.93 halt=0.12 train_steps=4.38 +ep80 val_rocauc=0.57410 val_adapt_rocauc=0.57405 adapt_steps=7.99 halt=0.12 train_steps=4.49 +ep90 val_rocauc=0.58333 val_adapt_rocauc=0.58333 adapt_steps=7.92 halt=0.13 train_steps=4.47 +ep100 val_rocauc=0.58659 val_adapt_rocauc=0.58673 adapt_steps=7.91 halt=0.13 train_steps=4.47 +[ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.5865936638036943} test={'rocauc': 0.624583829207758} adaptive={'rocauc': 0.6241791163198843} steps=7.881118881118881 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=cheb compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view cheb --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.52959 val_adapt_rocauc=0.53014 adapt_steps=7.83 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.59000 val_adapt_rocauc=0.59000 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.57720 val_adapt_rocauc=0.57720 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep40 val_rocauc=0.58010 val_adapt_rocauc=0.58016 adapt_steps=7.99 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.56105 val_adapt_rocauc=0.56396 adapt_steps=7.42 halt=0.12 train_steps=4.47 +ep60 val_rocauc=0.60272 val_adapt_rocauc=0.60144 adapt_steps=7.73 halt=0.13 train_steps=4.46 +ep70 val_rocauc=0.63704 val_adapt_rocauc=0.63704 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep80 val_rocauc=0.63367 val_adapt_rocauc=0.63378 adapt_steps=7.95 halt=0.12 train_steps=4.46 +ep90 val_rocauc=0.64091 val_adapt_rocauc=0.64157 adapt_steps=7.88 halt=0.13 train_steps=4.47 +ep100 val_rocauc=0.63703 val_adapt_rocauc=0.63925 adapt_steps=7.80 halt=0.13 train_steps=4.46 +[ogbg-molsider_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rocauc': 0.6409076943311921} test={'rocauc': 0.6149744329414113} adaptive={'rocauc': 0.6144652607315165} steps=7.8671328671328675 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=arma compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view arma --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.51335 val_adapt_rocauc=0.51335 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.51105 val_adapt_rocauc=0.50798 adapt_steps=7.59 halt=0.13 train_steps=4.47 +ep30 val_rocauc=0.54401 val_adapt_rocauc=0.54401 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.57421 val_adapt_rocauc=0.57421 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.58087 val_adapt_rocauc=0.58094 adapt_steps=7.98 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.58740 val_adapt_rocauc=0.58740 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.62738 val_adapt_rocauc=0.62725 adapt_steps=7.99 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.66049 val_adapt_rocauc=0.66028 adapt_steps=7.93 halt=0.13 train_steps=4.46 +ep90 val_rocauc=0.63467 val_adapt_rocauc=0.63512 adapt_steps=7.97 halt=0.13 train_steps=4.45 +ep100 val_rocauc=0.64614 val_adapt_rocauc=0.64687 adapt_steps=7.94 halt=0.12 train_steps=4.50 +[ogbg-molsider_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.6604919913889579} test={'rocauc': 0.5589855993934405} adaptive={'rocauc': 0.5580832949005652} steps=7.895104895104895 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=mf compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view mf --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.52188 val_adapt_rocauc=0.52188 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep20 val_rocauc=0.55853 val_adapt_rocauc=0.55853 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.55126 val_adapt_rocauc=0.55126 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.55645 val_adapt_rocauc=0.55527 adapt_steps=7.83 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.55799 val_adapt_rocauc=0.55799 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.59604 val_adapt_rocauc=0.59534 adapt_steps=7.92 halt=0.12 train_steps=4.49 +ep70 val_rocauc=0.57920 val_adapt_rocauc=0.57921 adapt_steps=7.96 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.63001 val_adapt_rocauc=0.62920 adapt_steps=7.96 halt=0.12 train_steps=4.49 +ep90 val_rocauc=0.61962 val_adapt_rocauc=0.61885 adapt_steps=7.95 halt=0.12 train_steps=4.50 +ep100 val_rocauc=0.61522 val_adapt_rocauc=0.61430 adapt_steps=7.93 halt=0.12 train_steps=4.47 +[ogbg-molsider_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.630007512812611} test={'rocauc': 0.5843445908586726} adaptive={'rocauc': 0.5856297203566897} steps=7.8671328671328675 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-molsider view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:0 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:0 --num_workers 0 +ep10 val_rocauc=0.52120 val_adapt_rocauc=0.52120 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.54017 val_adapt_rocauc=0.53843 adapt_steps=7.87 halt=0.12 train_steps=4.49 +ep30 val_rocauc=0.53233 val_adapt_rocauc=0.53233 adapt_steps=8.00 halt=0.12 train_steps=4.48 +ep40 val_rocauc=0.53931 val_adapt_rocauc=0.53735 adapt_steps=7.72 halt=0.13 train_steps=4.46 +ep50 val_rocauc=0.56152 val_adapt_rocauc=0.56188 adapt_steps=7.75 halt=0.13 train_steps=4.47 +ep60 val_rocauc=0.57531 val_adapt_rocauc=0.57388 adapt_steps=7.59 halt=0.13 train_steps=4.41 +ep70 val_rocauc=0.55453 val_adapt_rocauc=0.56066 adapt_steps=7.09 halt=0.13 train_steps=4.44 +ep80 val_rocauc=0.58010 val_adapt_rocauc=0.57429 adapt_steps=7.18 halt=0.13 train_steps=4.45 +ep90 val_rocauc=0.56976 val_adapt_rocauc=0.56750 adapt_steps=7.34 halt=0.13 train_steps=4.44 +ep100 val_rocauc=0.57081 val_adapt_rocauc=0.56938 adapt_steps=7.11 halt=0.13 train_steps=4.39 +[ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.58009596629467} test={'rocauc': 0.6009364115000575} adaptive={'rocauc': 0.5959003553252203} steps=7.27972027972028 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json diff --git a/logs/ogbg-molsider_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_e100_s0.log b/logs/ogbg-molsider_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_e100_s0.log new file mode 100644 index 0000000..3d6f14e --- /dev/null +++ b/logs/ogbg-molsider_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_e100_s0.log @@ -0,0 +1,84 @@ +[run] ogbg-molsider view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.51835 val_adapt_rocauc=0.51835 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.55881 val_adapt_rocauc=0.55881 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.52823 val_adapt_rocauc=0.52823 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.52164 val_adapt_rocauc=0.52164 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.55790 val_adapt_rocauc=0.55790 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.57934 val_adapt_rocauc=0.57937 adapt_steps=7.83 halt=0.12 train_steps=4.46 +ep70 val_rocauc=0.57559 val_adapt_rocauc=0.57449 adapt_steps=7.95 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.60248 val_adapt_rocauc=0.60248 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.58266 val_adapt_rocauc=0.58280 adapt_steps=7.99 halt=0.12 train_steps=4.50 +ep100 val_rocauc=0.59116 val_adapt_rocauc=0.59116 adapt_steps=8.00 halt=0.12 train_steps=4.50 +[ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=80 val={'rocauc': 0.6024836436339023} test={'rocauc': 0.5932734621249586} adaptive={'rocauc': 0.5932734621249586} steps=8.0 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molsider view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.56195 val_adapt_rocauc=0.56195 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.59090 val_adapt_rocauc=0.59090 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.56785 val_adapt_rocauc=0.56785 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.55460 val_adapt_rocauc=0.55460 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep50 val_rocauc=0.59103 val_adapt_rocauc=0.59103 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.56623 val_adapt_rocauc=0.56623 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.61162 val_adapt_rocauc=0.61169 adapt_steps=7.98 halt=0.12 train_steps=4.43 +ep80 val_rocauc=0.62851 val_adapt_rocauc=0.62851 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.63179 val_adapt_rocauc=0.63179 adapt_steps=7.99 halt=0.12 train_steps=4.47 +ep100 val_rocauc=0.62571 val_adapt_rocauc=0.62571 adapt_steps=8.00 halt=0.13 train_steps=4.46 +[ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=90 val={'rocauc': 0.6317896497739357} test={'rocauc': 0.640011295277304} adaptive={'rocauc': 0.6402407710265505} steps=7.937062937062937 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molsider view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.52921 val_adapt_rocauc=0.52921 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.51742 val_adapt_rocauc=0.51742 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.57194 val_adapt_rocauc=0.57194 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.57726 val_adapt_rocauc=0.57637 adapt_steps=7.68 halt=0.12 train_steps=4.40 +ep50 val_rocauc=0.56214 val_adapt_rocauc=0.56238 adapt_steps=7.98 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.59428 val_adapt_rocauc=0.59428 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep70 val_rocauc=0.62022 val_adapt_rocauc=0.61898 adapt_steps=7.87 halt=0.12 train_steps=4.42 +ep80 val_rocauc=0.61458 val_adapt_rocauc=0.61451 adapt_steps=7.99 halt=0.12 train_steps=4.50 +ep90 val_rocauc=0.62914 val_adapt_rocauc=0.62914 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep100 val_rocauc=0.61681 val_adapt_rocauc=0.61660 adapt_steps=7.94 halt=0.13 train_steps=4.49 +[ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=90 val={'rocauc': 0.6291378293840166} test={'rocauc': 0.622805287595805} adaptive={'rocauc': 0.6223183091184133} steps=7.916083916083916 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molsider view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.53256 val_adapt_rocauc=0.53256 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.54926 val_adapt_rocauc=0.54926 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.54957 val_adapt_rocauc=0.54957 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.51981 val_adapt_rocauc=0.52396 adapt_steps=7.78 halt=0.12 train_steps=4.44 +ep50 val_rocauc=0.60657 val_adapt_rocauc=0.60657 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep60 val_rocauc=0.58438 val_adapt_rocauc=0.58438 adapt_steps=8.00 halt=0.12 train_steps=4.47 +ep70 val_rocauc=0.57212 val_adapt_rocauc=0.57212 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.58304 val_adapt_rocauc=0.58304 adapt_steps=8.00 halt=0.12 train_steps=4.49 +ep90 val_rocauc=0.61059 val_adapt_rocauc=0.61099 adapt_steps=7.98 halt=0.12 train_steps=4.49 +ep100 val_rocauc=0.60016 val_adapt_rocauc=0.60046 adapt_steps=7.99 halt=0.12 train_steps=4.48 +[ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=90 val={'rocauc': 0.6105933624956364} test={'rocauc': 0.624320975867962} adaptive={'rocauc': 0.6243824341662988} steps=7.958041958041958 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molsider view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.53539 val_adapt_rocauc=0.53539 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.54274 val_adapt_rocauc=0.54274 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.56668 val_adapt_rocauc=0.56668 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.58346 val_adapt_rocauc=0.58251 adapt_steps=7.85 halt=0.12 train_steps=4.49 +ep50 val_rocauc=0.57517 val_adapt_rocauc=0.57482 adapt_steps=7.76 halt=0.12 train_steps=4.49 +ep60 val_rocauc=0.57520 val_adapt_rocauc=0.57520 adapt_steps=8.00 halt=0.13 train_steps=4.50 +ep70 val_rocauc=0.58768 val_adapt_rocauc=0.58768 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep80 val_rocauc=0.60462 val_adapt_rocauc=0.60442 adapt_steps=7.89 halt=0.13 train_steps=4.46 +ep90 val_rocauc=0.60757 val_adapt_rocauc=0.60786 adapt_steps=7.91 halt=0.12 train_steps=4.49 +ep100 val_rocauc=0.61648 val_adapt_rocauc=0.61625 adapt_steps=7.95 halt=0.12 train_steps=4.49 +[ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=100 val={'rocauc': 0.6164847255453625} test={'rocauc': 0.6344146740580251} adaptive={'rocauc': 0.6358083894071243} steps=7.916083916083916 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json +[run] ogbg-molsider view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molsider --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 30 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.50415 val_adapt_rocauc=0.50415 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep20 val_rocauc=0.55422 val_adapt_rocauc=0.55422 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep30 val_rocauc=0.54565 val_adapt_rocauc=0.54565 adapt_steps=8.00 halt=0.12 train_steps=4.50 +ep40 val_rocauc=0.56511 val_adapt_rocauc=0.56078 adapt_steps=7.85 halt=0.13 train_steps=4.44 +ep50 val_rocauc=0.55631 val_adapt_rocauc=0.55109 adapt_steps=7.76 halt=0.13 train_steps=4.48 +ep60 val_rocauc=0.57521 val_adapt_rocauc=0.56829 adapt_steps=7.38 halt=0.13 train_steps=4.46 +ep70 val_rocauc=0.56234 val_adapt_rocauc=0.54971 adapt_steps=7.09 halt=0.13 train_steps=4.41 +ep80 val_rocauc=0.58328 val_adapt_rocauc=0.57728 adapt_steps=7.38 halt=0.13 train_steps=4.44 +ep90 val_rocauc=0.58378 val_adapt_rocauc=0.56802 adapt_steps=7.01 halt=0.13 train_steps=4.39 +ep100 val_rocauc=0.58739 val_adapt_rocauc=0.57353 adapt_steps=7.03 halt=0.13 train_steps=4.38 +[ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0] best_ep=100 val={'rocauc': 0.5873882396417854} test={'rocauc': 0.5819785573765826} adaptive={'rocauc': 0.5894161989454557} steps=7.13986013986014 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json diff --git a/logs/ogbg-moltox21_0.log b/logs/ogbg-moltox21_0.log new file mode 100644 index 0000000..b345f4f --- /dev/null +++ b/logs/ogbg-moltox21_0.log @@ -0,0 +1,720 @@ +[run] ogbg-moltox21 view=gin compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view gin --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/tox21.zip +
0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 386.29it/s] +Processing... +Extracting /orion/u/oscarwan/rrog-gnn-runner/data/ogb/tox21.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/7831 [00:00<?, ?it/s]
100%|██████████| 7831/7831 [00:00<00:00, 157806.81it/s] +Converting graphs into PyG objects... +
0%| | 0/7831 [00:00<?, ?it/s]
100%|██████████| 7831/7831 [00:00<00:00, 92490.76it/s] +Done! +Saving... +ep10 val_rocauc=0.72484 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.74846 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.76490 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.76215 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.76595 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.76742 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.76664 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.76598 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.76901 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.76838 halt=0.00 train_steps=1.00 +[ogbg-moltox21_gin_classic_T0_ns1_h128_e100_s0] best_ep=90 val={'rocauc': 0.769011087128982} test={'rocauc': 0.724182297150406} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_gin_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-moltox21 view=gin compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view gin --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.69793 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.74054 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.74514 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.74791 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.74986 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75586 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.76768 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.76774 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.77178 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.76931 halt=0.00 train_steps=3.00 +[ogbg-moltox21_gin_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=90 val={'rocauc': 0.7717759383538949} test={'rocauc': 0.7236697240762989} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_gin_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-moltox21 view=gine compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view gine --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.68818 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.74111 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.76789 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.77438 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.76547 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.77108 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.77342 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.77174 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.77180 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.77312 halt=0.00 train_steps=1.00 +[ogbg-moltox21_gine_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rocauc': 0.7743797903105913} test={'rocauc': 0.7328494551753418} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_gine_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-moltox21 view=gine compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view gine --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.73735 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.72683 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.75433 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.75925 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.75777 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75932 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.76220 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.75791 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.76164 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.76080 halt=0.00 train_steps=3.00 +[ogbg-moltox21_gine_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=70 val={'rocauc': 0.7622004073608938} test={'rocauc': 0.7193472376632882} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_gine_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-moltox21 view=gcn compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view gcn --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.73863 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.75645 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.75601 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.75802 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.75053 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.75210 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.75306 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.75621 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.75552 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.75553 halt=0.00 train_steps=1.00 +[ogbg-moltox21_gcn_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rocauc': 0.7580202023804351} test={'rocauc': 0.7170910489918559} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_gcn_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-moltox21 view=gcn compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view gcn --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.74119 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.75287 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.75370 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.74513 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.75475 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.74906 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.75844 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.75876 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.75769 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.75797 halt=0.00 train_steps=3.00 +[ogbg-moltox21_gcn_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=80 val={'rocauc': 0.7587559779881515} test={'rocauc': 0.7230304767127982} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-moltox21 view=graphsage compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view graphsage --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.77089 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.76511 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.76566 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.76254 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.76285 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.75888 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.76083 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.75760 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.75699 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.75730 halt=0.00 train_steps=1.00 +[ogbg-moltox21_graphsage_classic_T0_ns1_h128_e100_s0] best_ep=10 val={'rocauc': 0.7708912322116328} test={'rocauc': 0.719565697251165} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_graphsage_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-moltox21 view=graphsage compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view graphsage --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.76513 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.75758 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.75776 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.75918 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.75893 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.76388 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.76881 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.76966 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.76845 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.76888 halt=0.00 train_steps=3.00 +[ogbg-moltox21_graphsage_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=80 val={'rocauc': 0.7696559719157566} test={'rocauc': 0.7204917205278893} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-moltox21 view=gatv2 compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view gatv2 --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.74480 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.76272 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.75593 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.75003 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.74890 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.75069 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.74928 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.74860 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.74783 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.74736 halt=0.00 train_steps=1.00 +[ogbg-moltox21_gatv2_classic_T0_ns1_h128_e100_s0] best_ep=20 val={'rocauc': 0.7627170708797383} test={'rocauc': 0.7159809011324226} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_gatv2_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-moltox21 view=gatv2 compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view gatv2 --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.74054 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.76240 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.76147 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.76879 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.77341 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.77619 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.76905 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.77076 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.76778 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.76949 halt=0.00 train_steps=3.00 +[ogbg-moltox21_gatv2_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=60 val={'rocauc': 0.7761905248713933} test={'rocauc': 0.7302941629609098} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-moltox21 view=graphconv compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view graphconv --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.78311 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.77225 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.77248 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.77295 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.77354 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.77640 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.77229 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.76658 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.76913 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.76699 halt=0.00 train_steps=1.00 +[ogbg-moltox21_graphconv_classic_T0_ns1_h128_e100_s0] best_ep=10 val={'rocauc': 0.7831111293212308} test={'rocauc': 0.7147413214946693} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_graphconv_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-moltox21 view=graphconv compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view graphconv --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.77949 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.77294 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.77430 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.76989 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.77667 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.77827 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.78203 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.78104 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.78098 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.77874 halt=0.00 train_steps=3.00 +[ogbg-moltox21_graphconv_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=70 val={'rocauc': 0.7820316625768228} test={'rocauc': 0.7313192526985618} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-moltox21 view=transformer compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view transformer --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.75425 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.75934 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.76560 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.76268 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.75813 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.75738 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.75319 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.75603 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.75327 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.75372 halt=0.00 train_steps=1.00 +[ogbg-moltox21_transformer_classic_T0_ns1_h128_e100_s0] best_ep=30 val={'rocauc': 0.7656017658932041} test={'rocauc': 0.7309364489214464} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_transformer_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-moltox21 view=transformer compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view transformer --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.74194 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.77615 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.77483 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.77105 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.76520 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.77096 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.76318 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.76083 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.75785 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.75802 halt=0.00 train_steps=3.00 +[ogbg-moltox21_transformer_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=20 val={'rocauc': 0.7761466167802987} test={'rocauc': 0.7291784660085319} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-moltox21 view=pna compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view pna --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.72096 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.73688 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.73962 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.70380 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.75643 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.75674 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.76476 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.76170 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.76597 halt=0.00 train_steps=1.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.76447 halt=0.00 train_steps=1.00 +[ogbg-moltox21_pna_classic_T0_ns1_h128_e100_s0] best_ep=90 val={'rocauc': 0.7659664923974269} test={'rocauc': 0.6945744978582721} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_pna_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-moltox21 view=pna compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view pna --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.58022 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.74452 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.76386 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.74277 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.77445 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.76062 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.75774 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.75313 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.75465 halt=0.00 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.75579 halt=0.00 train_steps=3.00 +[ogbg-moltox21_pna_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rocauc': 0.7744523976361245} test={'rocauc': 0.7348793665704174} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_pna_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-moltox21 view=gen compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view gen --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.75728 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.76274 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.77508 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.78345 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.77692 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.77932 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.77949 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.77426 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.77385 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.77440 halt=0.00 train_steps=1.00 +[ogbg-moltox21_gen_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rocauc': 0.783453783540323} test={'rocauc': 0.744374172706925} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_gen_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-moltox21 view=gen compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view gen --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.76453 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.76862 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.77571 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.77411 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.76511 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75944 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.76283 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.76241 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.76247 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.76180 halt=0.00 train_steps=3.00 +[ogbg-moltox21_gen_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.7757089729043948} test={'rocauc': 0.7312107536918231} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_gen_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-moltox21 view=film compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view film --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.74814 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.75905 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.76794 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.76664 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.77020 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.76890 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.76708 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.76375 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.76202 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.76131 halt=0.00 train_steps=1.00 +[ogbg-moltox21_film_classic_T0_ns1_h128_e100_s0] best_ep=50 val={'rocauc': 0.7701993310949509} test={'rocauc': 0.7160313530552065} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_film_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-moltox21 view=film compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view film --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.72171 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.76173 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.77267 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.77175 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.76336 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75720 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.76378 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.76209 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.75798 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.75964 halt=0.00 train_steps=3.00 +[ogbg-moltox21_film_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.7726742190325983} test={'rocauc': 0.7369411241728653} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_film_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-moltox21 view=resgated compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view resgated --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.73425 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.79504 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.77782 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.77016 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.77961 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.77546 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.77802 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.77498 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.77436 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.77488 halt=0.00 train_steps=1.00 +[ogbg-moltox21_resgated_classic_T0_ns1_h128_e100_s0] best_ep=20 val={'rocauc': 0.7950359690969749} test={'rocauc': 0.7275455467914984} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_resgated_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-moltox21 view=resgated compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view resgated --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.77024 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.78122 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.75711 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.77733 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.78866 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.78069 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.77869 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.77797 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.77717 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.77679 halt=0.00 train_steps=3.00 +[ogbg-moltox21_resgated_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rocauc': 0.7886618095832292} test={'rocauc': 0.7379821725919018} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-moltox21 view=tag compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view tag --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.77020 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.75053 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.77475 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.78655 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.77357 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.78210 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.77541 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.77523 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.77610 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.77533 halt=0.00 train_steps=1.00 +[ogbg-moltox21_tag_classic_T0_ns1_h128_e100_s0] best_ep=40 val={'rocauc': 0.7865543605336435} test={'rocauc': 0.7415570498308578} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_tag_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-moltox21 view=tag compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view tag --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.76097 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.75558 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.76705 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.76024 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.78386 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.77078 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.77584 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.77648 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.77944 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.77766 halt=0.00 train_steps=3.00 +[ogbg-moltox21_tag_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rocauc': 0.7838617216718421} test={'rocauc': 0.7341723374058734} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_tag_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-moltox21 view=sgc compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view sgc --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.74042 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.75125 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.76111 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.75660 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.75361 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.74742 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.75373 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.75183 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.75155 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.75209 halt=0.00 train_steps=1.00 +[ogbg-moltox21_sgc_classic_T0_ns1_h128_e100_s0] best_ep=30 val={'rocauc': 0.7611119280457176} test={'rocauc': 0.7239907988668123} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_sgc_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-moltox21 view=sgc compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view sgc --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.73403 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.74782 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.75058 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.74249 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.74208 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.73304 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.73890 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.73793 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.73960 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.74013 halt=0.00 train_steps=3.00 +[ogbg-moltox21_sgc_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.7505837592258088} test={'rocauc': 0.7354997840876948} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-moltox21 view=cheb compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view cheb --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.74437 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.77175 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.78344 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.76996 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.76678 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.76659 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.76423 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.76039 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.76311 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.76377 halt=0.00 train_steps=1.00 +[ogbg-moltox21_cheb_classic_T0_ns1_h128_e100_s0] best_ep=30 val={'rocauc': 0.7834436091147085} test={'rocauc': 0.7300685430388674} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_cheb_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-moltox21 view=cheb compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view cheb --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.73591 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.74295 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.76362 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.76600 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.77099 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.75645 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.76291 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.76312 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.76302 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.76310 halt=0.00 train_steps=3.00 +[ogbg-moltox21_cheb_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=50 val={'rocauc': 0.7709868045619044} test={'rocauc': 0.7285529943614071} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-moltox21 view=arma compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view arma --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.75328 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.76333 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.76992 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.77239 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.76722 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.77990 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.77874 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.77721 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.77836 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.77654 halt=0.00 train_steps=1.00 +[ogbg-moltox21_arma_classic_T0_ns1_h128_e100_s0] best_ep=60 val={'rocauc': 0.7798972501326612} test={'rocauc': 0.7222812510383411} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_arma_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-moltox21 view=arma compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view arma --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.74841 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.76256 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.76827 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.76564 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.76598 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.77710 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.76482 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.76599 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.76783 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.76711 halt=0.00 train_steps=3.00 +[ogbg-moltox21_arma_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=60 val={'rocauc': 0.7770957435163162} test={'rocauc': 0.7208970968150412} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_arma_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-moltox21 view=mf compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view mf --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.74780 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.77726 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.76923 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.76854 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.75343 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.76215 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.75537 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.75354 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.74992 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.75063 halt=0.00 train_steps=1.00 +[ogbg-moltox21_mf_classic_T0_ns1_h128_e100_s0] best_ep=20 val={'rocauc': 0.7772586253147277} test={'rocauc': 0.7280600105159073} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_mf_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-moltox21 view=mf compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view mf --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.74625 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.76664 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.76949 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.76083 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.76381 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.76172 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.76629 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.76347 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.76494 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.76533 halt=0.00 train_steps=3.00 +[ogbg-moltox21_mf_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=30 val={'rocauc': 0.7694895755359669} test={'rocauc': 0.7278719227082299} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_mf_fixed-rrog_T1_ns3_h128_e100_s0.json +[run] ogbg-moltox21 view=appnp compute=classic T=0 ns=1 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view appnp --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.72363 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.71790 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.71516 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.71924 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.72352 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.72489 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.72364 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.72546 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.72334 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.72316 halt=0.00 train_steps=1.00 +[ogbg-moltox21_appnp_classic_T0_ns1_h128_e100_s0] best_ep=80 val={'rocauc': 0.7254553558600404} test={'rocauc': 0.7158488769446065} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_appnp_classic_T0_ns1_h128_e100_s0.json +[run] ogbg-moltox21 view=appnp compute=fixed-rrog T=1 ns=3 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view appnp --compute fixed-rrog --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.71227 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.71980 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.71066 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.71010 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.71681 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.72800 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.71901 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.72089 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.72352 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.72217 halt=0.00 train_steps=3.00 +[ogbg-moltox21_appnp_fixed-rrog_T1_ns3_h128_e100_s0] best_ep=60 val={'rocauc': 0.7279951275996247} test={'rocauc': 0.7153555287245948} adaptive=None steps=None + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json + +Classic baseline: task x backbone +| task | backbone | metric | n | val | test | +| --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | rocauc | 1 | 0.6564 +/- 0.0000 | 0.7423 +/- 0.0000 | +| ogbg-molbace | arma | rocauc | 1 | 0.6923 +/- 0.0000 | 0.7839 +/- 0.0000 | +| ogbg-molbace | cheb | rocauc | 1 | 0.7267 +/- 0.0000 | 0.7969 +/- 0.0000 | +| ogbg-molbace | film | rocauc | 1 | 0.6703 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molbace | gatv2 | rocauc | 1 | 0.7029 +/- 0.0000 | 0.7400 +/- 0.0000 | +| ogbg-molbace | gcn | rocauc | 1 | 0.6381 +/- 0.0000 | 0.7393 +/- 0.0000 | +| ogbg-molbace | gen | rocauc | 1 | 0.7128 +/- 0.0000 | 0.7326 +/- 0.0000 | +| ogbg-molbace | gin | rocauc | 1 | 0.6520 +/- 0.0000 | 0.7336 +/- 0.0000 | +| ogbg-molbace | gine | rocauc | 1 | 0.6641 +/- 0.0000 | 0.7454 +/- 0.0000 | +| ogbg-molbace | graphconv | rocauc | 1 | 0.7311 +/- 0.0000 | 0.8035 +/- 0.0000 | +| ogbg-molbace | graphsage | rocauc | 1 | 0.6758 +/- 0.0000 | 0.7759 +/- 0.0000 | +| ogbg-molbace | mf | rocauc | 1 | 0.7421 +/- 0.0000 | 0.7760 +/- 0.0000 | +| ogbg-molbace | pna | rocauc | 1 | 0.7516 +/- 0.0000 | 0.6912 +/- 0.0000 | +| ogbg-molbace | resgated | rocauc | 1 | 0.7172 +/- 0.0000 | 0.7877 +/- 0.0000 | +| ogbg-molbace | sgc | rocauc | 1 | 0.6575 +/- 0.0000 | 0.6966 +/- 0.0000 | +| ogbg-molbace | tag | rocauc | 1 | 0.7084 +/- 0.0000 | 0.7345 +/- 0.0000 | +| ogbg-molbace | transformer | rocauc | 1 | 0.6663 +/- 0.0000 | 0.7364 +/- 0.0000 | +| ogbg-molbbbp | appnp | rocauc | 1 | 0.9147 +/- 0.0000 | 0.6388 +/- 0.0000 | +| ogbg-molbbbp | arma | rocauc | 1 | 0.9367 +/- 0.0000 | 0.6651 +/- 0.0000 | +| ogbg-molbbbp | cheb | rocauc | 1 | 0.9452 +/- 0.0000 | 0.6514 +/- 0.0000 | +| ogbg-molbbbp | film | rocauc | 1 | 0.9285 +/- 0.0000 | 0.6300 +/- 0.0000 | +| ogbg-molbbbp | gatv2 | rocauc | 1 | 0.9347 +/- 0.0000 | 0.6324 +/- 0.0000 | +| ogbg-molbbbp | gcn | rocauc | 1 | 0.9386 +/- 0.0000 | 0.6679 +/- 0.0000 | +| ogbg-molbbbp | gen | rocauc | 1 | 0.9549 +/- 0.0000 | 0.6775 +/- 0.0000 | +| ogbg-molbbbp | gin | rocauc | 1 | 0.9251 +/- 0.0000 | 0.5670 +/- 0.0000 | +| ogbg-molbbbp | gine | rocauc | 1 | 0.9324 +/- 0.0000 | 0.6160 +/- 0.0000 | +| ogbg-molbbbp | graphconv | rocauc | 1 | 0.9268 +/- 0.0000 | 0.5900 +/- 0.0000 | +| ogbg-molbbbp | graphsage | rocauc | 1 | 0.9483 +/- 0.0000 | 0.6288 +/- 0.0000 | +| ogbg-molbbbp | mf | rocauc | 1 | 0.9395 +/- 0.0000 | 0.6365 +/- 0.0000 | +| ogbg-molbbbp | pna | rocauc | 1 | 0.9554 +/- 0.0000 | 0.6418 +/- 0.0000 | +| ogbg-molbbbp | resgated | rocauc | 1 | 0.9183 +/- 0.0000 | 0.6626 +/- 0.0000 | +| ogbg-molbbbp | sgc | rocauc | 1 | 0.9300 +/- 0.0000 | 0.6239 +/- 0.0000 | +| ogbg-molbbbp | tag | rocauc | 1 | 0.9476 +/- 0.0000 | 0.6100 +/- 0.0000 | +| ogbg-molbbbp | transformer | rocauc | 1 | 0.9495 +/- 0.0000 | 0.6156 +/- 0.0000 | +| ogbg-molhiv | appnp | rocauc | 1 | 0.7675 +/- 0.0000 | 0.7000 +/- 0.0000 | +| ogbg-molhiv | arma | rocauc | 1 | 0.7872 +/- 0.0000 | 0.7296 +/- 0.0000 | +| ogbg-molhiv | cheb | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7282 +/- 0.0000 | +| ogbg-molhiv | film | rocauc | 1 | 0.7922 +/- 0.0000 | 0.7842 +/- 0.0000 | +| ogbg-molhiv | gatv2 | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7563 +/- 0.0000 | +| ogbg-molhiv | gcn | rocauc | 1 | 0.7754 +/- 0.0000 | 0.7198 +/- 0.0000 | +| ogbg-molhiv | gen | rocauc | 1 | 0.7530 +/- 0.0000 | 0.7314 +/- 0.0000 | +| ogbg-molhiv | gin | rocauc | 1 | 0.8167 +/- 0.0000 | 0.7724 +/- 0.0000 | +| ogbg-molhiv | gine | rocauc | 1 | 0.7942 +/- 0.0000 | 0.7445 +/- 0.0000 | +| ogbg-molhiv | graphconv | rocauc | 1 | 0.7707 +/- 0.0000 | 0.7108 +/- 0.0000 | +| ogbg-molhiv | graphsage | rocauc | 1 | 0.7969 +/- 0.0000 | 0.7625 +/- 0.0000 | +| ogbg-molhiv | mf | rocauc | 1 | 0.7845 +/- 0.0000 | 0.7074 +/- 0.0000 | +| ogbg-molhiv | pna | rocauc | 1 | 0.7780 +/- 0.0000 | 0.7648 +/- 0.0000 | +| ogbg-molhiv | resgated | rocauc | 1 | 0.8144 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molhiv | sgc | rocauc | 1 | 0.7479 +/- 0.0000 | 0.7019 +/- 0.0000 | +| ogbg-molhiv | tag | rocauc | 1 | 0.7528 +/- 0.0000 | 0.7255 +/- 0.0000 | +| ogbg-molhiv | transformer | rocauc | 1 | 0.7617 +/- 0.0000 | 0.7547 +/- 0.0000 | +| ogbg-moltox21 | appnp | rocauc | 1 | 0.7255 +/- 0.0000 | 0.7158 +/- 0.0000 | +| ogbg-moltox21 | arma | rocauc | 1 | 0.7799 +/- 0.0000 | 0.7223 +/- 0.0000 | +| ogbg-moltox21 | cheb | rocauc | 1 | 0.7834 +/- 0.0000 | 0.7301 +/- 0.0000 | +| ogbg-moltox21 | film | rocauc | 1 | 0.7702 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gatv2 | rocauc | 1 | 0.7627 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gcn | rocauc | 1 | 0.7580 +/- 0.0000 | 0.7171 +/- 0.0000 | +| ogbg-moltox21 | gen | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7444 +/- 0.0000 | +| ogbg-moltox21 | gin | rocauc | 1 | 0.7690 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-moltox21 | gine | rocauc | 1 | 0.7744 +/- 0.0000 | 0.7328 +/- 0.0000 | +| ogbg-moltox21 | graphconv | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7147 +/- 0.0000 | +| ogbg-moltox21 | graphsage | rocauc | 1 | 0.7709 +/- 0.0000 | 0.7196 +/- 0.0000 | +| ogbg-moltox21 | mf | rocauc | 1 | 0.7773 +/- 0.0000 | 0.7281 +/- 0.0000 | +| ogbg-moltox21 | pna | rocauc | 1 | 0.7660 +/- 0.0000 | 0.6946 +/- 0.0000 | +| ogbg-moltox21 | resgated | rocauc | 1 | 0.7950 +/- 0.0000 | 0.7275 +/- 0.0000 | +| ogbg-moltox21 | sgc | rocauc | 1 | 0.7611 +/- 0.0000 | 0.7240 +/- 0.0000 | +| ogbg-moltox21 | tag | rocauc | 1 | 0.7866 +/- 0.0000 | 0.7416 +/- 0.0000 | +| ogbg-moltox21 | transformer | rocauc | 1 | 0.7656 +/- 0.0000 | 0.7309 +/- 0.0000 | + +Delta vs matching classic +| task | backbone | compute | metric | n | val score (delta) | test score (delta) | steps | +| --- | --- | --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7168 (0.0604) | 0.7209 (-0.0214) | | +| ogbg-molbace | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7179 (0.0256) | 0.7672 (-0.0167) | | +| ogbg-molbace | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7114 (-0.0154) | 0.7533 (-0.0436) | | +| ogbg-molbace | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6652 (-0.0051) | 0.7242 (0.0000) | | +| ogbg-molbace | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7026 (-0.0004) | 0.7519 (0.0118) | | +| ogbg-molbace | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6374 (-0.0007) | 0.7733 (0.0339) | | +| ogbg-molbace | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6894 (-0.0234) | 0.7449 (0.0123) | | +| ogbg-molbace | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6538 (0.0018) | 0.7169 (-0.0167) | | +| ogbg-molbace | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6685 (0.0044) | 0.6994 (-0.0461) | | +| ogbg-molbace | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7462 (0.0150) | 0.7983 (-0.0052) | | +| ogbg-molbace | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6703 (-0.0055) | 0.7119 (-0.0640) | | +| ogbg-molbace | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7234 (-0.0187) | 0.7684 (-0.0077) | | +| ogbg-molbace | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7037 (-0.0480) | 0.7967 (0.1055) | | +| ogbg-molbace | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6912 (-0.0260) | 0.7465 (-0.0412) | | +| ogbg-molbace | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6454 (-0.0121) | 0.7727 (0.0762) | | +| ogbg-molbace | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7355 (0.0271) | 0.6806 (-0.0539) | | +| ogbg-molbace | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6982 (0.0319) | 0.7487 (0.0123) | | +| ogbg-molbbbp | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9360 (0.0213) | 0.6073 (-0.0314) | | +| ogbg-molbbbp | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9415 (0.0048) | 0.6635 (-0.0016) | | +| ogbg-molbbbp | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9278 (-0.0174) | 0.6659 (0.0145) | | +| ogbg-molbbbp | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9400 (0.0115) | 0.6323 (0.0023) | | +| ogbg-molbbbp | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9356 (0.0009) | 0.6560 (0.0235) | | +| ogbg-molbbbp | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9417 (0.0031) | 0.6017 (-0.0663) | | +| ogbg-molbbbp | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9429 (-0.0119) | 0.6037 (-0.0738) | | +| ogbg-molbbbp | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9526 (0.0275) | 0.5932 (0.0261) | | +| ogbg-molbbbp | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9421 (0.0098) | 0.6976 (0.0816) | | +| ogbg-molbbbp | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9337 (0.0069) | 0.6518 (0.0618) | | +| ogbg-molbbbp | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9502 (0.0019) | 0.5934 (-0.0354) | | +| ogbg-molbbbp | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9488 (0.0094) | 0.6481 (0.0116) | | +| ogbg-molbbbp | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9585 (0.0031) | 0.6682 (0.0264) | | +| ogbg-molbbbp | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9535 (0.0352) | 0.5839 (-0.0787) | | +| ogbg-molbbbp | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9285 (-0.0015) | 0.6454 (0.0215) | | +| ogbg-molbbbp | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9459 (-0.0017) | 0.6420 (0.0320) | | +| ogbg-molbbbp | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9355 (-0.0140) | 0.6221 (0.0065) | | +| ogbg-molhiv | appnp | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7203 (-0.0471) | 0.6825 (-0.0175) | | +| ogbg-molhiv | arma | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7926 (0.0054) | 0.7318 (0.0021) | | +| ogbg-molhiv | cheb | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7735 (-0.0096) | 0.7426 (0.0144) | | +| ogbg-molhiv | film | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7633 (-0.0288) | 0.7728 (-0.0114) | | +| ogbg-molhiv | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8049 (0.0214) | 0.7486 (-0.0077) | | +| ogbg-molhiv | gatv2 | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7835 (0.0001) | 0.7466 (-0.0096) | | +| ogbg-molhiv | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7833 (0.0079) | 0.7448 (0.0250) | | +| ogbg-molhiv | gcn | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7455 (-0.0300) | 0.7483 (0.0285) | | +| ogbg-molhiv | gen | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8128 (0.0598) | 0.7631 (0.0318) | | +| ogbg-molhiv | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0457) | 0.7668 (-0.0056) | | +| ogbg-molhiv | gin | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7524 (-0.0644) | 0.7324 (-0.0400) | | +| ogbg-molhiv | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7490 (-0.0453) | 0.7376 (-0.0070) | | +| ogbg-molhiv | gine | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7575 (-0.0368) | 0.7401 (-0.0044) | | +| ogbg-molhiv | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7817 (0.0110) | 0.7493 (0.0385) | | +| ogbg-molhiv | graphconv | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7713 (0.0006) | 0.6979 (-0.0129) | | +| ogbg-molhiv | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7893 (-0.0075) | 0.7633 (0.0008) | | +| ogbg-molhiv | graphsage | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7587 (-0.0382) | 0.7641 (0.0016) | | +| ogbg-molhiv | mf | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7931 (0.0085) | 0.7217 (0.0143) | | +| ogbg-molhiv | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8097 (0.0317) | 0.7602 (-0.0046) | | +| ogbg-molhiv | pna | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7890 (0.0111) | 0.7630 (-0.0018) | | +| ogbg-molhiv | resgated | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8174 (0.0030) | 0.7055 (-0.0187) | | +| ogbg-molhiv | sgc | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7482 (0.0003) | 0.7177 (0.0158) | | +| ogbg-molhiv | tag | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7804 (0.0276) | 0.7352 (0.0096) | | +| ogbg-molhiv | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7838 (0.0221) | 0.7648 (0.0100) | | +| ogbg-molhiv | transformer | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8088 (0.0471) | 0.7413 (-0.0134) | | +| ogbg-moltox21 | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7280 (0.0025) | 0.7154 (-0.0005) | | +| ogbg-moltox21 | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7771 (-0.0028) | 0.7209 (-0.0014) | | +| ogbg-moltox21 | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0125) | 0.7286 (-0.0015) | | +| ogbg-moltox21 | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7727 (0.0025) | 0.7369 (0.0209) | | +| ogbg-moltox21 | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7762 (0.0135) | 0.7303 (0.0143) | | +| ogbg-moltox21 | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7588 (0.0007) | 0.7230 (0.0059) | | +| ogbg-moltox21 | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7757 (-0.0077) | 0.7312 (-0.0132) | | +| ogbg-moltox21 | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7718 (0.0028) | 0.7237 (-0.0005) | | +| ogbg-moltox21 | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7622 (-0.0122) | 0.7193 (-0.0135) | | +| ogbg-moltox21 | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7820 (-0.0011) | 0.7313 (0.0166) | | +| ogbg-moltox21 | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7697 (-0.0012) | 0.7205 (0.0009) | | +| ogbg-moltox21 | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7695 (-0.0078) | 0.7279 (-0.0002) | | +| ogbg-moltox21 | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7745 (0.0085) | 0.7349 (0.0403) | | +| ogbg-moltox21 | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7887 (-0.0064) | 0.7380 (0.0104) | | +| ogbg-moltox21 | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7506 (-0.0105) | 0.7355 (0.0115) | | +| ogbg-moltox21 | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7839 (-0.0027) | 0.7342 (-0.0074) | | +| ogbg-moltox21 | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7761 (0.0105) | 0.7292 (-0.0018) | | diff --git a/logs/ogbg-moltox21_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log b/logs/ogbg-moltox21_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log new file mode 100644 index 0000000..daf20a1 --- /dev/null +++ b/logs/ogbg-moltox21_act_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_e100_s0.log @@ -0,0 +1,164 @@ +[run] ogbg-moltox21 view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/tox21.zip +
0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 0%| | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 2.13it/s]
Downloaded 0.00 GB: 50%|█████ | 1/2 [00:00<00:00, 2.13it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 4.25it/s] +Processing... +Extracting /home/yurenh2/rrog-gnn-runner/data/ogb/tox21.zip +Loading necessary files... +This might take a while. +Processing graphs... +
0%| | 0/7831 [00:00<?, ?it/s]
100%|██████████| 7831/7831 [00:00<00:00, 162374.47it/s] +Converting graphs into PyG objects... +
0%| | 0/7831 [00:00<?, ?it/s]
100%|██████████| 7831/7831 [00:00<00:00, 91009.23it/s] +Done! +Saving... +ep10 val_rocauc=0.71371 val_adapt_rocauc=0.69966 adapt_steps=3.11 halt=0.29 train_steps=2.95 +ep20 val_rocauc=0.63487 val_adapt_rocauc=0.60317 adapt_steps=2.49 halt=0.29 train_steps=2.93 +ep30 val_rocauc=0.71755 val_adapt_rocauc=0.70846 adapt_steps=3.98 halt=0.28 train_steps=2.98 +ep40 val_rocauc=0.71255 val_adapt_rocauc=0.68936 adapt_steps=3.00 halt=0.29 train_steps=2.94 +ep50 val_rocauc=0.72362 val_adapt_rocauc=0.72481 adapt_steps=3.24 halt=0.28 train_steps=3.16 +ep60 val_rocauc=0.71946 val_adapt_rocauc=0.72876 adapt_steps=3.93 halt=0.28 train_steps=3.08 +ep70 val_rocauc=0.72799 val_adapt_rocauc=0.73083 adapt_steps=3.71 halt=0.28 train_steps=3.13 +ep80 val_rocauc=0.75666 val_adapt_rocauc=0.76164 adapt_steps=4.28 halt=0.29 train_steps=3.06 +ep90 val_rocauc=0.75393 val_adapt_rocauc=0.76254 adapt_steps=3.78 halt=0.29 train_steps=3.06 +ep100 val_rocauc=0.76113 val_adapt_rocauc=0.76936 adapt_steps=3.90 halt=0.29 train_steps=3.04 +[ogbg-moltox21_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.7611296131897838} test={'rocauc': 0.7089667909334546} adaptive={'rocauc': 0.7126552901719999} steps=3.826530612244898 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-moltox21_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.59058 val_adapt_rocauc=0.61606 adapt_steps=2.60 halt=0.29 train_steps=2.95 +ep20 val_rocauc=0.73407 val_adapt_rocauc=0.73772 adapt_steps=4.45 halt=0.28 train_steps=3.03 +ep30 val_rocauc=0.66805 val_adapt_rocauc=0.67628 adapt_steps=2.39 halt=0.31 train_steps=2.83 +ep40 val_rocauc=0.75097 val_adapt_rocauc=0.75197 adapt_steps=3.77 halt=0.30 train_steps=2.93 +ep50 val_rocauc=0.75364 val_adapt_rocauc=0.75297 adapt_steps=2.95 halt=0.32 train_steps=2.68 +ep60 val_rocauc=0.76552 val_adapt_rocauc=0.77043 adapt_steps=3.76 halt=0.31 train_steps=2.86 +ep70 val_rocauc=0.75776 val_adapt_rocauc=0.75709 adapt_steps=3.80 halt=0.34 train_steps=2.62 +ep80 val_rocauc=0.75257 val_adapt_rocauc=0.76572 adapt_steps=2.98 halt=0.35 train_steps=2.57 +ep90 val_rocauc=0.75894 val_adapt_rocauc=0.76629 adapt_steps=2.81 halt=0.37 train_steps=2.40 +ep100 val_rocauc=0.75414 val_adapt_rocauc=0.76330 adapt_steps=2.75 halt=0.37 train_steps=2.36 +[ogbg-moltox21_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.7655200134252199} test={'rocauc': 0.7134396419831454} adaptive={'rocauc': 0.7234036772214454} steps=3.764030612244898 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-moltox21_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.66429 val_adapt_rocauc=0.65320 adapt_steps=3.43 halt=0.30 train_steps=2.88 +ep20 val_rocauc=0.68343 val_adapt_rocauc=0.70058 adapt_steps=2.30 halt=0.28 train_steps=3.01 +ep30 val_rocauc=0.74431 val_adapt_rocauc=0.74038 adapt_steps=3.91 halt=0.28 train_steps=3.06 +ep40 val_rocauc=0.77575 val_adapt_rocauc=0.78093 adapt_steps=3.57 halt=0.29 train_steps=3.01 +ep50 val_rocauc=0.76411 val_adapt_rocauc=0.76469 adapt_steps=3.98 halt=0.28 train_steps=3.10 +ep60 val_rocauc=0.74714 val_adapt_rocauc=0.75263 adapt_steps=4.61 halt=0.29 train_steps=2.98 +ep70 val_rocauc=0.76848 val_adapt_rocauc=0.77476 adapt_steps=3.52 halt=0.31 train_steps=2.93 +ep80 val_rocauc=0.77621 val_adapt_rocauc=0.77758 adapt_steps=3.50 halt=0.30 train_steps=2.90 +ep90 val_rocauc=0.77792 val_adapt_rocauc=0.77851 adapt_steps=3.40 halt=0.32 train_steps=2.79 +ep100 val_rocauc=0.77758 val_adapt_rocauc=0.77971 adapt_steps=3.31 halt=0.32 train_steps=2.76 +[ogbg-moltox21_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rocauc': 0.7779156296831152} test={'rocauc': 0.7359551442188313} adaptive={'rocauc': 0.7477856114096909} steps=3.485969387755102 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-moltox21_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.65297 val_adapt_rocauc=0.67456 adapt_steps=3.02 halt=0.29 train_steps=2.89 +ep20 val_rocauc=0.58464 val_adapt_rocauc=0.57802 adapt_steps=2.47 halt=0.28 train_steps=3.08 +ep30 val_rocauc=0.67479 val_adapt_rocauc=0.66288 adapt_steps=2.71 halt=0.28 train_steps=3.03 +ep40 val_rocauc=0.73567 val_adapt_rocauc=0.72464 adapt_steps=4.40 halt=0.29 train_steps=2.94 +ep50 val_rocauc=0.74825 val_adapt_rocauc=0.74753 adapt_steps=3.90 halt=0.30 train_steps=2.89 +ep60 val_rocauc=0.74074 val_adapt_rocauc=0.74859 adapt_steps=3.41 halt=0.29 train_steps=3.03 +ep70 val_rocauc=0.76016 val_adapt_rocauc=0.76365 adapt_steps=3.69 halt=0.32 train_steps=2.78 +ep80 val_rocauc=0.76849 val_adapt_rocauc=0.77008 adapt_steps=3.87 halt=0.32 train_steps=2.79 +ep90 val_rocauc=0.76637 val_adapt_rocauc=0.76973 adapt_steps=3.59 halt=0.31 train_steps=2.86 +ep100 val_rocauc=0.77008 val_adapt_rocauc=0.77327 adapt_steps=3.50 halt=0.32 train_steps=2.79 +[ogbg-moltox21_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.7700778158549199} test={'rocauc': 0.7162575064186166} adaptive={'rocauc': 0.7254468026027986} steps=3.506377551020408 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-moltox21_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.67403 val_adapt_rocauc=0.66074 adapt_steps=5.50 halt=0.30 train_steps=2.85 +ep20 val_rocauc=0.72382 val_adapt_rocauc=0.72638 adapt_steps=4.50 halt=0.29 train_steps=2.98 +ep30 val_rocauc=0.74375 val_adapt_rocauc=0.74426 adapt_steps=4.91 halt=0.30 train_steps=2.93 +ep40 val_rocauc=0.76136 val_adapt_rocauc=0.75836 adapt_steps=4.87 halt=0.30 train_steps=2.95 +ep50 val_rocauc=0.77110 val_adapt_rocauc=0.76887 adapt_steps=3.39 halt=0.31 train_steps=2.88 +ep60 val_rocauc=0.76514 val_adapt_rocauc=0.76428 adapt_steps=3.77 halt=0.30 train_steps=2.93 +ep70 val_rocauc=0.77659 val_adapt_rocauc=0.78194 adapt_steps=3.61 halt=0.33 train_steps=2.73 +ep80 val_rocauc=0.78163 val_adapt_rocauc=0.78200 adapt_steps=3.14 halt=0.32 train_steps=2.79 +ep90 val_rocauc=0.77395 val_adapt_rocauc=0.77600 adapt_steps=3.46 halt=0.34 train_steps=2.63 +ep100 val_rocauc=0.77629 val_adapt_rocauc=0.78067 adapt_steps=3.51 halt=0.34 train_steps=2.67 +[ogbg-moltox21_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.7816268997660386} test={'rocauc': 0.7115162457844392} adaptive={'rocauc': 0.7190898385325345} steps=3.205357142857143 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-moltox21_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.67337 val_adapt_rocauc=0.68763 adapt_steps=3.64 halt=0.31 train_steps=2.73 +ep20 val_rocauc=0.70783 val_adapt_rocauc=0.71959 adapt_steps=3.12 halt=0.30 train_steps=2.88 +ep30 val_rocauc=0.70171 val_adapt_rocauc=0.71441 adapt_steps=3.00 halt=0.30 train_steps=2.88 +ep40 val_rocauc=0.71979 val_adapt_rocauc=0.72206 adapt_steps=3.04 halt=0.31 train_steps=2.84 +ep50 val_rocauc=0.71376 val_adapt_rocauc=0.72112 adapt_steps=2.58 halt=0.32 train_steps=2.70 +ep60 val_rocauc=0.71062 val_adapt_rocauc=0.72892 adapt_steps=2.53 halt=0.37 train_steps=2.29 +ep70 val_rocauc=0.72376 val_adapt_rocauc=0.73807 adapt_steps=2.52 halt=0.38 train_steps=2.29 +ep80 val_rocauc=0.71834 val_adapt_rocauc=0.74502 adapt_steps=2.27 halt=0.38 train_steps=2.25 +ep90 val_rocauc=0.71743 val_adapt_rocauc=0.73867 adapt_steps=2.35 halt=0.40 train_steps=2.13 +ep100 val_rocauc=0.72314 val_adapt_rocauc=0.74270 adapt_steps=2.30 halt=0.39 train_steps=2.20 +[ogbg-moltox21_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.7237576716525247} test={'rocauc': 0.6822930471359431} adaptive={'rocauc': 0.7137838364459371} steps=2.63265306122449 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-moltox21_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=pna compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view pna --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.67622 val_adapt_rocauc=0.68638 adapt_steps=2.73 halt=0.29 train_steps=2.84 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.70913 val_adapt_rocauc=0.71306 adapt_steps=3.51 halt=0.30 train_steps=2.87 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.72224 val_adapt_rocauc=0.71267 adapt_steps=3.47 halt=0.29 train_steps=2.94 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.72374 val_adapt_rocauc=0.72731 adapt_steps=2.78 halt=0.30 train_steps=2.99 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.68200 val_adapt_rocauc=0.67391 adapt_steps=2.33 halt=0.29 train_steps=2.98 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.67336 val_adapt_rocauc=0.67501 adapt_steps=6.05 halt=0.31 train_steps=2.84 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.73655 val_adapt_rocauc=0.74091 adapt_steps=3.35 halt=0.30 train_steps=2.92 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.74975 val_adapt_rocauc=0.75746 adapt_steps=4.96 halt=0.29 train_steps=3.02 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.75471 val_adapt_rocauc=0.76064 adapt_steps=4.10 halt=0.29 train_steps=3.02 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.75208 val_adapt_rocauc=0.76070 adapt_steps=3.94 halt=0.30 train_steps=2.96 +[ogbg-moltox21_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rocauc': 0.7547109180572619} test={'rocauc': 0.6948890646179361} adaptive={'rocauc': 0.7075025478713003} steps=4.220663265306122 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-moltox21_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=resgated compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view resgated --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0 +ep10 val_rocauc=0.70487 val_adapt_rocauc=0.70394 adapt_steps=5.69 halt=0.30 train_steps=2.83 +ep20 val_rocauc=0.69675 val_adapt_rocauc=0.69557 adapt_steps=4.74 halt=0.29 train_steps=2.99 +ep30 val_rocauc=0.66699 val_adapt_rocauc=0.63127 adapt_steps=5.03 halt=0.28 train_steps=3.06 +ep40 val_rocauc=0.74485 val_adapt_rocauc=0.75016 adapt_steps=3.17 halt=0.29 train_steps=2.99 +ep50 val_rocauc=0.76238 val_adapt_rocauc=0.76296 adapt_steps=3.47 halt=0.30 train_steps=2.94 +ep60 val_rocauc=0.75613 val_adapt_rocauc=0.75760 adapt_steps=3.12 halt=0.30 train_steps=2.92 +ep70 val_rocauc=0.75660 val_adapt_rocauc=0.75749 adapt_steps=3.60 halt=0.33 train_steps=2.70 +ep80 val_rocauc=0.77965 val_adapt_rocauc=0.78270 adapt_steps=3.04 halt=0.33 train_steps=2.71 +ep90 val_rocauc=0.77346 val_adapt_rocauc=0.77623 adapt_steps=3.25 halt=0.35 train_steps=2.54 +ep100 val_rocauc=0.77053 val_adapt_rocauc=0.77614 adapt_steps=3.10 halt=0.36 train_steps=2.49 +[ogbg-moltox21_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.7796493691111651} test={'rocauc': 0.7201514791915015} adaptive={'rocauc': 0.7223894069034307} steps=3.0778061224489797 + wrote /home/yurenh2/rrog-gnn-runner/runs/ogbg-moltox21_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json diff --git a/logs/ogbg-moltox21_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log b/logs/ogbg-moltox21_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log new file mode 100644 index 0000000..f6f668c --- /dev/null +++ b/logs/ogbg-moltox21_act_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_e100_s0.log @@ -0,0 +1,278 @@ +[run] ogbg-moltox21 view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.73518 val_adapt_rocauc=0.73087 adapt_steps=4.49 halt=0.28 train_steps=2.97 +ep20 val_rocauc=0.71039 val_adapt_rocauc=0.70931 adapt_steps=4.19 halt=0.28 train_steps=3.12 +ep30 val_rocauc=0.64736 val_adapt_rocauc=0.64143 adapt_steps=2.97 halt=0.28 train_steps=3.01 +ep40 val_rocauc=0.72656 val_adapt_rocauc=0.72350 adapt_steps=4.94 halt=0.27 train_steps=3.15 +ep50 val_rocauc=0.68867 val_adapt_rocauc=0.72256 adapt_steps=3.45 halt=0.29 train_steps=3.01 +ep60 val_rocauc=0.73756 val_adapt_rocauc=0.73596 adapt_steps=5.25 halt=0.28 train_steps=3.07 +ep70 val_rocauc=0.76341 val_adapt_rocauc=0.76107 adapt_steps=4.26 halt=0.29 train_steps=3.08 +ep80 val_rocauc=0.75486 val_adapt_rocauc=0.76475 adapt_steps=4.17 halt=0.30 train_steps=2.91 +ep90 val_rocauc=0.75145 val_adapt_rocauc=0.76691 adapt_steps=3.96 halt=0.31 train_steps=2.86 +ep100 val_rocauc=0.75282 val_adapt_rocauc=0.76451 adapt_steps=4.03 halt=0.30 train_steps=2.99 +[ogbg-moltox21_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.763406691780224} test={'rocauc': 0.7044116432874441} adaptive={'rocauc': 0.7111955163056712} steps=4.165816326530612 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=gine compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view gine --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.66186 val_adapt_rocauc=0.66299 adapt_steps=3.61 halt=0.28 train_steps=3.04 +ep20 val_rocauc=0.71740 val_adapt_rocauc=0.70641 adapt_steps=4.29 halt=0.30 train_steps=2.97 +ep30 val_rocauc=0.67926 val_adapt_rocauc=0.66414 adapt_steps=3.89 halt=0.28 train_steps=3.03 +ep40 val_rocauc=0.71787 val_adapt_rocauc=0.71626 adapt_steps=3.31 halt=0.29 train_steps=2.99 +ep50 val_rocauc=0.71826 val_adapt_rocauc=0.72383 adapt_steps=4.48 halt=0.29 train_steps=2.99 +ep60 val_rocauc=0.74768 val_adapt_rocauc=0.74921 adapt_steps=4.13 halt=0.29 train_steps=2.98 +ep70 val_rocauc=0.75742 val_adapt_rocauc=0.75384 adapt_steps=3.98 halt=0.29 train_steps=3.08 +ep80 val_rocauc=0.75643 val_adapt_rocauc=0.74987 adapt_steps=4.43 halt=0.31 train_steps=2.96 +ep90 val_rocauc=0.75761 val_adapt_rocauc=0.75256 adapt_steps=4.07 halt=0.30 train_steps=2.99 +ep100 val_rocauc=0.76165 val_adapt_rocauc=0.75534 adapt_steps=4.04 halt=0.31 train_steps=2.91 +[ogbg-moltox21_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.7616493170582249} test={'rocauc': 0.7120140634942237} adaptive={'rocauc': 0.7177387150880706} steps=3.931122448979592 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=gcn compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view gcn --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.71516 val_adapt_rocauc=0.71843 adapt_steps=2.53 halt=0.29 train_steps=2.97 +ep20 val_rocauc=0.72992 val_adapt_rocauc=0.72176 adapt_steps=3.40 halt=0.30 train_steps=2.91 +ep30 val_rocauc=0.71748 val_adapt_rocauc=0.73422 adapt_steps=2.90 halt=0.30 train_steps=2.89 +ep40 val_rocauc=0.75509 val_adapt_rocauc=0.75981 adapt_steps=2.73 halt=0.32 train_steps=2.77 +ep50 val_rocauc=0.75894 val_adapt_rocauc=0.75514 adapt_steps=3.85 halt=0.33 train_steps=2.68 +ep60 val_rocauc=0.76775 val_adapt_rocauc=0.77369 adapt_steps=3.11 halt=0.35 train_steps=2.52 +ep70 val_rocauc=0.75412 val_adapt_rocauc=0.76445 adapt_steps=2.73 halt=0.38 train_steps=2.25 +ep80 val_rocauc=0.74793 val_adapt_rocauc=0.76557 adapt_steps=2.42 halt=0.40 train_steps=2.14 +ep90 val_rocauc=0.74992 val_adapt_rocauc=0.76933 adapt_steps=2.46 halt=0.42 train_steps=2.04 +ep100 val_rocauc=0.74961 val_adapt_rocauc=0.76962 adapt_steps=2.47 halt=0.42 train_steps=1.98 +[ogbg-moltox21_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.7677478126932855} test={'rocauc': 0.7135675459281269} adaptive={'rocauc': 0.7247326710130202} steps=3.2589285714285716 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=graphsage compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view graphsage --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.66353 val_adapt_rocauc=0.66241 adapt_steps=6.17 halt=0.30 train_steps=2.79 +ep20 val_rocauc=0.69687 val_adapt_rocauc=0.71600 adapt_steps=3.03 halt=0.28 train_steps=3.04 +ep30 val_rocauc=0.74011 val_adapt_rocauc=0.73276 adapt_steps=3.99 halt=0.30 train_steps=2.91 +ep40 val_rocauc=0.77334 val_adapt_rocauc=0.77752 adapt_steps=4.25 halt=0.31 train_steps=2.82 +ep50 val_rocauc=0.77022 val_adapt_rocauc=0.78137 adapt_steps=3.56 halt=0.32 train_steps=2.78 +ep60 val_rocauc=0.77918 val_adapt_rocauc=0.77520 adapt_steps=3.29 halt=0.34 train_steps=2.65 +ep70 val_rocauc=0.77387 val_adapt_rocauc=0.77500 adapt_steps=2.79 halt=0.37 train_steps=2.37 +ep80 val_rocauc=0.76848 val_adapt_rocauc=0.77284 adapt_steps=2.96 halt=0.40 train_steps=2.15 +ep90 val_rocauc=0.76947 val_adapt_rocauc=0.77447 adapt_steps=2.75 halt=0.40 train_steps=2.14 +ep100 val_rocauc=0.77243 val_adapt_rocauc=0.77696 adapt_steps=2.73 halt=0.40 train_steps=2.18 +[ogbg-moltox21_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.7791810357079593} test={'rocauc': 0.7217088253529022} adaptive={'rocauc': 0.7282454305579198} steps=3.3903061224489797 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=gatv2 compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view gatv2 --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.68214 val_adapt_rocauc=0.66532 adapt_steps=3.94 halt=0.27 train_steps=3.13 +ep20 val_rocauc=0.74877 val_adapt_rocauc=0.73707 adapt_steps=4.38 halt=0.29 train_steps=2.96 +ep30 val_rocauc=0.76735 val_adapt_rocauc=0.76425 adapt_steps=4.05 halt=0.30 train_steps=2.88 +ep40 val_rocauc=0.74010 val_adapt_rocauc=0.74347 adapt_steps=3.25 halt=0.31 train_steps=2.84 +ep50 val_rocauc=0.75964 val_adapt_rocauc=0.75650 adapt_steps=4.19 halt=0.33 train_steps=2.73 +ep60 val_rocauc=0.76484 val_adapt_rocauc=0.76741 adapt_steps=3.80 halt=0.30 train_steps=2.94 +ep70 val_rocauc=0.75529 val_adapt_rocauc=0.76640 adapt_steps=3.48 halt=0.35 train_steps=2.56 +ep80 val_rocauc=0.74656 val_adapt_rocauc=0.75879 adapt_steps=2.90 halt=0.36 train_steps=2.46 +ep90 val_rocauc=0.73882 val_adapt_rocauc=0.75668 adapt_steps=3.01 halt=0.39 train_steps=2.26 +ep100 val_rocauc=0.73632 val_adapt_rocauc=0.75539 adapt_steps=2.97 halt=0.38 train_steps=2.35 +[ogbg-moltox21_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=30 val={'rocauc': 0.767354951757618} test={'rocauc': 0.7155377552729235} adaptive={'rocauc': 0.7172144629316312} steps=4.042091836734694 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=graphconv compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view graphconv --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.70226 val_adapt_rocauc=0.68368 adapt_steps=4.53 halt=0.28 train_steps=3.06 +ep20 val_rocauc=0.69482 val_adapt_rocauc=0.69973 adapt_steps=2.94 halt=0.28 train_steps=3.02 +ep30 val_rocauc=0.73997 val_adapt_rocauc=0.72387 adapt_steps=3.56 halt=0.29 train_steps=2.95 +ep40 val_rocauc=0.73715 val_adapt_rocauc=0.74654 adapt_steps=3.93 halt=0.30 train_steps=2.93 +ep50 val_rocauc=0.76406 val_adapt_rocauc=0.76634 adapt_steps=4.12 halt=0.33 train_steps=2.73 +ep60 val_rocauc=0.74500 val_adapt_rocauc=0.77410 adapt_steps=3.28 halt=0.35 train_steps=2.53 +ep70 val_rocauc=0.74134 val_adapt_rocauc=0.76240 adapt_steps=3.34 halt=0.38 train_steps=2.30 +ep80 val_rocauc=0.74270 val_adapt_rocauc=0.76980 adapt_steps=3.36 halt=0.37 train_steps=2.39 +ep90 val_rocauc=0.74651 val_adapt_rocauc=0.76905 adapt_steps=2.91 halt=0.39 train_steps=2.26 +ep100 val_rocauc=0.74268 val_adapt_rocauc=0.76713 adapt_steps=2.77 halt=0.38 train_steps=2.29 +[ogbg-moltox21_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=50 val={'rocauc': 0.7640586359961631} test={'rocauc': 0.721040156330531} adaptive={'rocauc': 0.732265876016213} steps=4.089285714285714 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=transformer compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view transformer --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.67594 val_adapt_rocauc=0.67877 adapt_steps=2.90 halt=0.27 train_steps=3.04 +ep20 val_rocauc=0.74853 val_adapt_rocauc=0.75119 adapt_steps=4.17 halt=0.28 train_steps=3.04 +ep30 val_rocauc=0.75978 val_adapt_rocauc=0.77013 adapt_steps=3.66 halt=0.28 train_steps=3.06 +ep40 val_rocauc=0.78399 val_adapt_rocauc=0.79071 adapt_steps=4.20 halt=0.32 train_steps=2.76 +ep50 val_rocauc=0.76021 val_adapt_rocauc=0.77394 adapt_steps=3.78 halt=0.32 train_steps=2.70 +ep60 val_rocauc=0.77603 val_adapt_rocauc=0.77979 adapt_steps=3.46 halt=0.35 train_steps=2.50 +ep70 val_rocauc=0.78021 val_adapt_rocauc=0.78970 adapt_steps=2.86 halt=0.39 train_steps=2.27 +ep80 val_rocauc=0.77594 val_adapt_rocauc=0.78551 adapt_steps=2.57 halt=0.42 train_steps=2.00 +ep90 val_rocauc=0.77827 val_adapt_rocauc=0.78340 adapt_steps=2.53 halt=0.42 train_steps=2.00 +ep100 val_rocauc=0.77925 val_adapt_rocauc=0.78691 adapt_steps=2.50 halt=0.43 train_steps=1.93 +[ogbg-moltox21_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=40 val={'rocauc': 0.7839946999002233} test={'rocauc': 0.723701343716436} adaptive={'rocauc': 0.724166086603444} steps=4.32780612244898 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=pna compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view pna --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep10 val_rocauc=0.66669 val_adapt_rocauc=0.66243 adapt_steps=7.30 halt=0.29 train_steps=3.00 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_rocauc=0.69019 val_adapt_rocauc=0.67918 adapt_steps=5.84 halt=0.30 train_steps=2.85 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep30 val_rocauc=0.70422 val_adapt_rocauc=0.69523 adapt_steps=4.71 halt=0.28 train_steps=3.13 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep40 val_rocauc=0.71722 val_adapt_rocauc=0.71965 adapt_steps=2.52 halt=0.29 train_steps=2.95 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep50 val_rocauc=0.70706 val_adapt_rocauc=0.70996 adapt_steps=6.01 halt=0.30 train_steps=2.87 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep60 val_rocauc=0.73991 val_adapt_rocauc=0.74273 adapt_steps=4.85 halt=0.29 train_steps=2.98 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep70 val_rocauc=0.72423 val_adapt_rocauc=0.73134 adapt_steps=2.85 halt=0.31 train_steps=2.81 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep80 val_rocauc=0.75108 val_adapt_rocauc=0.74780 adapt_steps=4.23 halt=0.30 train_steps=2.91 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep90 val_rocauc=0.76247 val_adapt_rocauc=0.75804 adapt_steps=3.94 halt=0.32 train_steps=2.79 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep100 val_rocauc=0.75859 val_adapt_rocauc=0.75525 adapt_steps=3.88 halt=0.31 train_steps=2.83 +[ogbg-moltox21_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=90 val={'rocauc': 0.7624732674125697} test={'rocauc': 0.7137965144412185} adaptive={'rocauc': 0.7200143809038219} steps=4.058673469387755 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=gen compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view gen --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.65402 val_adapt_rocauc=0.65164 adapt_steps=3.07 halt=0.28 train_steps=2.91 +ep20 val_rocauc=0.67375 val_adapt_rocauc=0.66200 adapt_steps=3.13 halt=0.27 train_steps=3.10 +ep30 val_rocauc=0.70573 val_adapt_rocauc=0.70756 adapt_steps=3.81 halt=0.28 train_steps=3.02 +ep40 val_rocauc=0.73605 val_adapt_rocauc=0.74012 adapt_steps=3.52 halt=0.27 train_steps=3.16 +ep50 val_rocauc=0.71987 val_adapt_rocauc=0.73228 adapt_steps=3.73 halt=0.28 train_steps=3.07 +ep60 val_rocauc=0.74139 val_adapt_rocauc=0.73571 adapt_steps=3.62 halt=0.29 train_steps=3.01 +ep70 val_rocauc=0.74691 val_adapt_rocauc=0.74235 adapt_steps=3.40 halt=0.29 train_steps=3.05 +ep80 val_rocauc=0.75480 val_adapt_rocauc=0.76023 adapt_steps=3.50 halt=0.30 train_steps=2.97 +ep90 val_rocauc=0.75153 val_adapt_rocauc=0.75746 adapt_steps=3.76 halt=0.30 train_steps=2.96 +ep100 val_rocauc=0.75081 val_adapt_rocauc=0.76030 adapt_steps=3.70 halt=0.31 train_steps=2.86 +[ogbg-moltox21_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.7548045767051833} test={'rocauc': 0.7300226043604717} adaptive={'rocauc': 0.7365872982320871} steps=3.433673469387755 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=film compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view film --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.57757 val_adapt_rocauc=0.58541 adapt_steps=3.29 halt=0.31 train_steps=2.50 +ep20 val_rocauc=0.55966 val_adapt_rocauc=0.57096 adapt_steps=4.07 halt=0.28 train_steps=2.95 +ep30 val_rocauc=0.67643 val_adapt_rocauc=0.69130 adapt_steps=3.16 halt=0.28 train_steps=3.07 +ep40 val_rocauc=0.69186 val_adapt_rocauc=0.69814 adapt_steps=4.81 halt=0.28 train_steps=3.08 +ep50 val_rocauc=0.65619 val_adapt_rocauc=0.67613 adapt_steps=3.51 halt=0.27 train_steps=3.19 +ep60 val_rocauc=0.70395 val_adapt_rocauc=0.71660 adapt_steps=3.19 halt=0.31 train_steps=2.93 +ep70 val_rocauc=0.72848 val_adapt_rocauc=0.73235 adapt_steps=3.83 halt=0.31 train_steps=2.87 +ep80 val_rocauc=0.74847 val_adapt_rocauc=0.75433 adapt_steps=4.28 halt=0.30 train_steps=3.00 +ep90 val_rocauc=0.74854 val_adapt_rocauc=0.75584 adapt_steps=3.98 halt=0.32 train_steps=2.89 +ep100 val_rocauc=0.75129 val_adapt_rocauc=0.75550 adapt_steps=3.77 halt=0.32 train_steps=2.83 +[ogbg-moltox21_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.7512888457712221} test={'rocauc': 0.6885051838242511} adaptive={'rocauc': 0.6897262581951776} steps=3.55484693877551 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=resgated compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view resgated --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.69369 val_adapt_rocauc=0.68651 adapt_steps=3.85 halt=0.28 train_steps=3.03 +ep20 val_rocauc=0.73254 val_adapt_rocauc=0.71275 adapt_steps=5.04 halt=0.27 train_steps=3.19 +ep30 val_rocauc=0.70299 val_adapt_rocauc=0.70576 adapt_steps=3.07 halt=0.31 train_steps=2.80 +ep40 val_rocauc=0.76163 val_adapt_rocauc=0.76283 adapt_steps=4.54 halt=0.30 train_steps=2.90 +ep50 val_rocauc=0.75392 val_adapt_rocauc=0.75554 adapt_steps=4.28 halt=0.32 train_steps=2.71 +ep60 val_rocauc=0.77327 val_adapt_rocauc=0.77823 adapt_steps=3.05 halt=0.35 train_steps=2.49 +ep70 val_rocauc=0.77098 val_adapt_rocauc=0.77495 adapt_steps=3.01 halt=0.37 train_steps=2.37 +ep80 val_rocauc=0.77372 val_adapt_rocauc=0.78024 adapt_steps=2.81 halt=0.39 train_steps=2.26 +ep90 val_rocauc=0.77062 val_adapt_rocauc=0.77479 adapt_steps=2.66 halt=0.41 train_steps=2.11 +ep100 val_rocauc=0.76956 val_adapt_rocauc=0.77366 adapt_steps=2.72 halt=0.41 train_steps=2.10 +[ogbg-moltox21_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.7737227459288354} test={'rocauc': 0.7454181481867773} adaptive={'rocauc': 0.7448724120402496} steps=2.7767857142857144 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=tag compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view tag --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.65152 val_adapt_rocauc=0.63598 adapt_steps=5.82 halt=0.28 train_steps=3.00 +ep20 val_rocauc=0.71815 val_adapt_rocauc=0.71620 adapt_steps=3.05 halt=0.28 train_steps=3.03 +ep30 val_rocauc=0.72675 val_adapt_rocauc=0.72953 adapt_steps=5.25 halt=0.30 train_steps=2.85 +ep40 val_rocauc=0.70713 val_adapt_rocauc=0.71988 adapt_steps=4.60 halt=0.30 train_steps=2.87 +ep50 val_rocauc=0.73557 val_adapt_rocauc=0.74105 adapt_steps=3.83 halt=0.31 train_steps=2.81 +ep60 val_rocauc=0.75468 val_adapt_rocauc=0.76648 adapt_steps=3.73 halt=0.31 train_steps=2.88 +ep70 val_rocauc=0.77518 val_adapt_rocauc=0.77338 adapt_steps=3.67 halt=0.33 train_steps=2.67 +ep80 val_rocauc=0.77918 val_adapt_rocauc=0.78370 adapt_steps=3.28 halt=0.35 train_steps=2.52 +ep90 val_rocauc=0.77746 val_adapt_rocauc=0.77301 adapt_steps=3.44 halt=0.36 train_steps=2.46 +ep100 val_rocauc=0.77192 val_adapt_rocauc=0.76945 adapt_steps=3.25 halt=0.36 train_steps=2.43 +[ogbg-moltox21_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=80 val={'rocauc': 0.7791811026208421} test={'rocauc': 0.7194750067722034} adaptive={'rocauc': 0.7225403729796881} steps=3.318877551020408 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=sgc compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view sgc --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.58511 val_adapt_rocauc=0.58665 adapt_steps=2.96 halt=0.29 train_steps=2.97 +ep20 val_rocauc=0.72203 val_adapt_rocauc=0.68935 adapt_steps=3.69 halt=0.29 train_steps=2.92 +ep30 val_rocauc=0.74058 val_adapt_rocauc=0.74146 adapt_steps=4.68 halt=0.28 train_steps=3.06 +ep40 val_rocauc=0.74632 val_adapt_rocauc=0.74580 adapt_steps=4.82 halt=0.29 train_steps=3.01 +ep50 val_rocauc=0.72977 val_adapt_rocauc=0.73373 adapt_steps=3.75 halt=0.31 train_steps=2.89 +ep60 val_rocauc=0.74202 val_adapt_rocauc=0.74441 adapt_steps=3.87 halt=0.32 train_steps=2.77 +ep70 val_rocauc=0.76058 val_adapt_rocauc=0.75527 adapt_steps=3.41 halt=0.34 train_steps=2.64 +ep80 val_rocauc=0.76323 val_adapt_rocauc=0.76205 adapt_steps=3.39 halt=0.36 train_steps=2.47 +ep90 val_rocauc=0.76418 val_adapt_rocauc=0.76382 adapt_steps=3.20 halt=0.37 train_steps=2.39 +ep100 val_rocauc=0.76686 val_adapt_rocauc=0.76364 adapt_steps=3.21 halt=0.36 train_steps=2.44 +[ogbg-moltox21_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=100 val={'rocauc': 0.7668620788836082} test={'rocauc': 0.7261733029463184} adaptive={'rocauc': 0.7330710041428746} steps=3.260204081632653 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=cheb compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view cheb --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.71726 val_adapt_rocauc=0.71158 adapt_steps=2.69 halt=0.30 train_steps=2.93 +ep20 val_rocauc=0.74514 val_adapt_rocauc=0.74244 adapt_steps=3.13 halt=0.29 train_steps=2.94 +ep30 val_rocauc=0.74745 val_adapt_rocauc=0.74514 adapt_steps=4.27 halt=0.31 train_steps=2.82 +ep40 val_rocauc=0.75855 val_adapt_rocauc=0.75693 adapt_steps=3.17 halt=0.32 train_steps=2.71 +ep50 val_rocauc=0.77450 val_adapt_rocauc=0.77541 adapt_steps=3.24 halt=0.35 train_steps=2.52 +ep60 val_rocauc=0.78240 val_adapt_rocauc=0.78798 adapt_steps=2.92 halt=0.38 train_steps=2.30 +ep70 val_rocauc=0.77174 val_adapt_rocauc=0.78493 adapt_steps=2.44 halt=0.42 train_steps=1.98 +ep80 val_rocauc=0.76722 val_adapt_rocauc=0.78035 adapt_steps=2.14 halt=0.45 train_steps=1.75 +ep90 val_rocauc=0.76854 val_adapt_rocauc=0.78215 adapt_steps=2.12 halt=0.47 train_steps=1.67 +ep100 val_rocauc=0.77046 val_adapt_rocauc=0.78353 adapt_steps=2.12 halt=0.46 train_steps=1.67 +[ogbg-moltox21_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=60 val={'rocauc': 0.7823963460925124} test={'rocauc': 0.7195427399764524} adaptive={'rocauc': 0.7202976536434207} steps=3.014030612244898 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=arma compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view arma --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.63590 val_adapt_rocauc=0.63888 adapt_steps=2.72 halt=0.29 train_steps=2.91 +ep20 val_rocauc=0.71067 val_adapt_rocauc=0.70324 adapt_steps=4.82 halt=0.30 train_steps=2.86 +ep30 val_rocauc=0.75699 val_adapt_rocauc=0.76269 adapt_steps=4.94 halt=0.29 train_steps=2.96 +ep40 val_rocauc=0.75283 val_adapt_rocauc=0.76066 adapt_steps=2.89 halt=0.31 train_steps=2.87 +ep50 val_rocauc=0.74882 val_adapt_rocauc=0.75319 adapt_steps=2.96 halt=0.32 train_steps=2.76 +ep60 val_rocauc=0.74867 val_adapt_rocauc=0.75550 adapt_steps=2.58 halt=0.34 train_steps=2.61 +ep70 val_rocauc=0.75749 val_adapt_rocauc=0.77569 adapt_steps=2.86 halt=0.38 train_steps=2.31 +ep80 val_rocauc=0.73534 val_adapt_rocauc=0.77063 adapt_steps=2.44 halt=0.40 train_steps=2.10 +ep90 val_rocauc=0.74163 val_adapt_rocauc=0.77322 adapt_steps=2.37 halt=0.41 train_steps=2.04 +ep100 val_rocauc=0.74596 val_adapt_rocauc=0.77377 adapt_steps=2.39 halt=0.42 train_steps=1.95 +[ogbg-moltox21_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.7574890736647663} test={'rocauc': 0.7161943072626955} adaptive={'rocauc': 0.7237147258339075} steps=2.868622448979592 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=mf compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view mf --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.68103 val_adapt_rocauc=0.67327 adapt_steps=6.68 halt=0.28 train_steps=3.06 +ep20 val_rocauc=0.71526 val_adapt_rocauc=0.70565 adapt_steps=3.58 halt=0.27 train_steps=3.17 +ep30 val_rocauc=0.73936 val_adapt_rocauc=0.73882 adapt_steps=4.88 halt=0.30 train_steps=2.92 +ep40 val_rocauc=0.68475 val_adapt_rocauc=0.69545 adapt_steps=3.09 halt=0.32 train_steps=2.71 +ep50 val_rocauc=0.72737 val_adapt_rocauc=0.73189 adapt_steps=3.75 halt=0.33 train_steps=2.71 +ep60 val_rocauc=0.76486 val_adapt_rocauc=0.77034 adapt_steps=3.49 halt=0.35 train_steps=2.53 +ep70 val_rocauc=0.76555 val_adapt_rocauc=0.77366 adapt_steps=2.97 halt=0.37 train_steps=2.39 +ep80 val_rocauc=0.76124 val_adapt_rocauc=0.77200 adapt_steps=2.91 halt=0.40 train_steps=2.18 +ep90 val_rocauc=0.75552 val_adapt_rocauc=0.76936 adapt_steps=2.66 halt=0.40 train_steps=2.13 +ep100 val_rocauc=0.75477 val_adapt_rocauc=0.76857 adapt_steps=2.64 halt=0.42 train_steps=2.02 +[ogbg-moltox21_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=70 val={'rocauc': 0.76555289309204} test={'rocauc': 0.7235855082035453} adaptive={'rocauc': 0.7314152133751847} steps=2.9566326530612246 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json +[run] ogbg-moltox21 view=appnp compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-moltox21 --view appnp --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target loss --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:1 --num_workers 0 +ep10 val_rocauc=0.66956 val_adapt_rocauc=0.68596 adapt_steps=2.92 halt=0.30 train_steps=2.86 +ep20 val_rocauc=0.66741 val_adapt_rocauc=0.68976 adapt_steps=2.90 halt=0.31 train_steps=2.80 +ep30 val_rocauc=0.69725 val_adapt_rocauc=0.69142 adapt_steps=3.11 halt=0.33 train_steps=2.66 +ep40 val_rocauc=0.70858 val_adapt_rocauc=0.72396 adapt_steps=3.15 halt=0.36 train_steps=2.47 +ep50 val_rocauc=0.71714 val_adapt_rocauc=0.73276 adapt_steps=2.59 halt=0.39 train_steps=2.24 +ep60 val_rocauc=0.70738 val_adapt_rocauc=0.72373 adapt_steps=2.53 halt=0.42 train_steps=1.95 +ep70 val_rocauc=0.69595 val_adapt_rocauc=0.71924 adapt_steps=2.25 halt=0.43 train_steps=1.93 +ep80 val_rocauc=0.70875 val_adapt_rocauc=0.72985 adapt_steps=2.16 halt=0.44 train_steps=1.86 +ep90 val_rocauc=0.70758 val_adapt_rocauc=0.72805 adapt_steps=2.16 halt=0.44 train_steps=1.82 +ep100 val_rocauc=0.70806 val_adapt_rocauc=0.72668 adapt_steps=2.16 halt=0.44 train_steps=1.83 +[ogbg-moltox21_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0] best_ep=50 val={'rocauc': 0.7171412864790295} test={'rocauc': 0.7196990667216929} adaptive={'rocauc': 0.7331958989125181} steps=2.586734693877551 + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ogbg-moltox21_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json diff --git a/logs/zinc_cycle56_0.log b/logs/zinc_cycle56_0.log new file mode 100644 index 0000000..6be2a25 --- /dev/null +++ b/logs/zinc_cycle56_0.log @@ -0,0 +1,536 @@ +[run] zinc-cycle56 view=gin compute=classic T=0 ns=1 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 0 --n_sup 1 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view gin --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +Downloading https://www.dropbox.com/s/feo9qle74kg48gy/molecules.zip?dl=1 +Extracting /orion/u/oscarwan/rrog-gnn-runner/data/zinc/molecules.zip +Downloading https://raw.githubusercontent.com/graphdeeplearning/benchmarking-gnns/master/data/molecules/train.index +Downloading https://raw.githubusercontent.com/graphdeeplearning/benchmarking-gnns/master/data/molecules/val.index +Downloading https://raw.githubusercontent.com/graphdeeplearning/benchmarking-gnns/master/data/molecules/test.index +Processing... +
0%| | 0/10000 [00:00<?, ?it/s]
Processing train dataset: 0%| | 0/10000 [00:00<?, ?it/s]
Processing train dataset: 23%|██▎ | 2285/10000 [00:00<00:00, 22846.70it/s]
Processing train dataset: 47%|████▋ | 4656/10000 [00:00<00:00, 23350.15it/s]
Processing train dataset: 70%|███████ | 7014/10000 [00:00<00:00, 23450.91it/s]
Processing train dataset: 94%|█████████▍| 9378/10000 [00:00<00:00, 23523.77it/s]
Processing train dataset: 100%|██████████| 10000/10000 [00:00<00:00, 23330.09it/s] +
0%| | 0/1000 [00:00<?, ?it/s]
Processing val dataset: 0%| | 0/1000 [00:00<?, ?it/s]
Processing val dataset: 0%| | 1/1000 [00:00<01:56, 8.60it/s]
Processing val dataset: 100%|██████████| 1000/1000 [00:00<00:00, 4764.70it/s] +
0%| | 0/1000 [00:00<?, ?it/s]
Processing test dataset: 0%| | 0/1000 [00:00<?, ?it/s]
Processing test dataset: 96%|█████████▌| 961/1000 [00:00<00:00, 9606.89it/s]
Processing test dataset: 100%|██████████| 1000/1000 [00:00<00:00, 9827.65it/s] +Done! +ep20 val_mae=[0.306, 0.365] +ep40 val_mae=[0.281, 0.388] +ep60 val_mae=[0.191, 0.283] +ep80 val_mae=[0.194, 0.262] +ep100 val_mae=[0.168, 0.282] +ep120 val_mae=[0.143, 0.202] +ep140 val_mae=[0.133, 0.184] +ep160 val_mae=[0.127, 0.178] +ep180 val_mae=[0.125, 0.174] +ep200 val_mae=[0.126, 0.172] +[rec_rrog_full_sig0.0_K1_none_T0_ns1_trace_s0] test_mae=[0.109, 0.164] oracle@K=[0.109, 0.164] @ep200 (84.1s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_full_sig0.0_K1_none_T0_ns1_trace_s0.pt +[run] zinc-cycle56 view=gin compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 1 --n_sup 3 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view gin --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.336, 0.421] +ep40 val_mae=[0.186, 0.274] +ep60 val_mae=[0.289, 0.399] +ep80 val_mae=[0.139, 0.183] +ep100 val_mae=[0.128, 0.164] +ep120 val_mae=[0.113, 0.209] +ep140 val_mae=[0.097, 0.162] +ep160 val_mae=[0.092, 0.138] +ep180 val_mae=[0.089, 0.141] +ep200 val_mae=[0.089, 0.138] +[rec_rrog_full_sig0.0_K1_none_T1_ns3_trace_s0] test_mae=[0.088, 0.135] oracle@K=[0.088, 0.135] @ep200 (124.5s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_full_sig0.0_K1_none_T1_ns3_trace_s0.pt +[run] zinc-cycle56 view=gine compute=classic T=0 ns=1 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 0 --n_sup 1 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view gine --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.59, 0.486] +ep40 val_mae=[0.34, 0.422] +ep60 val_mae=[0.245, 0.322] +ep80 val_mae=[0.167, 0.224] +ep100 val_mae=[0.152, 0.262] +ep120 val_mae=[0.125, 0.226] +ep140 val_mae=[0.106, 0.161] +ep160 val_mae=[0.101, 0.157] +ep180 val_mae=[0.097, 0.143] +ep200 val_mae=[0.096, 0.143] +[rec_rrog_gine_full_sig0.0_K1_none_T0_ns1_trace_s0] test_mae=[0.091, 0.14] oracle@K=[0.091, 0.14] @ep200 (100.6s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_gine_full_sig0.0_K1_none_T0_ns1_trace_s0.pt +[run] zinc-cycle56 view=gine compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 1 --n_sup 3 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view gine --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.295, 0.393] +ep40 val_mae=[0.3, 0.394] +ep60 val_mae=[0.34, 0.437] +ep80 val_mae=[0.151, 0.236] +ep100 val_mae=[0.103, 0.167] +ep120 val_mae=[0.082, 0.232] +ep140 val_mae=[0.074, 0.127] +ep160 val_mae=[0.063, 0.116] +ep180 val_mae=[0.059, 0.106] +ep200 val_mae=[0.058, 0.106] +[rec_rrog_gine_full_sig0.0_K1_none_T1_ns3_trace_s0] test_mae=[0.052, 0.099] oracle@K=[0.052, 0.099] @ep200 (159.6s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_gine_full_sig0.0_K1_none_T1_ns3_trace_s0.pt +[run] zinc-cycle56 view=gcn compute=classic T=0 ns=1 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 0 --n_sup 1 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view gcn --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.43, 0.543] +ep40 val_mae=[0.478, 0.477] +ep60 val_mae=[0.339, 0.373] +ep80 val_mae=[0.352, 0.393] +ep100 val_mae=[0.294, 0.341] +ep120 val_mae=[0.295, 0.326] +ep140 val_mae=[0.302, 0.318] +ep160 val_mae=[0.274, 0.316] +ep180 val_mae=[0.272, 0.312] +ep200 val_mae=[0.271, 0.311] +[rec_rrog_gcn_full_sig0.0_K1_none_T0_ns1_trace_s0] test_mae=[0.268, 0.318] oracle@K=[0.268, 0.318] @ep200 (86.5s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_gcn_full_sig0.0_K1_none_T0_ns1_trace_s0.pt +[run] zinc-cycle56 view=gcn compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 1 --n_sup 3 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view gcn --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.459, 0.493] +ep40 val_mae=[0.402, 0.403] +ep60 val_mae=[0.275, 0.499] +ep80 val_mae=[0.244, 0.399] +ep100 val_mae=[0.229, 0.323] +ep120 val_mae=[0.262, 0.381] +ep140 val_mae=[0.187, 0.27] +ep160 val_mae=[0.181, 0.267] +ep180 val_mae=[0.179, 0.259] +ep200 val_mae=[0.18, 0.258] +[rec_rrog_gcn_full_sig0.0_K1_none_T1_ns3_trace_s0] test_mae=[0.179, 0.281] oracle@K=[0.179, 0.281] @ep200 (121.7s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_gcn_full_sig0.0_K1_none_T1_ns3_trace_s0.pt +[run] zinc-cycle56 view=graphsage compute=classic T=0 ns=1 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 0 --n_sup 1 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view graphsage --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.32, 0.417] +ep40 val_mae=[0.273, 0.35] +ep60 val_mae=[0.275, 0.333] +ep80 val_mae=[0.213, 0.307] +ep100 val_mae=[0.201, 0.268] +ep120 val_mae=[0.244, 0.263] +ep140 val_mae=[0.187, 0.251] +ep160 val_mae=[0.177, 0.251] +ep180 val_mae=[0.172, 0.243] +ep200 val_mae=[0.172, 0.242] +[rec_rrog_graphsage_full_sig0.0_K1_none_T0_ns1_trace_s0] test_mae=[0.17, 0.248] oracle@K=[0.17, 0.248] @ep200 (78.6s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_graphsage_full_sig0.0_K1_none_T0_ns1_trace_s0.pt +[run] zinc-cycle56 view=graphsage compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 1 --n_sup 3 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view graphsage --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.277, 0.426] +ep40 val_mae=[0.199, 0.308] +ep60 val_mae=[0.166, 0.27] +ep80 val_mae=[0.159, 0.257] +ep100 val_mae=[0.12, 0.274] +ep120 val_mae=[0.129, 0.253] +ep140 val_mae=[0.123, 0.237] +ep160 val_mae=[0.116, 0.23] +ep180 val_mae=[0.111, 0.227] +ep200 val_mae=[0.111, 0.227] +[rec_rrog_graphsage_full_sig0.0_K1_none_T1_ns3_trace_s0] test_mae=[0.101, 0.239] oracle@K=[0.101, 0.239] @ep200 (110.1s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_graphsage_full_sig0.0_K1_none_T1_ns3_trace_s0.pt +[run] zinc-cycle56 view=gatv2 compute=classic T=0 ns=1 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 0 --n_sup 1 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view gatv2 --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.383, 0.495] +ep40 val_mae=[0.336, 0.369] +ep60 val_mae=[0.222, 0.312] +ep80 val_mae=[0.207, 0.305] +ep100 val_mae=[0.19, 0.288] +ep120 val_mae=[0.178, 0.265] +ep140 val_mae=[0.168, 0.263] +ep160 val_mae=[0.164, 0.25] +ep180 val_mae=[0.16, 0.248] +ep200 val_mae=[0.16, 0.249] +[rec_rrog_gatv2_full_sig0.0_K1_none_T0_ns1_trace_s0] test_mae=[0.151, 0.251] oracle@K=[0.151, 0.251] @ep180 (113.7s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_gatv2_full_sig0.0_K1_none_T0_ns1_trace_s0.pt +[run] zinc-cycle56 view=gatv2 compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 1 --n_sup 3 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view gatv2 --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.364, 0.453] +ep40 val_mae=[0.224, 0.337] +ep60 val_mae=[0.16, 0.269] +ep80 val_mae=[0.138, 0.263] +ep100 val_mae=[0.121, 0.235] +ep120 val_mae=[0.108, 0.226] +ep140 val_mae=[0.107, 0.217] +ep160 val_mae=[0.105, 0.218] +ep180 val_mae=[0.102, 0.215] +ep200 val_mae=[0.102, 0.214] +[rec_rrog_gatv2_full_sig0.0_K1_none_T1_ns3_trace_s0] test_mae=[0.104, 0.208] oracle@K=[0.104, 0.208] @ep200 (160.3s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_gatv2_full_sig0.0_K1_none_T1_ns3_trace_s0.pt +[run] zinc-cycle56 view=graphconv compute=classic T=0 ns=1 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 0 --n_sup 1 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view graphconv --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.258, 0.331] +ep40 val_mae=[0.225, 0.289] +ep60 val_mae=[0.196, 0.251] +ep80 val_mae=[0.194, 0.273] +ep100 val_mae=[0.224, 0.238] +ep120 val_mae=[0.155, 0.217] +ep140 val_mae=[0.157, 0.211] +ep160 val_mae=[0.147, 0.21] +ep180 val_mae=[0.147, 0.204] +ep200 val_mae=[0.147, 0.204] +[rec_rrog_graphconv_full_sig0.0_K1_none_T0_ns1_trace_s0] test_mae=[0.145, 0.201] oracle@K=[0.145, 0.201] @ep180 (71.9s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_graphconv_full_sig0.0_K1_none_T0_ns1_trace_s0.pt +[run] zinc-cycle56 view=graphconv compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 1 --n_sup 3 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view graphconv --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.252, 0.353] +ep40 val_mae=[0.146, 0.283] +ep60 val_mae=[0.118, 0.198] +ep80 val_mae=[0.104, 0.178] +ep100 val_mae=[0.098, 0.161] +ep120 val_mae=[0.09, 0.175] +ep140 val_mae=[0.084, 0.137] +ep160 val_mae=[0.078, 0.135] +ep180 val_mae=[0.078, 0.132] +ep200 val_mae=[0.078, 0.132] +[rec_rrog_graphconv_full_sig0.0_K1_none_T1_ns3_trace_s0] test_mae=[0.079, 0.127] oracle@K=[0.079, 0.127] @ep200 (119.4s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_graphconv_full_sig0.0_K1_none_T1_ns3_trace_s0.pt +[run] zinc-cycle56 view=transformer compute=classic T=0 ns=1 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 0 --n_sup 1 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view transformer --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.362, 0.478] +ep40 val_mae=[0.225, 0.329] +ep60 val_mae=[0.216, 0.443] +ep80 val_mae=[0.2, 0.362] +ep100 val_mae=[0.199, 0.252] +ep120 val_mae=[0.17, 0.242] +ep140 val_mae=[0.171, 0.244] +ep160 val_mae=[0.157, 0.232] +ep180 val_mae=[0.154, 0.231] +ep200 val_mae=[0.154, 0.23] +[rec_rrog_transformer_full_sig0.0_K1_none_T0_ns1_trace_s0] test_mae=[0.149, 0.227] oracle@K=[0.149, 0.227] @ep200 (129.3s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_transformer_full_sig0.0_K1_none_T0_ns1_trace_s0.pt +[run] zinc-cycle56 view=transformer compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 1 --n_sup 3 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view transformer --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.312, 0.472] +ep40 val_mae=[0.262, 0.388] +ep60 val_mae=[0.155, 0.329] +ep80 val_mae=[0.125, 0.241] +ep100 val_mae=[0.117, 0.231] +ep120 val_mae=[0.109, 0.22] +ep140 val_mae=[0.102, 0.223] +ep160 val_mae=[0.104, 0.217] +ep180 val_mae=[0.099, 0.21] +ep200 val_mae=[0.1, 0.21] +[rec_rrog_transformer_full_sig0.0_K1_none_T1_ns3_trace_s0] test_mae=[0.104, 0.223] oracle@K=[0.104, 0.223] @ep180 (210.2s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_transformer_full_sig0.0_K1_none_T1_ns3_trace_s0.pt +[run] zinc-cycle56 view=pna compute=classic T=0 ns=1 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 0 --n_sup 1 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view pna --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_mae=[0.292, 0.492] +ep40 val_mae=[0.271, 0.743] +ep60 val_mae=[0.162, 0.354] +ep80 val_mae=[0.169, 0.276] +ep100 val_mae=[0.09, 0.3] +ep120 val_mae=[0.105, 0.183] +ep140 val_mae=[0.083, 0.139] +ep160 val_mae=[0.074, 0.103] +ep180 val_mae=[0.069, 0.087] +ep200 val_mae=[0.07, 0.088] +[rec_rrog_pna_full_sig0.0_K1_none_T0_ns1_trace_s0] test_mae=[0.062, 0.092] oracle@K=[0.062, 0.092] @ep180 (184.2s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_pna_full_sig0.0_K1_none_T0_ns1_trace_s0.pt +[run] zinc-cycle56 view=pna compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 1 --n_sup 3 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view pna --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/orion/u/oscarwan/rrog-gnn-runner/.venv/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 val_mae=[0.203, 0.567] +ep40 val_mae=[0.263, 0.275] +ep60 val_mae=[0.085, 0.122] +ep80 val_mae=[0.195, 0.228] +ep100 val_mae=[0.078, 0.096] +ep120 val_mae=[0.077, 0.089] +ep140 val_mae=[0.058, 0.08] +ep160 val_mae=[0.054, 0.088] +ep180 val_mae=[0.051, 0.071] +ep200 val_mae=[0.05, 0.071] +[rec_rrog_pna_full_sig0.0_K1_none_T1_ns3_trace_s0] test_mae=[0.042, 0.064] oracle@K=[0.042, 0.064] @ep200 (212.1s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_pna_full_sig0.0_K1_none_T1_ns3_trace_s0.pt +[run] zinc-cycle56 view=gen compute=classic T=0 ns=1 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 0 --n_sup 1 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view gen --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.388, 0.51] +ep40 val_mae=[0.278, 0.378] +ep60 val_mae=[0.289, 0.319] +ep80 val_mae=[0.216, 0.303] +ep100 val_mae=[0.179, 0.295] +ep120 val_mae=[0.165, 0.271] +ep140 val_mae=[0.169, 0.256] +ep160 val_mae=[0.153, 0.249] +ep180 val_mae=[0.151, 0.247] +ep200 val_mae=[0.151, 0.245] +[rec_rrog_gen_full_sig0.0_K1_none_T0_ns1_trace_s0] test_mae=[0.14, 0.246] oracle@K=[0.14, 0.246] @ep200 (101.3s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_gen_full_sig0.0_K1_none_T0_ns1_trace_s0.pt +[run] zinc-cycle56 view=gen compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 1 --n_sup 3 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view gen --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.333, 0.479] +ep40 val_mae=[0.256, 0.344] +ep60 val_mae=[0.198, 0.314] +ep80 val_mae=[0.181, 0.335] +ep100 val_mae=[0.149, 0.247] +ep120 val_mae=[0.147, 0.24] +ep140 val_mae=[0.137, 0.225] +ep160 val_mae=[0.14, 0.224] +ep180 val_mae=[0.136, 0.22] +ep200 val_mae=[0.135, 0.221] +[rec_rrog_gen_full_sig0.0_K1_none_T1_ns3_trace_s0] test_mae=[0.12, 0.22] oracle@K=[0.12, 0.22] @ep180 (150.1s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_gen_full_sig0.0_K1_none_T1_ns3_trace_s0.pt +[run] zinc-cycle56 view=film compute=classic T=0 ns=1 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 0 --n_sup 1 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view film --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.438, 0.56] +ep40 val_mae=[0.352, 0.514] +ep60 val_mae=[0.303, 0.449] +ep80 val_mae=[0.253, 0.416] +ep100 val_mae=[0.229, 0.347] +ep120 val_mae=[0.2, 0.336] +ep140 val_mae=[0.195, 0.328] +ep160 val_mae=[0.188, 0.315] +ep180 val_mae=[0.186, 0.31] +ep200 val_mae=[0.187, 0.304] +[rec_rrog_film_full_sig0.0_K1_none_T0_ns1_trace_s0] test_mae=[0.193, 0.307] oracle@K=[0.193, 0.307] @ep200 (102.7s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_film_full_sig0.0_K1_none_T0_ns1_trace_s0.pt +[run] zinc-cycle56 view=film compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 1 --n_sup 3 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view film --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.504, 0.602] +ep40 val_mae=[0.475, 0.488] +ep60 val_mae=[0.42, 0.48] +ep80 val_mae=[0.396, 0.46] +ep100 val_mae=[0.347, 0.438] +ep120 val_mae=[0.309, 0.413] +ep140 val_mae=[0.308, 0.411] +ep160 val_mae=[0.292, 0.403] +ep180 val_mae=[0.288, 0.406] +ep200 val_mae=[0.288, 0.402] +[rec_rrog_film_full_sig0.0_K1_none_T1_ns3_trace_s0] test_mae=[0.259, 0.406] oracle@K=[0.259, 0.406] @ep200 (216.1s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_film_full_sig0.0_K1_none_T1_ns3_trace_s0.pt +[run] zinc-cycle56 view=resgated compute=classic T=0 ns=1 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 0 --n_sup 1 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view resgated --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.222, 0.327] +ep40 val_mae=[0.208, 0.298] +ep60 val_mae=[0.262, 0.232] +ep80 val_mae=[0.179, 0.219] +ep100 val_mae=[0.16, 0.207] +ep120 val_mae=[0.152, 0.207] +ep140 val_mae=[0.142, 0.192] +ep160 val_mae=[0.138, 0.184] +ep180 val_mae=[0.137, 0.184] +ep200 val_mae=[0.136, 0.182] +[rec_rrog_resgated_full_sig0.0_K1_none_T0_ns1_trace_s0] test_mae=[0.137, 0.18] oracle@K=[0.137, 0.18] @ep200 (102.6s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_resgated_full_sig0.0_K1_none_T0_ns1_trace_s0.pt +[run] zinc-cycle56 view=resgated compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 1 --n_sup 3 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view resgated --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.201, 0.29] +ep40 val_mae=[0.137, 0.218] +ep60 val_mae=[0.148, 0.303] +ep80 val_mae=[0.102, 0.154] +ep100 val_mae=[0.082, 0.128] +ep120 val_mae=[0.075, 0.118] +ep140 val_mae=[0.074, 0.121] +ep160 val_mae=[0.074, 0.112] +ep180 val_mae=[0.072, 0.111] +ep200 val_mae=[0.073, 0.111] +[rec_rrog_resgated_full_sig0.0_K1_none_T1_ns3_trace_s0] test_mae=[0.069, 0.108] oracle@K=[0.069, 0.108] @ep180 (137.8s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_resgated_full_sig0.0_K1_none_T1_ns3_trace_s0.pt +[run] zinc-cycle56 view=tag compute=classic T=0 ns=1 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 0 --n_sup 1 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view tag --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.271, 0.411] +ep40 val_mae=[0.194, 0.294] +ep60 val_mae=[0.17, 0.262] +ep80 val_mae=[0.174, 0.222] +ep100 val_mae=[0.133, 0.221] +ep120 val_mae=[0.14, 0.213] +ep140 val_mae=[0.135, 0.194] +ep160 val_mae=[0.121, 0.184] +ep180 val_mae=[0.118, 0.173] +ep200 val_mae=[0.117, 0.172] +[rec_rrog_tag_full_sig0.0_K1_none_T0_ns1_trace_s0] test_mae=[0.112, 0.171] oracle@K=[0.112, 0.171] @ep200 (109.9s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_tag_full_sig0.0_K1_none_T0_ns1_trace_s0.pt +[run] zinc-cycle56 view=tag compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 1 --n_sup 3 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view tag --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.237, 0.321] +ep40 val_mae=[0.147, 0.206] +ep60 val_mae=[0.11, 0.251] +ep80 val_mae=[0.077, 0.131] +ep100 val_mae=[0.071, 0.109] +ep120 val_mae=[0.063, 0.101] +ep140 val_mae=[0.057, 0.097] +ep160 val_mae=[0.053, 0.093] +ep180 val_mae=[0.051, 0.092] +ep200 val_mae=[0.051, 0.09] +[rec_rrog_tag_full_sig0.0_K1_none_T1_ns3_trace_s0] test_mae=[0.051, 0.087] oracle@K=[0.051, 0.087] @ep200 (147.1s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_tag_full_sig0.0_K1_none_T1_ns3_trace_s0.pt +[run] zinc-cycle56 view=sgc compute=classic T=0 ns=1 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 0 --n_sup 1 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view sgc --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.502, 0.782] +ep40 val_mae=[0.469, 0.476] +ep60 val_mae=[0.396, 0.416] +ep80 val_mae=[0.362, 0.383] +ep100 val_mae=[0.362, 0.408] +ep120 val_mae=[0.333, 0.386] +ep140 val_mae=[0.391, 0.359] +ep160 val_mae=[0.296, 0.337] +ep180 val_mae=[0.293, 0.34] +ep200 val_mae=[0.291, 0.337] +[rec_rrog_sgc_full_sig0.0_K1_none_T0_ns1_trace_s0] test_mae=[0.292, 0.352] oracle@K=[0.292, 0.352] @ep200 (91.8s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_sgc_full_sig0.0_K1_none_T0_ns1_trace_s0.pt +[run] zinc-cycle56 view=sgc compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 1 --n_sup 3 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view sgc --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.46, 0.517] +ep40 val_mae=[0.412, 0.713] +ep60 val_mae=[0.405, 0.951] +ep80 val_mae=[0.262, 0.336] +ep100 val_mae=[0.251, 0.374] +ep120 val_mae=[0.241, 0.332] +ep140 val_mae=[0.227, 0.323] +ep160 val_mae=[0.205, 0.308] +ep180 val_mae=[0.199, 0.304] +ep200 val_mae=[0.198, 0.303] +[rec_rrog_sgc_full_sig0.0_K1_none_T1_ns3_trace_s0] test_mae=[0.191, 0.316] oracle@K=[0.191, 0.316] @ep200 (124.9s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_sgc_full_sig0.0_K1_none_T1_ns3_trace_s0.pt +[run] zinc-cycle56 view=cheb compute=classic T=0 ns=1 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 0 --n_sup 1 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view cheb --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.241, 0.363] +ep40 val_mae=[0.205, 0.365] +ep60 val_mae=[0.25, 0.316] +ep80 val_mae=[0.195, 0.273] +ep100 val_mae=[0.169, 0.277] +ep120 val_mae=[0.171, 0.256] +ep140 val_mae=[0.164, 0.251] +ep160 val_mae=[0.164, 0.241] +ep180 val_mae=[0.163, 0.242] +ep200 val_mae=[0.162, 0.242] +[rec_rrog_cheb_full_sig0.0_K1_none_T0_ns1_trace_s0] test_mae=[0.149, 0.24] oracle@K=[0.149, 0.24] @ep200 (112.8s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_cheb_full_sig0.0_K1_none_T0_ns1_trace_s0.pt +[run] zinc-cycle56 view=cheb compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 1 --n_sup 3 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view cheb --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.202, 0.334] +ep40 val_mae=[0.134, 0.274] +ep60 val_mae=[0.106, 0.279] +ep80 val_mae=[0.105, 0.221] +ep100 val_mae=[0.105, 0.209] +ep120 val_mae=[0.104, 0.224] +ep140 val_mae=[0.089, 0.203] +ep160 val_mae=[0.092, 0.203] +ep180 val_mae=[0.091, 0.201] +ep200 val_mae=[0.09, 0.2] +[rec_rrog_cheb_full_sig0.0_K1_none_T1_ns3_trace_s0] test_mae=[0.087, 0.196] oracle@K=[0.087, 0.196] @ep200 (149.4s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_cheb_full_sig0.0_K1_none_T1_ns3_trace_s0.pt +[run] zinc-cycle56 view=arma compute=classic T=0 ns=1 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 0 --n_sup 1 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view arma --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.405, 0.35] +ep40 val_mae=[0.255, 0.355] +ep60 val_mae=[0.193, 0.272] +ep80 val_mae=[0.203, 0.265] +ep100 val_mae=[0.165, 0.236] +ep120 val_mae=[0.156, 0.228] +ep140 val_mae=[0.169, 0.214] +ep160 val_mae=[0.141, 0.218] +ep180 val_mae=[0.14, 0.208] +ep200 val_mae=[0.14, 0.206] +[rec_rrog_arma_full_sig0.0_K1_none_T0_ns1_trace_s0] test_mae=[0.139, 0.202] oracle@K=[0.139, 0.202] @ep200 (136.4s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_arma_full_sig0.0_K1_none_T0_ns1_trace_s0.pt +[run] zinc-cycle56 view=arma compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 1 --n_sup 3 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view arma --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.288, 0.448] +ep40 val_mae=[0.143, 0.316] +ep60 val_mae=[0.16, 0.253] +ep80 val_mae=[0.113, 0.208] +ep100 val_mae=[0.101, 0.21] +ep120 val_mae=[0.114, 0.165] +ep140 val_mae=[0.097, 0.159] +ep160 val_mae=[0.095, 0.154] +ep180 val_mae=[0.094, 0.148] +ep200 val_mae=[0.094, 0.147] +[rec_rrog_arma_full_sig0.0_K1_none_T1_ns3_trace_s0] test_mae=[0.102, 0.136] oracle@K=[0.102, 0.136] @ep200 (213.2s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_arma_full_sig0.0_K1_none_T1_ns3_trace_s0.pt +[run] zinc-cycle56 view=mf compute=classic T=0 ns=1 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 0 --n_sup 1 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view mf --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.217, 0.291] +ep40 val_mae=[0.175, 0.237] +ep60 val_mae=[0.184, 0.219] +ep80 val_mae=[0.158, 0.226] +ep100 val_mae=[0.155, 0.201] +ep120 val_mae=[0.138, 0.183] +ep140 val_mae=[0.134, 0.176] +ep160 val_mae=[0.134, 0.176] +ep180 val_mae=[0.133, 0.172] +ep200 val_mae=[0.134, 0.171] +[rec_rrog_mf_full_sig0.0_K1_none_T0_ns1_trace_s0] test_mae=[0.131, 0.172] oracle@K=[0.131, 0.172] @ep180 (331.2s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_mf_full_sig0.0_K1_none_T0_ns1_trace_s0.pt +[run] zinc-cycle56 view=mf compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 1 --n_sup 3 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view mf --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.223, 0.323] +ep40 val_mae=[0.125, 0.233] +ep60 val_mae=[0.12, 0.184] +ep80 val_mae=[0.093, 0.153] +ep100 val_mae=[0.081, 0.148] +ep120 val_mae=[0.084, 0.151] +ep140 val_mae=[0.083, 0.137] +ep160 val_mae=[0.077, 0.131] +ep180 val_mae=[0.078, 0.121] +ep200 val_mae=[0.078, 0.121] +[rec_rrog_mf_full_sig0.0_K1_none_T1_ns3_trace_s0] test_mae=[0.069, 0.122] oracle@K=[0.069, 0.122] @ep200 (327.5s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_mf_full_sig0.0_K1_none_T1_ns3_trace_s0.pt +[run] zinc-cycle56 view=appnp compute=classic T=0 ns=1 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 0 --n_sup 1 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view appnp --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.536, 0.617] +ep40 val_mae=[0.529, 0.566] +ep60 val_mae=[0.537, 0.552] +ep80 val_mae=[0.525, 0.511] +ep100 val_mae=[0.517, 0.5] +ep120 val_mae=[0.514, 0.492] +ep140 val_mae=[0.517, 0.487] +ep160 val_mae=[0.517, 0.488] +ep180 val_mae=[0.517, 0.489] +ep200 val_mae=[0.516, 0.49] +[rec_rrog_appnp_full_sig0.0_K1_none_T0_ns1_trace_s0] test_mae=[0.524, 0.494] oracle@K=[0.524, 0.494] @ep140 (149.8s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_appnp_full_sig0.0_K1_none_T0_ns1_trace_s0.pt +[run] zinc-cycle56 view=appnp compute=fixed-rrog T=1 ns=3 device=cuda:0 +python3 diag/train_rec.py --grad_mode full --T 1 --n_sup 3 --hidden 64 --bs 256 --epochs 200 --agg_layers 5 --compute_layers 2 --view appnp --sigma 0 --K 1 --select none --seed 0 --device cuda:0 +ep20 val_mae=[0.537, 0.599] +ep40 val_mae=[0.543, 0.543] +ep60 val_mae=[0.52, 0.529] +ep80 val_mae=[0.495, 0.504] +ep100 val_mae=[0.485, 0.489] +ep120 val_mae=[0.487, 0.486] +ep140 val_mae=[0.493, 0.483] +ep160 val_mae=[0.493, 0.482] +ep180 val_mae=[0.491, 0.482] +ep200 val_mae=[0.491, 0.483] +[rec_rrog_appnp_full_sig0.0_K1_none_T1_ns3_trace_s0] test_mae=[0.494, 0.49] oracle@K=[0.494, 0.49] @ep120 (175.6s) + wrote /orion/u/oscarwan/rrog-gnn-runner/runs/ckpt_rec_rrog_appnp_full_sig0.0_K1_none_T1_ns3_trace_s0.pt + +ZINC-cycle56 classic baseline +| task | backbone | n | val MAE-sum | test MAE-sum | +| --- | --- | --- | --- | --- | +| zinc-cycle56 | appnp | 1 | 1.0040 +/- 0.0000 | 1.0183 +/- 0.0000 | +| zinc-cycle56 | arma | 1 | 0.3456 +/- 0.0000 | 0.3406 +/- 0.0000 | +| zinc-cycle56 | cheb | 1 | 0.4038 +/- 0.0000 | 0.3887 +/- 0.0000 | +| zinc-cycle56 | film | 1 | 0.4906 +/- 0.0000 | 0.4998 +/- 0.0000 | +| zinc-cycle56 | gatv2 | 1 | 0.4084 +/- 0.0000 | 0.4012 +/- 0.0000 | +| zinc-cycle56 | gcn | 1 | 0.5821 +/- 0.0000 | 0.5854 +/- 0.0000 | +| zinc-cycle56 | gen | 1 | 0.3961 +/- 0.0000 | 0.3854 +/- 0.0000 | +| zinc-cycle56 | gin | 1 | 0.2981 +/- 0.0000 | 0.2725 +/- 0.0000 | +| zinc-cycle56 | gine | 1 | 0.2387 +/- 0.0000 | 0.2317 +/- 0.0000 | +| zinc-cycle56 | graphconv | 1 | 0.3507 +/- 0.0000 | 0.3462 +/- 0.0000 | +| zinc-cycle56 | graphsage | 1 | 0.4134 +/- 0.0000 | 0.4179 +/- 0.0000 | +| zinc-cycle56 | mf | 1 | 0.3051 +/- 0.0000 | 0.3031 +/- 0.0000 | +| zinc-cycle56 | pna | 1 | 0.1565 +/- 0.0000 | 0.1539 +/- 0.0000 | +| zinc-cycle56 | resgated | 1 | 0.3183 +/- 0.0000 | 0.3168 +/- 0.0000 | +| zinc-cycle56 | sgc | 1 | 0.6287 +/- 0.0000 | 0.6432 +/- 0.0000 | +| zinc-cycle56 | tag | 1 | 0.2889 +/- 0.0000 | 0.2831 +/- 0.0000 | +| zinc-cycle56 | transformer | 1 | 0.3837 +/- 0.0000 | 0.3760 +/- 0.0000 | + +ZINC-cycle56 delta vs matching classic +| task | backbone | compute | n | val score (improvement) | test score (improvement) | +| --- | --- | --- | --- | --- | --- | +| zinc-cycle56 | appnp | fixed-rrog-T1-ns3+trace | 1 | 0.9730 (0.0310) | 0.9845 (0.0338) | +| zinc-cycle56 | arma | fixed-rrog-T1-ns3+trace | 1 | 0.2414 (0.1042) | 0.2378 (0.1028) | +| zinc-cycle56 | cheb | fixed-rrog-T1-ns3+trace | 1 | 0.2896 (0.1143) | 0.2830 (0.1057) | +| zinc-cycle56 | film | fixed-rrog-T1-ns3+trace | 1 | 0.6898 (-0.1993) | 0.6643 (-0.1646) | +| zinc-cycle56 | gatv2 | fixed-rrog-T1-ns3+trace | 1 | 0.3155 (0.0929) | 0.3121 (0.0891) | +| zinc-cycle56 | gcn | fixed-rrog-T1-ns3+trace | 1 | 0.4380 (0.1441) | 0.4603 (0.1251) | +| zinc-cycle56 | gen | fixed-rrog-T1-ns3+trace | 1 | 0.3554 (0.0407) | 0.3405 (0.0450) | +| zinc-cycle56 | gin | fixed-rrog-T1-ns3+trace | 1 | 0.2269 (0.0711) | 0.2222 (0.0502) | +| zinc-cycle56 | gine | fixed-rrog-T1-ns3+trace | 1 | 0.1641 (0.0745) | 0.1509 (0.0808) | +| zinc-cycle56 | graphconv | fixed-rrog-T1-ns3+trace | 1 | 0.2091 (0.1416) | 0.2060 (0.1402) | +| zinc-cycle56 | graphsage | fixed-rrog-T1-ns3+trace | 1 | 0.3381 (0.0753) | 0.3407 (0.0772) | +| zinc-cycle56 | mf | fixed-rrog-T1-ns3+trace | 1 | 0.1987 (0.1065) | 0.1911 (0.1120) | +| zinc-cycle56 | pna | fixed-rrog-T1-ns3+trace | 1 | 0.1216 (0.0349) | 0.1056 (0.0483) | +| zinc-cycle56 | resgated | fixed-rrog-T1-ns3+trace | 1 | 0.1834 (0.1350) | 0.1765 (0.1403) | +| zinc-cycle56 | sgc | fixed-rrog-T1-ns3+trace | 1 | 0.5008 (0.1278) | 0.5066 (0.1366) | +| zinc-cycle56 | tag | fixed-rrog-T1-ns3+trace | 1 | 0.1410 (0.1479) | 0.1386 (0.1445) | +| zinc-cycle56 | transformer | fixed-rrog-T1-ns3+trace | 1 | 0.3092 (0.0744) | 0.3268 (0.0491) | diff --git a/requirements.txt b/requirements.txt new file mode 100644 index 0000000..c0f2bc7 --- /dev/null +++ b/requirements.txt @@ -0,0 +1,5 @@ +numpy +networkx +ogb +torch-geometric +tqdm diff --git a/rrog/__init__.py b/rrog/__init__.py new file mode 100644 index 0000000..c09281d --- /dev/null +++ b/rrog/__init__.py @@ -0,0 +1,2 @@ +"""Experiment registry for RRoG/TRM-on-GNN sweeps.""" + diff --git a/rrog/backbones.py b/rrog/backbones.py new file mode 100644 index 0000000..81bfb9b --- /dev/null +++ b/rrog/backbones.py @@ -0,0 +1,72 @@ +from rrog.registry import ComputeSpec, ModifierSpec, ViewSpec, by_name + + +VIEWS = [ + ViewSpec("gin", "message-passing", "2d", 1, "implemented", + "Plain GINConv message passing."), + ViewSpec("gine", "message-passing", "2d", 2, "implemented", + "Edge-aware GIN variant. ZINC uses a learned constant edge token; OGB uses bond features."), + ViewSpec("gcn", "message-passing", "2d", 3, "implemented"), + ViewSpec("graphsage", "message-passing", "2d", 4, "implemented"), + ViewSpec("gatv2", "attention-mpnn", "2d", 5, "implemented"), + ViewSpec("graphconv", "message-passing", "2d", 6, "implemented"), + ViewSpec("transformer", "attention-mpnn", "2d", 7, "implemented"), + ViewSpec("pna", "message-passing", "2d", 8, "implemented", + "Requires degree histogram from the train split."), + ViewSpec("gen", "message-passing", "2d", 9, "implemented"), + ViewSpec("film", "message-passing", "2d", 10, "implemented"), + ViewSpec("resgated", "message-passing", "2d", 11, "implemented"), + ViewSpec("tag", "higher-order-hop", "2d", 12, "implemented"), + ViewSpec("sgc", "propagation", "2d", 13, "implemented"), + ViewSpec("cheb", "spectral", "2d", 14, "implemented"), + ViewSpec("arma", "spectral", "2d", 15, "implemented"), + ViewSpec("mf", "message-passing", "2d", 16, "implemented"), + ViewSpec("appnp", "propagation", "2d", 17, "implemented"), + ViewSpec("mixhop", "higher-order-hop", "2d", 18), + ViewSpec("gps", "hybrid-local-global", "2d", 19), + ViewSpec("graphormer", "global-attention", "2d", 20), + ViewSpec("san", "spectral-attention", "2d", 21), + ViewSpec("mpnn", "message-passing", "2d", 22), + ViewSpec("schnet", "continuous-filter", "3d", 23), + ViewSpec("dimenetpp", "angle-aware", "3d", 24), + ViewSpec("painn", "equivariant", "3d", 25), + ViewSpec("gemnet", "equivariant", "3d", 26), + ViewSpec("egnn", "equivariant", "3d", 27), + ViewSpec("equiformer", "equivariant", "3d", 28), + ViewSpec("mace", "equivariant", "3d", 29), +] + + +COMPUTES = [ + ComputeSpec("classic", "baseline", 1, "implemented", "Standard one-forward GNN baseline; no RRoG compute."), + ComputeSpec("view-only", "none", 2, "implemented", "RRoG view module only; no recursive compute."), + ComputeSpec("fixed-rrog", "recursive", 3, "implemented", "Fixed-depth edge-free y/z compute."), + ComputeSpec("rrog-act", "recursive-act", 4, "implemented", "Persistent full ACT recycling for graph batches."), + ComputeSpec("node-mlp", "recursive", 4), + ComputeSpec("gru-rrog", "recursive-gated", 5), + ComputeSpec("set-attn-core", "edge-free-attention", 6), + ComputeSpec("perceiver-core", "latent-attention", 7), + ComputeSpec("global-token-mixer", "token-mixer", 8), + ComputeSpec("equivariant-core", "3d-equivariant", 9), +] + + +MODIFIERS = [ + ModifierSpec("none", "none", 1, "implemented"), + ModifierSpec("dfa-gnn", "backward", 2, "planned", + "Non-BP/direct-feedback-style training; start on node classification."), + ModifierSpec("kaft", "backward", 3, "planned", + "User project in ../graph-grape; low priority until main table is stable."), + ModifierSpec("deep-supervision", "training", 4), + ModifierSpec("sam", "optimizer", 5), + ModifierSpec("lap-pe", "feature", 6), + ModifierSpec("rwse", "feature", 7), + ModifierSpec("virtual-node", "feature", 8), + ModifierSpec("dropedge", "regularization", 9), + ModifierSpec("flag", "augmentation", 10), +] + + +VIEW_BY_NAME = by_name(VIEWS) +COMPUTE_BY_NAME = by_name(COMPUTES) +MODIFIER_BY_NAME = by_name(MODIFIERS) diff --git a/rrog/benchmarks.py b/rrog/benchmarks.py new file mode 100644 index 0000000..dcd356b --- /dev/null +++ b/rrog/benchmarks.py @@ -0,0 +1,44 @@ +from rrog.registry import BenchmarkSpec, by_name + + +BENCHMARKS = [ + BenchmarkSpec("zinc-cycle56", "A", "molecule-2d", "graph-regression", "raw-mae", 1, + "implemented", "ZINC subset with #5/#6 cycle-count targets."), + BenchmarkSpec("zinc", "A", "molecule-2d", "graph-regression", "mae", 2), + BenchmarkSpec("ogbg-molhiv", "A", "molecule-2d", "graph-classification", "rocauc", 3, + "implemented", "OGB graph property prediction."), + BenchmarkSpec("ogbg-molpcba", "A", "molecule-2d", "graph-multilabel", "ap", 4, + "implemented", "OGB graph property prediction."), + BenchmarkSpec("ogbg-molbbbp", "A", "molecule-2d", "graph-classification", "rocauc", 5, + "implemented", "OGB graph property prediction."), + BenchmarkSpec("ogbg-molbace", "A", "molecule-2d", "graph-classification", "rocauc", 6, + "implemented", "OGB graph property prediction."), + BenchmarkSpec("ogbg-moltox21", "A", "molecule-2d", "graph-multilabel", "rocauc", 7, + "implemented", "OGB graph property prediction."), + BenchmarkSpec("ogbg-molclintox", "A", "molecule-2d", "graph-multilabel", "rocauc", 8, + "implemented", "OGB graph property prediction."), + BenchmarkSpec("ogbg-molsider", "A", "molecule-2d", "graph-multilabel", "rocauc", 9, + "implemented", "OGB graph property prediction."), + BenchmarkSpec("ogbg-molesol", "A", "molecule-2d", "graph-regression", "rmse", 10, + "implemented", "OGB ESOL graph property prediction."), + BenchmarkSpec("ogbg-molfreesolv", "A", "molecule-2d", "graph-regression", "rmse", 11, + "implemented", "OGB FreeSolv graph property prediction."), + BenchmarkSpec("ogbg-mollipo", "A", "molecule-2d", "graph-regression", "rmse", 12, + "implemented", "OGB Lipophilicity graph property prediction."), + BenchmarkSpec("pcqm4mv2", "A", "molecule-2d", "graph-regression", "mae", 13), + BenchmarkSpec("qm9", "A", "molecule-3d", "graph-regression", "mae", 14), + BenchmarkSpec("peptides-func", "B", "long-range", "graph-multilabel", "ap", 15), + BenchmarkSpec("peptides-struct", "B", "long-range", "graph-regression", "mae", 16), + BenchmarkSpec("pcqm-contact", "B", "long-range", "link-prediction", "mrr", 17), + BenchmarkSpec("pascalvoc-sp", "B", "superpixel", "node-classification", "f1", 18), + BenchmarkSpec("coco-sp", "B", "superpixel", "node-classification", "f1", 19), + BenchmarkSpec("ogbn-arxiv", "B", "citation", "node-classification", "accuracy", 20), + BenchmarkSpec("ogbn-products", "B", "commerce", "node-classification", "accuracy", 21), + BenchmarkSpec("rmd17", "C", "molecule-3d", "energy-force", "mae", 22), + BenchmarkSpec("oc20-s2ef", "C", "catalyst-3d", "energy-force", "mae", 23), + BenchmarkSpec("oc22", "C", "catalyst-3d", "energy-force", "mae", 24), + BenchmarkSpec("matbench-discovery", "C", "materials", "stability", "discovery-metrics", 25), + BenchmarkSpec("tgb-subset", "C", "temporal", "temporal-link-node", "dataset-specific", 26), +] + +BENCHMARK_BY_NAME = by_name(BENCHMARKS) diff --git a/rrog/cli.py b/rrog/cli.py new file mode 100644 index 0000000..5055b2e --- /dev/null +++ b/rrog/cli.py @@ -0,0 +1,179 @@ +import argparse +import json +import os +import subprocess + +from rrog.backbones import COMPUTES, MODIFIERS, VIEWS +from rrog.benchmarks import BENCHMARKS +from rrog.collect_results import print_tables +from rrog.collect_zinc import print_zinc +from rrog.runspecs import find_run_spec + + +def _rows(items): + return [ + { + "name": item.name, + "tier": getattr(item, "tier", None), + "family": getattr(item, "family", None), + "domain": getattr(item, "domain", None), + "task_type": getattr(item, "task_type", None), + "metric": getattr(item, "metric", None), + "priority": item.priority, + "status": item.status, + "notes": item.notes, + } + for item in items + ] + + +def _print_table(items): + for row in _rows(items): + cols = [row["name"], row.get("tier") or row.get("family") or "", row["status"], row["notes"]] + print("\t".join(str(c) for c in cols)) + + +def list_axis(axis: str, as_json: bool): + mapping = { + "benchmarks": BENCHMARKS, + "views": VIEWS, + "computes": COMPUTES, + "modifiers": MODIFIERS, + } + items = mapping[axis] + if as_json: + print(json.dumps(_rows(items), indent=2)) + else: + _print_table(items) + + +def build_command(args) -> list[str]: + spec = find_run_spec(args.task, args.view, args.compute, args.modifier) + run_args = dict(spec.default_args) + for key in [ + "epochs", "hidden", "bs", "seed", "T", "n_sup", "halt_max_steps", "halt_target", + "halt_min_steps", "halt_loss_threshold", "halt_exploration_prob", "q_warmup_epochs", + "act_train_mode", + "eval_every", "max_train_batches", "max_eval_batches", "num_workers", "ema", "lr", "lam_q", + "device", + ]: + value = getattr(args, key) + if value is not None: + run_args[key] = value + run_args["compute"] = args.compute + return spec.command_builder(run_args) + + +def print_matrix(args): + tasks = [b for b in BENCHMARKS if args.tier == "all" or b.tier == args.tier] + tasks = sorted(tasks, key=lambda x: x.priority)[:args.limit_tasks] + + if args.kind == "main": + views = sorted(VIEWS, key=lambda x: x.priority)[:args.limit_views] + computes = [c for c in COMPUTES if c.name in ["classic", "view-only", "fixed-rrog", "rrog-act"]] + for task in tasks: + for view in views: + for compute in computes: + try: + find_run_spec(task.name, view.name, compute.name) + status = "implemented" + except KeyError: + status = "planned" + print(f"{task.name}\t{view.name}\t{compute.name}\tnone\t{status}") + return + + if args.kind == "modifier": + task_names = {"zinc-cycle56", "ogbg-molhiv", "peptides-struct", "peptides-func", "ogbn-arxiv", "qm9"} + mods = [m for m in sorted(MODIFIERS, key=lambda x: x.priority) if m.name != "none"] + for task in tasks: + if task.name not in task_names: + continue + for mod in mods: + print(f"{task.name}\tgin\tview-only\t{mod.name}\tplanned") + return + + raise ValueError(args.kind) + + +def main(): + ap = argparse.ArgumentParser() + sub = ap.add_subparsers(dest="cmd", required=True) + + lp = sub.add_parser("list") + lp.add_argument("axis", choices=["benchmarks", "views", "computes", "modifiers"]) + lp.add_argument("--json", action="store_true") + + rp = sub.add_parser("run") + rp.add_argument("--task", default="zinc-cycle56") + rp.add_argument("--view", default="gin") + rp.add_argument("--compute", default="rrog-act") + rp.add_argument("--modifier", default="none") + rp.add_argument("--epochs", type=int) + rp.add_argument("--hidden", type=int) + rp.add_argument("--bs", type=int) + rp.add_argument("--seed", type=int) + rp.add_argument("--T", type=int) + rp.add_argument("--n_sup", type=int) + rp.add_argument("--halt_max_steps", type=int) + rp.add_argument("--halt_target", choices=["soft", "binary", "exact", "loss"]) + rp.add_argument("--halt_min_steps", type=int) + rp.add_argument("--halt_loss_threshold", type=float) + rp.add_argument("--halt_exploration_prob", type=float) + rp.add_argument("--q_warmup_epochs", type=int) + rp.add_argument("--act_train_mode", choices=["stream", "trace"]) + rp.add_argument("--eval_every", type=int) + rp.add_argument("--max_train_batches", type=int) + rp.add_argument("--max_eval_batches", type=int) + rp.add_argument("--num_workers", type=int) + rp.add_argument("--ema", type=float) + rp.add_argument("--lr", type=float) + rp.add_argument("--lam_q", type=float) + rp.add_argument("--device") + rp.add_argument("--dry-run", action="store_true") + + mp = sub.add_parser("matrix") + mp.add_argument("--kind", choices=["main", "modifier"], default="main") + mp.add_argument("--tier", choices=["A", "B", "C", "all"], default="A") + mp.add_argument("--limit-tasks", type=int, default=20) + mp.add_argument("--limit-views", type=int, default=6) + + op = sub.add_parser("results") + op.add_argument("--runs-dir", default="runs") + op.add_argument("--glob", default="*.json") + op.add_argument("--min-epochs", type=int, default=10) + op.add_argument("--epochs", type=int) + op.add_argument("--digits", type=int, default=4) + + zp = sub.add_parser("zinc-results") + zp.add_argument("--runs-dir", default="runs") + zp.add_argument("--epochs", type=int) + zp.add_argument("--min-epochs", type=int, default=10) + zp.add_argument("--digits", type=int, default=4) + + args = ap.parse_args() + if args.cmd == "list": + list_axis(args.axis, args.json) + return + if args.cmd == "matrix": + print_matrix(args) + return + if args.cmd == "results": + print_tables(args) + return + if args.cmd == "zinc-results": + print_zinc(args) + return + + cmd = build_command(args) + env = dict(os.environ) + env["PYTHONPATH"] = os.getcwd() + os.pathsep + env.get("PYTHONPATH", "") + print(" ".join(cmd), flush=True) + if not args.dry_run: + raise SystemExit(subprocess.call(cmd, env=env)) + + +if __name__ == "__main__": + try: + main() + except BrokenPipeError: + raise SystemExit(0) diff --git a/rrog/collect_results.py b/rrog/collect_results.py new file mode 100644 index 0000000..85925ba --- /dev/null +++ b/rrog/collect_results.py @@ -0,0 +1,267 @@ +import argparse +import json +import math +from collections import defaultdict +from pathlib import Path + + +HIGHER_BETTER = { + "accuracy", + "ap", + "auc", + "f1", + "mrr", + "rocauc", +} + +LOWER_BETTER = { + "mae", + "raw-mae", + "rmse", +} + + +def _metric_direction(metric: str) -> int: + metric = metric.lower() + if metric in HIGHER_BETTER: + return 1 + if metric in LOWER_BETTER: + return -1 + if "mae" in metric or "rmse" in metric: + return -1 + return 1 + + +def _read(path: Path) -> dict | None: + try: + with path.open() as f: + rep = json.load(f) + except (OSError, json.JSONDecodeError): + return None + required = {"dataset", "view", "compute", "seed", "metric", "val"} + if not required.issubset(rep): + return None + return rep + + +def _score(rep: dict, split: str) -> float | None: + metric = rep.get("metric") + if not metric: + return None + value = rep.get(split, {}).get(metric) + if value is None: + return None + return float(value) + + +def _rank_key(rep: dict) -> tuple[int, int, int]: + return ( + int(rep.get("epochs", 0)), + int(rep.get("hidden", 0)), + int(rep.get("ep", 0) or 0), + ) + + +def _mean(xs: list[float]) -> float: + return sum(xs) / len(xs) + + +def _std(xs: list[float]) -> float: + if len(xs) < 2: + return 0.0 + mu = _mean(xs) + return math.sqrt(sum((x - mu) ** 2 for x in xs) / (len(xs) - 1)) + + +def _fmt(value: float | None, digits: int) -> str: + if value is None: + return "" + return f"{value:.{digits}f}" + + +def _is_classic_baseline(rep: dict) -> bool: + return rep.get("compute") == "classic" and int(rep.get("T", -1)) == 0 and int(rep.get("n_sup", -1)) == 1 + + +def _compute_label(rep: dict) -> str: + compute = str(rep["compute"]) + if _is_classic_baseline(rep): + label = "classic" + elif compute == "rrog-act": + target = str(rep.get("halt_target", "")) + if target == "loss": + target += f"{float(rep.get('halt_loss_threshold', 0.0) or 0.0):g}" + label = ( + f"{compute}-{rep.get('act_train_mode', 'stream')}-T{rep.get('T')}-ns{rep.get('n_sup')}" + f"-hm{rep.get('halt_max_steps')}-min{rep.get('halt_min_steps')}" + f"-{target}-lq{float(rep.get('lam_q', 0.0) or 0.0):g}" + f"-hex{float(rep.get('halt_exploration_prob', 0.0) or 0.0):g}" + f"-qw{rep.get('q_warmup_epochs', 0)}" + ) + else: + label = f"{compute}-T{rep.get('T')}-ns{rep.get('n_sup')}" + ema = float(rep.get("ema", 0.0) or 0.0) + if ema > 0: + label += f"+ema{ema:g}" + return label + + +def _choose_runs(paths: list[Path], min_epochs: int, epochs: int | None) -> list[dict]: + candidates: dict[tuple[str, str, str, int], dict] = {} + for path in paths: + rep = _read(path) + if rep is None: + continue + if epochs is not None and int(rep.get("epochs", -1)) != epochs: + continue + if int(rep.get("epochs", 0)) < min_epochs: + continue + val = _score(rep, "val") + test = _score(rep, "test") + if val is None or test is None: + continue + key = (str(rep["dataset"]), str(rep["view"]), _compute_label(rep), int(rep["seed"])) + old = candidates.get(key) + if old is None or _rank_key(rep) > _rank_key(old): + candidates[key] = rep + return list(candidates.values()) + + +def _group_by_cell(runs: list[dict]) -> dict[tuple[str, str, str], list[dict]]: + grouped: dict[tuple[str, str, str], list[dict]] = defaultdict(list) + for rep in runs: + grouped[(str(rep["dataset"]), str(rep["view"]), _compute_label(rep))].append(rep) + return dict(grouped) + + +def _summarize_cell(reps: list[dict], split: str) -> tuple[float, float, int]: + scores = [_score(rep, split) for rep in reps] + xs = [x for x in scores if x is not None] + return _mean(xs), _std(xs), len(xs) + + +def _markdown_table(headers: list[str], rows: list[list[str]]) -> str: + out = ["| " + " | ".join(headers) + " |", "| " + " | ".join(["---"] * len(headers)) + " |"] + out.extend("| " + " | ".join(row) + " |" for row in rows) + return "\n".join(out) + + +def print_tables(args) -> None: + paths = sorted(Path(args.runs_dir).glob(args.glob)) + runs = _choose_runs(paths, args.min_epochs, args.epochs) + grouped = _group_by_cell(runs) + + classic_cells = { + (task, view): reps + for (task, view, compute), reps in grouped.items() + if compute == "classic" + for reps in [[rep for rep in reps if _is_classic_baseline(rep)]] + if reps + } + + baseline_rows = [] + for (task, view), reps in sorted(classic_cells.items()): + metric = str(reps[0]["metric"]) + val_mu, val_sd, n = _summarize_cell(reps, "val") + test_mu, test_sd, _ = _summarize_cell(reps, "test") + baseline_rows.append([ + task, + view, + metric, + str(n), + f"{_fmt(val_mu, args.digits)} +/- {_fmt(val_sd, args.digits)}", + f"{_fmt(test_mu, args.digits)} +/- {_fmt(test_sd, args.digits)}", + ]) + + delta_rows = [] + for (task, view, compute), reps in sorted(grouped.items()): + if compute == "classic": + continue + base = classic_cells.get((task, view)) + if not base: + continue + metric = str(reps[0]["metric"]) + direction = _metric_direction(metric) + base_by_seed = {int(rep["seed"]): rep for rep in base} + paired = [] + for rep in reps: + seed = int(rep["seed"]) + if seed in base_by_seed: + paired.append((rep, base_by_seed[seed])) + if not paired: + base_test_mu, _, _ = _summarize_cell(base, "test") + base_val_mu, _, _ = _summarize_cell(base, "val") + paired = [(rep, None) for rep in reps] + else: + base_test_mu = None + base_val_mu = None + + val_scores, test_scores, val_deltas, test_deltas = [], [], [], [] + adaptive_test_scores, adaptive_test_deltas = [], [] + adaptive_steps = [] + for rep, base_rep in paired: + val = _score(rep, "val") + test = _score(rep, "test") + if val is None or test is None: + continue + if base_rep is None: + base_val = base_val_mu + base_test = base_test_mu + else: + base_val = _score(base_rep, "val") + base_test = _score(base_rep, "test") + if base_val is None or base_test is None: + continue + val_scores.append(val) + test_scores.append(test) + val_deltas.append(direction * (val - base_val)) + test_deltas.append(direction * (test - base_test)) + adaptive_test = _score(rep, "test_adaptive") + if adaptive_test is not None: + adaptive_test_scores.append(adaptive_test) + adaptive_test_deltas.append(direction * (adaptive_test - base_test)) + if rep.get("adaptive_steps") is not None: + adaptive_steps.append(float(rep["adaptive_steps"])) + + if not test_scores: + continue + adaptive_test_cell = "" + if adaptive_test_scores: + adaptive_test_cell = ( + f"{_fmt(_mean(adaptive_test_scores), args.digits)} " + f"({_fmt(_mean(adaptive_test_deltas), args.digits)})" + ) + delta_rows.append([ + task, + view, + compute, + metric, + str(len(test_scores)), + f"{_fmt(_mean(val_scores), args.digits)} ({_fmt(_mean(val_deltas), args.digits)})", + f"{_fmt(_mean(test_scores), args.digits)} ({_fmt(_mean(test_deltas), args.digits)})", + adaptive_test_cell, + _fmt(_mean(adaptive_steps), 2) if adaptive_steps else "", + ]) + + print("\nClassic baseline: task x backbone") + print(_markdown_table(["task", "backbone", "metric", "n", "val", "test"], baseline_rows)) + print("\nDelta vs matching classic") + print(_markdown_table([ + "task", "backbone", "compute", "metric", "n", "val score (delta)", "test score (delta)", + "adaptive test (delta)", "steps" + ], delta_rows)) + + +def main() -> None: + ap = argparse.ArgumentParser() + ap.add_argument("--runs-dir", default="runs") + ap.add_argument("--glob", default="*.json") + ap.add_argument("--min-epochs", type=int, default=10) + ap.add_argument("--epochs", type=int) + ap.add_argument("--digits", type=int, default=4) + args = ap.parse_args() + print_tables(args) + + +if __name__ == "__main__": + main() diff --git a/rrog/collect_zinc.py b/rrog/collect_zinc.py new file mode 100644 index 0000000..49ae1e9 --- /dev/null +++ b/rrog/collect_zinc.py @@ -0,0 +1,137 @@ +import argparse +import json +import math +from collections import defaultdict +from pathlib import Path + + +def _read(path: Path) -> dict | None: + try: + with path.open() as f: + rep = json.load(f) + except (OSError, json.JSONDecodeError): + return None + if rep.get("dataset") != "ZINC-cycle56": + return None + if rep.get("K") != 1 or rep.get("select") != "none" or float(rep.get("sigma", 0.0)) != 0.0: + return None + if "test_mae" not in rep or "val_mae" not in rep: + return None + return rep + + +def _compute(rep: dict) -> str: + if rep.get("act"): + return f"rrog-act-T{rep.get('T')}-ns{rep.get('n_sup')}" + if int(rep.get("T", -1)) == 0 and int(rep.get("n_sup", -1)) == 1: + return "classic" + label = f"fixed-rrog-T{rep.get('T')}-ns{rep.get('n_sup')}" + if rep.get("loss_mode") == "trace": + label += "+trace" + return label + + +def _view(rep: dict) -> str: + return str(rep.get("view", "gin")) + + +def _score(rep: dict, split: str) -> float: + return float(sum(rep[f"{split}_mae"])) + + +def _mean(xs: list[float]) -> float: + return sum(xs) / len(xs) + + +def _std(xs: list[float]) -> float: + if len(xs) < 2: + return 0.0 + mu = _mean(xs) + return math.sqrt(sum((x - mu) ** 2 for x in xs) / (len(xs) - 1)) + + +def _fmt(x: float, digits: int) -> str: + return f"{x:.{digits}f}" + + +def _markdown(headers: list[str], rows: list[list[str]]) -> str: + lines = ["| " + " | ".join(headers) + " |", "| " + " | ".join(["---"] * len(headers)) + " |"] + lines.extend("| " + " | ".join(row) + " |" for row in rows) + return "\n".join(lines) + + +def print_zinc(args) -> None: + by_cell: dict[tuple[str, str, int], dict] = {} + for path in sorted(Path(args.runs_dir).glob("rec_rrog*_sig0.0_K1_none_T*_s*.json")): + rep = _read(path) + if rep is None: + continue + if args.epochs is not None and int(rep.get("epochs", -1)) != args.epochs: + continue + if int(rep.get("epochs", 0)) < args.min_epochs: + continue + key = (_view(rep), _compute(rep), int(rep["seed"])) + old = by_cell.get(key) + if old is None or int(rep.get("epochs", 0)) > int(old.get("epochs", 0)): + by_cell[key] = rep + + grouped: dict[tuple[str, str], list[dict]] = defaultdict(list) + for rep in by_cell.values(): + grouped[(_view(rep), _compute(rep))].append(rep) + + classic_by_view = { + view: reps + for (view, compute), reps in grouped.items() + if compute == "classic" + } + + base_rows = [] + for view, classic in sorted(classic_by_view.items()): + vals = [_score(rep, "val") for rep in classic] + tests = [_score(rep, "test") for rep in classic] + base_rows.append([ + "zinc-cycle56", + view, + str(len(classic)), + f"{_fmt(_mean(vals), args.digits)} +/- {_fmt(_std(vals), args.digits)}", + f"{_fmt(_mean(tests), args.digits)} +/- {_fmt(_std(tests), args.digits)}", + ]) + + delta_rows = [] + for (view, compute), reps in sorted(grouped.items()): + if compute == "classic": + continue + base_by_seed = {int(rep["seed"]): rep for rep in classic_by_view.get(view, [])} + paired = [(rep, base_by_seed[int(rep["seed"])]) for rep in reps if int(rep["seed"]) in base_by_seed] + if not paired: + continue + vals = [_score(rep, "val") for rep, _ in paired] + tests = [_score(rep, "test") for rep, _ in paired] + val_deltas = [_score(base, "val") - _score(rep, "val") for rep, base in paired] + test_deltas = [_score(base, "test") - _score(rep, "test") for rep, base in paired] + delta_rows.append([ + "zinc-cycle56", + view, + compute, + str(len(paired)), + f"{_fmt(_mean(vals), args.digits)} ({_fmt(_mean(val_deltas), args.digits)})", + f"{_fmt(_mean(tests), args.digits)} ({_fmt(_mean(test_deltas), args.digits)})", + ]) + + print("\nZINC-cycle56 classic baseline") + print(_markdown(["task", "backbone", "n", "val MAE-sum", "test MAE-sum"], base_rows)) + print("\nZINC-cycle56 delta vs matching classic") + print(_markdown(["task", "backbone", "compute", "n", "val score (improvement)", "test score (improvement)"], delta_rows)) + + +def main() -> None: + ap = argparse.ArgumentParser() + ap.add_argument("--runs-dir", default="runs") + ap.add_argument("--epochs", type=int) + ap.add_argument("--min-epochs", type=int, default=10) + ap.add_argument("--digits", type=int, default=4) + print_zinc(ap.parse_args()) + + +if __name__ == "__main__": + main() diff --git a/rrog/registry.py b/rrog/registry.py new file mode 100644 index 0000000..7f6b6fe --- /dev/null +++ b/rrog/registry.py @@ -0,0 +1,57 @@ +from dataclasses import dataclass, field +from typing import Callable + + +@dataclass(frozen=True) +class BenchmarkSpec: + name: str + tier: str + domain: str + task_type: str + metric: str + priority: int + status: str = "planned" + notes: str = "" + + +@dataclass(frozen=True) +class ViewSpec: + name: str + family: str + graph_type: str + priority: int + status: str = "planned" + notes: str = "" + + +@dataclass(frozen=True) +class ComputeSpec: + name: str + family: str + priority: int + status: str = "planned" + notes: str = "" + + +@dataclass(frozen=True) +class ModifierSpec: + name: str + family: str + priority: int + status: str = "planned" + notes: str = "" + + +@dataclass(frozen=True) +class RunSpec: + task: str + view: str + compute: str + modifier: str = "none" + default_args: dict[str, object] = field(default_factory=dict) + command_builder: Callable[[dict[str, object]], list[str]] | None = None + + +def by_name(items): + return {item.name: item for item in items} + diff --git a/rrog/run_ogb_hiv_remaining.sh b/rrog/run_ogb_hiv_remaining.sh new file mode 100755 index 0000000..067e736 --- /dev/null +++ b/rrog/run_ogb_hiv_remaining.sh @@ -0,0 +1,49 @@ +#!/usr/bin/env bash +set -euo pipefail + +ROOT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd)" +cd "${ROOT_DIR}" +export PYTHONPATH="${ROOT_DIR}:${PYTHONPATH:-}" + +DEVICE="${DEVICE:-cuda:3}" +EPOCHS="${EPOCHS:-100}" +SEED="${SEED:-0}" + +run_if_missing() { + local view="$1" + local compute="$2" + local t="$3" + local ns="$4" + local out="runs/ogbg-molhiv_${view}_${compute}_T${t}_ns${ns}_h128_e${EPOCHS}_s${SEED}.json" + if [[ -f "${out}" ]]; then + echo "[skip] ${out}" + return + fi + echo "[run] view=${view} compute=${compute} T=${t} ns=${ns} device=${DEVICE}" + python3 -m rrog.cli run \ + --task ogbg-molhiv \ + --view "${view}" \ + --compute "${compute}" \ + --epochs "${EPOCHS}" \ + --T "${t}" \ + --n_sup "${ns}" \ + --seed "${SEED}" \ + --device "${DEVICE}" +} + +# Complete remaining OGB-HIV backbone x {classic, fixed-RRoG} cells. +# Existing json files are skipped, so the queue can be restarted safely. +run_if_missing sgc fixed-rrog 3 3 +run_if_missing cheb classic 0 1 +run_if_missing cheb fixed-rrog 3 3 +run_if_missing arma classic 0 1 +run_if_missing arma fixed-rrog 3 3 +run_if_missing mf classic 0 1 +run_if_missing mf fixed-rrog 3 3 +run_if_missing appnp classic 0 1 +run_if_missing appnp fixed-rrog 3 3 +run_if_missing pna fixed-rrog 3 3 +run_if_missing gine classic 0 1 +run_if_missing gine fixed-rrog 3 3 + +python3 -m rrog.cli results --epochs "${EPOCHS}" diff --git a/rrog/run_zinc_gine.sh b/rrog/run_zinc_gine.sh new file mode 100755 index 0000000..1ca36e1 --- /dev/null +++ b/rrog/run_zinc_gine.sh @@ -0,0 +1,36 @@ +#!/usr/bin/env bash +set -euo pipefail + +ROOT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd)" +cd "${ROOT_DIR}" +export PYTHONPATH="${ROOT_DIR}:${PYTHONPATH:-}" + +DEVICE="${DEVICE:-cuda:3}" +EPOCHS="${EPOCHS:-200}" +SEED="${SEED:-0}" + +run_if_missing() { + local compute="$1" + local t="$2" + local ns="$3" + local out="runs/rec_rrog_gine_full_sig0.0_K1_none_T${t}_ns${ns}_trace_s${SEED}.json" + if [[ -f "${out}" ]]; then + echo "[skip] ${out}" + return + fi + echo "[run] zinc-cycle56 view=gine compute=${compute} T=${t} ns=${ns} device=${DEVICE}" + python3 -m rrog.cli run \ + --task zinc-cycle56 \ + --view gine \ + --compute "${compute}" \ + --epochs "${EPOCHS}" \ + --T "${t}" \ + --n_sup "${ns}" \ + --seed "${SEED}" \ + --device "${DEVICE}" +} + +run_if_missing classic 0 1 +run_if_missing fixed-rrog 1 3 + +python3 -m rrog.cli zinc-results --epochs "${EPOCHS}" diff --git a/rrog/run_zinc_gine_after_pid.sh b/rrog/run_zinc_gine_after_pid.sh new file mode 100755 index 0000000..a4d24ae --- /dev/null +++ b/rrog/run_zinc_gine_after_pid.sh @@ -0,0 +1,14 @@ +#!/usr/bin/env bash +set -euo pipefail + +WAIT_PID="${1:?usage: run_zinc_gine_after_pid.sh <pid>}" +ROOT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd)" +cd "${ROOT_DIR}" + +echo "[wait] OGB queue pid=${WAIT_PID}" +while kill -0 "${WAIT_PID}" 2>/dev/null; do + sleep 60 +done + +echo "[start] OGB queue exited; launching ZINC gine" +DEVICE="${DEVICE:-cuda:1}" EPOCHS="${EPOCHS:-200}" SEED="${SEED:-0}" ./rrog/run_zinc_gine.sh diff --git a/rrog/runspecs.py b/rrog/runspecs.py new file mode 100644 index 0000000..17c5ef4 --- /dev/null +++ b/rrog/runspecs.py @@ -0,0 +1,198 @@ +from rrog.registry import RunSpec + + +ZINC_VIEWS = [ + "gin", "gine", "gcn", "graphsage", "gatv2", "graphconv", "transformer", "pna", + "gen", "film", "resgated", "tag", "sgc", "cheb", "arma", "mf", "appnp", +] +OGB_MOL_VIEWS = [ + "gin", "gine", "gcn", "graphsage", "gatv2", "graphconv", "transformer", "pna", + "gen", "film", "resgated", "tag", "sgc", "cheb", "arma", "mf", "appnp", +] +OGB_MOL_TASKS = [ + "ogbg-molhiv", + "ogbg-molpcba", + "ogbg-molbbbp", + "ogbg-molbace", + "ogbg-moltox21", + "ogbg-molclintox", + "ogbg-molsider", + "ogbg-molesol", + "ogbg-molfreesolv", + "ogbg-mollipo", +] + + +def _zinc_cycle56_gin_command(args: dict[str, object]) -> list[str]: + compute = str(args.get("compute", "rrog-act")) + view = str(args.get("view", "gin")) + epochs = int(args.get("epochs", 200)) + hidden = int(args.get("hidden", 64)) + batch_size = int(args.get("bs", 256)) + seed = int(args.get("seed", 0)) + t = int(args.get("T", 1)) + n_sup = int(args.get("n_sup", 3)) + halt_max_steps = int(args.get("halt_max_steps", 8)) + halt_target = str(args.get("halt_target", "binary")) + + cmd = [ + "python3", "diag/train_rec.py", + "--grad_mode", "full", + "--T", str(t), + "--n_sup", str(n_sup), + "--hidden", str(hidden), + "--bs", str(batch_size), + "--epochs", str(epochs), + "--agg_layers", str(args.get("agg_layers", 5)), + "--compute_layers", str(args.get("compute_layers", 2)), + "--view", view, + "--sigma", "0", + "--K", "1", + "--select", "none", + "--seed", str(seed), + ] + + if compute in ["classic", "view-only"]: + cmd[cmd.index("--T") + 1] = "0" + elif compute == "fixed-rrog": + pass + elif compute == "rrog-act": + cmd.extend([ + "--act", + "--halt_max_steps", str(halt_max_steps), + "--halt_target", halt_target, + "--halt_norm_threshold", str(args.get("halt_norm_threshold", 0.3)), + ]) + else: + raise ValueError(f"unsupported compute for zinc-cycle56/{view}: {compute}") + if args.get("device") is not None: + cmd.extend(["--device", str(args["device"])]) + return cmd + + +def _ogb_graphprop_gin_command(args: dict[str, object]) -> list[str]: + task = str(args["task"]) + view = str(args.get("view", "gin")) + compute = str(args.get("compute", "rrog-act")) + cmd = [ + "python3", "rrog/train_ogb_graphprop.py", + "--dataset", task, + "--view", view, + "--compute", compute, + "--T", str(args.get("T", 1)), + "--n_sup", str(args.get("n_sup", 3)), + "--hidden", str(args.get("hidden", 128)), + "--bs", str(args.get("bs", 128)), + "--epochs", str(args.get("epochs", 100)), + "--eval_every", str(args.get("eval_every", 10)), + "--agg_layers", str(args.get("agg_layers", 5)), + "--compute_layers", str(args.get("compute_layers", 2)), + "--seed", str(args.get("seed", 0)), + ] + for key in ["lr", "lam_q"]: + if args.get(key) is not None: + cmd.extend([f"--{key}", str(args[key])]) + if compute == "rrog-act": + cmd.extend([ + "--halt_max_steps", str(args.get("halt_max_steps", 8)), + "--halt_min_steps", str(args.get("halt_min_steps", 2)), + "--halt_target", str(args.get("halt_target", "loss")), + "--halt_loss_threshold", str(args.get("halt_loss_threshold", 0.2)), + "--halt_exploration_prob", str(args.get("halt_exploration_prob", 0.1)), + "--act_train_mode", str(args.get("act_train_mode", "stream")), + ]) + if args.get("q_warmup_epochs") is not None: + cmd.extend(["--q_warmup_epochs", str(args["q_warmup_epochs"])]) + if float(args.get("ema", 0.0) or 0.0) > 0: + cmd.extend(["--ema", str(args["ema"])]) + if args.get("device") is not None: + cmd.extend(["--device", str(args["device"])]) + for key in ["max_train_batches", "max_eval_batches", "num_workers"]: + if args.get(key) is not None: + cmd.extend([f"--{key}", str(args[key])]) + return cmd + + +RUN_SPECS = [ +] + +for _view in ZINC_VIEWS: + RUN_SPECS.extend([ + RunSpec( + task="zinc-cycle56", + view=_view, + compute="classic", + default_args={"compute": "classic", "view": _view, "T": 0, "n_sup": 1, "epochs": 200}, + command_builder=_zinc_cycle56_gin_command, + ), + RunSpec( + task="zinc-cycle56", + view=_view, + compute="view-only", + default_args={"compute": "view-only", "view": _view, "T": 0, "n_sup": 3, "epochs": 200}, + command_builder=_zinc_cycle56_gin_command, + ), + RunSpec( + task="zinc-cycle56", + view=_view, + compute="fixed-rrog", + default_args={"compute": "fixed-rrog", "view": _view, "T": 3, "n_sup": 3, "epochs": 200}, + command_builder=_zinc_cycle56_gin_command, + ), + RunSpec( + task="zinc-cycle56", + view=_view, + compute="rrog-act", + default_args={"compute": "rrog-act", "view": _view, "T": 1, "n_sup": 3, "epochs": 200}, + command_builder=_zinc_cycle56_gin_command, + ), + ]) + +for _task in OGB_MOL_TASKS: + for _view in OGB_MOL_VIEWS: + RUN_SPECS.extend([ + RunSpec( + task=_task, + view=_view, + compute="classic", + default_args={"task": _task, "view": _view, "compute": "classic", "T": 0, "n_sup": 1, "epochs": 100}, + command_builder=_ogb_graphprop_gin_command, + ), + RunSpec( + task=_task, + view=_view, + compute="view-only", + default_args={"task": _task, "view": _view, "compute": "view-only", "T": 0, "n_sup": 3, "epochs": 100}, + command_builder=_ogb_graphprop_gin_command, + ), + RunSpec( + task=_task, + view=_view, + compute="fixed-rrog", + default_args={"task": _task, "view": _view, "compute": "fixed-rrog", "T": 3, "n_sup": 3, "epochs": 100}, + command_builder=_ogb_graphprop_gin_command, + ), + RunSpec( + task=_task, + view=_view, + compute="rrog-act", + default_args={ + "task": _task, + "view": _view, + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "epochs": 100, + "act_train_mode": "stream", + "lam_q": 0.1, + }, + command_builder=_ogb_graphprop_gin_command, + ), + ]) + + +def find_run_spec(task: str, view: str, compute: str, modifier: str = "none") -> RunSpec: + for spec in RUN_SPECS: + if (spec.task, spec.view, spec.compute, spec.modifier) == (task, view, compute, modifier): + return spec + raise KeyError(f"no implemented run spec for task={task} view={view} compute={compute} modifier={modifier}") diff --git a/rrog/train_ogb_graphprop.py b/rrog/train_ogb_graphprop.py new file mode 100644 index 0000000..0961359 --- /dev/null +++ b/rrog/train_ogb_graphprop.py @@ -0,0 +1,704 @@ +import argparse +from contextlib import contextmanager +import json +import os +import time + +import numpy as np +import torch +import torch.nn as nn +from ogb.graphproppred import Evaluator, PygGraphPropPredDataset +from ogb.graphproppred.mol_encoder import AtomEncoder, BondEncoder +from torch_geometric.data import Batch +from torch_geometric.loader import DataLoader +from torch_geometric.nn import ( + APPNP, + ARMAConv, + ChebConv, + FiLMConv, + GATv2Conv, + GCNConv, + GENConv, + GINEConv, + GraphConv, + MFConv, + PNAConv, + ResGatedGraphConv, + SAGEConv, + SGConv, + TAGConv, + TransformerConv, + global_add_pool, +) +from torch_geometric.utils import degree + + +PROJECT_ROOT = os.environ.get( + "RROG_ROOT", + os.path.abspath(os.path.join(os.path.dirname(__file__), "..")), +) +DATA_ROOT = os.environ.get("RROG_DATA_DIR", os.path.join(PROJECT_ROOT, "data")) +ROOT = os.path.join(DATA_ROOT, "ogb") +OUT = os.environ.get("RROG_RUNS_DIR", os.path.join(PROJECT_ROOT, "runs")) +SUPPORTED_VIEWS = [ + "gin", "gine", "gcn", "graphsage", "gatv2", "graphconv", "transformer", "pna", + "gen", "film", "resgated", "tag", "sgc", "cheb", "arma", "mf", "appnp", +] +SUPPORTED_MOL_DATASETS = [ + "ogbg-molhiv", + "ogbg-molpcba", + "ogbg-molbbbp", + "ogbg-molbace", + "ogbg-moltox21", + "ogbg-molclintox", + "ogbg-molsider", + "ogbg-molesol", + "ogbg-molfreesolv", + "ogbg-mollipo", +] +HIGHER_BETTER = {"rocauc", "ap", "auc", "accuracy", "acc", "f1"} +LOWER_BETTER = {"rmse", "mae"} + +_TORCH_LOAD = torch.load + + +def _torch_load_ogb_compat(*args, **kwargs): + kwargs.setdefault("weights_only", False) + return _TORCH_LOAD(*args, **kwargs) + + +torch.load = _torch_load_ogb_compat + + +def clone_state_dict(model): + return {k: v.detach().clone() for k, v in model.state_dict().items()} + + +@torch.no_grad() +def update_ema_state(ema_state, model, decay): + if ema_state is None: + return + for key, value in model.state_dict().items(): + if torch.is_floating_point(value): + ema_state[key].mul_(decay).add_(value.detach(), alpha=1.0 - decay) + else: + ema_state[key].copy_(value.detach()) + + +@contextmanager +def using_ema_state(model, ema_state): + if ema_state is None: + yield + return + raw_state = clone_state_dict(model) + model.load_state_dict(ema_state, strict=True) + try: + yield + finally: + model.load_state_dict(raw_state, strict=True) + + +def metric_direction(metric: str) -> int: + metric = metric.lower() + if metric in LOWER_BETTER or "rmse" in metric or "mae" in metric: + return -1 + return 1 + + +def is_regression_metric(metric: str) -> bool: + return metric_direction(metric) < 0 + + +def is_better(score: float, best: float | None, metric: str) -> bool: + if best is None: + return True + direction = metric_direction(metric) + return score > best if direction > 0 else score < best + + +def jsonable(obj): + if isinstance(obj, dict): + return {str(k): jsonable(v) for k, v in obj.items()} + if isinstance(obj, (list, tuple)): + return [jsonable(v) for v in obj] + if isinstance(obj, (np.integer, np.floating)): + return obj.item() + if isinstance(obj, torch.Tensor): + if obj.ndim == 0: + return obj.detach().cpu().item() + return obj.detach().cpu().tolist() + return obj + + +def degree_histogram(dataset) -> torch.Tensor: + max_degree = 0 + degs = [] + for graph in dataset: + deg = degree(graph.edge_index[1], num_nodes=graph.num_nodes, dtype=torch.long) + degs.append(deg) + if deg.numel(): + max_degree = max(max_degree, int(deg.max().item())) + hist = torch.zeros(max_degree + 1, dtype=torch.long) + for deg in degs: + hist += torch.bincount(deg, minlength=hist.numel()) + return hist + + +def make_view_layer(view: str, hidden: int, deg: torch.Tensor | None): + if view in {"gin", "gine"}: + mlp = nn.Sequential(nn.Linear(hidden, hidden), nn.ReLU(), nn.Linear(hidden, hidden)) + return GINEConv(mlp, train_eps=True) + if view == "gcn": + return GCNConv(hidden, hidden) + if view == "graphsage": + return SAGEConv(hidden, hidden) + if view == "gatv2": + return GATv2Conv(hidden, hidden, heads=4, concat=False, edge_dim=hidden) + if view == "graphconv": + return GraphConv(hidden, hidden) + if view == "transformer": + return TransformerConv(hidden, hidden, heads=4, concat=False, edge_dim=hidden) + if view == "pna": + if deg is None: + raise ValueError("PNA view requires a training-set degree histogram") + return PNAConv( + hidden, hidden, + aggregators=["mean", "min", "max", "std"], + scalers=["identity", "amplification", "attenuation"], + deg=deg, + edge_dim=hidden, + ) + if view == "gen": + return GENConv(hidden, hidden, edge_dim=hidden) + if view == "film": + return FiLMConv(hidden, hidden) + if view == "resgated": + return ResGatedGraphConv(hidden, hidden, edge_dim=hidden) + if view == "tag": + return TAGConv(hidden, hidden, K=3) + if view == "sgc": + return SGConv(hidden, hidden, K=2, cached=False) + if view == "cheb": + return ChebConv(hidden, hidden, K=3) + if view == "arma": + return ARMAConv(hidden, hidden, num_stacks=1, num_layers=2) + if view == "mf": + return MFConv(hidden, hidden) + if view == "appnp": + return APPNP(K=5, alpha=0.1) + raise ValueError(f"unsupported OGB view: {view}") + + +EDGE_ATTR_VIEWS = {"gin", "gine", "gatv2", "transformer", "pna", "gen", "resgated"} + + +class OGBRRoG(nn.Module): + def __init__( + self, hidden, num_tasks, view="gin", T=1, n_sup=3, agg_layers=5, + compute_layers=2, grad_mode="full", deg=None, + ): + super().__init__() + self.view = view + self.atom_encoder = AtomEncoder(hidden) + self.bond_encoder = BondEncoder(hidden) + self.agg_convs = nn.ModuleList() + self.agg_bns = nn.ModuleList() + for _ in range(agg_layers): + self.agg_convs.append(make_view_layer(view, hidden, deg)) + self.agg_bns.append(nn.BatchNorm1d(hidden)) + + core = [] + d = hidden + for _ in range(compute_layers - 1): + core += [nn.Linear(d, hidden), nn.GELU()] + d = hidden + core.append(nn.Linear(d, hidden)) + self.core_norm = nn.LayerNorm(hidden) + self.core = nn.Sequential(*core) + nn.init.zeros_(self.core[-1].weight) + nn.init.zeros_(self.core[-1].bias) + + self.head = nn.Sequential(nn.Linear(hidden, hidden), nn.ReLU(), nn.Linear(hidden, num_tasks)) + self.qhead = nn.Sequential(nn.Linear(hidden, hidden), nn.ReLU(), nn.Linear(hidden, 1)) + with torch.no_grad(): + self.qhead[-1].weight.zero_() + self.qhead[-1].bias.fill_(-5.0) + + self.T = T + self.n_sup = n_sup + self.grad_mode = grad_mode + self.agg_layers = agg_layers + self.compute_layers = compute_layers + self.hidden = hidden + self.num_tasks = num_tasks + + def aggregate(self, x, edge_index, edge_attr): + h = self.atom_encoder(x) + e = self.bond_encoder(edge_attr) + for conv, bn in zip(self.agg_convs, self.agg_bns): + if self.view in {"gin", "gine", "pna", "gen", "resgated"}: + h = bn(conv(h, edge_index, e)).relu() + elif self.view in {"gatv2", "transformer"}: + h = bn(conv(h, edge_index, edge_attr=e)).relu() + else: + h = bn(conv(h, edge_index)).relu() + return h + + def core_step(self, combined, state): + return state + self.core(self.core_norm(combined)) + + def _z_step(self, y, z, ctx): + return self.core_step(ctx + y + z, z) + + def _y_step(self, y, z): + return self.core_step(y + z, y) + + def recurse(self, y, z, ctx, one_step=False): + if self.T == 0: + return y, z + if one_step: + with torch.no_grad(): + for _ in range(self.T - 1): + z = self._z_step(y, z, ctx) + z = z.detach() + z = self._z_step(y, z, ctx) + y = self._y_step(y, z) + return y, z + for _ in range(self.T): + z = self._z_step(y, z, ctx) + y = self._y_step(y, z) + return y, z + + def predict(self, y, batch): + pooled = global_add_pool(y, batch) + return self.head(pooled), self.qhead(pooled).view(-1) + + def forward_trace(self, data, steps): + ctx = self.aggregate(data.x, data.edge_index, data.edge_attr) + y = ctx + z = torch.zeros_like(ctx) + preds, q_logits = [], [] + for s in range(steps): + y, z = self.recurse(y, z, ctx, one_step=(self.grad_mode == "1step")) + pred, q = self.predict(y, data.batch) + preds.append(pred) + q_logits.append(q) + if s < steps - 1: + y, z = y.detach(), z.detach() + return preds, q_logits + + def forward(self, data): + steps = self.n_sup + preds, q_logits = self.forward_trace(data, steps) + return preds, q_logits[-1] + + +def supervised_loss(logits, y, metric): + per_graph, has_label = per_graph_supervised_loss(logits, y, metric) + if not has_label.any(): + return logits.sum() * 0.0 + return per_graph[has_label].mean() + + +def per_graph_supervised_loss(logits, y, metric): + y = y.to(torch.float32) + mask = ~torch.isnan(y) + target = torch.where(mask, y, torch.zeros_like(y)) + if is_regression_metric(metric): + losses = (logits - target).pow(2) + else: + losses = nn.functional.binary_cross_entropy_with_logits(logits, target, reduction="none") + losses = torch.where(mask, losses, torch.zeros_like(losses)) + denom = mask.sum(dim=1).clamp_min(1) + return losses.sum(dim=1) / denom, mask.any(dim=1) + + +@torch.no_grad() +def halt_targets(logits, y): + y = y.to(torch.float32) + mask = ~torch.isnan(y) + pred = (logits > 0).to(y.dtype) + correct_or_missing = (~mask) | (pred == y) + has_label = mask.any(dim=1) + return (correct_or_missing.all(dim=1) & has_label).to(logits.dtype) + + +@torch.no_grad() +def evaluate(model, loader, evaluator, dev, steps=None, adaptive=False, halt_min_steps=1, max_batches=0): + model.eval() + ys, ps = [], [] + step_sum = 0.0 + n = 0 + for i, batch in enumerate(loader): + if max_batches and i >= max_batches: + break + batch = batch.to(dev) + if steps is None: + preds, _ = model(batch) + pred = preds[-1] + used_steps = float(model.n_sup) + else: + preds, qs = model.forward_trace(batch, steps) + stack = torch.stack(preds, dim=0) + if adaptive: + q = torch.stack(qs, dim=0) + step_ids = torch.arange(1, steps + 1, device=dev).view(-1, 1) + halted = (q > 0) & (step_ids >= halt_min_steps) + any_halt = halted.any(dim=0) + first_halt = halted.to(torch.int64).argmax(dim=0) + fallback = torch.full_like(first_halt, steps - 1) + idx = torch.where(any_halt, first_halt, fallback) + pred = stack[idx, torch.arange(stack.size(1), device=dev)] + used_steps = float((idx.to(torch.float32) + 1).sum().item()) + else: + pred = stack[-1] + used_steps = float(steps * batch.num_graphs) + ys.append(batch.y.detach().cpu()) + ps.append(pred.detach().cpu()) + step_sum += used_steps + n += batch.num_graphs + y_true = torch.cat(ys, dim=0) + y_pred = torch.cat(ps, dim=0) + result = evaluator.eval({"y_true": y_true, "y_pred": y_pred}) + return result, step_sum / max(n, 1) + + +def _split_nodes(t, ptr): + return [t[ptr[i].item():ptr[i + 1].item()].detach() for i in range(ptr.numel() - 1)] + + +def act_train_step(model, state, replacement_batch, opt, dev, args, epoch, metric): + replacement = replacement_batch.to_data_list() + batch_size = len(replacement) + if state is None: + state = { + "graphs": [None for _ in range(batch_size)], + "y": [None for _ in range(batch_size)], + "z": [None for _ in range(batch_size)], + "steps": torch.zeros(batch_size, dtype=torch.long, device=dev), + "halted": torch.ones(batch_size, dtype=torch.bool, device=dev), + } + + halted_cpu = state["halted"].detach().cpu().tolist() + for i, halted in enumerate(halted_cpu): + if halted: + state["graphs"][i] = replacement[i] + + batch = Batch.from_data_list(state["graphs"]).to(dev) + ctx = model.aggregate(batch.x, batch.edge_index, batch.edge_attr) + ptr = batch.ptr + y_parts, z_parts = [], [] + for i in range(batch_size): + start, end = ptr[i].item(), ptr[i + 1].item() + if halted_cpu[i] or state["y"][i] is None: + y_parts.append(ctx[start:end]) + z_parts.append(torch.zeros_like(ctx[start:end])) + else: + y_parts.append(state["y"][i].to(dev)) + z_parts.append(state["z"][i].to(dev)) + y = torch.cat(y_parts, dim=0) + z = torch.cat(z_parts, dim=0) + + opt.zero_grad() + y, z = model.recurse(y, z, ctx, one_step=(model.grad_mode == "1step")) + logits, q = model.predict(y, batch.batch) + pred_loss = supervised_loss(logits, batch.y, metric) + if args.halt_target == "exact" and not is_regression_metric(metric): + target = halt_targets(logits.detach(), batch.y) + elif args.halt_target == "loss": + per_graph_loss, has_label = per_graph_supervised_loss(logits.detach(), batch.y, metric) + target = ((per_graph_loss <= args.halt_loss_threshold) & has_label).to(logits.dtype) + else: + raise ValueError(args.halt_target) + if epoch <= args.q_warmup_epochs: + q_loss = pred_loss.detach() * 0.0 + loss = pred_loss + else: + q_loss = nn.functional.binary_cross_entropy_with_logits(q, target) + loss = pred_loss + 0.5 * args.lam_q * q_loss + y_det, z_det = y.detach(), z.detach() + loss.backward() + torch.nn.utils.clip_grad_norm_(model.parameters(), 1.0) + opt.step() + + state["y"] = _split_nodes(y_det, ptr) + state["z"] = _split_nodes(z_det, ptr) + with torch.no_grad(): + was_halted = state["halted"] + steps = torch.where(was_halted, torch.zeros_like(state["steps"]), state["steps"]) + 1 + halted = (steps >= args.halt_max_steps) | ((q.detach() > 0) & (steps >= args.halt_min_steps)) + if args.halt_exploration_prob > 0 and args.halt_max_steps > 1: + explore = torch.rand_like(q) < args.halt_exploration_prob + min_steps = torch.where( + explore, + torch.randint(2, args.halt_max_steps + 1, steps.shape, device=dev), + torch.zeros_like(steps), + ) + halted = halted & (steps >= min_steps) + state["steps"] = steps + state["halted"] = halted + + return state, { + "loss": float(loss.detach().cpu()), + "pred_loss": float(pred_loss.detach().cpu()), + "q_loss": float(q_loss.detach().cpu()), + "halted_frac": float(state["halted"].to(torch.float32).mean().detach().cpu()), + "steps": float(state["steps"].to(torch.float32).mean().detach().cpu()), + } + + +def _halt_target(args, logits, y, metric): + if args.halt_target == "exact" and not is_regression_metric(metric): + return halt_targets(logits.detach(), y) + if args.halt_target == "loss": + per_graph_loss, has_label = per_graph_supervised_loss(logits.detach(), y, metric) + return ((per_graph_loss <= args.halt_loss_threshold) & has_label).to(logits.dtype) + raise ValueError(args.halt_target) + + +def act_trace_train_step(model, batch, opt, dev, args, epoch, metric): + batch = batch.to(dev) + steps = max(1, args.halt_max_steps) + opt.zero_grad() + preds, qs = model.forward_trace(batch, steps) + pred_loss = sum(supervised_loss(pred, batch.y, metric) for pred in preds) / len(preds) + if epoch <= args.q_warmup_epochs: + q_loss = pred_loss.detach() * 0.0 + loss = pred_loss + else: + q_losses = [] + for step_idx, (pred, q) in enumerate(zip(preds, qs), start=1): + target = _halt_target(args, pred, batch.y, metric) + if step_idx < args.halt_min_steps: + target = torch.zeros_like(target) + q_losses.append(nn.functional.binary_cross_entropy_with_logits(q, target)) + q_loss = sum(q_losses) / len(q_losses) + loss = pred_loss + 0.5 * args.lam_q * q_loss + loss.backward() + torch.nn.utils.clip_grad_norm_(model.parameters(), 1.0) + opt.step() + + with torch.no_grad(): + q_stack = torch.stack(qs, dim=0) + step_ids = torch.arange(1, steps + 1, device=dev).view(-1, 1) + halted = (q_stack > 0) & (step_ids >= args.halt_min_steps) + any_halt = halted.any(dim=0) + first_halt = halted.to(torch.int64).argmax(dim=0) + fallback = torch.full_like(first_halt, steps - 1) + idx = torch.where(any_halt, first_halt, fallback) + + return { + "loss": float(loss.detach().cpu()), + "pred_loss": float(pred_loss.detach().cpu()), + "q_loss": float(q_loss.detach().cpu()), + "halted_frac": float(any_halt.to(torch.float32).mean().detach().cpu()), + "steps": float((idx.to(torch.float32) + 1).mean().detach().cpu()), + } + + +def train_epoch(model, loader, opt, dev, args, act_state, ema_state, epoch, metric): + model.train() + metrics = [] + for i, batch in enumerate(loader): + if args.max_train_batches and i >= args.max_train_batches: + break + if args.compute == "rrog-act": + if args.act_train_mode == "stream": + act_state, m = act_train_step(model, act_state, batch, opt, dev, args, epoch, metric) + else: + m = act_trace_train_step(model, batch, opt, dev, args, epoch, metric) + update_ema_state(ema_state, model, args.ema) + metrics.append(m) + continue + batch = batch.to(dev) + opt.zero_grad() + preds, _ = model(batch) + loss = sum(supervised_loss(pred, batch.y, metric) for pred in preds) / len(preds) + loss.backward() + torch.nn.utils.clip_grad_norm_(model.parameters(), 1.0) + opt.step() + update_ema_state(ema_state, model, args.ema) + metrics.append({"loss": float(loss.detach().cpu()), "halted_frac": 0.0, "steps": float(model.n_sup)}) + return act_state, metrics + + +def metric_value(result, evaluator): + return float(result[evaluator.eval_metric]) + + +def main(): + ap = argparse.ArgumentParser() + ap.add_argument("--dataset", choices=SUPPORTED_MOL_DATASETS, default="ogbg-molhiv") + ap.add_argument("--view", choices=SUPPORTED_VIEWS, default="gin") + ap.add_argument("--compute", choices=["classic", "view-only", "fixed-rrog", "rrog-act"], default="rrog-act") + ap.add_argument("--T", type=int, default=1) + ap.add_argument("--n_sup", type=int, default=3) + ap.add_argument("--hidden", type=int, default=128) + ap.add_argument("--agg_layers", type=int, default=5) + ap.add_argument("--compute_layers", type=int, default=2) + ap.add_argument("--epochs", type=int, default=100) + ap.add_argument("--eval_every", type=int, default=10) + ap.add_argument("--lr", type=float, default=1e-3) + ap.add_argument("--bs", type=int, default=128) + ap.add_argument("--lam_q", type=float, default=1.0) + ap.add_argument("--halt_max_steps", type=int, default=8) + ap.add_argument("--halt_min_steps", type=int, default=1) + ap.add_argument("--halt_target", choices=["exact", "loss"], default="loss") + ap.add_argument("--halt_loss_threshold", type=float, default=0.2) + ap.add_argument("--halt_exploration_prob", type=float, default=0.1) + ap.add_argument("--q_warmup_epochs", type=int, default=0) + ap.add_argument("--act_train_mode", choices=["stream", "trace"], default="stream") + ap.add_argument("--ema", type=float, default=0.0) + ap.add_argument("--seed", type=int, default=0) + ap.add_argument("--num_workers", type=int, default=0) + ap.add_argument("--max_train_batches", type=int, default=0) + ap.add_argument("--max_eval_batches", type=int, default=0) + ap.add_argument("--device", default="auto") + args = ap.parse_args() + + torch.manual_seed(args.seed) + np.random.seed(args.seed) + if args.compute == "classic": + args.n_sup = 1 + if args.device == "auto": + dev = "cuda" if torch.cuda.is_available() else "cpu" + else: + dev = args.device + os.makedirs(OUT, exist_ok=True) + + dataset = PygGraphPropPredDataset(name=args.dataset, root=ROOT) + split_idx = dataset.get_idx_split() + evaluator = Evaluator(args.dataset) + metric = evaluator.eval_metric + num_tasks = dataset.num_tasks + + train_dataset = dataset[split_idx["train"]] + valid_dataset = dataset[split_idx["valid"]] + test_dataset = dataset[split_idx["test"]] + train_loader = DataLoader(train_dataset, batch_size=args.bs, shuffle=True, + drop_last=True, num_workers=args.num_workers) + valid_loader = DataLoader(valid_dataset, batch_size=256, shuffle=False, + num_workers=args.num_workers) + test_loader = DataLoader(test_dataset, batch_size=256, shuffle=False, + num_workers=args.num_workers) + + T = 0 if args.compute in ["classic", "view-only"] else args.T + deg = degree_histogram(train_dataset) if args.view == "pna" else None + model = OGBRRoG(args.hidden, num_tasks, view=args.view, T=T, n_sup=args.n_sup, + agg_layers=args.agg_layers, compute_layers=args.compute_layers, deg=deg).to(dev) + opt = torch.optim.Adam(model.parameters(), lr=args.lr, weight_decay=1e-5) + sched = torch.optim.lr_scheduler.CosineAnnealingLR(opt, max(args.epochs, 1)) + ema_state = clone_state_dict(model) if args.ema > 0 else None + + t0 = time.time() + best_val = None + best = {} + best_state = None + act_state = None + steps = max(1, args.halt_max_steps) + + for ep in range(args.epochs): + act_state, train_metrics = train_epoch( + model, train_loader, opt, dev, args, act_state, ema_state, ep + 1, metric) + sched.step() + if (ep + 1) % args.eval_every == 0 or ep == args.epochs - 1: + with using_ema_state(model, ema_state): + if args.compute == "rrog-act": + val_result, fixed_val_steps = evaluate(model, valid_loader, evaluator, dev, steps=steps, + adaptive=False, halt_min_steps=args.halt_min_steps, + max_batches=args.max_eval_batches) + val_adapt, adaptive_val_steps = evaluate(model, valid_loader, evaluator, dev, steps=steps, + adaptive=True, halt_min_steps=args.halt_min_steps, + max_batches=args.max_eval_batches) + else: + val_result, _ = evaluate(model, valid_loader, evaluator, dev, + max_batches=args.max_eval_batches) + val_score = metric_value(val_result, evaluator) + if is_better(val_score, best_val, metric): + best_val = val_score + if args.compute == "rrog-act": + test_fixed, fixed_steps = evaluate(model, test_loader, evaluator, dev, steps=steps, + adaptive=False, halt_min_steps=args.halt_min_steps, + max_batches=args.max_eval_batches) + test_adapt, adaptive_steps = evaluate(model, test_loader, evaluator, dev, steps=steps, + adaptive=True, halt_min_steps=args.halt_min_steps, + max_batches=args.max_eval_batches) + best = { + "ep": ep + 1, + "val": val_result, + "val_adaptive": val_adapt, + "test": test_fixed, + "test_adaptive": test_adapt, + "fixed_val_steps": fixed_val_steps, + "adaptive_val_steps": adaptive_val_steps, + "fixed_steps": fixed_steps, + "adaptive_steps": adaptive_steps, + } + else: + test_result, _ = evaluate(model, test_loader, evaluator, dev, + max_batches=args.max_eval_batches) + best = {"ep": ep + 1, "val": val_result, "test": test_result} + best_state = {k: v.detach().cpu().clone() for k, v in model.state_dict().items()} + halted = sum(m.get("halted_frac", 0.0) for m in train_metrics) / max(len(train_metrics), 1) + train_steps = sum(m.get("steps", 0.0) for m in train_metrics) / max(len(train_metrics), 1) + msg = f"ep{ep+1} val_{evaluator.eval_metric}={val_score:.5f}" + if args.compute == "rrog-act": + msg += ( + f" val_adapt_{evaluator.eval_metric}={metric_value(val_adapt, evaluator):.5f}" + f" adapt_steps={adaptive_val_steps:.2f}" + ) + msg += f" halt={halted:.2f} train_steps={train_steps:.2f}" + print(msg, flush=True) + + ema_tag = f"_ema{args.ema:g}" if args.ema > 0 else "" + act_tag = "" + if args.compute == "rrog-act": + target_tag = args.halt_target + if args.halt_target == "loss": + target_tag += f"{args.halt_loss_threshold:g}" + act_tag = ( + f"_{args.act_train_mode}_hm{args.halt_max_steps}_hmin{args.halt_min_steps}_" + f"{target_tag}_lq{args.lam_q:g}_hex{args.halt_exploration_prob:g}_qw{args.q_warmup_epochs}" + ) + tag = ( + f"{args.dataset}_{args.view}_{args.compute}_T{T}_ns{args.n_sup}{act_tag}_" + f"h{args.hidden}_e{args.epochs}{ema_tag}_s{args.seed}" + ) + rep = { + "dataset": args.dataset, + "tag": tag, + **vars(args), + "metric": evaluator.eval_metric, + "sec": round(time.time() - t0, 1), + "dev": dev, + **best, + } + with open(os.path.join(OUT, f"{tag}.json"), "w") as f: + json.dump(jsonable(rep), f, indent=2) + torch.save({ + "state": best_state or model.state_dict(), + "cfg": { + "dataset": args.dataset, + "hidden": args.hidden, + "num_tasks": num_tasks, + "T": T, + "n_sup": args.n_sup, + "agg_layers": args.agg_layers, + "compute_layers": args.compute_layers, + "compute": args.compute, + "halt_max_steps": steps, + "halt_min_steps": args.halt_min_steps, + "halt_target": args.halt_target, + "halt_loss_threshold": args.halt_loss_threshold, + "halt_exploration_prob": args.halt_exploration_prob, + "act_train_mode": args.act_train_mode, + "view": args.view, + }, + }, os.path.join(OUT, f"ckpt_{tag}.pt")) + print(f"[{tag}] best_ep={best.get('ep')} val={best.get('val')} test={best.get('test')} " + f"adaptive={best.get('test_adaptive')} steps={best.get('adaptive_steps')}", flush=True) + print(" wrote", os.path.join(OUT, f"{tag}.json")) + + +if __name__ == "__main__": + main() diff --git a/run_two_a6000_72h.sbatch b/run_two_a6000_72h.sbatch new file mode 100644 index 0000000..ebb1c1a --- /dev/null +++ b/run_two_a6000_72h.sbatch @@ -0,0 +1,41 @@ +#!/bin/bash +#SBATCH --job-name=rrog-gnn-2xa6000 +#SBATCH --output=slurm-rrog-gnn-%j.out +#SBATCH --error=slurm-rrog-gnn-%j.err +#SBATCH --time=72:00:00 +#SBATCH --account=orion +#SBATCH --partition=orion +#SBATCH --nodes=1 +#SBATCH --ntasks-per-node=1 +#SBATCH --gres=gpu:a6000:2 +#SBATCH --cpus-per-task=16 +#SBATCH --mem=128G + +set -euo pipefail + +ROOT_DIR="${ROOT_DIR:-/orion/u/oscarwan/rrog}" +cd "${ROOT_DIR}" + +echo "Host: $(hostname)" +echo "Job ID: ${SLURM_JOB_ID:-local}" +echo "Workdir: $(pwd)" +echo "CUDA_VISIBLE_DEVICES=${CUDA_VISIBLE_DEVICES:-unset}" +echo "SKIP_SETUP=${SKIP_SETUP:-0}" +echo "ZINC_DEVICE=${ZINC_DEVICE:-cuda:0}" +echo "OGB_DEVICE=${OGB_DEVICE:-cuda:1}" +echo "ZINC_EPOCHS=${ZINC_EPOCHS:-200}" +echo "OGB_EPOCHS=${OGB_EPOCHS:-100}" +echo "OGB_TASK=${OGB_TASK:-ogbg-molhiv}" +echo "SEED=${SEED:-0}" + +nvidia-smi + +[[ -x ./scripts/setup_and_run_two_a6000.sh ]] || { + echo "FATAL: missing executable ./scripts/setup_and_run_two_a6000.sh" + exit 1 +} + +# This intentionally delegates to the repository's one-command runner unchanged. +# Override repo-supported options with sbatch --export, e.g.: +# sbatch --export=ALL,SKIP_SETUP=1 run_two_a6000_72h.sbatch +./scripts/setup_and_run_two_a6000.sh diff --git a/runs/.last_real_log b/runs/.last_real_log new file mode 100644 index 0000000..1c84084 --- /dev/null +++ b/runs/.last_real_log @@ -0,0 +1 @@ +/home/yurenh2/rrog/runs/real_sweep_20260616_081956.log diff --git a/runs/.last_sweep_log b/runs/.last_sweep_log new file mode 100644 index 0000000..cc8070e --- /dev/null +++ b/runs/.last_sweep_log @@ -0,0 +1 @@ +/home/yurenh2/rrog/runs/diag_sweep_20260616_074509.log diff --git a/runs/archA.log b/runs/archA.log new file mode 100644 index 0000000..4b2b4f7 --- /dev/null +++ b/runs/archA.log @@ -0,0 +1,242 @@ +A start gpu=0 2026-06-16T15:29:24-05:00 +== A s0 conv=gcn == +ep20 solve_rate=0.000 mean_conflicts=162.09 +ep40 solve_rate=0.000 mean_conflicts=129.86 +ep60 solve_rate=0.000 mean_conflicts=149.86 +ep80 solve_rate=0.000 mean_conflicts=47.19 +ep100 solve_rate=0.000 mean_conflicts=72.71 +ep120 solve_rate=0.000 mean_conflicts=153.69 +ep140 solve_rate=0.000 mean_conflicts=163.38 +ep150 solve_rate=0.000 mean_conflicts=163.18 +[color_gcn_full_none_n50_k3_p0.2_T3_ns3_s0] best solve_rate=0.0 @ep20 (199.2s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s0.pt +[gcn/full] LE n=300 fail=1.00 | SOLVED +nan UNSOLVED -1.276 sep=+nan AUROC=nan mean_lam=-1.276 +[pe=none s0] deterministic solve_rate = 0.000 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.000 0.000 0.000 0.000 nan + wrote /home/yurenh2/rrog/runs/ptrm_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s0.json +== A s0 conv=sage == +ep20 solve_rate=0.303 mean_conflicts=4.08 +ep40 solve_rate=0.703 mean_conflicts=1.23 +ep60 solve_rate=0.730 mean_conflicts=1.09 +ep80 solve_rate=0.720 mean_conflicts=1.05 +ep100 solve_rate=0.680 mean_conflicts=1.20 +ep120 solve_rate=0.707 mean_conflicts=1.28 +ep140 solve_rate=0.667 mean_conflicts=1.62 +ep150 solve_rate=0.660 mean_conflicts=1.76 +[color_sage_full_none_n50_k3_p0.2_T3_ns3_s0] best solve_rate=0.73 @ep60 (163.3s) + wrote /home/yurenh2/rrog/runs/ckpt_color_sage_full_none_n50_k3_p0.2_T3_ns3_s0.pt +[sage/full] LE n=300 fail=0.27 | SOLVED -0.131 UNSOLVED +0.052 sep=+0.183 AUROC=0.793 mean_lam=-0.082 +[pe=none s0] deterministic solve_rate = 0.747 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.953 0.813 0.767 0.762 0.771 + wrote /home/yurenh2/rrog/runs/ptrm_color_sage_full_none_n50_k3_p0.2_T3_ns3_s0.json +== A s0 conv=gat == +ep20 solve_rate=0.000 mean_conflicts=152.21 +ep40 solve_rate=0.000 mean_conflicts=143.93 +ep60 solve_rate=0.007 mean_conflicts=116.76 +ep80 solve_rate=0.013 mean_conflicts=107.49 +ep100 solve_rate=0.000 mean_conflicts=102.05 +ep120 solve_rate=0.003 mean_conflicts=111.15 +ep140 solve_rate=0.000 mean_conflicts=163.45 +ep150 solve_rate=0.000 mean_conflicts=163.46 +[color_gat_full_none_n50_k3_p0.2_T3_ns3_s0] best solve_rate=0.0133 @ep80 (305.2s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gat_full_none_n50_k3_p0.2_T3_ns3_s0.pt +[gat/full] LE n=300 fail=0.99 | SOLVED -0.211 UNSOLVED -0.296 sep=-0.084 AUROC=0.353 mean_lam=-0.295 +[pe=none s0] deterministic solve_rate = 0.007 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.047 0.020 0.027 0.020 0.203 + wrote /home/yurenh2/rrog/runs/ptrm_color_gat_full_none_n50_k3_p0.2_T3_ns3_s0.json +== A s1 conv=gcn == +ep20 solve_rate=0.000 mean_conflicts=41.51 +ep40 solve_rate=0.000 mean_conflicts=35.89 +ep60 solve_rate=0.000 mean_conflicts=66.98 +ep80 solve_rate=0.000 mean_conflicts=73.91 +ep100 solve_rate=0.000 mean_conflicts=60.61 +ep120 solve_rate=0.000 mean_conflicts=61.23 +ep140 solve_rate=0.000 mean_conflicts=53.94 +ep150 solve_rate=0.003 mean_conflicts=47.46 +[color_gcn_full_none_n50_k3_p0.2_T3_ns3_s1] best solve_rate=0.0033 @ep150 (200.7s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s1.pt +[gcn/full] LE n=300 fail=1.00 | SOLVED -0.234 UNSOLVED -0.104 sep=+0.130 AUROC=0.893 mean_lam=-0.105 +[pe=none s1] deterministic solve_rate = 0.000 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.007 0.000 0.000 0.000 0.941 + wrote /home/yurenh2/rrog/runs/ptrm_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s1.json +== A s1 conv=sage == +ep20 solve_rate=0.223 mean_conflicts=4.59 +ep40 solve_rate=0.723 mean_conflicts=1.13 +ep60 solve_rate=0.760 mean_conflicts=0.84 +ep80 solve_rate=0.780 mean_conflicts=0.82 +ep100 solve_rate=0.750 mean_conflicts=0.96 +ep120 solve_rate=0.787 mean_conflicts=0.78 +ep140 solve_rate=0.760 mean_conflicts=0.81 +ep150 solve_rate=0.740 mean_conflicts=0.87 +[color_sage_full_none_n50_k3_p0.2_T3_ns3_s1] best solve_rate=0.7867 @ep120 (159.8s) + wrote /home/yurenh2/rrog/runs/ckpt_color_sage_full_none_n50_k3_p0.2_T3_ns3_s1.pt +[sage/full] LE n=300 fail=0.21 | SOLVED +0.063 UNSOLVED +0.160 sep=+0.097 AUROC=0.688 mean_lam=+0.084 +[pe=none s1] deterministic solve_rate = 0.827 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.973 0.873 0.793 0.781 0.702 + wrote /home/yurenh2/rrog/runs/ptrm_color_sage_full_none_n50_k3_p0.2_T3_ns3_s1.json +== A s1 conv=gat == +ep20 solve_rate=0.000 mean_conflicts=161.72 +ep40 solve_rate=0.000 mean_conflicts=146.74 +ep60 solve_rate=0.000 mean_conflicts=115.72 +ep80 solve_rate=0.007 mean_conflicts=81.21 +ep100 solve_rate=0.003 mean_conflicts=118.91 +ep120 solve_rate=0.000 mean_conflicts=111.77 +ep140 solve_rate=0.000 mean_conflicts=140.12 +ep150 solve_rate=0.000 mean_conflicts=141.12 +[color_gat_full_none_n50_k3_p0.2_T3_ns3_s1] best solve_rate=0.0067 @ep80 (870.5s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gat_full_none_n50_k3_p0.2_T3_ns3_s1.pt +[gat/full] LE n=300 fail=0.99 | SOLVED -0.101 UNSOLVED -0.253 sep=-0.153 AUROC=0.087 mean_lam=-0.252 +[pe=none s1] deterministic solve_rate = 0.013 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.033 0.020 0.013 0.014 0.177 + wrote /home/yurenh2/rrog/runs/ptrm_color_gat_full_none_n50_k3_p0.2_T3_ns3_s1.json +== A s2 conv=gcn == +ep20 solve_rate=0.000 mean_conflicts=40.93 +ep40 solve_rate=0.000 mean_conflicts=48.18 +ep60 solve_rate=0.000 mean_conflicts=92.76 +ep80 solve_rate=0.000 mean_conflicts=86.67 +ep100 solve_rate=0.003 mean_conflicts=60.79 +ep120 solve_rate=0.003 mean_conflicts=46.40 +ep140 solve_rate=0.003 mean_conflicts=59.99 +ep150 solve_rate=0.003 mean_conflicts=75.26 +[color_gcn_full_none_n50_k3_p0.2_T3_ns3_s2] best solve_rate=0.0033 @ep100 (676.3s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s2.pt +[gcn/full] LE n=300 fail=1.00 | SOLVED -0.221 UNSOLVED -0.262 sep=-0.041 AUROC=0.301 mean_lam=-0.262 +[pe=none s2] deterministic solve_rate = 0.007 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.007 0.007 0.000 0.003 0.563 + wrote /home/yurenh2/rrog/runs/ptrm_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s2.json +== A s2 conv=sage == +ep20 solve_rate=0.267 mean_conflicts=3.97 +ep40 solve_rate=0.727 mean_conflicts=1.07 +ep60 solve_rate=0.830 mean_conflicts=0.68 +ep80 solve_rate=0.827 mean_conflicts=0.54 +ep100 solve_rate=0.803 mean_conflicts=0.74 +ep120 solve_rate=0.680 mean_conflicts=1.54 +ep140 solve_rate=0.587 mean_conflicts=2.31 +ep150 solve_rate=0.527 mean_conflicts=2.94 +[color_sage_full_none_n50_k3_p0.2_T3_ns3_s2] best solve_rate=0.83 @ep60 (224.4s) + wrote /home/yurenh2/rrog/runs/ckpt_color_sage_full_none_n50_k3_p0.2_T3_ns3_s2.pt +[sage/full] LE n=300 fail=0.17 | SOLVED -0.105 UNSOLVED +0.102 sep=+0.207 AUROC=0.814 mean_lam=-0.070 +[pe=none s2] deterministic solve_rate = 0.847 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.980 0.907 0.833 0.820 0.790 + wrote /home/yurenh2/rrog/runs/ptrm_color_sage_full_none_n50_k3_p0.2_T3_ns3_s2.json +== A s2 conv=gat == +ep20 solve_rate=0.000 mean_conflicts=130.86 +ep40 solve_rate=0.000 mean_conflicts=163.47 +ep60 solve_rate=0.000 mean_conflicts=163.48 +ep80 solve_rate=0.000 mean_conflicts=163.48 +ep100 solve_rate=0.003 mean_conflicts=152.94 +ep120 solve_rate=0.000 mean_conflicts=156.99 +ep140 solve_rate=0.000 mean_conflicts=163.18 +ep150 solve_rate=0.000 mean_conflicts=163.48 +[color_gat_full_none_n50_k3_p0.2_T3_ns3_s2] best solve_rate=0.0033 @ep100 (871.7s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gat_full_none_n50_k3_p0.2_T3_ns3_s2.pt +[gat/full] LE n=300 fail=1.00 | SOLVED -0.133 UNSOLVED -0.253 sep=-0.120 AUROC=0.147 mean_lam=-0.252 +[pe=none s2] deterministic solve_rate = 0.007 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.033 0.013 0.020 0.013 0.248 + wrote /home/yurenh2/rrog/runs/ptrm_color_gat_full_none_n50_k3_p0.2_T3_ns3_s2.json +== A s3 conv=gcn == +ep20 solve_rate=0.000 mean_conflicts=44.52 +ep40 solve_rate=0.000 mean_conflicts=47.99 +ep60 solve_rate=0.000 mean_conflicts=91.15 +ep80 solve_rate=0.000 mean_conflicts=99.85 +ep100 solve_rate=0.003 mean_conflicts=69.26 +ep120 solve_rate=0.003 mean_conflicts=54.51 +ep140 solve_rate=0.003 mean_conflicts=59.94 +ep150 solve_rate=0.003 mean_conflicts=54.14 +[color_gcn_full_none_n50_k3_p0.2_T3_ns3_s3] best solve_rate=0.0033 @ep100 (675.0s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s3.pt +[gcn/full] LE n=300 fail=1.00 | SOLVED -0.372 UNSOLVED -0.330 sep=+0.042 AUROC=0.672 mean_lam=-0.330 +[pe=none s3] deterministic solve_rate = 0.007 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.013 0.000 0.007 0.004 0.697 + wrote /home/yurenh2/rrog/runs/ptrm_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s3.json +== A s3 conv=sage == +ep20 solve_rate=0.227 mean_conflicts=4.44 +ep40 solve_rate=0.653 mean_conflicts=1.48 +ep60 solve_rate=0.767 mean_conflicts=0.88 +ep80 solve_rate=0.803 mean_conflicts=0.71 +ep100 solve_rate=0.797 mean_conflicts=0.72 +ep120 solve_rate=0.773 mean_conflicts=0.91 +ep140 solve_rate=0.747 mean_conflicts=1.25 +ep150 solve_rate=0.707 mean_conflicts=1.48 +[color_sage_full_none_n50_k3_p0.2_T3_ns3_s3] best solve_rate=0.8033 @ep80 (223.5s) + wrote /home/yurenh2/rrog/runs/ckpt_color_sage_full_none_n50_k3_p0.2_T3_ns3_s3.pt +[sage/full] LE n=300 fail=0.20 | SOLVED +0.002 UNSOLVED +0.120 sep=+0.118 AUROC=0.680 mean_lam=+0.025 +[pe=none s3] deterministic solve_rate = 0.813 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.953 0.880 0.780 0.802 0.750 + wrote /home/yurenh2/rrog/runs/ptrm_color_sage_full_none_n50_k3_p0.2_T3_ns3_s3.json +== A s3 conv=gat == +ep20 solve_rate=0.000 mean_conflicts=161.40 +ep40 solve_rate=0.027 mean_conflicts=28.43 +ep60 solve_rate=0.100 mean_conflicts=17.61 +ep80 solve_rate=0.063 mean_conflicts=13.36 +ep100 solve_rate=0.030 mean_conflicts=19.86 +ep120 solve_rate=0.007 mean_conflicts=53.33 +ep140 solve_rate=0.000 mean_conflicts=139.14 +ep150 solve_rate=0.000 mean_conflicts=140.87 +[color_gat_full_none_n50_k3_p0.2_T3_ns3_s3] best solve_rate=0.1 @ep60 (869.6s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gat_full_none_n50_k3_p0.2_T3_ns3_s3.pt +[gat/full] LE n=300 fail=0.90 | SOLVED -0.097 UNSOLVED -0.064 sep=+0.034 AUROC=0.585 mean_lam=-0.067 +[pe=none s3] deterministic solve_rate = 0.113 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.220 0.113 0.113 0.105 0.614 + wrote /home/yurenh2/rrog/runs/ptrm_color_gat_full_none_n50_k3_p0.2_T3_ns3_s3.json +== A s4 conv=gcn == +ep20 solve_rate=0.000 mean_conflicts=81.70 +ep40 solve_rate=0.000 mean_conflicts=39.68 +ep60 solve_rate=0.000 mean_conflicts=67.85 +ep80 solve_rate=0.000 mean_conflicts=58.58 +ep100 solve_rate=0.003 mean_conflicts=60.47 +ep120 solve_rate=0.000 mean_conflicts=54.07 +ep140 solve_rate=0.003 mean_conflicts=100.63 +ep150 solve_rate=0.003 mean_conflicts=106.05 +[color_gcn_full_none_n50_k3_p0.2_T3_ns3_s4] best solve_rate=0.0033 @ep100 (676.5s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s4.pt +[gcn/full] LE n=300 fail=1.00 | SOLVED -0.254 UNSOLVED -0.117 sep=+0.137 AUROC=0.943 mean_lam=-0.117 +[pe=none s4] deterministic solve_rate = 0.000 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.007 0.000 0.000 0.001 0.062 + wrote /home/yurenh2/rrog/runs/ptrm_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s4.json +== A s4 conv=sage == +ep20 solve_rate=0.210 mean_conflicts=3.76 +ep40 solve_rate=0.717 mean_conflicts=0.97 +ep60 solve_rate=0.813 mean_conflicts=0.73 +ep80 solve_rate=0.803 mean_conflicts=0.72 +ep100 solve_rate=0.817 mean_conflicts=0.70 +ep120 solve_rate=0.817 mean_conflicts=0.65 +ep140 solve_rate=0.800 mean_conflicts=0.96 +ep150 solve_rate=0.773 mean_conflicts=1.14 +[color_sage_full_none_n50_k3_p0.2_T3_ns3_s4] best solve_rate=0.8167 @ep100 (215.8s) + wrote /home/yurenh2/rrog/runs/ckpt_color_sage_full_none_n50_k3_p0.2_T3_ns3_s4.pt +[sage/full] LE n=300 fail=0.18 | SOLVED -0.011 UNSOLVED +0.182 sep=+0.193 AUROC=0.828 mean_lam=+0.024 +[pe=none s4] deterministic solve_rate = 0.840 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.987 0.893 0.847 0.835 0.752 + wrote /home/yurenh2/rrog/runs/ptrm_color_sage_full_none_n50_k3_p0.2_T3_ns3_s4.json +== A s4 conv=gat == +ep20 solve_rate=0.000 mean_conflicts=155.28 +ep40 solve_rate=0.000 mean_conflicts=163.18 +ep60 solve_rate=0.000 mean_conflicts=111.24 +ep80 solve_rate=0.077 mean_conflicts=26.13 +ep100 solve_rate=0.060 mean_conflicts=47.08 +ep120 solve_rate=0.050 mean_conflicts=77.35 +ep140 solve_rate=0.080 mean_conflicts=76.13 +ep150 solve_rate=0.060 mean_conflicts=81.07 +[color_gat_full_none_n50_k3_p0.2_T3_ns3_s4] best solve_rate=0.08 @ep140 (871.2s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gat_full_none_n50_k3_p0.2_T3_ns3_s4.pt +[gat/full] LE n=300 fail=0.92 | SOLVED +0.013 UNSOLVED -0.019 sep=-0.032 AUROC=0.423 mean_lam=-0.016 +[pe=none s4] deterministic solve_rate = 0.133 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.227 0.147 0.120 0.113 0.454 + wrote /home/yurenh2/rrog/runs/ptrm_color_gat_full_none_n50_k3_p0.2_T3_ns3_s4.json +doneA=2026-06-16T18:14:25-05:00 diff --git a/runs/archB.log b/runs/archB.log new file mode 100644 index 0000000..fd9b1fb --- /dev/null +++ b/runs/archB.log @@ -0,0 +1,302 @@ +B start gpu=1 2026-06-16T15:29:24-05:00 +== B s0 conv=gps == +ep20 solve_rate=0.403 mean_conflicts=3.29 +ep40 solve_rate=0.437 mean_conflicts=2.99 +ep60 solve_rate=0.287 mean_conflicts=5.24 +ep80 solve_rate=0.463 mean_conflicts=2.91 +ep100 solve_rate=0.653 mean_conflicts=1.54 +ep120 solve_rate=0.797 mean_conflicts=0.81 +ep140 solve_rate=0.903 mean_conflicts=0.31 +ep150 solve_rate=0.913 mean_conflicts=0.29 +[color_gps_full_none_n50_k3_p0.2_T3_ns3_s0] best solve_rate=0.9133 @ep150 (591.9s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gps_full_none_n50_k3_p0.2_T3_ns3_s0.pt +[gps/full] LE n=300 fail=0.09 | SOLVED -0.390 UNSOLVED +0.044 sep=+0.434 AUROC=0.898 mean_lam=-0.352 +[pe=none s0] deterministic solve_rate = 0.940 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.987 0.960 0.920 0.925 0.819 + wrote /home/yurenh2/rrog/runs/ptrm_color_gps_full_none_n50_k3_p0.2_T3_ns3_s0.json +== B s0 gin pe=lappe == +/home/yurenh2/rrog/diag/train_color.py:90: RuntimeWarning: divide by zero encountered in divide + di = np.where(deg > 0, 1.0 / np.sqrt(deg), 0.0) +ep20 solve_rate=0.000 mean_conflicts=161.60 +ep40 solve_rate=0.050 mean_conflicts=135.93 +ep60 solve_rate=0.253 mean_conflicts=47.45 +ep80 solve_rate=0.390 mean_conflicts=20.85 +ep100 solve_rate=0.090 mean_conflicts=71.30 +ep120 solve_rate=0.073 mean_conflicts=94.81 +ep140 solve_rate=0.073 mean_conflicts=61.36 +ep150 solve_rate=0.110 mean_conflicts=51.49 +[color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s0] best solve_rate=0.39 @ep80 (150.2s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s0.pt +/home/yurenh2/rrog/diag/train_color.py:90: RuntimeWarning: divide by zero encountered in divide + di = np.where(deg > 0, 1.0 / np.sqrt(deg), 0.0) +[gin/full] LE n=300 fail=0.61 | SOLVED -0.249 UNSOLVED -0.010 sep=+0.240 AUROC=0.843 mean_lam=-0.103 +/home/yurenh2/rrog/diag/train_color.py:90: RuntimeWarning: divide by zero encountered in divide + di = np.where(deg > 0, 1.0 / np.sqrt(deg), 0.0) +[pe=lappe s0] deterministic solve_rate = 0.420 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.760 0.600 0.387 0.378 0.839 + wrote /home/yurenh2/rrog/runs/ptrm_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s0.json +== B s0 gin pe=all == +/home/yurenh2/rrog/diag/train_color.py:84: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +ep20 solve_rate=0.000 mean_conflicts=36.32 +ep40 solve_rate=0.193 mean_conflicts=25.99 +ep60 solve_rate=0.260 mean_conflicts=53.12 +ep80 solve_rate=0.670 mean_conflicts=4.01 +ep100 solve_rate=0.543 mean_conflicts=30.14 +ep120 solve_rate=0.510 mean_conflicts=35.56 +ep140 solve_rate=0.557 mean_conflicts=28.97 +ep150 solve_rate=0.563 mean_conflicts=27.39 +[color_gin_full_all_n50_k3_p0.2_T3_ns3_s0] best solve_rate=0.67 @ep80 (151.3s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gin_full_all_n50_k3_p0.2_T3_ns3_s0.pt +/home/yurenh2/rrog/diag/train_color.py:84: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +[gin/full] LE n=300 fail=0.33 | SOLVED -0.372 UNSOLVED +0.020 sep=+0.393 AUROC=0.875 mean_lam=-0.243 +/home/yurenh2/rrog/diag/train_color.py:84: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +[pe=all s0] deterministic solve_rate = 0.693 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.887 0.833 0.693 0.694 0.898 + wrote /home/yurenh2/rrog/runs/ptrm_color_gin_full_all_n50_k3_p0.2_T3_ns3_s0.json +== B s1 conv=gps == +ep20 solve_rate=0.443 mean_conflicts=3.22 +ep40 solve_rate=0.350 mean_conflicts=4.18 +ep60 solve_rate=0.163 mean_conflicts=12.75 +ep80 solve_rate=0.397 mean_conflicts=4.12 +ep100 solve_rate=0.643 mean_conflicts=1.80 +ep120 solve_rate=0.837 mean_conflicts=0.64 +ep140 solve_rate=0.907 mean_conflicts=0.30 +ep150 solve_rate=0.927 mean_conflicts=0.30 +[color_gps_full_none_n50_k3_p0.2_T3_ns3_s1] best solve_rate=0.9267 @ep150 (2583.0s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gps_full_none_n50_k3_p0.2_T3_ns3_s1.pt +[gps/full] LE n=300 fail=0.07 | SOLVED -0.388 UNSOLVED +0.017 sep=+0.405 AUROC=0.863 mean_lam=-0.358 +[pe=none s1] deterministic solve_rate = 0.940 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.987 0.953 0.960 0.938 0.857 + wrote /home/yurenh2/rrog/runs/ptrm_color_gps_full_none_n50_k3_p0.2_T3_ns3_s1.json +== B s1 gin pe=lappe == +/home/yurenh2/rrog/diag/train_color.py:90: RuntimeWarning: divide by zero encountered in divide + di = np.where(deg > 0, 1.0 / np.sqrt(deg), 0.0) +ep20 solve_rate=0.000 mean_conflicts=81.19 +ep40 solve_rate=0.193 mean_conflicts=23.68 +ep60 solve_rate=0.320 mean_conflicts=14.89 +ep80 solve_rate=0.397 mean_conflicts=7.99 +ep100 solve_rate=0.593 mean_conflicts=6.31 +ep120 solve_rate=0.247 mean_conflicts=63.22 +ep140 solve_rate=0.033 mean_conflicts=112.15 +ep150 solve_rate=0.017 mean_conflicts=118.57 +[color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s1] best solve_rate=0.5933 @ep100 (224.3s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s1.pt +/home/yurenh2/rrog/diag/train_color.py:90: RuntimeWarning: divide by zero encountered in divide + di = np.where(deg > 0, 1.0 / np.sqrt(deg), 0.0) +[gin/full] LE n=300 fail=0.41 | SOLVED -0.233 UNSOLVED +0.025 sep=+0.258 AUROC=0.890 mean_lam=-0.128 +/home/yurenh2/rrog/diag/train_color.py:90: RuntimeWarning: divide by zero encountered in divide + di = np.where(deg > 0, 1.0 / np.sqrt(deg), 0.0) +[pe=lappe s1] deterministic solve_rate = 0.620 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.927 0.787 0.573 0.583 0.863 + wrote /home/yurenh2/rrog/runs/ptrm_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s1.json +== B s1 gin pe=all == +/home/yurenh2/rrog/diag/train_color.py:84: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +ep20 solve_rate=0.000 mean_conflicts=57.12 +ep40 solve_rate=0.167 mean_conflicts=26.04 +ep60 solve_rate=0.190 mean_conflicts=119.01 +ep80 solve_rate=0.657 mean_conflicts=5.39 +ep100 solve_rate=0.643 mean_conflicts=16.68 +ep120 solve_rate=0.707 mean_conflicts=8.86 +ep140 solve_rate=0.697 mean_conflicts=10.20 +ep150 solve_rate=0.650 mean_conflicts=13.00 +[color_gin_full_all_n50_k3_p0.2_T3_ns3_s1] best solve_rate=0.7067 @ep120 (216.1s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gin_full_all_n50_k3_p0.2_T3_ns3_s1.pt +/home/yurenh2/rrog/diag/train_color.py:84: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +[gin/full] LE n=300 fail=0.29 | SOLVED -0.214 UNSOLVED +0.091 sep=+0.305 AUROC=0.869 mean_lam=-0.125 +/home/yurenh2/rrog/diag/train_color.py:84: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +[pe=all s1] deterministic solve_rate = 0.760 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.940 0.820 0.773 0.735 0.878 + wrote /home/yurenh2/rrog/runs/ptrm_color_gin_full_all_n50_k3_p0.2_T3_ns3_s1.json +== B s2 conv=gps == +ep20 solve_rate=0.390 mean_conflicts=3.38 +ep40 solve_rate=0.430 mean_conflicts=3.72 +ep60 solve_rate=0.173 mean_conflicts=12.65 +ep80 solve_rate=0.430 mean_conflicts=3.79 +ep100 solve_rate=0.660 mean_conflicts=1.73 +ep120 solve_rate=0.840 mean_conflicts=0.76 +ep140 solve_rate=0.913 mean_conflicts=0.34 +ep150 solve_rate=0.937 mean_conflicts=0.22 +[color_gps_full_none_n50_k3_p0.2_T3_ns3_s2] best solve_rate=0.9367 @ep150 (3039.3s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gps_full_none_n50_k3_p0.2_T3_ns3_s2.pt +[gps/full] LE n=300 fail=0.06 | SOLVED -0.410 UNSOLVED +0.012 sep=+0.422 AUROC=0.913 mean_lam=-0.384 +[pe=none s2] deterministic solve_rate = 0.953 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.980 0.953 0.927 0.935 0.872 + wrote /home/yurenh2/rrog/runs/ptrm_color_gps_full_none_n50_k3_p0.2_T3_ns3_s2.json +== B s2 gin pe=lappe == +/home/yurenh2/rrog/diag/train_color.py:90: RuntimeWarning: divide by zero encountered in divide + di = np.where(deg > 0, 1.0 / np.sqrt(deg), 0.0) +ep20 solve_rate=0.000 mean_conflicts=109.99 +ep40 solve_rate=0.057 mean_conflicts=113.77 +ep60 solve_rate=0.087 mean_conflicts=31.41 +ep80 solve_rate=0.193 mean_conflicts=20.53 +ep100 solve_rate=0.373 mean_conflicts=25.48 +ep120 solve_rate=0.260 mean_conflicts=29.57 +ep140 solve_rate=0.197 mean_conflicts=45.54 +ep150 solve_rate=0.173 mean_conflicts=55.97 +[color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s2] best solve_rate=0.3733 @ep100 (225.1s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s2.pt +/home/yurenh2/rrog/diag/train_color.py:90: RuntimeWarning: divide by zero encountered in divide + di = np.where(deg > 0, 1.0 / np.sqrt(deg), 0.0) +[gin/full] LE n=300 fail=0.63 | SOLVED -0.206 UNSOLVED +0.000 sep=+0.206 AUROC=0.821 mean_lam=-0.077 +/home/yurenh2/rrog/diag/train_color.py:90: RuntimeWarning: divide by zero encountered in divide + di = np.where(deg > 0, 1.0 / np.sqrt(deg), 0.0) +[pe=lappe s2] deterministic solve_rate = 0.413 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.760 0.540 0.393 0.400 0.834 + wrote /home/yurenh2/rrog/runs/ptrm_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s2.json +== B s2 gin pe=all == +/home/yurenh2/rrog/diag/train_color.py:84: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +ep20 solve_rate=0.000 mean_conflicts=65.87 +ep40 solve_rate=0.327 mean_conflicts=21.26 +ep60 solve_rate=0.333 mean_conflicts=59.61 +ep80 solve_rate=0.097 mean_conflicts=67.57 +ep100 solve_rate=0.130 mean_conflicts=85.23 +ep120 solve_rate=0.160 mean_conflicts=68.36 +ep140 solve_rate=0.120 mean_conflicts=72.82 +ep150 solve_rate=0.100 mean_conflicts=68.99 +[color_gin_full_all_n50_k3_p0.2_T3_ns3_s2] best solve_rate=0.3333 @ep60 (233.5s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gin_full_all_n50_k3_p0.2_T3_ns3_s2.pt +/home/yurenh2/rrog/diag/train_color.py:84: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +[gin/full] LE n=300 fail=0.67 | SOLVED -0.363 UNSOLVED -0.253 sep=+0.110 AUROC=0.623 mean_lam=-0.290 +/home/yurenh2/rrog/diag/train_color.py:84: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +[pe=all s2] deterministic solve_rate = 0.327 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.460 0.327 0.280 0.303 0.656 + wrote /home/yurenh2/rrog/runs/ptrm_color_gin_full_all_n50_k3_p0.2_T3_ns3_s2.json +== B s3 conv=gps == +ep20 solve_rate=0.420 mean_conflicts=3.03 +ep40 solve_rate=0.457 mean_conflicts=2.82 +ep60 solve_rate=0.313 mean_conflicts=5.62 +ep80 solve_rate=0.457 mean_conflicts=3.50 +ep100 solve_rate=0.670 mean_conflicts=1.60 +ep120 solve_rate=0.823 mean_conflicts=0.81 +ep140 solve_rate=0.920 mean_conflicts=0.30 +ep150 solve_rate=0.943 mean_conflicts=0.23 +[color_gps_full_none_n50_k3_p0.2_T3_ns3_s3] best solve_rate=0.9433 @ep150 (3097.1s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gps_full_none_n50_k3_p0.2_T3_ns3_s3.pt +[gps/full] LE n=300 fail=0.06 | SOLVED -0.397 UNSOLVED -0.056 sep=+0.341 AUROC=0.856 mean_lam=-0.378 +[pe=none s3] deterministic solve_rate = 0.933 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.987 0.973 0.953 0.940 0.866 + wrote /home/yurenh2/rrog/runs/ptrm_color_gps_full_none_n50_k3_p0.2_T3_ns3_s3.json +== B s3 gin pe=lappe == +/home/yurenh2/rrog/diag/train_color.py:90: RuntimeWarning: divide by zero encountered in divide + di = np.where(deg > 0, 1.0 / np.sqrt(deg), 0.0) +ep20 solve_rate=0.000 mean_conflicts=119.16 +ep40 solve_rate=0.127 mean_conflicts=97.26 +ep60 solve_rate=0.350 mean_conflicts=25.49 +ep80 solve_rate=0.523 mean_conflicts=6.35 +ep100 solve_rate=0.483 mean_conflicts=14.99 +ep120 solve_rate=0.353 mean_conflicts=36.89 +ep140 solve_rate=0.090 mean_conflicts=92.76 +ep150 solve_rate=0.063 mean_conflicts=95.97 +[color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s3] best solve_rate=0.5233 @ep80 (234.0s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s3.pt +/home/yurenh2/rrog/diag/train_color.py:90: RuntimeWarning: divide by zero encountered in divide + di = np.where(deg > 0, 1.0 / np.sqrt(deg), 0.0) +[gin/full] LE n=300 fail=0.48 | SOLVED -0.311 UNSOLVED -0.045 sep=+0.266 AUROC=0.871 mean_lam=-0.184 +/home/yurenh2/rrog/diag/train_color.py:90: RuntimeWarning: divide by zero encountered in divide + di = np.where(deg > 0, 1.0 / np.sqrt(deg), 0.0) +[pe=lappe s3] deterministic solve_rate = 0.567 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.853 0.727 0.520 0.519 0.864 + wrote /home/yurenh2/rrog/runs/ptrm_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s3.json +== B s3 gin pe=all == +/home/yurenh2/rrog/diag/train_color.py:84: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +ep20 solve_rate=0.000 mean_conflicts=63.12 +ep40 solve_rate=0.040 mean_conflicts=139.63 +ep60 solve_rate=0.457 mean_conflicts=22.17 +ep80 solve_rate=0.130 mean_conflicts=95.35 +ep100 solve_rate=0.097 mean_conflicts=82.22 +ep120 solve_rate=0.047 mean_conflicts=92.15 +ep140 solve_rate=0.027 mean_conflicts=93.55 +ep150 solve_rate=0.037 mean_conflicts=88.97 +[color_gin_full_all_n50_k3_p0.2_T3_ns3_s3] best solve_rate=0.4567 @ep60 (229.5s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gin_full_all_n50_k3_p0.2_T3_ns3_s3.pt +/home/yurenh2/rrog/diag/train_color.py:84: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +[gin/full] LE n=300 fail=0.54 | SOLVED -0.265 UNSOLVED +0.014 sep=+0.280 AUROC=0.839 mean_lam=-0.113 +/home/yurenh2/rrog/diag/train_color.py:84: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +[pe=all s3] deterministic solve_rate = 0.467 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.760 0.627 0.427 0.456 0.891 + wrote /home/yurenh2/rrog/runs/ptrm_color_gin_full_all_n50_k3_p0.2_T3_ns3_s3.json +== B s4 conv=gps == +ep20 solve_rate=0.440 mean_conflicts=3.41 +ep40 solve_rate=0.477 mean_conflicts=2.97 +ep60 solve_rate=0.420 mean_conflicts=3.52 +ep80 solve_rate=0.510 mean_conflicts=2.78 +ep100 solve_rate=0.660 mean_conflicts=1.68 +ep120 solve_rate=0.807 mean_conflicts=0.87 +ep140 solve_rate=0.930 mean_conflicts=0.31 +ep150 solve_rate=0.937 mean_conflicts=0.22 +[color_gps_full_none_n50_k3_p0.2_T3_ns3_s4] best solve_rate=0.9367 @ep150 (3113.0s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gps_full_none_n50_k3_p0.2_T3_ns3_s4.pt +[gps/full] LE n=300 fail=0.06 | SOLVED -0.402 UNSOLVED +0.045 sep=+0.448 AUROC=0.936 mean_lam=-0.374 +[pe=none s4] deterministic solve_rate = 0.960 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.993 0.967 0.947 0.952 0.900 + wrote /home/yurenh2/rrog/runs/ptrm_color_gps_full_none_n50_k3_p0.2_T3_ns3_s4.json +== B s4 gin pe=lappe == +/home/yurenh2/rrog/diag/train_color.py:90: RuntimeWarning: divide by zero encountered in divide + di = np.where(deg > 0, 1.0 / np.sqrt(deg), 0.0) +ep20 solve_rate=0.000 mean_conflicts=96.50 +ep40 solve_rate=0.150 mean_conflicts=33.60 +ep60 solve_rate=0.313 mean_conflicts=31.99 +ep80 solve_rate=0.333 mean_conflicts=28.49 +ep100 solve_rate=0.260 mean_conflicts=36.77 +ep120 solve_rate=0.180 mean_conflicts=38.74 +ep140 solve_rate=0.147 mean_conflicts=47.98 +ep150 solve_rate=0.133 mean_conflicts=51.20 +[color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s4] best solve_rate=0.3333 @ep80 (229.4s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s4.pt +/home/yurenh2/rrog/diag/train_color.py:90: RuntimeWarning: divide by zero encountered in divide + di = np.where(deg > 0, 1.0 / np.sqrt(deg), 0.0) +[gin/full] LE n=300 fail=0.67 | SOLVED -0.220 UNSOLVED -0.063 sep=+0.156 AUROC=0.776 mean_lam=-0.115 +/home/yurenh2/rrog/diag/train_color.py:90: RuntimeWarning: divide by zero encountered in divide + di = np.where(deg > 0, 1.0 / np.sqrt(deg), 0.0) +[pe=lappe s4] deterministic solve_rate = 0.340 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.753 0.507 0.307 0.333 0.784 + wrote /home/yurenh2/rrog/runs/ptrm_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s4.json +== B s4 gin pe=all == +/home/yurenh2/rrog/diag/train_color.py:84: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +ep20 solve_rate=0.000 mean_conflicts=64.98 +ep40 solve_rate=0.360 mean_conflicts=13.46 +ep60 solve_rate=0.567 mean_conflicts=22.46 +ep80 solve_rate=0.523 mean_conflicts=32.14 +ep100 solve_rate=0.287 mean_conflicts=53.76 +ep120 solve_rate=0.343 mean_conflicts=43.17 +ep140 solve_rate=0.200 mean_conflicts=60.30 +ep150 solve_rate=0.177 mean_conflicts=63.07 +[color_gin_full_all_n50_k3_p0.2_T3_ns3_s4] best solve_rate=0.5667 @ep60 (233.8s) + wrote /home/yurenh2/rrog/runs/ckpt_color_gin_full_all_n50_k3_p0.2_T3_ns3_s4.pt +/home/yurenh2/rrog/diag/train_color.py:84: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +[gin/full] LE n=300 fail=0.43 | SOLVED -0.376 UNSOLVED -0.027 sep=+0.349 AUROC=0.879 mean_lam=-0.225 +/home/yurenh2/rrog/diag/train_color.py:84: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +[pe=all s4] deterministic solve_rate = 0.593 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.787 0.707 0.567 0.575 0.901 + wrote /home/yurenh2/rrog/runs/ptrm_color_gin_full_all_n50_k3_p0.2_T3_ns3_s4.json +doneB=2026-06-16T21:03:05-05:00 diff --git a/runs/cin_sweep.log b/runs/cin_sweep.log new file mode 100644 index 0000000..c1759c1 --- /dev/null +++ b/runs/cin_sweep.log @@ -0,0 +1,58 @@ +PPGN done -> CIN +CIN start gpu=1 2026-06-17T04:31:06-05:00 +== cin s0 == +ep20 solve=0.063 +ep40 solve=0.423 +ep60 solve=0.340 +ep80 solve=0.397 +ep100 solve=0.417 +ep120 solve=0.460 +ep140 solve=0.477 +ep150 solve=0.470 +[cin/full] solve=0.477 LE AUROC=0.763 mean_lam=+0.074 passK=0.473 lamsel=0.473 (639s) + wrote cin_full_none_n50_k3_p0.2_T3_ns3_s0 +== cin s1 == +ep20 solve=0.013 +ep40 solve=0.413 +ep60 solve=0.443 +ep80 solve=0.467 +ep100 solve=0.313 +ep120 solve=0.507 +ep140 solve=0.533 +ep150 solve=0.520 +[cin/full] solve=0.533 LE AUROC=0.763 mean_lam=+0.134 passK=0.553 lamsel=0.553 (1125s) + wrote cin_full_none_n50_k3_p0.2_T3_ns3_s1 +== cin s2 == +ep20 solve=0.080 +ep40 solve=0.413 +ep60 solve=0.360 +ep80 solve=0.403 +ep100 solve=0.510 +ep120 solve=0.453 +ep140 solve=0.483 +ep150 solve=0.517 +[cin/full] solve=0.517 LE AUROC=0.713 mean_lam=+0.087 passK=0.567 lamsel=0.567 (1127s) + wrote cin_full_none_n50_k3_p0.2_T3_ns3_s2 +== cin s3 == +ep20 solve=0.070 +ep40 solve=0.470 +ep60 solve=0.453 +ep80 solve=0.493 +ep100 solve=0.463 +ep120 solve=0.550 +ep140 solve=0.597 +ep150 solve=0.577 +[cin/full] solve=0.597 LE AUROC=0.655 mean_lam=+0.162 passK=0.587 lamsel=0.587 (1112s) + wrote cin_full_none_n50_k3_p0.2_T3_ns3_s3 +== cin s4 == +ep20 solve=0.037 +ep40 solve=0.193 +ep60 solve=0.223 +ep80 solve=0.393 +ep100 solve=0.510 +ep120 solve=0.457 +ep140 solve=0.423 +ep150 solve=0.463 +[cin/full] solve=0.510 LE AUROC=0.752 mean_lam=+0.123 passK=0.527 lamsel=0.527 (1127s) + wrote cin_full_none_n50_k3_p0.2_T3_ns3_s4 +doneCIN=2026-06-17T05:57:37-05:00 diff --git a/runs/color_1step_n50_k3_p0.2_T3_ns3_s0.json b/runs/color_1step_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..56cc6f8 --- /dev/null +++ b/runs/color_1step_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,22 @@ +{ + "task": "graph3coloring", + "tag": "color_1step_n50_k3_p0.2_T3_ns3_s0", + "mode": "train", + "grad_mode": "1step", + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 0, + "sec": 121.4, + "ep": 150, + "solve_rate": 0.2833, + "mean_conflicts": 5.193 +}
\ No newline at end of file diff --git a/runs/color_1step_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/color_1step_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..17e736a --- /dev/null +++ b/runs/color_1step_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,25 @@ +{ + "task": "graph3coloring", + "tag": "color_1step_none_n50_k3_p0.2_T3_ns3_s0", + "mode": "train", + "grad_mode": "1step", + "pe": "none", + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 0, + "in_dim": 8, + "sec": 127.1, + "ep": 60, + "solve_rate": 0.2, + "mean_conflicts": 18.333 +}
\ No newline at end of file diff --git a/runs/color_1step_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/color_1step_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..4c6ec55 --- /dev/null +++ b/runs/color_1step_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,25 @@ +{ + "task": "graph3coloring", + "tag": "color_1step_none_n50_k3_p0.2_T3_ns3_s1", + "mode": "train", + "grad_mode": "1step", + "pe": "none", + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 1, + "in_dim": 8, + "sec": 123.3, + "ep": 80, + "solve_rate": 0.3333, + "mean_conflicts": 8.7 +}
\ No newline at end of file diff --git a/runs/color_1step_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/color_1step_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..5a049d9 --- /dev/null +++ b/runs/color_1step_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,25 @@ +{ + "task": "graph3coloring", + "tag": "color_1step_none_n50_k3_p0.2_T3_ns3_s2", + "mode": "train", + "grad_mode": "1step", + "pe": "none", + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 2, + "in_dim": 8, + "sec": 131.6, + "ep": 100, + "solve_rate": 0.3567, + "mean_conflicts": 4.67 +}
\ No newline at end of file diff --git a/runs/color_1step_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/color_1step_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..cc9da6e --- /dev/null +++ b/runs/color_1step_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,25 @@ +{ + "task": "graph3coloring", + "tag": "color_1step_none_n50_k3_p0.2_T3_ns3_s3", + "mode": "train", + "grad_mode": "1step", + "pe": "none", + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 3, + "in_dim": 8, + "sec": 124.3, + "ep": 120, + "solve_rate": 0.3367, + "mean_conflicts": 7.227 +}
\ No newline at end of file diff --git a/runs/color_1step_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/color_1step_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..51bab30 --- /dev/null +++ b/runs/color_1step_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,25 @@ +{ + "task": "graph3coloring", + "tag": "color_1step_none_n50_k3_p0.2_T3_ns3_s4", + "mode": "train", + "grad_mode": "1step", + "pe": "none", + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 4, + "in_dim": 8, + "sec": 120.8, + "ep": 60, + "solve_rate": 0.2367, + "mean_conflicts": 22.393 +}
\ No newline at end of file diff --git a/runs/color_cin_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/color_cin_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..3580f31 --- /dev/null +++ b/runs/color_cin_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1 @@ +{"conv": "cin", "pe": "none", "grad_mode": "full", "contract": false, "seed": 0, "solve_rate": 0.4766666666666667}
\ No newline at end of file diff --git a/runs/color_cin_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/color_cin_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..cbd69ae --- /dev/null +++ b/runs/color_cin_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1 @@ +{"conv": "cin", "pe": "none", "grad_mode": "full", "contract": false, "seed": 1, "solve_rate": 0.5333333333333333}
\ No newline at end of file diff --git a/runs/color_cin_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/color_cin_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..887f539 --- /dev/null +++ b/runs/color_cin_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1 @@ +{"conv": "cin", "pe": "none", "grad_mode": "full", "contract": false, "seed": 2, "solve_rate": 0.5166666666666667}
\ No newline at end of file diff --git a/runs/color_cin_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/color_cin_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..2e3be07 --- /dev/null +++ b/runs/color_cin_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1 @@ +{"conv": "cin", "pe": "none", "grad_mode": "full", "contract": false, "seed": 3, "solve_rate": 0.5966666666666667}
\ No newline at end of file diff --git a/runs/color_cin_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/color_cin_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..cd8d485 --- /dev/null +++ b/runs/color_cin_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1 @@ +{"conv": "cin", "pe": "none", "grad_mode": "full", "contract": false, "seed": 4, "solve_rate": 0.51}
\ No newline at end of file diff --git a/runs/color_esan_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/color_esan_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..ebd9a08 --- /dev/null +++ b/runs/color_esan_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1 @@ +{"conv": "esan", "pe": "none", "grad_mode": "full", "contract": false, "seed": 0, "solve_rate": 0.49666666666666665}
\ No newline at end of file diff --git a/runs/color_esan_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/color_esan_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..481b197 --- /dev/null +++ b/runs/color_esan_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1 @@ +{"conv": "esan", "pe": "none", "grad_mode": "full", "contract": false, "seed": 1, "solve_rate": 0.48333333333333334}
\ No newline at end of file diff --git a/runs/color_esan_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/color_esan_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..9f89fcc --- /dev/null +++ b/runs/color_esan_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1 @@ +{"conv": "esan", "pe": "none", "grad_mode": "full", "contract": false, "seed": 2, "solve_rate": 0.7133333333333334}
\ No newline at end of file diff --git a/runs/color_esan_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/color_esan_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..cc17641 --- /dev/null +++ b/runs/color_esan_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1 @@ +{"conv": "esan", "pe": "none", "grad_mode": "full", "contract": false, "seed": 3, "solve_rate": 0.5633333333333334}
\ No newline at end of file diff --git a/runs/color_esan_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/color_esan_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..4f05b5c --- /dev/null +++ b/runs/color_esan_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1 @@ +{"conv": "esan", "pe": "none", "grad_mode": "full", "contract": false, "seed": 4, "solve_rate": 0.67}
\ No newline at end of file diff --git a/runs/color_full_gsn_n50_k3_p0.2_T3_ns3_s0.json b/runs/color_full_gsn_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..3072e52 --- /dev/null +++ b/runs/color_full_gsn_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,25 @@ +{ + "task": "graph3coloring", + "tag": "color_full_gsn_n50_k3_p0.2_T3_ns3_s0", + "mode": "train", + "grad_mode": "full", + "pe": "gsn", + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 0, + "in_dim": 10, + "sec": 153.5, + "ep": 80, + "solve_rate": 0.6433, + "mean_conflicts": 2.77 +}
\ No newline at end of file diff --git a/runs/color_full_gsn_n50_k3_p0.2_T3_ns3_s1.json b/runs/color_full_gsn_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..90e63c6 --- /dev/null +++ b/runs/color_full_gsn_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,25 @@ +{ + "task": "graph3coloring", + "tag": "color_full_gsn_n50_k3_p0.2_T3_ns3_s1", + "mode": "train", + "grad_mode": "full", + "pe": "gsn", + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 1, + "in_dim": 10, + "sec": 150.6, + "ep": 80, + "solve_rate": 0.5333, + "mean_conflicts": 19.95 +}
\ No newline at end of file diff --git a/runs/color_full_gsn_n50_k3_p0.2_T3_ns3_s2.json b/runs/color_full_gsn_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..293548e --- /dev/null +++ b/runs/color_full_gsn_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,25 @@ +{ + "task": "graph3coloring", + "tag": "color_full_gsn_n50_k3_p0.2_T3_ns3_s2", + "mode": "train", + "grad_mode": "full", + "pe": "gsn", + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 2, + "in_dim": 10, + "sec": 154.1, + "ep": 80, + "solve_rate": 0.65, + "mean_conflicts": 9.427 +}
\ No newline at end of file diff --git a/runs/color_full_gsn_n50_k3_p0.2_T3_ns3_s3.json b/runs/color_full_gsn_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..a7108c4 --- /dev/null +++ b/runs/color_full_gsn_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,25 @@ +{ + "task": "graph3coloring", + "tag": "color_full_gsn_n50_k3_p0.2_T3_ns3_s3", + "mode": "train", + "grad_mode": "full", + "pe": "gsn", + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 3, + "in_dim": 10, + "sec": 150.0, + "ep": 80, + "solve_rate": 0.5767, + "mean_conflicts": 7.477 +}
\ No newline at end of file diff --git a/runs/color_full_gsn_n50_k3_p0.2_T3_ns3_s4.json b/runs/color_full_gsn_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..4978587 --- /dev/null +++ b/runs/color_full_gsn_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,25 @@ +{ + "task": "graph3coloring", + "tag": "color_full_gsn_n50_k3_p0.2_T3_ns3_s4", + "mode": "train", + "grad_mode": "full", + "pe": "gsn", + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 4, + "in_dim": 10, + "sec": 153.1, + "ep": 100, + "solve_rate": 0.5767, + "mean_conflicts": 7.393 +}
\ No newline at end of file diff --git a/runs/color_full_n50_k3_p0.15_T3_ns3_s0.json b/runs/color_full_n50_k3_p0.15_T3_ns3_s0.json new file mode 100644 index 0000000..e31bd27 --- /dev/null +++ b/runs/color_full_n50_k3_p0.15_T3_ns3_s0.json @@ -0,0 +1,22 @@ +{ + "task": "graph3coloring", + "tag": "color_full_n50_k3_p0.15_T3_ns3_s0", + "mode": "train", + "grad_mode": "full", + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.15, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 120, + "lr": 0.001, + "bs": 32, + "seed": 0, + "sec": 116.5, + "ep": 60, + "solve_rate": 0.2033, + "mean_conflicts": 3.24 +}
\ No newline at end of file diff --git a/runs/color_full_n50_k3_p0.2_T3_ns3_s0.json b/runs/color_full_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..3b96fd4 --- /dev/null +++ b/runs/color_full_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,22 @@ +{ + "task": "graph3coloring", + "tag": "color_full_n50_k3_p0.2_T3_ns3_s0", + "mode": "train", + "grad_mode": "full", + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 0, + "sec": 153.7, + "ep": 60, + "solve_rate": 0.5033, + "mean_conflicts": 19.497 +}
\ No newline at end of file diff --git a/runs/color_full_none_ctr_n50_k3_p0.2_T3_ns3_s0.json b/runs/color_full_none_ctr_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..2636c64 --- /dev/null +++ b/runs/color_full_none_ctr_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,26 @@ +{ + "task": "graph3coloring", + "tag": "color_full_none_ctr_n50_k3_p0.2_T3_ns3_s0", + "mode": "train", + "grad_mode": "full", + "pe": "none", + "contract": true, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 0, + "in_dim": 8, + "sec": 207.1, + "ep": 20, + "solve_rate": 0.0, + "mean_conflicts": 163.477 +}
\ No newline at end of file diff --git a/runs/color_full_none_ctr_n50_k3_p0.2_T3_ns3_s1.json b/runs/color_full_none_ctr_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..a0f3b6c --- /dev/null +++ b/runs/color_full_none_ctr_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,26 @@ +{ + "task": "graph3coloring", + "tag": "color_full_none_ctr_n50_k3_p0.2_T3_ns3_s1", + "mode": "train", + "grad_mode": "full", + "pe": "none", + "contract": true, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 1, + "in_dim": 8, + "sec": 206.4, + "ep": 20, + "solve_rate": 0.0, + "mean_conflicts": 107.593 +}
\ No newline at end of file diff --git a/runs/color_full_none_ctr_n50_k3_p0.2_T3_ns3_s2.json b/runs/color_full_none_ctr_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..13e785a --- /dev/null +++ b/runs/color_full_none_ctr_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,26 @@ +{ + "task": "graph3coloring", + "tag": "color_full_none_ctr_n50_k3_p0.2_T3_ns3_s2", + "mode": "train", + "grad_mode": "full", + "pe": "none", + "contract": true, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 2, + "in_dim": 8, + "sec": 208.2, + "ep": 20, + "solve_rate": 0.0, + "mean_conflicts": 102.423 +}
\ No newline at end of file diff --git a/runs/color_full_none_ctr_n50_k3_p0.2_T3_ns3_s3.json b/runs/color_full_none_ctr_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..97a1eb7 --- /dev/null +++ b/runs/color_full_none_ctr_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,26 @@ +{ + "task": "graph3coloring", + "tag": "color_full_none_ctr_n50_k3_p0.2_T3_ns3_s3", + "mode": "train", + "grad_mode": "full", + "pe": "none", + "contract": true, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 3, + "in_dim": 8, + "sec": 206.2, + "ep": 20, + "solve_rate": 0.0, + "mean_conflicts": 125.593 +}
\ No newline at end of file diff --git a/runs/color_full_none_ctr_n50_k3_p0.2_T3_ns3_s4.json b/runs/color_full_none_ctr_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..2b92684 --- /dev/null +++ b/runs/color_full_none_ctr_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,26 @@ +{ + "task": "graph3coloring", + "tag": "color_full_none_ctr_n50_k3_p0.2_T3_ns3_s4", + "mode": "train", + "grad_mode": "full", + "pe": "none", + "contract": true, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 4, + "in_dim": 8, + "sec": 208.3, + "ep": 20, + "solve_rate": 0.0, + "mean_conflicts": 156.353 +}
\ No newline at end of file diff --git a/runs/color_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/color_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..d0f58a1 --- /dev/null +++ b/runs/color_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,25 @@ +{ + "task": "graph3coloring", + "tag": "color_full_none_n50_k3_p0.2_T3_ns3_s0", + "mode": "train", + "grad_mode": "full", + "pe": "none", + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 0, + "in_dim": 8, + "sec": 155.3, + "ep": 80, + "solve_rate": 0.61, + "mean_conflicts": 4.323 +}
\ No newline at end of file diff --git a/runs/color_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/color_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..929be63 --- /dev/null +++ b/runs/color_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,25 @@ +{ + "task": "graph3coloring", + "tag": "color_full_none_n50_k3_p0.2_T3_ns3_s1", + "mode": "train", + "grad_mode": "full", + "pe": "none", + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 1, + "in_dim": 8, + "sec": 151.0, + "ep": 80, + "solve_rate": 0.4533, + "mean_conflicts": 11.753 +}
\ No newline at end of file diff --git a/runs/color_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/color_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..5d04e02 --- /dev/null +++ b/runs/color_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,25 @@ +{ + "task": "graph3coloring", + "tag": "color_full_none_n50_k3_p0.2_T3_ns3_s2", + "mode": "train", + "grad_mode": "full", + "pe": "none", + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 2, + "in_dim": 8, + "sec": 154.4, + "ep": 80, + "solve_rate": 0.4133, + "mean_conflicts": 16.23 +}
\ No newline at end of file diff --git a/runs/color_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/color_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..67f9b8b --- /dev/null +++ b/runs/color_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,25 @@ +{ + "task": "graph3coloring", + "tag": "color_full_none_n50_k3_p0.2_T3_ns3_s3", + "mode": "train", + "grad_mode": "full", + "pe": "none", + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 3, + "in_dim": 8, + "sec": 151.6, + "ep": 60, + "solve_rate": 0.46, + "mean_conflicts": 15.68 +}
\ No newline at end of file diff --git a/runs/color_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/color_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..8fadc86 --- /dev/null +++ b/runs/color_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,25 @@ +{ + "task": "graph3coloring", + "tag": "color_full_none_n50_k3_p0.2_T3_ns3_s4", + "mode": "train", + "grad_mode": "full", + "pe": "none", + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 4, + "in_dim": 8, + "sec": 149.8, + "ep": 60, + "solve_rate": 0.3467, + "mean_conflicts": 27.197 +}
\ No newline at end of file diff --git a/runs/color_full_rwse_n50_k3_p0.2_T3_ns3_s0.json b/runs/color_full_rwse_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..55afe75 --- /dev/null +++ b/runs/color_full_rwse_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,25 @@ +{ + "task": "graph3coloring", + "tag": "color_full_rwse_n50_k3_p0.2_T3_ns3_s0", + "mode": "train", + "grad_mode": "full", + "pe": "rwse", + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 0, + "in_dim": 24, + "sec": 153.3, + "ep": 100, + "solve_rate": 0.3833, + "mean_conflicts": 31.483 +}
\ No newline at end of file diff --git a/runs/color_full_rwse_n50_k3_p0.2_T3_ns3_s1.json b/runs/color_full_rwse_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..3c5b1b9 --- /dev/null +++ b/runs/color_full_rwse_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,25 @@ +{ + "task": "graph3coloring", + "tag": "color_full_rwse_n50_k3_p0.2_T3_ns3_s1", + "mode": "train", + "grad_mode": "full", + "pe": "rwse", + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 1, + "in_dim": 24, + "sec": 152.1, + "ep": 140, + "solve_rate": 0.5367, + "mean_conflicts": 13.68 +}
\ No newline at end of file diff --git a/runs/color_full_rwse_n50_k3_p0.2_T3_ns3_s2.json b/runs/color_full_rwse_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..707c3e3 --- /dev/null +++ b/runs/color_full_rwse_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,25 @@ +{ + "task": "graph3coloring", + "tag": "color_full_rwse_n50_k3_p0.2_T3_ns3_s2", + "mode": "train", + "grad_mode": "full", + "pe": "rwse", + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 2, + "in_dim": 24, + "sec": 151.8, + "ep": 80, + "solve_rate": 0.56, + "mean_conflicts": 3.4 +}
\ No newline at end of file diff --git a/runs/color_full_rwse_n50_k3_p0.2_T3_ns3_s3.json b/runs/color_full_rwse_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..1cf0e40 --- /dev/null +++ b/runs/color_full_rwse_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,25 @@ +{ + "task": "graph3coloring", + "tag": "color_full_rwse_n50_k3_p0.2_T3_ns3_s3", + "mode": "train", + "grad_mode": "full", + "pe": "rwse", + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 3, + "in_dim": 24, + "sec": 152.1, + "ep": 100, + "solve_rate": 0.49, + "mean_conflicts": 12.46 +}
\ No newline at end of file diff --git a/runs/color_full_rwse_n50_k3_p0.2_T3_ns3_s4.json b/runs/color_full_rwse_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..9dd65cd --- /dev/null +++ b/runs/color_full_rwse_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,25 @@ +{ + "task": "graph3coloring", + "tag": "color_full_rwse_n50_k3_p0.2_T3_ns3_s4", + "mode": "train", + "grad_mode": "full", + "pe": "rwse", + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 4, + "in_dim": 24, + "sec": 154.2, + "ep": 100, + "solve_rate": 0.5467, + "mean_conflicts": 6.193 +}
\ No newline at end of file diff --git a/runs/color_full_sub_n50_k3_p0.2_T3_ns3_s0.json b/runs/color_full_sub_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..3190cee --- /dev/null +++ b/runs/color_full_sub_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,26 @@ +{ + "task": "graph3coloring", + "tag": "color_full_sub_n50_k3_p0.2_T3_ns3_s0", + "mode": "train", + "grad_mode": "full", + "pe": "sub", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 0, + "in_dim": 11, + "sec": 155.3, + "ep": 100, + "solve_rate": 0.71, + "mean_conflicts": 1.94 +}
\ No newline at end of file diff --git a/runs/color_full_sub_n50_k3_p0.2_T3_ns3_s1.json b/runs/color_full_sub_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..7c1bdc7 --- /dev/null +++ b/runs/color_full_sub_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,26 @@ +{ + "task": "graph3coloring", + "tag": "color_full_sub_n50_k3_p0.2_T3_ns3_s1", + "mode": "train", + "grad_mode": "full", + "pe": "sub", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 1, + "in_dim": 11, + "sec": 148.6, + "ep": 80, + "solve_rate": 0.57, + "mean_conflicts": 7.483 +}
\ No newline at end of file diff --git a/runs/color_full_sub_n50_k3_p0.2_T3_ns3_s2.json b/runs/color_full_sub_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..d30c923 --- /dev/null +++ b/runs/color_full_sub_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,26 @@ +{ + "task": "graph3coloring", + "tag": "color_full_sub_n50_k3_p0.2_T3_ns3_s2", + "mode": "train", + "grad_mode": "full", + "pe": "sub", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 2, + "in_dim": 11, + "sec": 152.1, + "ep": 80, + "solve_rate": 0.67, + "mean_conflicts": 3.317 +}
\ No newline at end of file diff --git a/runs/color_full_sub_n50_k3_p0.2_T3_ns3_s3.json b/runs/color_full_sub_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..d6d8ebe --- /dev/null +++ b/runs/color_full_sub_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,26 @@ +{ + "task": "graph3coloring", + "tag": "color_full_sub_n50_k3_p0.2_T3_ns3_s3", + "mode": "train", + "grad_mode": "full", + "pe": "sub", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 3, + "in_dim": 11, + "sec": 152.2, + "ep": 40, + "solve_rate": 0.2533, + "mean_conflicts": 27.497 +}
\ No newline at end of file diff --git a/runs/color_full_sub_n50_k3_p0.2_T3_ns3_s4.json b/runs/color_full_sub_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..b072361 --- /dev/null +++ b/runs/color_full_sub_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,26 @@ +{ + "task": "graph3coloring", + "tag": "color_full_sub_n50_k3_p0.2_T3_ns3_s4", + "mode": "train", + "grad_mode": "full", + "pe": "sub", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 4, + "in_dim": 11, + "sec": 152.1, + "ep": 80, + "solve_rate": 0.6233, + "mean_conflicts": 4.323 +}
\ No newline at end of file diff --git a/runs/color_gat_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/color_gat_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..91f6bec --- /dev/null +++ b/runs/color_gat_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gat_full_none_n50_k3_p0.2_T3_ns3_s0", + "mode": "train", + "conv": "gat", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 0, + "in_dim": 8, + "sec": 305.2, + "ep": 80, + "solve_rate": 0.0133, + "mean_conflicts": 107.493 +}
\ No newline at end of file diff --git a/runs/color_gat_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/color_gat_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..e17df81 --- /dev/null +++ b/runs/color_gat_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gat_full_none_n50_k3_p0.2_T3_ns3_s1", + "mode": "train", + "conv": "gat", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 1, + "in_dim": 8, + "sec": 870.5, + "ep": 80, + "solve_rate": 0.0067, + "mean_conflicts": 81.21 +}
\ No newline at end of file diff --git a/runs/color_gat_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/color_gat_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..c3eed62 --- /dev/null +++ b/runs/color_gat_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gat_full_none_n50_k3_p0.2_T3_ns3_s2", + "mode": "train", + "conv": "gat", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 2, + "in_dim": 8, + "sec": 871.7, + "ep": 100, + "solve_rate": 0.0033, + "mean_conflicts": 152.937 +}
\ No newline at end of file diff --git a/runs/color_gat_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/color_gat_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..34f928f --- /dev/null +++ b/runs/color_gat_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gat_full_none_n50_k3_p0.2_T3_ns3_s3", + "mode": "train", + "conv": "gat", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 3, + "in_dim": 8, + "sec": 869.6, + "ep": 60, + "solve_rate": 0.1, + "mean_conflicts": 17.607 +}
\ No newline at end of file diff --git a/runs/color_gat_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/color_gat_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..295a8c4 --- /dev/null +++ b/runs/color_gat_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gat_full_none_n50_k3_p0.2_T3_ns3_s4", + "mode": "train", + "conv": "gat", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 4, + "in_dim": 8, + "sec": 871.2, + "ep": 140, + "solve_rate": 0.08, + "mean_conflicts": 76.133 +}
\ No newline at end of file diff --git a/runs/color_gcn_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/color_gcn_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..a8c5704 --- /dev/null +++ b/runs/color_gcn_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gcn_full_none_n50_k3_p0.2_T3_ns3_s0", + "mode": "train", + "conv": "gcn", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 0, + "in_dim": 8, + "sec": 199.2, + "ep": 20, + "solve_rate": 0.0, + "mean_conflicts": 162.087 +}
\ No newline at end of file diff --git a/runs/color_gcn_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/color_gcn_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..ea6888a --- /dev/null +++ b/runs/color_gcn_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gcn_full_none_n50_k3_p0.2_T3_ns3_s1", + "mode": "train", + "conv": "gcn", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 1, + "in_dim": 8, + "sec": 200.7, + "ep": 150, + "solve_rate": 0.0033, + "mean_conflicts": 47.46 +}
\ No newline at end of file diff --git a/runs/color_gcn_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/color_gcn_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..18e485d --- /dev/null +++ b/runs/color_gcn_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gcn_full_none_n50_k3_p0.2_T3_ns3_s2", + "mode": "train", + "conv": "gcn", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 2, + "in_dim": 8, + "sec": 676.3, + "ep": 100, + "solve_rate": 0.0033, + "mean_conflicts": 60.787 +}
\ No newline at end of file diff --git a/runs/color_gcn_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/color_gcn_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..9e7baec --- /dev/null +++ b/runs/color_gcn_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gcn_full_none_n50_k3_p0.2_T3_ns3_s3", + "mode": "train", + "conv": "gcn", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 3, + "in_dim": 8, + "sec": 675.0, + "ep": 100, + "solve_rate": 0.0033, + "mean_conflicts": 69.257 +}
\ No newline at end of file diff --git a/runs/color_gcn_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/color_gcn_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..f4e9c85 --- /dev/null +++ b/runs/color_gcn_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gcn_full_none_n50_k3_p0.2_T3_ns3_s4", + "mode": "train", + "conv": "gcn", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 4, + "in_dim": 8, + "sec": 676.5, + "ep": 100, + "solve_rate": 0.0033, + "mean_conflicts": 60.47 +}
\ No newline at end of file diff --git a/runs/color_gin_full_all_n50_k3_p0.2_T3_ns3_s0.json b/runs/color_gin_full_all_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..ee36730 --- /dev/null +++ b/runs/color_gin_full_all_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gin_full_all_n50_k3_p0.2_T3_ns3_s0", + "mode": "train", + "conv": "gin", + "grad_mode": "full", + "pe": "all", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 0, + "in_dim": 29, + "sec": 151.3, + "ep": 80, + "solve_rate": 0.67, + "mean_conflicts": 4.01 +}
\ No newline at end of file diff --git a/runs/color_gin_full_all_n50_k3_p0.2_T3_ns3_s1.json b/runs/color_gin_full_all_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..f1d9a2d --- /dev/null +++ b/runs/color_gin_full_all_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gin_full_all_n50_k3_p0.2_T3_ns3_s1", + "mode": "train", + "conv": "gin", + "grad_mode": "full", + "pe": "all", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 1, + "in_dim": 29, + "sec": 216.1, + "ep": 120, + "solve_rate": 0.7067, + "mean_conflicts": 8.86 +}
\ No newline at end of file diff --git a/runs/color_gin_full_all_n50_k3_p0.2_T3_ns3_s2.json b/runs/color_gin_full_all_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..33411ee --- /dev/null +++ b/runs/color_gin_full_all_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gin_full_all_n50_k3_p0.2_T3_ns3_s2", + "mode": "train", + "conv": "gin", + "grad_mode": "full", + "pe": "all", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 2, + "in_dim": 29, + "sec": 233.5, + "ep": 60, + "solve_rate": 0.3333, + "mean_conflicts": 59.61 +}
\ No newline at end of file diff --git a/runs/color_gin_full_all_n50_k3_p0.2_T3_ns3_s3.json b/runs/color_gin_full_all_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..824b09f --- /dev/null +++ b/runs/color_gin_full_all_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gin_full_all_n50_k3_p0.2_T3_ns3_s3", + "mode": "train", + "conv": "gin", + "grad_mode": "full", + "pe": "all", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 3, + "in_dim": 29, + "sec": 229.5, + "ep": 60, + "solve_rate": 0.4567, + "mean_conflicts": 22.17 +}
\ No newline at end of file diff --git a/runs/color_gin_full_all_n50_k3_p0.2_T3_ns3_s4.json b/runs/color_gin_full_all_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..b39b5b7 --- /dev/null +++ b/runs/color_gin_full_all_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gin_full_all_n50_k3_p0.2_T3_ns3_s4", + "mode": "train", + "conv": "gin", + "grad_mode": "full", + "pe": "all", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 4, + "in_dim": 29, + "sec": 233.8, + "ep": 60, + "solve_rate": 0.5667, + "mean_conflicts": 22.46 +}
\ No newline at end of file diff --git a/runs/color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s0.json b/runs/color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..66d25a8 --- /dev/null +++ b/runs/color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s0", + "mode": "train", + "conv": "gin", + "grad_mode": "full", + "pe": "lappe", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 0, + "in_dim": 16, + "sec": 150.2, + "ep": 80, + "solve_rate": 0.39, + "mean_conflicts": 20.85 +}
\ No newline at end of file diff --git a/runs/color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s1.json b/runs/color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..e9c392f --- /dev/null +++ b/runs/color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s1", + "mode": "train", + "conv": "gin", + "grad_mode": "full", + "pe": "lappe", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 1, + "in_dim": 16, + "sec": 224.3, + "ep": 100, + "solve_rate": 0.5933, + "mean_conflicts": 6.31 +}
\ No newline at end of file diff --git a/runs/color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s2.json b/runs/color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..36be7ed --- /dev/null +++ b/runs/color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s2", + "mode": "train", + "conv": "gin", + "grad_mode": "full", + "pe": "lappe", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 2, + "in_dim": 16, + "sec": 225.1, + "ep": 100, + "solve_rate": 0.3733, + "mean_conflicts": 25.483 +}
\ No newline at end of file diff --git a/runs/color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s3.json b/runs/color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..6c98e9a --- /dev/null +++ b/runs/color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s3", + "mode": "train", + "conv": "gin", + "grad_mode": "full", + "pe": "lappe", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 3, + "in_dim": 16, + "sec": 234.0, + "ep": 80, + "solve_rate": 0.5233, + "mean_conflicts": 6.353 +}
\ No newline at end of file diff --git a/runs/color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s4.json b/runs/color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..1e3c323 --- /dev/null +++ b/runs/color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s4", + "mode": "train", + "conv": "gin", + "grad_mode": "full", + "pe": "lappe", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 4, + "in_dim": 16, + "sec": 229.4, + "ep": 80, + "solve_rate": 0.3333, + "mean_conflicts": 28.493 +}
\ No newline at end of file diff --git a/runs/color_gps_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/color_gps_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..8fc703b --- /dev/null +++ b/runs/color_gps_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gps_full_none_n50_k3_p0.2_T3_ns3_s0", + "mode": "train", + "conv": "gps", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 0, + "in_dim": 8, + "sec": 591.9, + "ep": 150, + "solve_rate": 0.9133, + "mean_conflicts": 0.287 +}
\ No newline at end of file diff --git a/runs/color_gps_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/color_gps_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..5c5cc97 --- /dev/null +++ b/runs/color_gps_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gps_full_none_n50_k3_p0.2_T3_ns3_s1", + "mode": "train", + "conv": "gps", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 1, + "in_dim": 8, + "sec": 2583.0, + "ep": 150, + "solve_rate": 0.9267, + "mean_conflicts": 0.3 +}
\ No newline at end of file diff --git a/runs/color_gps_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/color_gps_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..5328a20 --- /dev/null +++ b/runs/color_gps_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gps_full_none_n50_k3_p0.2_T3_ns3_s2", + "mode": "train", + "conv": "gps", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 2, + "in_dim": 8, + "sec": 3039.3, + "ep": 150, + "solve_rate": 0.9367, + "mean_conflicts": 0.22 +}
\ No newline at end of file diff --git a/runs/color_gps_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/color_gps_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..7adf4c6 --- /dev/null +++ b/runs/color_gps_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gps_full_none_n50_k3_p0.2_T3_ns3_s3", + "mode": "train", + "conv": "gps", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 3, + "in_dim": 8, + "sec": 3097.1, + "ep": 150, + "solve_rate": 0.9433, + "mean_conflicts": 0.227 +}
\ No newline at end of file diff --git a/runs/color_gps_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/color_gps_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..4128e17 --- /dev/null +++ b/runs/color_gps_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_gps_full_none_n50_k3_p0.2_T3_ns3_s4", + "mode": "train", + "conv": "gps", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 4, + "in_dim": 8, + "sec": 3113.0, + "ep": 150, + "solve_rate": 0.9367, + "mean_conflicts": 0.223 +}
\ No newline at end of file diff --git a/runs/color_pna_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/color_pna_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..5a69424 --- /dev/null +++ b/runs/color_pna_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_pna_full_none_n50_k3_p0.2_T3_ns3_s0", + "mode": "train", + "conv": "pna", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 0, + "in_dim": 8, + "sec": 718.5, + "ep": 140, + "solve_rate": 0.92, + "mean_conflicts": 0.323 +}
\ No newline at end of file diff --git a/runs/color_pna_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/color_pna_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..8b82fd5 --- /dev/null +++ b/runs/color_pna_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_pna_full_none_n50_k3_p0.2_T3_ns3_s1", + "mode": "train", + "conv": "pna", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 1, + "in_dim": 8, + "sec": 718.2, + "ep": 150, + "solve_rate": 0.9433, + "mean_conflicts": 0.15 +}
\ No newline at end of file diff --git a/runs/color_pna_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/color_pna_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..0abace8 --- /dev/null +++ b/runs/color_pna_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_pna_full_none_n50_k3_p0.2_T3_ns3_s2", + "mode": "train", + "conv": "pna", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 2, + "in_dim": 8, + "sec": 714.9, + "ep": 150, + "solve_rate": 0.9167, + "mean_conflicts": 0.197 +}
\ No newline at end of file diff --git a/runs/color_pna_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/color_pna_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..c8c6c59 --- /dev/null +++ b/runs/color_pna_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_pna_full_none_n50_k3_p0.2_T3_ns3_s3", + "mode": "train", + "conv": "pna", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 3, + "in_dim": 8, + "sec": 614.3, + "ep": 140, + "solve_rate": 0.9433, + "mean_conflicts": 0.2 +}
\ No newline at end of file diff --git a/runs/color_pna_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/color_pna_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..e02ff41 --- /dev/null +++ b/runs/color_pna_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_pna_full_none_n50_k3_p0.2_T3_ns3_s4", + "mode": "train", + "conv": "pna", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 4, + "in_dim": 8, + "sec": 702.2, + "ep": 150, + "solve_rate": 0.9233, + "mean_conflicts": 0.293 +}
\ No newline at end of file diff --git a/runs/color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..160bc33 --- /dev/null +++ b/runs/color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,8 @@ +{ + "conv": "ppgn", + "pe": "none", + "grad_mode": "full", + "contract": false, + "seed": 0, + "solve_rate": 0.9233333333333333 +}
\ No newline at end of file diff --git a/runs/color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..3e27997 --- /dev/null +++ b/runs/color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,8 @@ +{ + "conv": "ppgn", + "pe": "none", + "grad_mode": "full", + "contract": false, + "seed": 1, + "solve_rate": 0.93 +}
\ No newline at end of file diff --git a/runs/color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..0af6f22 --- /dev/null +++ b/runs/color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,8 @@ +{ + "conv": "ppgn", + "pe": "none", + "grad_mode": "full", + "contract": false, + "seed": 2, + "solve_rate": 0.9333333333333333 +}
\ No newline at end of file diff --git a/runs/color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..69cda09 --- /dev/null +++ b/runs/color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,8 @@ +{ + "conv": "ppgn", + "pe": "none", + "grad_mode": "full", + "contract": false, + "seed": 3, + "solve_rate": 0.9466666666666667 +}
\ No newline at end of file diff --git a/runs/color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..748da35 --- /dev/null +++ b/runs/color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,8 @@ +{ + "conv": "ppgn", + "pe": "none", + "grad_mode": "full", + "contract": false, + "seed": 4, + "solve_rate": 0.9233333333333333 +}
\ No newline at end of file diff --git a/runs/color_rrog_attn_gin_full_none_n50_k3_p0.2_T1_ns3_s0.json b/runs/color_rrog_attn_gin_full_none_n50_k3_p0.2_T1_ns3_s0.json new file mode 100644 index 0000000..eb12b67 --- /dev/null +++ b/runs/color_rrog_attn_gin_full_none_n50_k3_p0.2_T1_ns3_s0.json @@ -0,0 +1,32 @@ +{ + "task": "graph3coloring", + "tag": "color_rrog_attn_gin_full_none_n50_k3_p0.2_T1_ns3_s0", + "mode": "train", + "conv": "gin", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 1, + "n_sup": 3, + "epochs": 80, + "agg_layers": 1, + "compute_layers": 2, + "compute": "attn", + "attn_heads": 4, + "lr": 0.001, + "bs": 32, + "seed": 0, + "in_dim": 8, + "arch": "rrog_once_agg_hidden_compute", + "sec": 96.3, + "ep": 20, + "solve_rate": 0.0, + "mean_conflicts": 50.673 +}
\ No newline at end of file diff --git a/runs/color_rrog_gin_1step_none_n12_k3_p0.2_T2_ns2_s7.json b/runs/color_rrog_gin_1step_none_n12_k3_p0.2_T2_ns2_s7.json new file mode 100644 index 0000000..4c3017b --- /dev/null +++ b/runs/color_rrog_gin_1step_none_n12_k3_p0.2_T2_ns2_s7.json @@ -0,0 +1,30 @@ +{ + "task": "graph3coloring", + "tag": "color_rrog_gin_1step_none_n12_k3_p0.2_T2_ns2_s7", + "mode": "train", + "conv": "gin", + "grad_mode": "1step", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 12, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 16, + "T": 2, + "n_sup": 2, + "epochs": 1, + "agg_layers": 1, + "compute_layers": 2, + "lr": 0.001, + "bs": 1024, + "seed": 7, + "in_dim": 8, + "arch": "rrog_once_agg_node_compute", + "sec": 1.4, + "ep": 1, + "solve_rate": 0.0, + "mean_conflicts": 8.867 +}
\ No newline at end of file diff --git a/runs/color_rrog_gin_full_none_n12_k3_p0.2_T2_ns2_s7.json b/runs/color_rrog_gin_full_none_n12_k3_p0.2_T2_ns2_s7.json new file mode 100644 index 0000000..4074d2a --- /dev/null +++ b/runs/color_rrog_gin_full_none_n12_k3_p0.2_T2_ns2_s7.json @@ -0,0 +1,30 @@ +{ + "task": "graph3coloring", + "tag": "color_rrog_gin_full_none_n12_k3_p0.2_T2_ns2_s7", + "mode": "train", + "conv": "gin", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 12, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 16, + "T": 2, + "n_sup": 2, + "epochs": 1, + "agg_layers": 1, + "compute_layers": 2, + "lr": 0.001, + "bs": 1024, + "seed": 7, + "in_dim": 8, + "arch": "rrog_once_agg_node_compute", + "sec": 1.4, + "ep": 1, + "solve_rate": 0.0, + "mean_conflicts": 8.867 +}
\ No newline at end of file diff --git a/runs/color_rrog_gin_full_none_n50_k3_p0.2_T1_ns3_s0.json b/runs/color_rrog_gin_full_none_n50_k3_p0.2_T1_ns3_s0.json new file mode 100644 index 0000000..78fdd5c --- /dev/null +++ b/runs/color_rrog_gin_full_none_n50_k3_p0.2_T1_ns3_s0.json @@ -0,0 +1,30 @@ +{ + "task": "graph3coloring", + "tag": "color_rrog_gin_full_none_n50_k3_p0.2_T1_ns3_s0", + "mode": "train", + "conv": "gin", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 1, + "n_sup": 3, + "epochs": 150, + "agg_layers": 1, + "compute_layers": 2, + "lr": 0.001, + "bs": 32, + "seed": 0, + "in_dim": 8, + "arch": "rrog_once_agg_node_compute", + "sec": 127.8, + "ep": 20, + "solve_rate": 0.0, + "mean_conflicts": 61.333 +}
\ No newline at end of file diff --git a/runs/color_rrog_gin_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/color_rrog_gin_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..8cdba1c --- /dev/null +++ b/runs/color_rrog_gin_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,30 @@ +{ + "task": "graph3coloring", + "tag": "color_rrog_gin_full_none_n50_k3_p0.2_T3_ns3_s0", + "mode": "train", + "conv": "gin", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "agg_layers": 1, + "compute_layers": 2, + "lr": 0.001, + "bs": 32, + "seed": 0, + "in_dim": 8, + "arch": "rrog_once_agg_node_compute", + "sec": 141.4, + "ep": 20, + "solve_rate": 0.0, + "mean_conflicts": 66.637 +}
\ No newline at end of file diff --git a/runs/color_rrog_node_gcn_full_none_n50_k3_p0.2_T0_ns3_s0.json b/runs/color_rrog_node_gcn_full_none_n50_k3_p0.2_T0_ns3_s0.json new file mode 100644 index 0000000..3a1a8bf --- /dev/null +++ b/runs/color_rrog_node_gcn_full_none_n50_k3_p0.2_T0_ns3_s0.json @@ -0,0 +1,32 @@ +{ + "task": "graph3coloring", + "tag": "color_rrog_node_gcn_full_none_n50_k3_p0.2_T0_ns3_s0", + "mode": "train", + "conv": "gcn", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 0, + "n_sup": 3, + "epochs": 150, + "agg_layers": 4, + "compute_layers": 2, + "compute": "node", + "attn_heads": 4, + "lr": 0.001, + "bs": 32, + "seed": 0, + "in_dim": 8, + "arch": "rrog_once_agg_hidden_compute", + "sec": 72.9, + "ep": 120, + "solve_rate": 0.0067, + "mean_conflicts": 20.977 +}
\ No newline at end of file diff --git a/runs/color_rrog_node_gin_full_none_n50_k3_p0.2_T0_ns3_s0.json b/runs/color_rrog_node_gin_full_none_n50_k3_p0.2_T0_ns3_s0.json new file mode 100644 index 0000000..0df9c45 --- /dev/null +++ b/runs/color_rrog_node_gin_full_none_n50_k3_p0.2_T0_ns3_s0.json @@ -0,0 +1,32 @@ +{ + "task": "graph3coloring", + "tag": "color_rrog_node_gin_full_none_n50_k3_p0.2_T0_ns3_s0", + "mode": "train", + "conv": "gin", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 0, + "n_sup": 3, + "epochs": 150, + "agg_layers": 4, + "compute_layers": 2, + "compute": "node", + "attn_heads": 4, + "lr": 0.001, + "bs": 32, + "seed": 0, + "in_dim": 8, + "arch": "rrog_once_agg_hidden_compute", + "sec": 69.4, + "ep": 20, + "solve_rate": 0.0, + "mean_conflicts": 81.17 +}
\ No newline at end of file diff --git a/runs/color_rrog_node_gin_full_none_n50_k3_p0.2_T1_ns3_s0.json b/runs/color_rrog_node_gin_full_none_n50_k3_p0.2_T1_ns3_s0.json new file mode 100644 index 0000000..bdd9c8a --- /dev/null +++ b/runs/color_rrog_node_gin_full_none_n50_k3_p0.2_T1_ns3_s0.json @@ -0,0 +1,32 @@ +{ + "task": "graph3coloring", + "tag": "color_rrog_node_gin_full_none_n50_k3_p0.2_T1_ns3_s0", + "mode": "train", + "conv": "gin", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 1, + "n_sup": 3, + "epochs": 80, + "agg_layers": 4, + "compute_layers": 2, + "compute": "node", + "attn_heads": 4, + "lr": 0.001, + "bs": 32, + "seed": 0, + "in_dim": 8, + "arch": "rrog_once_agg_hidden_compute", + "sec": 54.3, + "ep": 20, + "solve_rate": 0.0, + "mean_conflicts": 58.17 +}
\ No newline at end of file diff --git a/runs/color_sage_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/color_sage_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..3a7c8e5 --- /dev/null +++ b/runs/color_sage_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_sage_full_none_n50_k3_p0.2_T3_ns3_s0", + "mode": "train", + "conv": "sage", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 0, + "in_dim": 8, + "sec": 163.3, + "ep": 60, + "solve_rate": 0.73, + "mean_conflicts": 1.087 +}
\ No newline at end of file diff --git a/runs/color_sage_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/color_sage_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..5756b5f --- /dev/null +++ b/runs/color_sage_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_sage_full_none_n50_k3_p0.2_T3_ns3_s1", + "mode": "train", + "conv": "sage", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 1, + "in_dim": 8, + "sec": 159.8, + "ep": 120, + "solve_rate": 0.7867, + "mean_conflicts": 0.777 +}
\ No newline at end of file diff --git a/runs/color_sage_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/color_sage_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..ac70950 --- /dev/null +++ b/runs/color_sage_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_sage_full_none_n50_k3_p0.2_T3_ns3_s2", + "mode": "train", + "conv": "sage", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 2, + "in_dim": 8, + "sec": 224.4, + "ep": 60, + "solve_rate": 0.83, + "mean_conflicts": 0.677 +}
\ No newline at end of file diff --git a/runs/color_sage_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/color_sage_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..36cb84b --- /dev/null +++ b/runs/color_sage_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_sage_full_none_n50_k3_p0.2_T3_ns3_s3", + "mode": "train", + "conv": "sage", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 3, + "in_dim": 8, + "sec": 223.5, + "ep": 80, + "solve_rate": 0.8033, + "mean_conflicts": 0.713 +}
\ No newline at end of file diff --git a/runs/color_sage_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/color_sage_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..6c7d058 --- /dev/null +++ b/runs/color_sage_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,27 @@ +{ + "task": "graph3coloring", + "tag": "color_sage_full_none_n50_k3_p0.2_T3_ns3_s4", + "mode": "train", + "conv": "sage", + "grad_mode": "full", + "pe": "none", + "contract": false, + "rwse_k": 16, + "ckpt": null, + "n": 50, + "k": 3, + "p": 0.2, + "r": 8, + "hidden": 128, + "T": 3, + "n_sup": 3, + "epochs": 150, + "lr": 0.001, + "bs": 32, + "seed": 4, + "in_dim": 8, + "sec": 215.8, + "ep": 100, + "solve_rate": 0.8167, + "mean_conflicts": 0.697 +}
\ No newline at end of file diff --git a/runs/color_sweep.log b/runs/color_sweep.log new file mode 100644 index 0000000..f93d0ac --- /dev/null +++ b/runs/color_sweep.log @@ -0,0 +1,27 @@ +host=timan1.cs.illinois.edu gpu=0 start=2026-06-16T10:47:27-05:00 +===== train full ===== +ep20 solve_rate=0.000 mean_conflicts=159.45 +ep40 solve_rate=0.137 mean_conflicts=51.42 +ep60 solve_rate=0.503 mean_conflicts=19.50 +ep80 solve_rate=0.357 mean_conflicts=56.76 +ep100 solve_rate=0.060 mean_conflicts=115.03 +ep120 solve_rate=0.007 mean_conflicts=113.40 +ep140 solve_rate=0.003 mean_conflicts=102.39 +ep150 solve_rate=0.003 mean_conflicts=101.91 +[color_full_n50_k3_p0.2_T3_ns3_s0] best solve_rate=0.5033 mean_conflicts=19.497 @ep60 (153.7s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_n50_k3_p0.2_T3_ns3_s0.pt +===== train 1step ===== +ep20 solve_rate=0.000 mean_conflicts=43.71 +ep40 solve_rate=0.120 mean_conflicts=14.24 +ep60 solve_rate=0.250 mean_conflicts=12.98 +ep80 solve_rate=0.273 mean_conflicts=5.86 +ep100 solve_rate=0.237 mean_conflicts=6.15 +ep120 solve_rate=0.257 mean_conflicts=6.03 +ep140 solve_rate=0.223 mean_conflicts=5.50 +ep150 solve_rate=0.283 mean_conflicts=5.19 +[color_1step_n50_k3_p0.2_T3_ns3_s0] best solve_rate=0.2833 mean_conflicts=5.193 @ep150 (121.4s) + wrote /home/yurenh2/rrog/runs/ckpt_color_1step_n50_k3_p0.2_T3_ns3_s0.pt +===== LE diagnostic (lambda1: solved vs unsolved) ===== +[full] LE n=300 fail_rate=0.50 | lambda1 SOLVED mean -0.4828 (n=151) | UNSOLVED mean -0.1333 (n=149) | sep=+0.3495 | AUROC(fail|lambda1)=0.871 | mean_lambda1=-0.3092 +[1step] LE n=300 fail_rate=0.72 | lambda1 SOLVED mean +0.0215 (n=85) | UNSOLVED mean +0.2097 (n=215) | sep=+0.1882 | AUROC(fail|lambda1)=0.814 | mean_lambda1=+0.1564 +done=2026-06-16T10:52:55-05:00 diff --git a/runs/cyc_gcn_none_L5_s0.json b/runs/cyc_gcn_none_L5_s0.json new file mode 100644 index 0000000..8e3a5c2 --- /dev/null +++ b/runs/cyc_gcn_none_L5_s0.json @@ -0,0 +1,32 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "gcn_none_L5_s0", + "conv": "gcn", + "feat": "none", + "layers": 5, + "hidden": 128, + "rni_dim": 16, + "epochs": 200, + "lr": 0.001, + "bs": 128, + "seed": 0, + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "sec": 127.8, + "dev": "cuda", + "ep": 200, + "train_mae": [ + 0.05943963676691055, + 0.08676010370254517 + ], + "val_mae": [ + 0.15079250931739807, + 0.20910263061523438 + ], + "test_mae": [ + 0.1485612541437149, + 0.21971328556537628 + ] +}
\ No newline at end of file diff --git a/runs/cyc_gin_none_L5_s0.json b/runs/cyc_gin_none_L5_s0.json new file mode 100644 index 0000000..7b53fb3 --- /dev/null +++ b/runs/cyc_gin_none_L5_s0.json @@ -0,0 +1,32 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "gin_none_L5_s0", + "conv": "gin", + "feat": "none", + "layers": 5, + "hidden": 128, + "rni_dim": 16, + "epochs": 200, + "lr": 0.001, + "bs": 128, + "seed": 0, + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "sec": 125.5, + "dev": "cuda", + "ep": 200, + "train_mae": [ + 0.00937615055590868, + 0.02337666228413582 + ], + "val_mae": [ + 0.05451786890625954, + 0.09657028317451477 + ], + "test_mae": [ + 0.052763670682907104, + 0.08840502053499222 + ] +}
\ No newline at end of file diff --git a/runs/cyc_gin_rni_L5_s0.json b/runs/cyc_gin_rni_L5_s0.json new file mode 100644 index 0000000..3fb13b3 --- /dev/null +++ b/runs/cyc_gin_rni_L5_s0.json @@ -0,0 +1,32 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "gin_rni_L5_s0", + "conv": "gin", + "feat": "rni", + "layers": 5, + "hidden": 128, + "rni_dim": 16, + "epochs": 200, + "lr": 0.001, + "bs": 128, + "seed": 0, + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "sec": 134.3, + "dev": "cuda", + "ep": 200, + "train_mae": [ + 0.012719802558422089, + 0.02454240433871746 + ], + "val_mae": [ + 0.06555940210819244, + 0.10593626648187637 + ], + "test_mae": [ + 0.052439868450164795, + 0.0945335254073143 + ] +}
\ No newline at end of file diff --git a/runs/cyc_gin_rwse_L5_s0.json b/runs/cyc_gin_rwse_L5_s0.json new file mode 100644 index 0000000..59f13e7 --- /dev/null +++ b/runs/cyc_gin_rwse_L5_s0.json @@ -0,0 +1,32 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "gin_rwse_L5_s0", + "conv": "gin", + "feat": "rwse", + "layers": 5, + "hidden": 128, + "rni_dim": 16, + "epochs": 200, + "lr": 0.001, + "bs": 128, + "seed": 0, + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "sec": 125.3, + "dev": "cuda", + "ep": 200, + "train_mae": [ + 0.005093096289783716, + 0.011449216865003109 + ], + "val_mae": [ + 0.009772364050149918, + 0.020356670022010803 + ], + "test_mae": [ + 0.008741355501115322, + 0.016079651191830635 + ] +}
\ No newline at end of file diff --git a/runs/cycle_sweep.log b/runs/cycle_sweep.log new file mode 100644 index 0000000..04a3494 --- /dev/null +++ b/runs/cycle_sweep.log @@ -0,0 +1,54 @@ +host=timan1.cs.illinois.edu gpu=0 start=2026-06-16T08:59:16-05:00 +===== --conv gin --feat none ===== +ep20 val_mae(c5,c6)=[0.402, 0.44] +ep40 val_mae(c5,c6)=[0.225, 0.404] +ep60 val_mae(c5,c6)=[0.128, 0.188] +ep80 val_mae(c5,c6)=[0.09, 0.169] +ep100 val_mae(c5,c6)=[0.078, 0.124] +ep120 val_mae(c5,c6)=[0.062, 0.106] +ep140 val_mae(c5,c6)=[0.081, 0.136] +ep160 val_mae(c5,c6)=[0.056, 0.104] +ep180 val_mae(c5,c6)=[0.056, 0.097] +ep200 val_mae(c5,c6)=[0.055, 0.097] +[gin_none_L5_s0] train_mae(c5,c6)=[0.009, 0.023] test_mae=[0.053, 0.088] (raw rings; std=[0.78, 0.95]) @ep200 (125.5s) + wrote /home/yurenh2/rrog/runs/cyc_gin_none_L5_s0.json +===== --conv gcn --feat none ===== +ep20 val_mae(c5,c6)=[0.451, 0.691] +ep40 val_mae(c5,c6)=[0.352, 1.192] +ep60 val_mae(c5,c6)=[0.284, 0.438] +ep80 val_mae(c5,c6)=[0.234, 0.287] +ep100 val_mae(c5,c6)=[0.221, 0.333] +ep120 val_mae(c5,c6)=[0.201, 0.369] +ep140 val_mae(c5,c6)=[0.195, 0.264] +ep160 val_mae(c5,c6)=[0.153, 0.212] +ep180 val_mae(c5,c6)=[0.152, 0.212] +ep200 val_mae(c5,c6)=[0.151, 0.209] +[gcn_none_L5_s0] train_mae(c5,c6)=[0.059, 0.087] test_mae=[0.149, 0.22] (raw rings; std=[0.78, 0.95]) @ep200 (127.8s) + wrote /home/yurenh2/rrog/runs/cyc_gcn_none_L5_s0.json +===== --conv gin --feat rni ===== +ep20 val_mae(c5,c6)=[0.212, 0.288] +ep40 val_mae(c5,c6)=[0.161, 0.273] +ep60 val_mae(c5,c6)=[0.116, 0.226] +ep80 val_mae(c5,c6)=[0.14, 0.185] +ep100 val_mae(c5,c6)=[0.095, 0.139] +ep120 val_mae(c5,c6)=[0.08, 0.12] +ep140 val_mae(c5,c6)=[0.073, 0.117] +ep160 val_mae(c5,c6)=[0.069, 0.111] +ep180 val_mae(c5,c6)=[0.067, 0.107] +ep200 val_mae(c5,c6)=[0.066, 0.106] +[gin_rni_L5_s0] train_mae(c5,c6)=[0.013, 0.025] test_mae=[0.052, 0.095] (raw rings; std=[0.78, 0.95]) @ep200 (134.3s) + wrote /home/yurenh2/rrog/runs/cyc_gin_rni_L5_s0.json +===== --conv gin --feat rwse ===== +ep20 val_mae(c5,c6)=[0.09, 0.974] +ep40 val_mae(c5,c6)=[0.074, 0.268] +ep60 val_mae(c5,c6)=[0.069, 0.734] +ep80 val_mae(c5,c6)=[0.041, 0.347] +ep100 val_mae(c5,c6)=[0.054, 0.22] +ep120 val_mae(c5,c6)=[0.028, 0.092] +ep140 val_mae(c5,c6)=[0.017, 0.048] +ep160 val_mae(c5,c6)=[0.017, 0.053] +ep180 val_mae(c5,c6)=[0.01, 0.021] +ep200 val_mae(c5,c6)=[0.01, 0.02] +[gin_rwse_L5_s0] train_mae(c5,c6)=[0.005, 0.011] test_mae=[0.009, 0.016] (raw rings; std=[0.78, 0.95]) @ep200 (125.3s) + wrote /home/yurenh2/rrog/runs/cyc_gin_rwse_L5_s0.json +done=2026-06-16T09:08:37-05:00 diff --git a/runs/diag_csl_gcn_L4_s0.json b/runs/diag_csl_gcn_L4_s0.json new file mode 100644 index 0000000..a244c96 --- /dev/null +++ b/runs/diag_csl_gcn_L4_s0.json @@ -0,0 +1,24 @@ +{ + "task": "csl", + "model": "gcn", + "layers": 4, + "seed": 0, + "kind": null, + "n": 150, + "n_train": 100, + "n_test": 50, + "conv_round": 1, + "sec": 5.3, + "dev": "cuda", + "train_acc": 0.1, + "test_acc": 0.1, + "wl_ceiling_acc_converged": 0.1, + "wl_ceiling_acc_Ldepth": 0.1, + "test_bucket_counts": { + "H2": 50 + }, + "failure_bucket_counts": { + "H2": 45 + }, + "n_failures": 45 +}
\ No newline at end of file diff --git a/runs/diag_csl_gin_L4_s0.json b/runs/diag_csl_gin_L4_s0.json new file mode 100644 index 0000000..d3a2432 --- /dev/null +++ b/runs/diag_csl_gin_L4_s0.json @@ -0,0 +1,24 @@ +{ + "task": "csl", + "model": "gin", + "layers": 4, + "seed": 0, + "kind": null, + "n": 150, + "n_train": 100, + "n_test": 50, + "conv_round": 1, + "sec": 4.9, + "dev": "cuda", + "train_acc": 0.1, + "test_acc": 0.1, + "wl_ceiling_acc_converged": 0.1, + "wl_ceiling_acc_Ldepth": 0.1, + "test_bucket_counts": { + "H2": 50 + }, + "failure_bucket_counts": { + "H2": 45 + }, + "n_failures": 45 +}
\ No newline at end of file diff --git a/runs/diag_sweep_20260616_074509.log b/runs/diag_sweep_20260616_074509.log new file mode 100644 index 0000000..c90d558 --- /dev/null +++ b/runs/diag_sweep_20260616_074509.log @@ -0,0 +1,20 @@ +host=timan1.cs.illinois.edu gpu=0 start=2026-06-16T07:45:09-05:00 +===== --task csl --model gin ===== +[csl/gin] train_acc=0.100 test_acc=0.100 | 1-WL ceiling(conv)=0.100 L-depth=0.100 | failures=45 -> {'H2': 45} + wrote /home/yurenh2/rrog/runs/diag_csl_gin_L4_s0.json +===== --task tri --model gin --kind er ===== +[tri/gin/er] train_mse=3.474 test_mse=4.077 | 1-WL oracle floor(H2)=0.000 | unseen=1.00 singleton=1.00 | learn_gap=4.077 var_y=13.583 + wrote /home/yurenh2/rrog/runs/diag_tri_er_gin_L4_s0.json +===== --task tri --model gin --kind regular ===== +[tri/gin/regular] train_mse=1.582 test_mse=1.486 | 1-WL oracle floor(H2)=1.483 | unseen=0.00 singleton=0.00 | learn_gap=0.002 var_y=1.482 + wrote /home/yurenh2/rrog/runs/diag_tri_regular_gin_L4_s0.json +===== --task csl --model gcn ===== +[csl/gcn] train_acc=0.100 test_acc=0.100 | 1-WL ceiling(conv)=0.100 L-depth=0.100 | failures=45 -> {'H2': 45} + wrote /home/yurenh2/rrog/runs/diag_csl_gcn_L4_s0.json +===== --task tri --model gcn --kind er ===== +[tri/gcn/er] train_mse=15.246 test_mse=13.652 | 1-WL oracle floor(H2)=0.000 | unseen=1.00 singleton=1.00 | learn_gap=13.652 var_y=13.583 + wrote /home/yurenh2/rrog/runs/diag_tri_er_gcn_L4_s0.json +===== --task tri --model gcn --kind regular ===== +[tri/gcn/regular] train_mse=1.582 test_mse=1.485 | 1-WL oracle floor(H2)=1.483 | unseen=0.00 singleton=0.00 | learn_gap=0.001 var_y=1.482 + wrote /home/yurenh2/rrog/runs/diag_tri_regular_gcn_L4_s0.json +done=2026-06-16T07:47:46-05:00 diff --git a/runs/diag_tri_er_gcn_L4_s0.json b/runs/diag_tri_er_gcn_L4_s0.json new file mode 100644 index 0000000..b7ff68e --- /dev/null +++ b/runs/diag_tri_er_gcn_L4_s0.json @@ -0,0 +1,22 @@ +{ + "task": "tri", + "model": "gcn", + "layers": 4, + "seed": 0, + "kind": "er", + "n": 800, + "n_train": 560, + "n_test": 240, + "conv_round": 7, + "sec": 23.9, + "dev": "cuda", + "train_mse": 15.2464, + "test_mse_gin": 13.652, + "mse_floor_oracle_H2": 0.0, + "mse_floor_converged_train": 13.6509, + "mse_floor_Ldepth_train": 13.6509, + "var_target_test": 13.5833, + "frac_test_unseen_color": 1.0, + "frac_test_singleton_color": 1.0, + "learn_gap_test": 13.652 +}
\ No newline at end of file diff --git a/runs/diag_tri_er_gin_L4_s0.json b/runs/diag_tri_er_gin_L4_s0.json new file mode 100644 index 0000000..9c246bf --- /dev/null +++ b/runs/diag_tri_er_gin_L4_s0.json @@ -0,0 +1,22 @@ +{ + "task": "tri", + "model": "gin", + "layers": 4, + "seed": 0, + "kind": "er", + "n": 800, + "n_train": 560, + "n_test": 240, + "conv_round": 7, + "sec": 26.0, + "dev": "cuda", + "train_mse": 3.4742, + "test_mse_gin": 4.0773, + "mse_floor_oracle_H2": 0.0, + "mse_floor_converged_train": 13.6509, + "mse_floor_Ldepth_train": 13.6509, + "var_target_test": 13.5833, + "frac_test_unseen_color": 1.0, + "frac_test_singleton_color": 1.0, + "learn_gap_test": 4.0773 +}
\ No newline at end of file diff --git a/runs/diag_tri_gin_L4_s0.json b/runs/diag_tri_gin_L4_s0.json new file mode 100644 index 0000000..432c669 --- /dev/null +++ b/runs/diag_tri_gin_L4_s0.json @@ -0,0 +1,20 @@ +{ + "task": "tri", + "model": "gin", + "layers": 4, + "seed": 0, + "n": 800, + "n_train": 560, + "n_test": 240, + "conv_round": 1, + "sec": 4.9, + "dev": "cuda", + "test_mse_gin": 13820393400.4686, + "mse_floor_oracle_H2": 1.4835, + "mse_floor_converged_train": 1.4854, + "mse_floor_Ldepth_train": 1.4854, + "var_target_test": 1.4816, + "frac_test_unseen_color": 0.0, + "frac_test_singleton_color": 0.0, + "learn_gap": 13820393398.9851 +}
\ No newline at end of file diff --git a/runs/diag_tri_regular_gcn_L4_s0.json b/runs/diag_tri_regular_gcn_L4_s0.json new file mode 100644 index 0000000..e9c70f5 --- /dev/null +++ b/runs/diag_tri_regular_gcn_L4_s0.json @@ -0,0 +1,22 @@ +{ + "task": "tri", + "model": "gcn", + "layers": 4, + "seed": 0, + "kind": "regular", + "n": 800, + "n_train": 560, + "n_test": 240, + "conv_round": 1, + "sec": 24.2, + "dev": "cuda", + "train_mse": 1.5822, + "test_mse_gin": 1.4847, + "mse_floor_oracle_H2": 1.4835, + "mse_floor_converged_train": 1.4854, + "mse_floor_Ldepth_train": 1.4854, + "var_target_test": 1.4816, + "frac_test_unseen_color": 0.0, + "frac_test_singleton_color": 0.0, + "learn_gap_test": 0.0012 +}
\ No newline at end of file diff --git a/runs/diag_tri_regular_gin_L4_s0.json b/runs/diag_tri_regular_gin_L4_s0.json new file mode 100644 index 0000000..b4c06d7 --- /dev/null +++ b/runs/diag_tri_regular_gin_L4_s0.json @@ -0,0 +1,22 @@ +{ + "task": "tri", + "model": "gin", + "layers": 4, + "seed": 0, + "kind": "regular", + "n": 800, + "n_train": 560, + "n_test": 240, + "conv_round": 1, + "sec": 25.1, + "dev": "cuda", + "train_mse": 1.5821, + "test_mse_gin": 1.4857, + "mse_floor_oracle_H2": 1.4835, + "mse_floor_converged_train": 1.4854, + "mse_floor_Ldepth_train": 1.4854, + "var_target_test": 1.4816, + "frac_test_unseen_color": 0.0, + "frac_test_singleton_color": 0.0, + "learn_gap_test": 0.0022 +}
\ No newline at end of file diff --git a/runs/esan_sweep.log b/runs/esan_sweep.log new file mode 100644 index 0000000..ffcdb42 --- /dev/null +++ b/runs/esan_sweep.log @@ -0,0 +1,58 @@ +PNA done -> ESAN +ESAN start gpu=0 2026-06-17T04:49:09-05:00 +== esan s0 == +ep20 solve=0.053 +ep40 solve=0.313 +ep60 solve=0.367 +ep80 solve=0.270 +ep100 solve=0.467 +ep120 solve=0.487 +ep140 solve=0.473 +ep150 solve=0.497 +[esan/full] solve=0.497 LE AUROC=0.790 mean_lam=+0.084 passK=0.513 lamsel=0.513 (486s) + wrote esan_full_none_n50_k3_p0.2_T3_ns3_s0 +== esan s1 == +ep20 solve=0.063 +ep40 solve=0.260 +ep60 solve=0.290 +ep80 solve=0.310 +ep100 solve=0.340 +ep120 solve=0.417 +ep140 solve=0.483 +ep150 solve=0.457 +[esan/full] solve=0.483 LE AUROC=0.791 mean_lam=+0.109 passK=0.453 lamsel=0.453 (487s) + wrote esan_full_none_n50_k3_p0.2_T3_ns3_s1 +== esan s2 == +ep20 solve=0.063 +ep40 solve=0.317 +ep60 solve=0.327 +ep80 solve=0.543 +ep100 solve=0.650 +ep120 solve=0.713 +ep140 solve=0.663 +ep150 solve=0.687 +[esan/full] solve=0.713 LE AUROC=0.887 mean_lam=+0.025 passK=0.773 lamsel=0.773 (486s) + wrote esan_full_none_n50_k3_p0.2_T3_ns3_s2 +== esan s3 == +ep20 solve=0.063 +ep40 solve=0.233 +ep60 solve=0.397 +ep80 solve=0.373 +ep100 solve=0.487 +ep120 solve=0.463 +ep140 solve=0.537 +ep150 solve=0.563 +[esan/full] solve=0.563 LE AUROC=0.651 mean_lam=+0.150 passK=0.613 lamsel=0.613 (487s) + wrote esan_full_none_n50_k3_p0.2_T3_ns3_s3 +== esan s4 == +ep20 solve=0.020 +ep40 solve=0.343 +ep60 solve=0.407 +ep80 solve=0.537 +ep100 solve=0.670 +ep120 solve=0.667 +ep140 solve=0.670 +ep150 solve=0.650 +[esan/full] solve=0.670 LE AUROC=0.826 mean_lam=+0.049 passK=0.720 lamsel=0.720 (488s) + wrote esan_full_none_n50_k3_p0.2_T3_ns3_s4 +doneESAN=2026-06-17T05:30:33-05:00 diff --git a/runs/ff_sweep.log b/runs/ff_sweep.log new file mode 100644 index 0000000..a91967f --- /dev/null +++ b/runs/ff_sweep.log @@ -0,0 +1,20 @@ +FF start gpu=0 2026-06-17T09:36:53-05:00 +[ff/gcn/L4/s0] solve=0.007 +[ff/gcn/L4/s1] solve=0.007 +[ff/gcn/L4/s2] solve=0.007 +[ff/gcn/L8/s0] solve=0.017 +[ff/gcn/L8/s1] solve=0.013 +[ff/gcn/L8/s2] solve=0.020 +[ff/gcn/L16/s0] solve=0.000 +[ff/gcn/L16/s1] solve=0.000 +[ff/gcn/L16/s2] solve=0.000 +[ff/gat/L4/s0] solve=0.000 +[ff/gat/L4/s1] solve=0.003 +[ff/gat/L4/s2] solve=0.000 +[ff/gat/L8/s0] solve=0.000 +[ff/gat/L8/s1] solve=0.000 +[ff/gat/L8/s2] solve=0.000 +[ff/gat/L16/s0] solve=0.000 +[ff/gat/L16/s1] solve=0.000 +[ff/gat/L16/s2] solve=0.000 +doneFF=2026-06-17T11:34:28-05:00 diff --git a/runs/le_color_1step_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/le_color_1step_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..79bb648 --- /dev/null +++ b/runs/le_color_1step_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,12 @@ +{ + "grad_mode": "1step", + "pe": "none", + "seed": 0, + "n": 300, + "fail_rate": 0.8, + "auroc": 0.7704861111111111, + "sep": 0.17692238994714662, + "lam_solved": -0.2978147272290058, + "lam_unsolved": -0.12089233728185919, + "mean_lam": -0.15627681527128853 +}
\ No newline at end of file diff --git a/runs/le_color_1step_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/le_color_1step_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..1f789af --- /dev/null +++ b/runs/le_color_1step_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,12 @@ +{ + "grad_mode": "1step", + "pe": "none", + "seed": 1, + "n": 300, + "fail_rate": 0.6666666666666666, + "auroc": 0.8459000000000001, + "sep": 0.29627635299530486, + "lam_solved": -0.27734302583486875, + "lam_unsolved": 0.018933327160436116, + "mean_lam": -0.07982545717133217 +}
\ No newline at end of file diff --git a/runs/le_color_1step_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/le_color_1step_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..ab7d7fb --- /dev/null +++ b/runs/le_color_1step_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,12 @@ +{ + "grad_mode": "1step", + "pe": "none", + "seed": 2, + "n": 300, + "fail_rate": 0.6433333333333333, + "auroc": 0.8665439930269722, + "sep": 0.30687106563423694, + "lam_solved": -0.21527756840739037, + "lam_unsolved": 0.09159349722684659, + "mean_lam": -0.01785718284936458 +}
\ No newline at end of file diff --git a/runs/le_color_1step_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/le_color_1step_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..ecbf3c4 --- /dev/null +++ b/runs/le_color_1step_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,12 @@ +{ + "grad_mode": "1step", + "pe": "none", + "seed": 3, + "n": 300, + "fail_rate": 0.6633333333333333, + "auroc": 0.7862580227872034, + "sep": 0.18177656397526462, + "lam_solved": -0.01236024695468813, + "lam_unsolved": 0.1694163170205765, + "mean_lam": 0.10821820714890407 +}
\ No newline at end of file diff --git a/runs/le_color_1step_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/le_color_1step_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..50cddc9 --- /dev/null +++ b/runs/le_color_1step_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,12 @@ +{ + "grad_mode": "1step", + "pe": "none", + "seed": 4, + "n": 300, + "fail_rate": 0.7633333333333333, + "auroc": 0.8352912233224676, + "sep": 0.2472765305163136, + "lam_solved": -0.299572467096354, + "lam_unsolved": -0.0522959365800404, + "mean_lam": -0.11081804880223461 +}
\ No newline at end of file diff --git a/runs/le_color_cin_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/le_color_cin_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..28e195f --- /dev/null +++ b/runs/le_color_cin_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1 @@ +{"conv": "cin", "pe": "none", "grad_mode": "full", "contract": false, "seed": 0, "auroc": 0.7627027990729185, "mean_lam": 0.07398854013587206}
\ No newline at end of file diff --git a/runs/le_color_cin_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/le_color_cin_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..1592377 --- /dev/null +++ b/runs/le_color_cin_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1 @@ +{"conv": "cin", "pe": "none", "grad_mode": "full", "contract": false, "seed": 1, "auroc": 0.7631720913504765, "mean_lam": 0.13374968373699594}
\ No newline at end of file diff --git a/runs/le_color_cin_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/le_color_cin_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..8824de9 --- /dev/null +++ b/runs/le_color_cin_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1 @@ +{"conv": "cin", "pe": "none", "grad_mode": "full", "contract": false, "seed": 2, "auroc": 0.7134841628959276, "mean_lam": 0.08663227541678578}
\ No newline at end of file diff --git a/runs/le_color_cin_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/le_color_cin_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..4bf55d7 --- /dev/null +++ b/runs/le_color_cin_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1 @@ +{"conv": "cin", "pe": "none", "grad_mode": "full", "contract": false, "seed": 3, "auroc": 0.654508797653959, "mean_lam": 0.16228838449736402}
\ No newline at end of file diff --git a/runs/le_color_cin_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/le_color_cin_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..6756f6b --- /dev/null +++ b/runs/le_color_cin_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1 @@ +{"conv": "cin", "pe": "none", "grad_mode": "full", "contract": false, "seed": 4, "auroc": 0.7523622749153146, "mean_lam": 0.12296970983169525}
\ No newline at end of file diff --git a/runs/le_color_esan_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/le_color_esan_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..96eca89 --- /dev/null +++ b/runs/le_color_esan_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1 @@ +{"conv": "esan", "pe": "none", "grad_mode": "full", "contract": false, "seed": 0, "auroc": 0.7902508450453656, "mean_lam": 0.08353524500741279}
\ No newline at end of file diff --git a/runs/le_color_esan_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/le_color_esan_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..1cff3e5 --- /dev/null +++ b/runs/le_color_esan_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1 @@ +{"conv": "esan", "pe": "none", "grad_mode": "full", "contract": false, "seed": 1, "auroc": 0.7905308464849355, "mean_lam": 0.10852073952883344}
\ No newline at end of file diff --git a/runs/le_color_esan_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/le_color_esan_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..79cfa33 --- /dev/null +++ b/runs/le_color_esan_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1 @@ +{"conv": "esan", "pe": "none", "grad_mode": "full", "contract": false, "seed": 2, "auroc": 0.8874239350912778, "mean_lam": 0.025470853106484417}
\ No newline at end of file diff --git a/runs/le_color_esan_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/le_color_esan_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..9ba5357 --- /dev/null +++ b/runs/le_color_esan_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1 @@ +{"conv": "esan", "pe": "none", "grad_mode": "full", "contract": false, "seed": 3, "auroc": 0.6510494752623688, "mean_lam": 0.1498462958365713}
\ No newline at end of file diff --git a/runs/le_color_esan_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/le_color_esan_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..2817267 --- /dev/null +++ b/runs/le_color_esan_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1 @@ +{"conv": "esan", "pe": "none", "grad_mode": "full", "contract": false, "seed": 4, "auroc": 0.826058201058201, "mean_lam": 0.0494715114729479}
\ No newline at end of file diff --git a/runs/le_color_full_gsn_n50_k3_p0.2_T3_ns3_s0.json b/runs/le_color_full_gsn_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..c70cc10 --- /dev/null +++ b/runs/le_color_full_gsn_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,12 @@ +{ + "grad_mode": "full", + "pe": "gsn", + "seed": 0, + "n": 300, + "fail_rate": 0.3566666666666667, + "auroc": 0.8982615853953804, + "sep": 0.35803423783369703, + "lam_solved": -0.34035963701800304, + "lam_unsolved": 0.017674600815693997, + "mean_lam": -0.2126607588573178 +}
\ No newline at end of file diff --git a/runs/le_color_full_gsn_n50_k3_p0.2_T3_ns3_s1.json b/runs/le_color_full_gsn_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..4953be4 --- /dev/null +++ b/runs/le_color_full_gsn_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,12 @@ +{ + "grad_mode": "full", + "pe": "gsn", + "seed": 1, + "n": 300, + "fail_rate": 0.4666666666666667, + "auroc": 0.85375, + "sep": 0.2892627108727711, + "lam_solved": -0.25632031088160956, + "lam_unsolved": 0.03294239999116158, + "mean_lam": -0.1213310458076497 +}
\ No newline at end of file diff --git a/runs/le_color_full_gsn_n50_k3_p0.2_T3_ns3_s2.json b/runs/le_color_full_gsn_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..7f6d1ec --- /dev/null +++ b/runs/le_color_full_gsn_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,12 @@ +{ + "grad_mode": "full", + "pe": "gsn", + "seed": 2, + "n": 300, + "fail_rate": 0.35, + "auroc": 0.838827838827839, + "sep": 0.3273356129052927, + "lam_solved": -0.38730427610735674, + "lam_unsolved": -0.05996866320206401, + "mean_lam": -0.2727368115905043 +}
\ No newline at end of file diff --git a/runs/le_color_full_gsn_n50_k3_p0.2_T3_ns3_s3.json b/runs/le_color_full_gsn_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..df024b6 --- /dev/null +++ b/runs/le_color_full_gsn_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,12 @@ +{ + "grad_mode": "full", + "pe": "gsn", + "seed": 3, + "n": 300, + "fail_rate": 0.42333333333333334, + "auroc": 0.8570388239042375, + "sep": 0.29659789015355364, + "lam_solved": -0.29392590991084694, + "lam_unsolved": 0.002671980242706691, + "mean_lam": -0.16836613641250922 +}
\ No newline at end of file diff --git a/runs/le_color_full_gsn_n50_k3_p0.2_T3_ns3_s4.json b/runs/le_color_full_gsn_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..dcf0d12 --- /dev/null +++ b/runs/le_color_full_gsn_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,12 @@ +{ + "grad_mode": "full", + "pe": "gsn", + "seed": 4, + "n": 300, + "fail_rate": 0.42333333333333334, + "auroc": 0.8897182649856629, + "sep": 0.3100360129828437, + "lam_solved": -0.30639521868468567, + "lam_unsolved": 0.0036407942981580657, + "mean_lam": -0.17514663985528187 +}
\ No newline at end of file diff --git a/runs/le_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s0.json b/runs/le_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..2dfc2ce --- /dev/null +++ b/runs/le_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,13 @@ +{ + "grad_mode": "full", + "pe": "none", + "contract": true, + "seed": 0, + "n": 300, + "fail_rate": 1.0, + "auroc": NaN, + "sep": NaN, + "lam_solved": null, + "lam_unsolved": -0.6307877821110769, + "mean_lam": -0.6307877821110769 +}
\ No newline at end of file diff --git a/runs/le_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s1.json b/runs/le_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..27ee082 --- /dev/null +++ b/runs/le_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,13 @@ +{ + "grad_mode": "full", + "pe": "none", + "contract": true, + "seed": 1, + "n": 300, + "fail_rate": 1.0, + "auroc": NaN, + "sep": NaN, + "lam_solved": null, + "lam_unsolved": -1.047869036831134, + "mean_lam": -1.047869036831134 +}
\ No newline at end of file diff --git a/runs/le_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s2.json b/runs/le_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..f1ac24d --- /dev/null +++ b/runs/le_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,13 @@ +{ + "grad_mode": "full", + "pe": "none", + "contract": true, + "seed": 2, + "n": 300, + "fail_rate": 1.0, + "auroc": NaN, + "sep": NaN, + "lam_solved": null, + "lam_unsolved": -0.988645583950673, + "mean_lam": -0.988645583950673 +}
\ No newline at end of file diff --git a/runs/le_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s3.json b/runs/le_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..4267ba7 --- /dev/null +++ b/runs/le_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,13 @@ +{ + "grad_mode": "full", + "pe": "none", + "contract": true, + "seed": 3, + "n": 300, + "fail_rate": 1.0, + "auroc": NaN, + "sep": NaN, + "lam_solved": null, + "lam_unsolved": -0.5764816490510163, + "mean_lam": -0.5764816490510163 +}
\ No newline at end of file diff --git a/runs/le_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s4.json b/runs/le_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..f7622b5 --- /dev/null +++ b/runs/le_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,13 @@ +{ + "grad_mode": "full", + "pe": "none", + "contract": true, + "seed": 4, + "n": 300, + "fail_rate": 1.0, + "auroc": NaN, + "sep": NaN, + "lam_solved": null, + "lam_unsolved": -0.7751220583778976, + "mean_lam": -0.7751220583778976 +}
\ No newline at end of file diff --git a/runs/le_color_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/le_color_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..1928960 --- /dev/null +++ b/runs/le_color_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,12 @@ +{ + "grad_mode": "full", + "pe": "none", + "seed": 0, + "n": 300, + "fail_rate": 0.39, + "auroc": 0.9187333613563121, + "sep": 0.36915687154651744, + "lam_solved": -0.3206477810760501, + "lam_unsolved": 0.04850909047046736, + "mean_lam": -0.1766766011729083 +}
\ No newline at end of file diff --git a/runs/le_color_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/le_color_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..fe44e6a --- /dev/null +++ b/runs/le_color_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,12 @@ +{ + "grad_mode": "full", + "pe": "none", + "seed": 1, + "n": 300, + "fail_rate": 0.5466666666666666, + "auroc": 0.8641499282639885, + "sep": 0.2756670027758962, + "lam_solved": -0.3182340920534473, + "lam_unsolved": -0.04256708927755117, + "mean_lam": -0.16753613053595742 +}
\ No newline at end of file diff --git a/runs/le_color_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/le_color_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..2b1a5cc --- /dev/null +++ b/runs/le_color_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,12 @@ +{ + "grad_mode": "full", + "pe": "none", + "seed": 2, + "n": 300, + "fail_rate": 0.5866666666666667, + "auroc": 0.8303702346041055, + "sep": 0.21174650838964304, + "lam_solved": -0.29134582768622963, + "lam_unsolved": -0.0795993192965866, + "mean_lam": -0.1671212094309724 +}
\ No newline at end of file diff --git a/runs/le_color_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/le_color_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..632cb67 --- /dev/null +++ b/runs/le_color_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,12 @@ +{ + "grad_mode": "full", + "pe": "none", + "seed": 3, + "n": 300, + "fail_rate": 0.54, + "auroc": 0.8864734299516908, + "sep": 0.33899259038282137, + "lam_solved": -0.42155256822806314, + "lam_unsolved": -0.08255997784524179, + "mean_lam": -0.23849656942133962 +}
\ No newline at end of file diff --git a/runs/le_color_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/le_color_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..9627001 --- /dev/null +++ b/runs/le_color_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,12 @@ +{ + "grad_mode": "full", + "pe": "none", + "seed": 4, + "n": 300, + "fail_rate": 0.6533333333333333, + "auroc": 0.8417386185243327, + "sep": 0.2567499832492072, + "lam_solved": -0.40076147058114775, + "lam_unsolved": -0.14401148733194052, + "mean_lam": -0.23301814819166566 +}
\ No newline at end of file diff --git a/runs/le_color_full_rwse_n50_k3_p0.2_T3_ns3_s0.json b/runs/le_color_full_rwse_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..097a3a3 --- /dev/null +++ b/runs/le_color_full_rwse_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,12 @@ +{ + "grad_mode": "full", + "pe": "rwse", + "seed": 0, + "n": 300, + "fail_rate": 0.6166666666666667, + "auroc": 0.8173913043478261, + "sep": 0.19336201375907117, + "lam_solved": -0.1833865268431505, + "lam_unsolved": 0.009975486915920677, + "mean_lam": -0.06414661835838995 +}
\ No newline at end of file diff --git a/runs/le_color_full_rwse_n50_k3_p0.2_T3_ns3_s1.json b/runs/le_color_full_rwse_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..6beaf15 --- /dev/null +++ b/runs/le_color_full_rwse_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,12 @@ +{ + "grad_mode": "full", + "pe": "rwse", + "seed": 1, + "n": 300, + "fail_rate": 0.4633333333333333, + "auroc": 0.7742973323204789, + "sep": 0.15543756282073046, + "lam_solved": 0.02188775661090568, + "lam_unsolved": 0.17732531943163615, + "mean_lam": 0.09390716071784415 +}
\ No newline at end of file diff --git a/runs/le_color_full_rwse_n50_k3_p0.2_T3_ns3_s2.json b/runs/le_color_full_rwse_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..ca15bcd --- /dev/null +++ b/runs/le_color_full_rwse_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,12 @@ +{ + "grad_mode": "full", + "pe": "rwse", + "seed": 2, + "n": 300, + "fail_rate": 0.44, + "auroc": 0.882711038961039, + "sep": 0.30343676796421315, + "lam_solved": -0.23277661128446367, + "lam_unsolved": 0.07066015667974951, + "mean_lam": -0.09926443338020986 +}
\ No newline at end of file diff --git a/runs/le_color_full_rwse_n50_k3_p0.2_T3_ns3_s3.json b/runs/le_color_full_rwse_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..8011dc0 --- /dev/null +++ b/runs/le_color_full_rwse_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,12 @@ +{ + "grad_mode": "full", + "pe": "rwse", + "seed": 3, + "n": 300, + "fail_rate": 0.51, + "auroc": 0.8299319727891156, + "sep": 0.20560663420246325, + "lam_solved": -0.04382999812552701, + "lam_unsolved": 0.16177663607693624, + "mean_lam": 0.061029385317729244 +}
\ No newline at end of file diff --git a/runs/le_color_full_rwse_n50_k3_p0.2_T3_ns3_s4.json b/runs/le_color_full_rwse_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..081bb6b --- /dev/null +++ b/runs/le_color_full_rwse_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,12 @@ +{ + "grad_mode": "full", + "pe": "rwse", + "seed": 4, + "n": 300, + "fail_rate": 0.4533333333333333, + "auroc": 0.8797973457675753, + "sep": 0.2826686345638501, + "lam_solved": -0.1742354800275462, + "lam_unsolved": 0.10843315453630388, + "mean_lam": -0.04609236569193416 +}
\ No newline at end of file diff --git a/runs/le_color_full_sub_n50_k3_p0.2_T3_ns3_s0.json b/runs/le_color_full_sub_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..2dd7285 --- /dev/null +++ b/runs/le_color_full_sub_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,13 @@ +{ + "grad_mode": "full", + "pe": "sub", + "contract": false, + "seed": 0, + "n": 300, + "fail_rate": 0.29, + "auroc": 0.8854352166639685, + "sep": 0.371421663181259, + "lam_solved": -0.33706009613483473, + "lam_unsolved": 0.034361567046424304, + "mean_lam": -0.2293478138122696 +}
\ No newline at end of file diff --git a/runs/le_color_full_sub_n50_k3_p0.2_T3_ns3_s1.json b/runs/le_color_full_sub_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..5c26620 --- /dev/null +++ b/runs/le_color_full_sub_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,13 @@ +{ + "grad_mode": "full", + "pe": "sub", + "contract": false, + "seed": 1, + "n": 300, + "fail_rate": 0.43, + "auroc": 0.9283739063420826, + "sep": 0.3461654921982069, + "lam_solved": -0.31389610731037476, + "lam_unsolved": 0.032269384887832125, + "mean_lam": -0.1650449456651458 +}
\ No newline at end of file diff --git a/runs/le_color_full_sub_n50_k3_p0.2_T3_ns3_s2.json b/runs/le_color_full_sub_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..4b0a09c --- /dev/null +++ b/runs/le_color_full_sub_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,13 @@ +{ + "grad_mode": "full", + "pe": "sub", + "contract": false, + "seed": 2, + "n": 300, + "fail_rate": 0.33, + "auroc": 0.9373837881300568, + "sep": 0.4122078550399701, + "lam_solved": -0.36501360948855494, + "lam_unsolved": 0.04719424555141518, + "mean_lam": -0.22898501732536478 +}
\ No newline at end of file diff --git a/runs/le_color_full_sub_n50_k3_p0.2_T3_ns3_s3.json b/runs/le_color_full_sub_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..714ead1 --- /dev/null +++ b/runs/le_color_full_sub_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,13 @@ +{ + "grad_mode": "full", + "pe": "sub", + "contract": false, + "seed": 3, + "n": 300, + "fail_rate": 0.7466666666666667, + "auroc": 0.8052749060150376, + "sep": 0.18687849755263247, + "lam_solved": -0.37974399775664913, + "lam_unsolved": -0.19286550020401666, + "mean_lam": -0.2402080529173502 +}
\ No newline at end of file diff --git a/runs/le_color_full_sub_n50_k3_p0.2_T3_ns3_s4.json b/runs/le_color_full_sub_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..2f17fb7 --- /dev/null +++ b/runs/le_color_full_sub_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,13 @@ +{ + "grad_mode": "full", + "pe": "sub", + "contract": false, + "seed": 4, + "n": 300, + "fail_rate": 0.37666666666666665, + "auroc": 0.9398514031517676, + "sep": 0.40571009494029864, + "lam_solved": -0.3912686726042387, + "lam_unsolved": 0.014441422336059918, + "mean_lam": -0.2384512035100596 +}
\ No newline at end of file diff --git a/runs/le_color_gat_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/le_color_gat_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..119b039 --- /dev/null +++ b/runs/le_color_gat_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,14 @@ +{ + "conv": "gat", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 0, + "n": 300, + "fail_rate": 0.9866666666666667, + "auroc": 0.35304054054054057, + "sep": -0.08434677179811781, + "lam_solved": -0.21130188492437205, + "lam_unsolved": -0.29564865672248986, + "mean_lam": -0.294524033098515 +}
\ No newline at end of file diff --git a/runs/le_color_gat_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/le_color_gat_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..d138938 --- /dev/null +++ b/runs/le_color_gat_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,14 @@ +{ + "conv": "gat", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 1, + "n": 300, + "fail_rate": 0.9933333333333333, + "auroc": 0.087248322147651, + "sep": -0.15258480964050894, + "lam_solved": -0.1005014719751974, + "lam_unsolved": -0.25308628161570634, + "mean_lam": -0.2520690495514362 +}
\ No newline at end of file diff --git a/runs/le_color_gat_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/le_color_gat_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..dd33101 --- /dev/null +++ b/runs/le_color_gat_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,14 @@ +{ + "conv": "gat", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 2, + "n": 300, + "fail_rate": 0.9966666666666667, + "auroc": 0.14715719063545152, + "sep": -0.11967090781858178, + "lam_solved": -0.133104228725036, + "lam_unsolved": -0.2527751365436178, + "mean_lam": -0.25237623351755584 +}
\ No newline at end of file diff --git a/runs/le_color_gat_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/le_color_gat_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..e8465b0 --- /dev/null +++ b/runs/le_color_gat_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,14 @@ +{ + "conv": "gat", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 3, + "n": 300, + "fail_rate": 0.9, + "auroc": 0.5854320987654321, + "sep": 0.03350021469580089, + "lam_solved": -0.09700316947591664, + "lam_unsolved": -0.06350295478011575, + "mean_lam": -0.06685297624969583 +}
\ No newline at end of file diff --git a/runs/le_color_gat_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/le_color_gat_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..d2fc632 --- /dev/null +++ b/runs/le_color_gat_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,14 @@ +{ + "conv": "gat", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 4, + "n": 300, + "fail_rate": 0.92, + "auroc": 0.4227053140096618, + "sep": -0.03209031551551487, + "lam_solved": 0.013302566394418977, + "lam_unsolved": -0.01878774912109589, + "mean_lam": -0.0162205238798547 +}
\ No newline at end of file diff --git a/runs/le_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/le_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..23780b9 --- /dev/null +++ b/runs/le_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,14 @@ +{ + "conv": "gcn", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 0, + "n": 300, + "fail_rate": 1.0, + "auroc": NaN, + "sep": NaN, + "lam_solved": null, + "lam_unsolved": -1.2761640768029072, + "mean_lam": -1.2761640768029072 +}
\ No newline at end of file diff --git a/runs/le_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/le_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..e0ccaaf --- /dev/null +++ b/runs/le_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,14 @@ +{ + "conv": "gcn", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 1, + "n": 300, + "fail_rate": 0.9966666666666667, + "auroc": 0.8929765886287625, + "sep": 0.12979977201457832, + "lam_solved": -0.23425789011849296, + "lam_unsolved": -0.10445811810391464, + "mean_lam": -0.1048907840106299 +}
\ No newline at end of file diff --git a/runs/le_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/le_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..3fb8258 --- /dev/null +++ b/runs/le_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,14 @@ +{ + "conv": "gcn", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 2, + "n": 300, + "fail_rate": 0.9966666666666667, + "auroc": 0.3010033444816054, + "sep": -0.04060677371960947, + "lam_solved": -0.22116798617773586, + "lam_unsolved": -0.26177475989734533, + "mean_lam": -0.2616394039849466 +}
\ No newline at end of file diff --git a/runs/le_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/le_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..6130217 --- /dev/null +++ b/runs/le_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,14 @@ +{ + "conv": "gcn", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 3, + "n": 300, + "fail_rate": 0.9966666666666667, + "auroc": 0.6722408026755853, + "sep": 0.04162079442172012, + "lam_solved": -0.3715861423148049, + "lam_unsolved": -0.3299653478930848, + "mean_lam": -0.3301040838744905 +}
\ No newline at end of file diff --git a/runs/le_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/le_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..8567fac --- /dev/null +++ b/runs/le_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,14 @@ +{ + "conv": "gcn", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 4, + "n": 300, + "fail_rate": 0.9966666666666667, + "auroc": 0.9431438127090301, + "sep": 0.13671148504996603, + "lam_solved": -0.2536296047684219, + "lam_unsolved": -0.11691811971845587, + "mean_lam": -0.11737382466862244 +}
\ No newline at end of file diff --git a/runs/le_color_gin_full_all_n50_k3_p0.2_T3_ns3_s0.json b/runs/le_color_gin_full_all_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..6ce761a --- /dev/null +++ b/runs/le_color_gin_full_all_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,14 @@ +{ + "conv": "gin", + "grad_mode": "full", + "pe": "all", + "contract": false, + "seed": 0, + "n": 300, + "fail_rate": 0.33, + "auroc": 0.875119352731293, + "sep": 0.39282084404068157, + "lam_solved": -0.3723896080101707, + "lam_unsolved": 0.02043123603051091, + "mean_lam": -0.24275872947674576 +}
\ No newline at end of file diff --git a/runs/le_color_gin_full_all_n50_k3_p0.2_T3_ns3_s1.json b/runs/le_color_gin_full_all_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..c50870c --- /dev/null +++ b/runs/le_color_gin_full_all_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,14 @@ +{ + "conv": "gin", + "grad_mode": "full", + "pe": "all", + "contract": false, + "seed": 1, + "n": 300, + "fail_rate": 0.29333333333333333, + "auroc": 0.8694253859348199, + "sep": 0.3051520100323088, + "lam_solved": -0.21418917401960944, + "lam_unsolved": 0.09096283601269936, + "mean_lam": -0.12467791774346551 +}
\ No newline at end of file diff --git a/runs/le_color_gin_full_all_n50_k3_p0.2_T3_ns3_s2.json b/runs/le_color_gin_full_all_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..001fff1 --- /dev/null +++ b/runs/le_color_gin_full_all_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,14 @@ +{ + "conv": "gin", + "grad_mode": "full", + "pe": "all", + "contract": false, + "seed": 2, + "n": 300, + "fail_rate": 0.6666666666666666, + "auroc": 0.62255, + "sep": 0.11030953636694896, + "lam_solved": -0.3633558039967869, + "lam_unsolved": -0.25304626762983795, + "mean_lam": -0.2898161130854876 +}
\ No newline at end of file diff --git a/runs/le_color_gin_full_all_n50_k3_p0.2_T3_ns3_s3.json b/runs/le_color_gin_full_all_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..689c02a --- /dev/null +++ b/runs/le_color_gin_full_all_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,14 @@ +{ + "conv": "gin", + "grad_mode": "full", + "pe": "all", + "contract": false, + "seed": 3, + "n": 300, + "fail_rate": 0.5433333333333333, + "auroc": 0.8387443464242533, + "sep": 0.27962101447452803, + "lam_solved": -0.2652154538338771, + "lam_unsolved": 0.0144055606406509, + "mean_lam": -0.11328803596938357 +}
\ No newline at end of file diff --git a/runs/le_color_gin_full_all_n50_k3_p0.2_T3_ns3_s4.json b/runs/le_color_gin_full_all_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..338c14b --- /dev/null +++ b/runs/le_color_gin_full_all_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,14 @@ +{ + "conv": "gin", + "grad_mode": "full", + "pe": "all", + "contract": false, + "seed": 4, + "n": 300, + "fail_rate": 0.43333333333333335, + "auroc": 0.8791855203619909, + "sep": 0.34873692015189584, + "lam_solved": -0.37620393001391506, + "lam_unsolved": -0.027467009862019227, + "mean_lam": -0.2250845979480935 +}
\ No newline at end of file diff --git a/runs/le_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s0.json b/runs/le_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..27ce86b --- /dev/null +++ b/runs/le_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,14 @@ +{ + "conv": "gin", + "grad_mode": "full", + "pe": "lappe", + "contract": false, + "seed": 0, + "n": 300, + "fail_rate": 0.61, + "auroc": 0.8431180234458923, + "sep": 0.23954686694875665, + "lam_solved": -0.24919056584773336, + "lam_unsolved": -0.009643698898976713, + "mean_lam": -0.10306697700899181 +}
\ No newline at end of file diff --git a/runs/le_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s1.json b/runs/le_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..d96a7ab --- /dev/null +++ b/runs/le_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,14 @@ +{ + "conv": "gin", + "grad_mode": "full", + "pe": "lappe", + "contract": false, + "seed": 1, + "n": 300, + "fail_rate": 0.4066666666666667, + "auroc": 0.8900349972370603, + "sep": 0.25754704093557873, + "lam_solved": -0.23253211094147053, + "lam_unsolved": 0.025014929994108197, + "mean_lam": -0.1277963142943352 +}
\ No newline at end of file diff --git a/runs/le_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s2.json b/runs/le_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..acdd56b --- /dev/null +++ b/runs/le_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,14 @@ +{ + "conv": "gin", + "grad_mode": "full", + "pe": "lappe", + "contract": false, + "seed": 2, + "n": 300, + "fail_rate": 0.6266666666666667, + "auroc": 0.8214285714285715, + "sep": 0.20622674168925886, + "lam_solved": -0.20602498477854253, + "lam_unsolved": 0.00020175691071634133, + "mean_lam": -0.07678955998660697 +}
\ No newline at end of file diff --git a/runs/le_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s3.json b/runs/le_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..05dfcaa --- /dev/null +++ b/runs/le_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,14 @@ +{ + "conv": "gin", + "grad_mode": "full", + "pe": "lappe", + "contract": false, + "seed": 3, + "n": 300, + "fail_rate": 0.4766666666666667, + "auroc": 0.8708743485813549, + "sep": 0.2660060151580407, + "lam_solved": -0.3108652821187193, + "lam_unsolved": -0.04485926696067862, + "mean_lam": -0.1840690815600532 +}
\ No newline at end of file diff --git a/runs/le_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s4.json b/runs/le_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..50172fd --- /dev/null +++ b/runs/le_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,14 @@ +{ + "conv": "gin", + "grad_mode": "full", + "pe": "lappe", + "contract": false, + "seed": 4, + "n": 300, + "fail_rate": 0.6666666666666666, + "auroc": 0.7764, + "sep": 0.15627152857246984, + "lam_solved": -0.21964845005493164, + "lam_unsolved": -0.06337692148246181, + "mean_lam": -0.11546743100661842 +}
\ No newline at end of file diff --git a/runs/le_color_gps_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/le_color_gps_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..4064b3a --- /dev/null +++ b/runs/le_color_gps_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,14 @@ +{ + "conv": "gps", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 0, + "n": 300, + "fail_rate": 0.08666666666666667, + "auroc": 0.8976698483997754, + "sep": 0.433656147833876, + "lam_solved": -0.3897495614230082, + "lam_unsolved": 0.043906586410867796, + "mean_lam": -0.3521660286107389 +}
\ No newline at end of file diff --git a/runs/le_color_gps_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/le_color_gps_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..5f4efe0 --- /dev/null +++ b/runs/le_color_gps_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,14 @@ +{ + "conv": "gps", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 1, + "n": 300, + "fail_rate": 0.07333333333333333, + "auroc": 0.8626553302812295, + "sep": 0.40458751982158114, + "lam_solved": -0.38756856991550986, + "lam_unsolved": 0.017018949906071265, + "mean_lam": -0.3578988184619272 +}
\ No newline at end of file diff --git a/runs/le_color_gps_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/le_color_gps_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..ad81820 --- /dev/null +++ b/runs/le_color_gps_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,14 @@ +{ + "conv": "gps", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 2, + "n": 300, + "fail_rate": 0.06333333333333334, + "auroc": 0.9134669413747893, + "sep": 0.4224918690249863, + "lam_solved": -0.4104796568638945, + "lam_unsolved": 0.012012212161091832, + "mean_lam": -0.38372183849231195 +}
\ No newline at end of file diff --git a/runs/le_color_gps_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/le_color_gps_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..c8934a3 --- /dev/null +++ b/runs/le_color_gps_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,14 @@ +{ + "conv": "gps", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 3, + "n": 300, + "fail_rate": 0.056666666666666664, + "auroc": 0.8559551028892123, + "sep": 0.34088548051302103, + "lam_solved": -0.39706455164588167, + "lam_unsolved": -0.056179071132860636, + "mean_lam": -0.37774770775014377 +}
\ No newline at end of file diff --git a/runs/le_color_gps_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/le_color_gps_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..69cb51c --- /dev/null +++ b/runs/le_color_gps_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,14 @@ +{ + "conv": "gps", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 4, + "n": 300, + "fail_rate": 0.06333333333333334, + "auroc": 0.9361303614909159, + "sep": 0.44779683882547483, + "lam_solved": -0.4023600169638574, + "lam_unsolved": 0.045436821861617405, + "mean_lam": -0.3739995505049107 +}
\ No newline at end of file diff --git a/runs/le_color_pna_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/le_color_pna_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..163c4d4 --- /dev/null +++ b/runs/le_color_pna_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,14 @@ +{ + "conv": "pna", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 0, + "n": 300, + "fail_rate": 0.08, + "auroc": 0.8668478260869565, + "sep": 0.3206947953297776, + "lam_solved": -0.1496762873718966, + "lam_unsolved": 0.171018507957881, + "mean_lam": -0.12402070374551438 +}
\ No newline at end of file diff --git a/runs/le_color_pna_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/le_color_pna_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..64a3763 --- /dev/null +++ b/runs/le_color_pna_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,14 @@ +{ + "conv": "pna", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 1, + "n": 300, + "fail_rate": 0.056666666666666664, + "auroc": 0.7266680523799626, + "sep": 0.1446541795370263, + "lam_solved": -0.16350230373766278, + "lam_unsolved": -0.01884812420063646, + "mean_lam": -0.15530523356389797 +}
\ No newline at end of file diff --git a/runs/le_color_pna_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/le_color_pna_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..ab8f446 --- /dev/null +++ b/runs/le_color_pna_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,14 @@ +{ + "conv": "pna", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 2, + "n": 300, + "fail_rate": 0.08333333333333333, + "auroc": 0.7729454545454545, + "sep": 0.21168878280404826, + "lam_solved": -0.20395821199521913, + "lam_unsolved": 0.007730570808829122, + "mean_lam": -0.18631748009488178 +}
\ No newline at end of file diff --git a/runs/le_color_pna_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/le_color_pna_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..ef3a99b --- /dev/null +++ b/runs/le_color_pna_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,14 @@ +{ + "conv": "pna", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 3, + "n": 300, + "fail_rate": 0.056666666666666664, + "auroc": 0.7563916025774267, + "sep": 0.20069597616913837, + "lam_solved": -0.16172555582132558, + "lam_unsolved": 0.03897042034781278, + "mean_lam": -0.15035278383840775 +}
\ No newline at end of file diff --git a/runs/le_color_pna_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/le_color_pna_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..2591a8c --- /dev/null +++ b/runs/le_color_pna_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,14 @@ +{ + "conv": "pna", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 4, + "n": 300, + "fail_rate": 0.07666666666666666, + "auroc": 0.7783707424266206, + "sep": 0.20707521025037756, + "lam_solved": -0.13658651744906117, + "lam_unsolved": 0.07048869280131638, + "mean_lam": -0.12071075132986554 +}
\ No newline at end of file diff --git a/runs/le_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/le_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..4d5ee52 --- /dev/null +++ b/runs/le_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,11 @@ +{ + "conv": "ppgn", + "pe": "none", + "grad_mode": "full", + "contract": false, + "seed": 0, + "auroc": 0.8571428571428572, + "mean_lam": -0.024575068365040895, + "lam_solved": -0.03098289660826143, + "lam_unsolved": 0.10632770860360728 +}
\ No newline at end of file diff --git a/runs/le_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/le_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..31f2d05 --- /dev/null +++ b/runs/le_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,11 @@ +{ + "conv": "ppgn", + "pe": "none", + "grad_mode": "full", + "contract": false, + "seed": 1, + "auroc": 0.7531034482758621, + "mean_lam": -0.010107360393438418, + "lam_solved": -0.013472549581830657, + "lam_unsolved": 0.0874831260699365 +}
\ No newline at end of file diff --git a/runs/le_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/le_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..03b0176 --- /dev/null +++ b/runs/le_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,11 @@ +{ + "conv": "ppgn", + "pe": "none", + "grad_mode": "full", + "contract": false, + "seed": 2, + "auroc": 0.7793103448275862, + "mean_lam": -0.011402015426623011, + "lam_solved": -0.014706044295830362, + "lam_unsolved": 0.08441482178039021 +}
\ No newline at end of file diff --git a/runs/le_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/le_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..436f54a --- /dev/null +++ b/runs/le_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,11 @@ +{ + "conv": "ppgn", + "pe": "none", + "grad_mode": "full", + "contract": false, + "seed": 3, + "auroc": 0.7696551724137932, + "mean_lam": 0.013861869268444363, + "lam_solved": 0.011020388753700146, + "lam_unsolved": 0.0962648041960266 +}
\ No newline at end of file diff --git a/runs/le_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/le_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..0d1f945 --- /dev/null +++ b/runs/le_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,11 @@ +{ + "conv": "ppgn", + "pe": "none", + "grad_mode": "full", + "contract": false, + "seed": 4, + "auroc": 0.7280092592592593, + "mean_lam": -0.03937435364091975, + "lam_solved": -0.04227734012992759, + "lam_unsolved": 0.030297322095268295 +}
\ No newline at end of file diff --git a/runs/le_color_rrog_gin_full_none_n12_k3_p0.2_T2_ns2_s7.json b/runs/le_color_rrog_gin_full_none_n12_k3_p0.2_T2_ns2_s7.json new file mode 100644 index 0000000..81715aa --- /dev/null +++ b/runs/le_color_rrog_gin_full_none_n12_k3_p0.2_T2_ns2_s7.json @@ -0,0 +1,15 @@ +{ + "conv": "gin", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 7, + "arch": "rrog_once_agg_node_compute", + "n": 300, + "fail_rate": 1.0, + "auroc": NaN, + "sep": NaN, + "lam_solved": null, + "lam_unsolved": -6.027523296422051e-07, + "mean_lam": -6.027523296422051e-07 +}
\ No newline at end of file diff --git a/runs/le_color_sage_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/le_color_sage_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..bd2e44f --- /dev/null +++ b/runs/le_color_sage_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,14 @@ +{ + "conv": "sage", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 0, + "n": 300, + "fail_rate": 0.27, + "auroc": 0.7929421049664581, + "sep": 0.18276381259910376, + "lam_solved": -0.13102778772546086, + "lam_unsolved": 0.0517360248736429, + "mean_lam": -0.08168155832370286 +}
\ No newline at end of file diff --git a/runs/le_color_sage_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/le_color_sage_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..aa47b30 --- /dev/null +++ b/runs/le_color_sage_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,14 @@ +{ + "conv": "sage", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 1, + "n": 300, + "fail_rate": 0.21333333333333335, + "auroc": 0.6884931144067798, + "sep": 0.0968948235826547, + "lam_solved": 0.06293318916170748, + "lam_unsolved": 0.15982801274436217, + "mean_lam": 0.0836040848593405 +}
\ No newline at end of file diff --git a/runs/le_color_sage_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/le_color_sage_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..3c27d79 --- /dev/null +++ b/runs/le_color_sage_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,14 @@ +{ + "conv": "sage", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 2, + "n": 300, + "fail_rate": 0.17, + "auroc": 0.8143948342389165, + "sep": 0.20737819121386966, + "lam_solved": -0.10523268078443035, + "lam_unsolved": 0.10214551042943931, + "mean_lam": -0.06997838827807248 +}
\ No newline at end of file diff --git a/runs/le_color_sage_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/le_color_sage_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..b8352fc --- /dev/null +++ b/runs/le_color_sage_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,14 @@ +{ + "conv": "sage", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 3, + "n": 300, + "fail_rate": 0.19666666666666666, + "auroc": 0.6804979253112032, + "sep": 0.11776359703690804, + "lam_solved": 0.002266006156251741, + "lam_unsolved": 0.12002960319315978, + "mean_lam": 0.025426180240176986 +}
\ No newline at end of file diff --git a/runs/le_color_sage_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/le_color_sage_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..6287958 --- /dev/null +++ b/runs/le_color_sage_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,14 @@ +{ + "conv": "sage", + "grad_mode": "full", + "pe": "none", + "contract": false, + "seed": 4, + "n": 300, + "fail_rate": 0.18333333333333332, + "auroc": 0.8282745825602968, + "sep": 0.1934978023844479, + "lam_solved": -0.011430386611423616, + "lam_unsolved": 0.18206741577302427, + "mean_lam": 0.024044210492391832 +}
\ No newline at end of file diff --git a/runs/le_sweep.log b/runs/le_sweep.log new file mode 100644 index 0000000..a34180d --- /dev/null +++ b/runs/le_sweep.log @@ -0,0 +1,29 @@ +host=timan1.cs.illinois.edu gpu=0 start=2026-06-16T10:23:58-05:00 +ep20 val_mae=[0.316, 0.393] +ep40 val_mae=[0.357, 0.365] +ep60 val_mae=[0.165, 0.247] +ep80 val_mae=[0.171, 0.226] +ep100 val_mae=[0.415, 0.502] +ep120 val_mae=[0.183, 0.27] +ep140 val_mae=[0.149, 0.203] +ep160 val_mae=[0.172, 0.243] +ep180 val_mae=[0.171, 0.205] +ep200 val_mae=[0.176, 0.212] +[rec_full_sig0.0_K1_bestq_T3_ns3_s0] test_mae=[0.145, 0.198] oracle@K=[0.145, 0.198] @ep140 (209.3s) + wrote /home/yurenh2/rrog/runs/ckpt_rec_full_sig0.0_K1_bestq_T3_ns3_s0.pt +ep20 val_mae=[0.353, 0.393] +ep40 val_mae=[0.281, 0.337] +ep60 val_mae=[0.217, 0.308] +ep80 val_mae=[0.194, 0.285] +ep100 val_mae=[0.185, 0.313] +ep120 val_mae=[0.21, 0.373] +ep140 val_mae=[0.531, 0.684] +ep160 val_mae=[0.471, 0.599] +ep180 val_mae=[0.56, 0.6] +ep200 val_mae=[0.595, 0.645] +[rec_1step_sig0.0_K1_bestq_T3_ns3_s0] test_mae=[0.211, 0.293] oracle@K=[0.211, 0.293] @ep80 (168.0s) + wrote /home/yurenh2/rrog/runs/ckpt_rec_1step_sig0.0_K1_bestq_T3_ns3_s0.pt +===== LE diagnostic (lambda1: success vs failure) ===== +[full] n=300 fail_rate=0.15 | lambda1 SUCC mean -0.0402 std 0.1253 (n=256) | FAIL mean +0.0156 std 0.1058 (n=44) | sep(fail-succ)=+0.0558 | AUROC(fail|lambda1)=0.633 | mean_lambda1=-0.0320 +[1step] n=300 fail_rate=0.29 | lambda1 SUCC mean -0.2247 std 0.1226 (n=213) | FAIL mean -0.1706 std 0.1229 (n=87) | sep(fail-succ)=+0.0542 | AUROC(fail|lambda1)=0.630 | mean_lambda1=-0.2090 +done=2026-06-16T10:31:15-05:00 diff --git a/runs/ogb_hiv_remaining_gpu1.log b/runs/ogb_hiv_remaining_gpu1.log new file mode 100644 index 0000000..97ed9bb --- /dev/null +++ b/runs/ogb_hiv_remaining_gpu1.log @@ -0,0 +1,79 @@ ++ [[ hB != hxB ]] ++ XTRACE_STATE=-x ++ [[ hxB != hxB ]] ++ VERBOSE_STATE=+v ++ set +xv ++ unset XTRACE_STATE VERBOSE_STATE ++ set -euo pipefail ++ cd /home/yurenh2/rrog ++ export PYTHONPATH=/home/yurenh2/rrog: ++ PYTHONPATH=/home/yurenh2/rrog: ++ DEVICE=cuda:1 ++ EPOCHS=100 ++ SEED=0 ++ run_if_missing sgc fixed-rrog 3 3 ++ local view=sgc ++ local compute=fixed-rrog ++ local t=3 ++ local ns=3 ++ local out=runs/ogbg-molhiv_sgc_fixed-rrog_T3_ns3_h128_e100_s0.json ++ [[ -f runs/ogbg-molhiv_sgc_fixed-rrog_T3_ns3_h128_e100_s0.json ]] ++ echo '[run] view=sgc compute=fixed-rrog T=3 ns=3 device=cuda:1' +[run] view=sgc compute=fixed-rrog T=3 ns=3 device=cuda:1 ++ python3 -m rrog.cli run --task ogbg-molhiv --view sgc --compute fixed-rrog --epochs 100 --T 3 --n_sup 3 --seed 0 --device cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view sgc --compute fixed-rrog --T 3 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.71985 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.72847 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.72656 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.72385 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.73415 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.74863 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.73652 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.74310 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.74841 halt=0.00 train_steps=3.00 +ep100 val_rocauc=0.73595 halt=0.00 train_steps=3.00 +[ogbg-molhiv_sgc_fixed-rrog_T3_ns3_h128_e100_s0] best_ep=60 val={'rocauc': 0.7486343817362336} test={'rocauc': 0.7382220591359432} adaptive=None steps=None + wrote /home/yurenh2/rrog/runs/ogbg-molhiv_sgc_fixed-rrog_T3_ns3_h128_e100_s0.json ++ run_if_missing cheb classic 0 1 ++ local view=cheb ++ local compute=classic ++ local t=0 ++ local ns=1 ++ local out=runs/ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s0.json ++ [[ -f runs/ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s0.json ]] ++ echo '[run] view=cheb compute=classic T=0 ns=1 device=cuda:1' +[run] view=cheb compute=classic T=0 ns=1 device=cuda:1 ++ python3 -m rrog.cli run --task ogbg-molhiv --view cheb --compute classic --epochs 100 --T 0 --n_sup 1 --seed 0 --device cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view cheb --compute classic --T 0 --n_sup 1 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.72594 halt=0.00 train_steps=1.00 +ep20 val_rocauc=0.78152 halt=0.00 train_steps=1.00 +ep30 val_rocauc=0.75664 halt=0.00 train_steps=1.00 +ep40 val_rocauc=0.74200 halt=0.00 train_steps=1.00 +ep50 val_rocauc=0.79068 halt=0.00 train_steps=1.00 +ep60 val_rocauc=0.79676 halt=0.00 train_steps=1.00 +ep70 val_rocauc=0.76138 halt=0.00 train_steps=1.00 +ep80 val_rocauc=0.77612 halt=0.00 train_steps=1.00 +ep90 val_rocauc=0.77074 halt=0.00 train_steps=1.00 +ep100 val_rocauc=0.77029 halt=0.00 train_steps=1.00 +[ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s0] best_ep=60 val={'rocauc': 0.796764770723104} test={'rocauc': 0.7451302651654147} adaptive=None steps=None + wrote /home/yurenh2/rrog/runs/ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s0.json ++ run_if_missing cheb fixed-rrog 3 3 ++ local view=cheb ++ local compute=fixed-rrog ++ local t=3 ++ local ns=3 ++ local out=runs/ogbg-molhiv_cheb_fixed-rrog_T3_ns3_h128_e100_s0.json ++ [[ -f runs/ogbg-molhiv_cheb_fixed-rrog_T3_ns3_h128_e100_s0.json ]] ++ echo '[run] view=cheb compute=fixed-rrog T=3 ns=3 device=cuda:1' +[run] view=cheb compute=fixed-rrog T=3 ns=3 device=cuda:1 ++ python3 -m rrog.cli run --task ogbg-molhiv --view cheb --compute fixed-rrog --epochs 100 --T 3 --n_sup 3 --seed 0 --device cuda:1 +python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view cheb --compute fixed-rrog --T 3 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --device cuda:1 +ep10 val_rocauc=0.72235 halt=0.00 train_steps=3.00 +ep20 val_rocauc=0.76443 halt=0.00 train_steps=3.00 +ep30 val_rocauc=0.77549 halt=0.00 train_steps=3.00 +ep40 val_rocauc=0.73576 halt=0.00 train_steps=3.00 +ep50 val_rocauc=0.77500 halt=0.00 train_steps=3.00 +ep60 val_rocauc=0.77257 halt=0.00 train_steps=3.00 +ep70 val_rocauc=0.76067 halt=0.00 train_steps=3.00 +ep80 val_rocauc=0.76616 halt=0.00 train_steps=3.00 +ep90 val_rocauc=0.76171 halt=0.00 train_steps=3.00 diff --git a/runs/ogbg-molbace_appnp_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbace_appnp_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..e30e682 --- /dev/null +++ b/runs/ogbg-molbace_appnp_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_appnp_classic_T0_ns1_h128_e100_s0", + "view": "appnp", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 17.3, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.6564102564102564 + }, + "test": { + "rocauc": 0.7423056859676577 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbace_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..c30d31f --- /dev/null +++ b/runs/ogbg-molbace_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_appnp_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "appnp", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 20.1, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.7168498168498169 + }, + "test": { + "rocauc": 0.7209181011997913 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..d061742 --- /dev/null +++ b/runs/ogbg-molbace_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "appnp", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 34.5, + "dev": "cuda:3", + "ep": 10, + "val": { + "rocauc": 0.6802197802197802 + }, + "val_adaptive": { + "rocauc": 0.6714285714285715 + }, + "test": { + "rocauc": 0.6833594157537818 + }, + "test_adaptive": { + "rocauc": 0.7826464962615197 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.1059602649006623, + "fixed_steps": 8.0, + "adaptive_steps": 2.0921052631578947 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..5dbddc8 --- /dev/null +++ b/runs/ogbg-molbace_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "appnp", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 38.3, + "dev": "cuda:0", + "ep": 20, + "val": { + "rocauc": 0.6835164835164835 + }, + "val_adaptive": { + "rocauc": 0.6549450549450551 + }, + "test": { + "rocauc": 0.7118761954442705 + }, + "test_adaptive": { + "rocauc": 0.7328290732046601 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.357615894039735, + "fixed_steps": 8.0, + "adaptive_steps": 2.1315789473684212 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_arma_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbace_arma_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..4d18ef2 --- /dev/null +++ b/runs/ogbg-molbace_arma_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_arma_classic_T0_ns1_h128_e100_s0", + "view": "arma", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 30.6, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.6923076923076924 + }, + "test": { + "rocauc": 0.7838636758824552 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_arma_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbace_arma_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..8090a35 --- /dev/null +++ b/runs/ogbg-molbace_arma_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_arma_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "arma", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 38.9, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.717948717948718 + }, + "test": { + "rocauc": 0.7671709267953399 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..ae5bc4f --- /dev/null +++ b/runs/ogbg-molbace_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "arma", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 36.3, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.7355311355311356 + }, + "val_adaptive": { + "rocauc": 0.7347985347985347 + }, + "test": { + "rocauc": 0.7450878108155102 + }, + "test_adaptive": { + "rocauc": 0.7645626847504782 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 4.71523178807947, + "fixed_steps": 8.0, + "adaptive_steps": 4.375 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_cheb_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbace_cheb_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..ffd0717 --- /dev/null +++ b/runs/ogbg-molbace_cheb_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_cheb_classic_T0_ns1_h128_e100_s0", + "view": "cheb", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 15.4, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.7267399267399268 + }, + "test": { + "rocauc": 0.7969048861067639 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbace_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..0fec992 --- /dev/null +++ b/runs/ogbg-molbace_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_cheb_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "cheb", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 23.6, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.7113553113553114 + }, + "test": { + "rocauc": 0.7532603025560771 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..62ad993 --- /dev/null +++ b/runs/ogbg-molbace_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "cheb", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 37.2, + "dev": "cuda:0", + "ep": 70, + "val": { + "rocauc": 0.7164835164835166 + }, + "val_adaptive": { + "rocauc": 0.7380952380952381 + }, + "test": { + "rocauc": 0.8007303077725613 + }, + "test_adaptive": { + "rocauc": 0.8120326899669622 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.8675496688741724, + "fixed_steps": 8.0, + "adaptive_steps": 2.598684210526316 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_film_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbace_film_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..c263851 --- /dev/null +++ b/runs/ogbg-molbace_film_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_film_classic_T0_ns1_h128_e100_s0", + "view": "film", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 17.2, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.6703296703296703 + }, + "test": { + "rocauc": 0.7242218744566161 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_film_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbace_film_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..dc748cb --- /dev/null +++ b/runs/ogbg-molbace_film_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_film_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "film", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 26.1, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.6652014652014652 + }, + "test": { + "rocauc": 0.7242218744566163 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..2187ffa --- /dev/null +++ b/runs/ogbg-molbace_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "film", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 35.3, + "dev": "cuda:0", + "ep": 70, + "val": { + "rocauc": 0.6467032967032967 + }, + "val_adaptive": { + "rocauc": 0.6472527472527473 + }, + "test": { + "rocauc": 0.6802295252999478 + }, + "test_adaptive": { + "rocauc": 0.6732742131803164 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 6.139072847682119, + "fixed_steps": 8.0, + "adaptive_steps": 5.256578947368421 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_gatv2_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbace_gatv2_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..7d5f25d --- /dev/null +++ b/runs/ogbg-molbace_gatv2_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_gatv2_classic_T0_ns1_h128_e100_s0", + "view": "gatv2", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 29.9, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.702930402930403 + }, + "test": { + "rocauc": 0.7400452095287776 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbace_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..4ed6321 --- /dev/null +++ b/runs/ogbg-molbace_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_gatv2_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gatv2", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 34.7, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.7025641025641026 + }, + "test": { + "rocauc": 0.751869240132151 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..9f3dced --- /dev/null +++ b/runs/ogbg-molbace_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gatv2", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 45.8, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.7131868131868132 + }, + "val_adaptive": { + "rocauc": 0.7197802197802198 + }, + "test": { + "rocauc": 0.8261171970092158 + }, + "test_adaptive": { + "rocauc": 0.8262910798122065 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 4.52317880794702, + "fixed_steps": 8.0, + "adaptive_steps": 4.006578947368421 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_gcn_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbace_gcn_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..438332b --- /dev/null +++ b/runs/ogbg-molbace_gcn_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_gcn_classic_T0_ns1_h128_e100_s0", + "view": "gcn", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 11.5, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.638095238095238 + }, + "test": { + "rocauc": 0.7393496783168144 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbace_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..4d02789 --- /dev/null +++ b/runs/ogbg-molbace_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_gcn_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gcn", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 22.2, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.6373626373626374 + }, + "test": { + "rocauc": 0.7732568249000173 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..7c2ac00 --- /dev/null +++ b/runs/ogbg-molbace_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gcn", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 30.9, + "dev": "cuda:3", + "ep": 10, + "val": { + "rocauc": 0.6615384615384615 + }, + "val_adaptive": { + "rocauc": 0.6882783882783883 + }, + "test": { + "rocauc": 0.4418362023995827 + }, + "test_adaptive": { + "rocauc": 0.5362545644235784 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.1589403973509933, + "fixed_steps": 8.0, + "adaptive_steps": 2.8421052631578947 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..992eef2 --- /dev/null +++ b/runs/ogbg-molbace_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gcn", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 33.9, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.7201465201465201 + }, + "val_adaptive": { + "rocauc": 0.7021978021978023 + }, + "test": { + "rocauc": 0.7483915840723353 + }, + "test_adaptive": { + "rocauc": 0.7450878108155105 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 4.28476821192053, + "fixed_steps": 8.0, + "adaptive_steps": 3.960526315789474 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_gen_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbace_gen_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..13095ae --- /dev/null +++ b/runs/ogbg-molbace_gen_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_gen_classic_T0_ns1_h128_e100_s0", + "view": "gen", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 13.8, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.7128205128205128 + }, + "test": { + "rocauc": 0.7325682490001738 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_gen_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbace_gen_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..19b0e7a --- /dev/null +++ b/runs/ogbg-molbace_gen_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_gen_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gen", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 17.5, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.6893772893772894 + }, + "test": { + "rocauc": 0.7449139280125194 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..fb8deeb --- /dev/null +++ b/runs/ogbg-molbace_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gen", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 35.7, + "dev": "cuda:0", + "ep": 60, + "val": { + "rocauc": 0.6534798534798535 + }, + "val_adaptive": { + "rocauc": 0.6428571428571429 + }, + "test": { + "rocauc": 0.6915319074943488 + }, + "test_adaptive": { + "rocauc": 0.6788384628760215 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 4.450331125827814, + "fixed_steps": 8.0, + "adaptive_steps": 3.9802631578947367 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_gin_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbace_gin_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..c3a8f27 --- /dev/null +++ b/runs/ogbg-molbace_gin_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_gin_classic_T0_ns1_h128_e100_s0", + "view": "gin", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 22.0, + "dev": "cuda:1", + "ep": 100, + "val": { + "rocauc": 0.652014652014652 + }, + "test": { + "rocauc": 0.7336115458181186 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_gin_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbace_gin_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..f168f82 --- /dev/null +++ b/runs/ogbg-molbace_gin_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_gin_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gin", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 27.0, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.6538461538461539 + }, + "test": { + "rocauc": 0.7169187967310032 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..ddaea1e --- /dev/null +++ b/runs/ogbg-molbace_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 32.2, + "dev": "cuda:3", + "ep": 60, + "val": { + "rocauc": 0.6630036630036631 + }, + "val_adaptive": { + "rocauc": 0.694871794871795 + }, + "test": { + "rocauc": 0.7275256477134411 + }, + "test_adaptive": { + "rocauc": 0.7369153190749435 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0860927152317883, + "fixed_steps": 8.0, + "adaptive_steps": 2.0526315789473686 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..e194917 --- /dev/null +++ b/runs/ogbg-molbace_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 33.3, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.6802197802197802 + }, + "val_adaptive": { + "rocauc": 0.6652014652014652 + }, + "test": { + "rocauc": 0.723526343244653 + }, + "test_adaptive": { + "rocauc": 0.721961398017736 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 4.397350993377484, + "fixed_steps": 8.0, + "adaptive_steps": 3.473684210526316 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_gine_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbace_gine_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..358ccad --- /dev/null +++ b/runs/ogbg-molbace_gine_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_gine_classic_T0_ns1_h128_e100_s0", + "view": "gine", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 12.1, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.6641025641025642 + }, + "test": { + "rocauc": 0.7454355764214919 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_gine_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbace_gine_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..b9c0532 --- /dev/null +++ b/runs/ogbg-molbace_gine_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_gine_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gine", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 19.0, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.6684981684981685 + }, + "test": { + "rocauc": 0.6993566336289341 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..76f621a --- /dev/null +++ b/runs/ogbg-molbace_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gine", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 33.3, + "dev": "cuda:0", + "ep": 70, + "val": { + "rocauc": 0.6824175824175824 + }, + "val_adaptive": { + "rocauc": 0.6978021978021979 + }, + "test": { + "rocauc": 0.7718657624760911 + }, + "test_adaptive": { + "rocauc": 0.7697791688402017 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.980132450331126, + "fixed_steps": 8.0, + "adaptive_steps": 3.1710526315789473 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_graphconv_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbace_graphconv_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..1ecb1b8 --- /dev/null +++ b/runs/ogbg-molbace_graphconv_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_graphconv_classic_T0_ns1_h128_e100_s0", + "view": "graphconv", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 18.2, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.7311355311355311 + }, + "test": { + "rocauc": 0.8035124326204138 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbace_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..38b40bc --- /dev/null +++ b/runs/ogbg-molbace_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_graphconv_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "graphconv", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 22.5, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.7461538461538462 + }, + "test": { + "rocauc": 0.7982959485306903 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..90181e4 --- /dev/null +++ b/runs/ogbg-molbace_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphconv", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 29.6, + "dev": "cuda:3", + "ep": 70, + "val": { + "rocauc": 0.6926739926739928 + }, + "val_adaptive": { + "rocauc": 0.6978021978021979 + }, + "test": { + "rocauc": 0.6736219787862981 + }, + "test_adaptive": { + "rocauc": 0.734828725439054 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0, + "fixed_steps": 8.0, + "adaptive_steps": 2.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..5023a02 --- /dev/null +++ b/runs/ogbg-molbace_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphconv", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 31.4, + "dev": "cuda:0", + "ep": 30, + "val": { + "rocauc": 0.6908424908424909 + }, + "val_adaptive": { + "rocauc": 0.6923076923076923 + }, + "test": { + "rocauc": 0.7475221700573813 + }, + "test_adaptive": { + "rocauc": 0.7638671535385151 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 5.887417218543046, + "fixed_steps": 8.0, + "adaptive_steps": 4.276315789473684 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_graphsage_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbace_graphsage_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..fbd4ded --- /dev/null +++ b/runs/ogbg-molbace_graphsage_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_graphsage_classic_T0_ns1_h128_e100_s0", + "view": "graphsage", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 11.0, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.6758241758241759 + }, + "test": { + "rocauc": 0.7758650669448792 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbace_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..01d7a96 --- /dev/null +++ b/runs/ogbg-molbace_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_graphsage_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "graphsage", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 16.6, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.6703296703296704 + }, + "test": { + "rocauc": 0.7118761954442706 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..b99cda3 --- /dev/null +++ b/runs/ogbg-molbace_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphsage", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 31.9, + "dev": "cuda:0", + "ep": 70, + "val": { + "rocauc": 0.7091575091575092 + }, + "val_adaptive": { + "rocauc": 0.715018315018315 + }, + "test": { + "rocauc": 0.7821248478525474 + }, + "test_adaptive": { + "rocauc": 0.7909928708050773 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 4.543046357615894, + "fixed_steps": 8.0, + "adaptive_steps": 3.75 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_mf_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbace_mf_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..0be66cb --- /dev/null +++ b/runs/ogbg-molbace_mf_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_mf_classic_T0_ns1_h128_e100_s0", + "view": "mf", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 51.3, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.7421245421245422 + }, + "test": { + "rocauc": 0.7760389497478699 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_mf_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbace_mf_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..8667208 --- /dev/null +++ b/runs/ogbg-molbace_mf_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_mf_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "mf", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 52.6, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.7234432234432234 + }, + "test": { + "rocauc": 0.7683881064162754 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..7913df0 --- /dev/null +++ b/runs/ogbg-molbace_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "mf", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 56.2, + "dev": "cuda:0", + "ep": 30, + "val": { + "rocauc": 0.7747252747252747 + }, + "val_adaptive": { + "rocauc": 0.7472527472527473 + }, + "test": { + "rocauc": 0.8019474873934969 + }, + "test_adaptive": { + "rocauc": 0.7949921752738653 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 5.026490066225166, + "fixed_steps": 8.0, + "adaptive_steps": 4.980263157894737 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_pna_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbace_pna_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..d12a0be --- /dev/null +++ b/runs/ogbg-molbace_pna_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_pna_classic_T0_ns1_h128_e100_s0", + "view": "pna", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 30.2, + "dev": "cuda:1", + "ep": 90, + "val": { + "rocauc": 0.7516483516483518 + }, + "test": { + "rocauc": 0.6911841418883674 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_pna_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbace_pna_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..1ac26ac --- /dev/null +++ b/runs/ogbg-molbace_pna_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_pna_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "pna", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 29.3, + "dev": "cuda:1", + "ep": 100, + "val": { + "rocauc": 0.7036630036630036 + }, + "test": { + "rocauc": 0.7967310033037731 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..88f629c --- /dev/null +++ b/runs/ogbg-molbace_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "pna", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 41.0, + "dev": "cuda:3", + "ep": 30, + "val": { + "rocauc": 0.658974358974359 + }, + "val_adaptive": { + "rocauc": 0.6501831501831502 + }, + "test": { + "rocauc": 0.7480438184663536 + }, + "test_adaptive": { + "rocauc": 0.7546513649800034 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.562913907284768, + "fixed_steps": 8.0, + "adaptive_steps": 2.6315789473684212 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..639257f --- /dev/null +++ b/runs/ogbg-molbace_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "pna", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 44.7, + "dev": "cuda:0", + "ep": 20, + "val": { + "rocauc": 0.7095238095238096 + }, + "val_adaptive": { + "rocauc": 0.5846153846153846 + }, + "test": { + "rocauc": 0.7809076682316118 + }, + "test_adaptive": { + "rocauc": 0.7337854286211093 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.556291390728477, + "fixed_steps": 8.0, + "adaptive_steps": 3.914473684210526 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_resgated_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbace_resgated_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..2789193 --- /dev/null +++ b/runs/ogbg-molbace_resgated_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_resgated_classic_T0_ns1_h128_e100_s0", + "view": "resgated", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 21.1, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.7172161172161172 + }, + "test": { + "rocauc": 0.7876890975482524 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbace_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..cc03d1d --- /dev/null +++ b/runs/ogbg-molbace_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_resgated_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "resgated", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 22.7, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.6912087912087912 + }, + "test": { + "rocauc": 0.7464788732394366 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..98d5a43 --- /dev/null +++ b/runs/ogbg-molbace_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "resgated", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 33.7, + "dev": "cuda:3", + "ep": 60, + "val": { + "rocauc": 0.6941391941391942 + }, + "val_adaptive": { + "rocauc": 0.6959706959706959 + }, + "test": { + "rocauc": 0.7231785776386715 + }, + "test_adaptive": { + "rocauc": 0.7640410363415059 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0, + "fixed_steps": 8.0, + "adaptive_steps": 2.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..53dcf92 --- /dev/null +++ b/runs/ogbg-molbace_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "resgated", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 36.1, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.7395604395604396 + }, + "val_adaptive": { + "rocauc": 0.7293040293040294 + }, + "test": { + "rocauc": 0.7313510693792384 + }, + "test_adaptive": { + "rocauc": 0.7617805599026256 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 4.139072847682119, + "fixed_steps": 8.0, + "adaptive_steps": 3.388157894736842 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_sgc_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbace_sgc_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..2749fcc --- /dev/null +++ b/runs/ogbg-molbace_sgc_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_sgc_classic_T0_ns1_h128_e100_s0", + "view": "sgc", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 13.6, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.6575091575091575 + }, + "test": { + "rocauc": 0.6965745087810815 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbace_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..387544f --- /dev/null +++ b/runs/ogbg-molbace_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_sgc_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "sgc", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 23.0, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.6454212454212455 + }, + "test": { + "rocauc": 0.772735176491045 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..2c56535 --- /dev/null +++ b/runs/ogbg-molbace_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "sgc", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 32.1, + "dev": "cuda:3", + "ep": 70, + "val": { + "rocauc": 0.643956043956044 + }, + "val_adaptive": { + "rocauc": 0.6227106227106227 + }, + "test": { + "rocauc": 0.7117023126412798 + }, + "test_adaptive": { + "rocauc": 0.7499565292992523 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0, + "fixed_steps": 8.0, + "adaptive_steps": 2.013157894736842 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..67e5a89 --- /dev/null +++ b/runs/ogbg-molbace_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "sgc", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 33.9, + "dev": "cuda:0", + "ep": 60, + "val": { + "rocauc": 0.6615384615384615 + }, + "val_adaptive": { + "rocauc": 0.6641025641025642 + }, + "test": { + "rocauc": 0.7970787689097547 + }, + "test_adaptive": { + "rocauc": 0.7988175969396626 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.966887417218543, + "fixed_steps": 8.0, + "adaptive_steps": 3.638157894736842 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_tag_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbace_tag_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..e34b3b7 --- /dev/null +++ b/runs/ogbg-molbace_tag_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_tag_classic_T0_ns1_h128_e100_s0", + "view": "tag", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 16.0, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.7084249084249085 + }, + "test": { + "rocauc": 0.7344809598330725 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_tag_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbace_tag_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..c399fa2 --- /dev/null +++ b/runs/ogbg-molbace_tag_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_tag_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "tag", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 22.1, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.7355311355311356 + }, + "test": { + "rocauc": 0.6805772909059293 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..33942a1 --- /dev/null +++ b/runs/ogbg-molbace_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "tag", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 33.9, + "dev": "cuda:3", + "ep": 30, + "val": { + "rocauc": 0.6545787545787546 + }, + "val_adaptive": { + "rocauc": 0.663003663003663 + }, + "test": { + "rocauc": 0.8191618848895844 + }, + "test_adaptive": { + "rocauc": 0.8142931664058426 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.013245033112583, + "fixed_steps": 8.0, + "adaptive_steps": 2.111842105263158 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..851014a --- /dev/null +++ b/runs/ogbg-molbace_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "tag", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 38.5, + "dev": "cuda:0", + "ep": 60, + "val": { + "rocauc": 0.7084249084249085 + }, + "val_adaptive": { + "rocauc": 0.6970695970695971 + }, + "test": { + "rocauc": 0.7960354720918101 + }, + "test_adaptive": { + "rocauc": 0.7776038949747869 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.9735099337748343, + "fixed_steps": 8.0, + "adaptive_steps": 2.5526315789473686 +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_transformer_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbace_transformer_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..ef02f11 --- /dev/null +++ b/runs/ogbg-molbace_transformer_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_transformer_classic_T0_ns1_h128_e100_s0", + "view": "transformer", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 21.7, + "dev": "cuda:1", + "ep": 90, + "val": { + "rocauc": 0.6663003663003664 + }, + "test": { + "rocauc": 0.7363936706659711 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbace_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..4d9ce01 --- /dev/null +++ b/runs/ogbg-molbace_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_transformer_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "transformer", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 28.7, + "dev": "cuda:1", + "ep": 90, + "val": { + "rocauc": 0.6981684981684982 + }, + "test": { + "rocauc": 0.7487393496783169 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbace_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbace_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..1d80a20 --- /dev/null +++ b/runs/ogbg-molbace_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbace", + "tag": "ogbg-molbace_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "transformer", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 41.7, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.6534798534798535 + }, + "val_adaptive": { + "rocauc": 0.6538461538461539 + }, + "test": { + "rocauc": 0.7191792731698834 + }, + "test_adaptive": { + "rocauc": 0.729264475743349 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.357615894039735, + "fixed_steps": 8.0, + "adaptive_steps": 2.710526315789474 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_appnp_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbbbp_appnp_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..e01c17a --- /dev/null +++ b/runs/ogbg-molbbbp_appnp_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_appnp_classic_T0_ns1_h128_e100_s0", + "view": "appnp", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 19.6, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.9146669321915762 + }, + "test": { + "rocauc": 0.6387924382716049 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbbbp_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..03928c0 --- /dev/null +++ b/runs/ogbg-molbbbp_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_appnp_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "appnp", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 26.7, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.9359753061834113 + }, + "test": { + "rocauc": 0.6073495370370371 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..39e5ebe --- /dev/null +++ b/runs/ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "appnp", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 45.2, + "dev": "cuda:3", + "ep": 50, + "val": { + "rocauc": 0.8797172159713232 + }, + "val_adaptive": { + "rocauc": 0.9080951906800757 + }, + "test": { + "rocauc": 0.5456211419753086 + }, + "test_adaptive": { + "rocauc": 0.5880594135802469 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0, + "fixed_steps": 8.0, + "adaptive_steps": 2.0098039215686274 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..b46a244 --- /dev/null +++ b/runs/ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "appnp", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 48.8, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.9066016130638256 + }, + "val_adaptive": { + "rocauc": 0.9337847256795779 + }, + "test": { + "rocauc": 0.5573881172839507 + }, + "test_adaptive": { + "rocauc": 0.6225887345679013 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0, + "fixed_steps": 8.0, + "adaptive_steps": 2.014705882352941 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json b/runs/ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json new file mode 100644 index 0000000..9ae24fc --- /dev/null +++ b/runs/ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0", + "view": "appnp", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 30, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 43.8, + "dev": "cuda:3", + "ep": 80, + "val": { + "rocauc": 0.8966444289554915 + }, + "val_adaptive": { + "rocauc": 0.924225828935577 + }, + "test": { + "rocauc": 0.6170910493827161 + }, + "test_adaptive": { + "rocauc": 0.6361882716049383 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0098039215686274, + "fixed_steps": 8.0, + "adaptive_steps": 2.0049019607843137 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_arma_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbbbp_arma_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..d3696cf --- /dev/null +++ b/runs/ogbg-molbbbp_arma_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_arma_classic_T0_ns1_h128_e100_s0", + "view": "arma", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 23.0, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.9366723090709947 + }, + "test": { + "rocauc": 0.6651234567901235 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_arma_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbbbp_arma_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..f14e5c2 --- /dev/null +++ b/runs/ogbg-molbbbp_arma_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_arma_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "arma", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 44.9, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.941451757442995 + }, + "test": { + "rocauc": 0.6634837962962963 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..fe7120a --- /dev/null +++ b/runs/ogbg-molbbbp_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "arma", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 52.3, + "dev": "cuda:0", + "ep": 70, + "val": { + "rocauc": 0.9404560390321618 + }, + "val_adaptive": { + "rocauc": 0.9375684556407449 + }, + "test": { + "rocauc": 0.6411072530864197 + }, + "test_adaptive": { + "rocauc": 0.636766975308642 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0245098039215685, + "fixed_steps": 8.0, + "adaptive_steps": 2.1519607843137254 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_cheb_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbbbp_cheb_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..c66161b --- /dev/null +++ b/runs/ogbg-molbbbp_cheb_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_cheb_classic_T0_ns1_h128_e100_s0", + "view": "cheb", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 19.6, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.9452354874041621 + }, + "test": { + "rocauc": 0.6514274691358024 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbbbp_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..3b92e52 --- /dev/null +++ b/runs/ogbg-molbbbp_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_cheb_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "cheb", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 27.4, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.9278104152145773 + }, + "test": { + "rocauc": 0.665895061728395 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..ae93dcd --- /dev/null +++ b/runs/ogbg-molbbbp_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "cheb", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 48.9, + "dev": "cuda:0", + "ep": 70, + "val": { + "rocauc": 0.9496166484118291 + }, + "val_adaptive": { + "rocauc": 0.9449367718809121 + }, + "test": { + "rocauc": 0.6182484567901234 + }, + "test_adaptive": { + "rocauc": 0.611014660493827 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0294117647058822, + "fixed_steps": 8.0, + "adaptive_steps": 2.1666666666666665 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_film_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbbbp_film_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..71cf8e4 --- /dev/null +++ b/runs/ogbg-molbbbp_film_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_film_classic_T0_ns1_h128_e100_s0", + "view": "film", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 15.9, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.9285074181021606 + }, + "test": { + "rocauc": 0.6300154320987654 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_film_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbbbp_film_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..75350d8 --- /dev/null +++ b/runs/ogbg-molbbbp_film_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_film_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "film", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 39.4, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.939958179826745 + }, + "test": { + "rocauc": 0.6323302469135803 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..f3e24ce --- /dev/null +++ b/runs/ogbg-molbbbp_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "film", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 46.4, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.9392611769391616 + }, + "val_adaptive": { + "rocauc": 0.9483222144777457 + }, + "test": { + "rocauc": 0.5584490740740741 + }, + "test_adaptive": { + "rocauc": 0.5745563271604939 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.696078431372549, + "fixed_steps": 8.0, + "adaptive_steps": 3.2058823529411766 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_gatv2_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbbbp_gatv2_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..c775266 --- /dev/null +++ b/runs/ogbg-molbbbp_gatv2_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_gatv2_classic_T0_ns1_h128_e100_s0", + "view": "gatv2", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 34.3, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.9346808722493279 + }, + "test": { + "rocauc": 0.6324266975308642 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbbbp_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..3c0370c --- /dev/null +++ b/runs/ogbg-molbbbp_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_gatv2_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gatv2", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 42.8, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.935577018819078 + }, + "test": { + "rocauc": 0.6559606481481481 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..b485203 --- /dev/null +++ b/runs/ogbg-molbbbp_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gatv2", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 55.0, + "dev": "cuda:0", + "ep": 70, + "val": { + "rocauc": 0.9302997112416609 + }, + "val_adaptive": { + "rocauc": 0.9165587971721598 + }, + "test": { + "rocauc": 0.6648341049382716 + }, + "test_adaptive": { + "rocauc": 0.6627121913580247 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.1029411764705883, + "fixed_steps": 8.0, + "adaptive_steps": 2.1372549019607843 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_gcn_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbbbp_gcn_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..a6a18df --- /dev/null +++ b/runs/ogbg-molbbbp_gcn_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_gcn_classic_T0_ns1_h128_e100_s0", + "view": "gcn", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 13.4, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.9385641740515782 + }, + "test": { + "rocauc": 0.667920524691358 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbbbp_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..ba2c88e --- /dev/null +++ b/runs/ogbg-molbbbp_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_gcn_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gcn", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 19.8, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.9416509011251619 + }, + "test": { + "rocauc": 0.601658950617284 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..9c600a3 --- /dev/null +++ b/runs/ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gcn", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 38.4, + "dev": "cuda:3", + "ep": 40, + "val": { + "rocauc": 0.9429453350592453 + }, + "val_adaptive": { + "rocauc": 0.9520063725978294 + }, + "test": { + "rocauc": 0.6137152777777778 + }, + "test_adaptive": { + "rocauc": 0.675829475308642 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0098039215686274, + "fixed_steps": 8.0, + "adaptive_steps": 2.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..bd80655 --- /dev/null +++ b/runs/ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gcn", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 42.2, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.9528029473264961 + }, + "val_adaptive": { + "rocauc": 0.9538982375784127 + }, + "test": { + "rocauc": 0.6794945987654321 + }, + "test_adaptive": { + "rocauc": 0.6629050925925926 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.1715686274509802, + "fixed_steps": 8.0, + "adaptive_steps": 2.269607843137255 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json b/runs/ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json new file mode 100644 index 0000000..7070fb1 --- /dev/null +++ b/runs/ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0", + "view": "gcn", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 30, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 37.9, + "dev": "cuda:3", + "ep": 70, + "val": { + "rocauc": 0.9343821567260779 + }, + "val_adaptive": { + "rocauc": 0.9363735935477446 + }, + "test": { + "rocauc": 0.6946373456790124 + }, + "test_adaptive": { + "rocauc": 0.6956983024691358 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.377450980392157, + "fixed_steps": 8.0, + "adaptive_steps": 3.0049019607843137 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_gen_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbbbp_gen_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..96c4f79 --- /dev/null +++ b/runs/ogbg-molbbbp_gen_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_gen_classic_T0_ns1_h128_e100_s0", + "view": "gen", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 18.0, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.9548939559892462 + }, + "test": { + "rocauc": 0.677469135802469 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_gen_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbbbp_gen_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..46346d4 --- /dev/null +++ b/runs/ogbg-molbbbp_gen_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_gen_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gen", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 37.8, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.9429453350592453 + }, + "test": { + "rocauc": 0.6036844135802468 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..098535e --- /dev/null +++ b/runs/ogbg-molbbbp_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gen", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 45.4, + "dev": "cuda:0", + "ep": 30, + "val": { + "rocauc": 0.925121975505327 + }, + "val_adaptive": { + "rocauc": 0.9211391018619934 + }, + "test": { + "rocauc": 0.6313657407407408 + }, + "test_adaptive": { + "rocauc": 0.6291473765432098 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 4.622549019607843, + "fixed_steps": 8.0, + "adaptive_steps": 3.7892156862745097 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_gin_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbbbp_gin_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..6e9794f --- /dev/null +++ b/runs/ogbg-molbbbp_gin_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_gin_classic_T0_ns1_h128_e100_s0", + "view": "gin", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 14.3, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.925121975505327 + }, + "test": { + "rocauc": 0.5670331790123456 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_gin_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbbbp_gin_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..4d3d022 --- /dev/null +++ b/runs/ogbg-molbbbp_gin_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_gin_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gin", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 34.4, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.9526038036443294 + }, + "test": { + "rocauc": 0.5931712962962963 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..1bf5645 --- /dev/null +++ b/runs/ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 40.8, + "dev": "cuda:3", + "ep": 50, + "val": { + "rocauc": 0.9282087025789106 + }, + "val_adaptive": { + "rocauc": 0.936473165388828 + }, + "test": { + "rocauc": 0.6619405864197531 + }, + "test_adaptive": { + "rocauc": 0.6692708333333333 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.088235294117647, + "fixed_steps": 8.0, + "adaptive_steps": 2.0833333333333335 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..1c17af9 --- /dev/null +++ b/runs/ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 44.8, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.92044209897441 + }, + "val_adaptive": { + "rocauc": 0.9314945733346609 + }, + "test": { + "rocauc": 0.6527777777777778 + }, + "test_adaptive": { + "rocauc": 0.65258487654321 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.1323529411764706, + "fixed_steps": 8.0, + "adaptive_steps": 4.872549019607843 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json b/runs/ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json new file mode 100644 index 0000000..852bc5b --- /dev/null +++ b/runs/ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 30, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 38.1, + "dev": "cuda:3", + "ep": 60, + "val": { + "rocauc": 0.9426466195359953 + }, + "val_adaptive": { + "rocauc": 0.944040625311162 + }, + "test": { + "rocauc": 0.6331018518518519 + }, + "test_adaptive": { + "rocauc": 0.638406635802469 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.142156862745098, + "fixed_steps": 8.0, + "adaptive_steps": 3.2058823529411766 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_gine_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbbbp_gine_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..d696564 --- /dev/null +++ b/runs/ogbg-molbbbp_gine_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_gine_classic_T0_ns1_h128_e100_s0", + "view": "gine", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 19.6, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.932390719904411 + }, + "test": { + "rocauc": 0.6160300925925926 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_gine_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbbbp_gine_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..7082f6c --- /dev/null +++ b/runs/ogbg-molbbbp_gine_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_gine_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gine", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 34.1, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.9421487603305785 + }, + "test": { + "rocauc": 0.6976273148148147 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..5a7c602 --- /dev/null +++ b/runs/ogbg-molbbbp_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gine", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 45.5, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.9205416708154933 + }, + "val_adaptive": { + "rocauc": 0.912277208005576 + }, + "test": { + "rocauc": 0.591820987654321 + }, + "test_adaptive": { + "rocauc": 0.5948109567901234 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.573529411764706, + "fixed_steps": 8.0, + "adaptive_steps": 2.9166666666666665 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_graphconv_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbbbp_graphconv_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..7883f62 --- /dev/null +++ b/runs/ogbg-molbbbp_graphconv_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_graphconv_classic_T0_ns1_h128_e100_s0", + "view": "graphconv", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 16.2, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.9268146968037438 + }, + "test": { + "rocauc": 0.5899884259259258 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbbbp_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..5d5dc58 --- /dev/null +++ b/runs/ogbg-molbbbp_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_graphconv_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "graphconv", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 18.9, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.9336851538384945 + }, + "test": { + "rocauc": 0.6518132716049383 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..1a941f7 --- /dev/null +++ b/runs/ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphconv", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 38.1, + "dev": "cuda:3", + "ep": 50, + "val": { + "rocauc": 0.9056058946529921 + }, + "val_adaptive": { + "rocauc": 0.923927113412327 + }, + "test": { + "rocauc": 0.6368634259259259 + }, + "test_adaptive": { + "rocauc": 0.6415895061728395 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0049019607843137, + "fixed_steps": 8.0, + "adaptive_steps": 2.1176470588235294 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..6e2f49d --- /dev/null +++ b/runs/ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphconv", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 40.5, + "dev": "cuda:0", + "ep": 60, + "val": { + "rocauc": 0.9234292542069104 + }, + "val_adaptive": { + "rocauc": 0.9375684556407448 + }, + "test": { + "rocauc": 0.6602044753086419 + }, + "test_adaptive": { + "rocauc": 0.6875 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.2058823529411766, + "fixed_steps": 8.0, + "adaptive_steps": 2.7941176470588234 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json b/runs/ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json new file mode 100644 index 0000000..5f5eadb --- /dev/null +++ b/runs/ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0", + "view": "graphconv", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 30, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 36.0, + "dev": "cuda:3", + "ep": 80, + "val": { + "rocauc": 0.9495170765707459 + }, + "val_adaptive": { + "rocauc": 0.9502140794583291 + }, + "test": { + "rocauc": 0.6861496913580247 + }, + "test_adaptive": { + "rocauc": 0.6808449074074074 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.1127450980392157, + "fixed_steps": 8.0, + "adaptive_steps": 2.7058823529411766 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_graphsage_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbbbp_graphsage_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..b21c0b7 --- /dev/null +++ b/runs/ogbg-molbbbp_graphsage_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_graphsage_classic_T0_ns1_h128_e100_s0", + "view": "graphsage", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 14.6, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.9483222144777457 + }, + "test": { + "rocauc": 0.628761574074074 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbbbp_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..1a95b3f --- /dev/null +++ b/runs/ogbg-molbbbp_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_graphsage_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "graphsage", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 30.4, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.9502140794583291 + }, + "test": { + "rocauc": 0.5933641975308641 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..a0534f9 --- /dev/null +++ b/runs/ogbg-molbbbp_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphsage", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 42.0, + "dev": "cuda:0", + "ep": 10, + "val": { + "rocauc": 0.9406551827143284 + }, + "val_adaptive": { + "rocauc": 0.9543960967838296 + }, + "test": { + "rocauc": 0.6039737654320988 + }, + "test_adaptive": { + "rocauc": 0.6147762345679012 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.5441176470588234, + "fixed_steps": 8.0, + "adaptive_steps": 2.5686274509803924 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_mf_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbbbp_mf_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..cd6c06d --- /dev/null +++ b/runs/ogbg-molbbbp_mf_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_mf_classic_T0_ns1_h128_e100_s0", + "view": "mf", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 64.9, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.9394603206213283 + }, + "test": { + "rocauc": 0.6364776234567902 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_mf_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbbbp_mf_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..067dcf6 --- /dev/null +++ b/runs/ogbg-molbbbp_mf_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_mf_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "mf", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 73.9, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.9488200736831625 + }, + "test": { + "rocauc": 0.6480516975308641 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..f221069 --- /dev/null +++ b/runs/ogbg-molbbbp_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "mf", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 76.6, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.936771880912078 + }, + "val_adaptive": { + "rocauc": 0.9453350592452454 + }, + "test": { + "rocauc": 0.662133487654321 + }, + "test_adaptive": { + "rocauc": 0.667824074074074 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.6862745098039214, + "fixed_steps": 8.0, + "adaptive_steps": 3.5441176470588234 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_pna_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbbbp_pna_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..04fb49d --- /dev/null +++ b/runs/ogbg-molbbbp_pna_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_pna_classic_T0_ns1_h128_e100_s0", + "view": "pna", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 45.6, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.955391815194663 + }, + "test": { + "rocauc": 0.6417824074074073 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_pna_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbbbp_pna_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..fd856dc --- /dev/null +++ b/runs/ogbg-molbbbp_pna_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_pna_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "pna", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 51.7, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.9584785422682465 + }, + "test": { + "rocauc": 0.6682098765432098 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..b0434cf --- /dev/null +++ b/runs/ogbg-molbbbp_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "pna", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 52.0, + "dev": "cuda:3", + "ep": 30, + "val": { + "rocauc": 0.9379667430050782 + }, + "val_adaptive": { + "rocauc": 0.9427461913770785 + }, + "test": { + "rocauc": 0.6539351851851851 + }, + "test_adaptive": { + "rocauc": 0.6563464506172839 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.200980392156863, + "fixed_steps": 8.0, + "adaptive_steps": 2.3137254901960786 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..a9791f9 --- /dev/null +++ b/runs/ogbg-molbbbp_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "pna", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 62.0, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.9500149357761626 + }, + "val_adaptive": { + "rocauc": 0.9505127949815791 + }, + "test": { + "rocauc": 0.6172839506172839 + }, + "test_adaptive": { + "rocauc": 0.6179591049382716 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.6715686274509802, + "fixed_steps": 8.0, + "adaptive_steps": 4.686274509803922 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_resgated_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbbbp_resgated_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..fdf12c1 --- /dev/null +++ b/runs/ogbg-molbbbp_resgated_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_resgated_classic_T0_ns1_h128_e100_s0", + "view": "resgated", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 20.4, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.9182515184705764 + }, + "test": { + "rocauc": 0.6626157407407406 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbbbp_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..accc032 --- /dev/null +++ b/runs/ogbg-molbbbp_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_resgated_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "resgated", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 40.2, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.9534999502140794 + }, + "test": { + "rocauc": 0.583912037037037 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..82cc92f --- /dev/null +++ b/runs/ogbg-molbbbp_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "resgated", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 42.6, + "dev": "cuda:3", + "ep": 20, + "val": { + "rocauc": 0.9499153639350792 + }, + "val_adaptive": { + "rocauc": 0.9558896744000798 + }, + "test": { + "rocauc": 0.6603973765432098 + }, + "test_adaptive": { + "rocauc": 0.6677276234567902 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.1519607843137254, + "fixed_steps": 8.0, + "adaptive_steps": 2.343137254901961 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..197b41e --- /dev/null +++ b/runs/ogbg-molbbbp_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "resgated", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 46.9, + "dev": "cuda:0", + "ep": 30, + "val": { + "rocauc": 0.9132729264164094 + }, + "val_adaptive": { + "rocauc": 0.9309967141292442 + }, + "test": { + "rocauc": 0.5753279320987655 + }, + "test_adaptive": { + "rocauc": 0.5887345679012346 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.6323529411764706, + "fixed_steps": 8.0, + "adaptive_steps": 3.593137254901961 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_sgc_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbbbp_sgc_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..e1f6e85 --- /dev/null +++ b/runs/ogbg-molbbbp_sgc_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_sgc_classic_T0_ns1_h128_e100_s0", + "view": "sgc", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 15.1, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.9300009957184109 + }, + "test": { + "rocauc": 0.6239390432098766 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbbbp_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..256ff82 --- /dev/null +++ b/runs/ogbg-molbbbp_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_sgc_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "sgc", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 22.0, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.9285074181021606 + }, + "test": { + "rocauc": 0.6454475308641976 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..beab1b0 --- /dev/null +++ b/runs/ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "sgc", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 39.6, + "dev": "cuda:3", + "ep": 70, + "val": { + "rocauc": 0.9346808722493279 + }, + "val_adaptive": { + "rocauc": 0.9448372000398287 + }, + "test": { + "rocauc": 0.6516203703703703 + }, + "test_adaptive": { + "rocauc": 0.6385030864197532 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0, + "fixed_steps": 8.0, + "adaptive_steps": 2.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..c0fc97d --- /dev/null +++ b/runs/ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "sgc", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 43.2, + "dev": "cuda:0", + "ep": 60, + "val": { + "rocauc": 0.947525639749079 + }, + "val_adaptive": { + "rocauc": 0.9579806830628299 + }, + "test": { + "rocauc": 0.6593364197530864 + }, + "test_adaptive": { + "rocauc": 0.6675347222222222 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.073529411764706, + "fixed_steps": 8.0, + "adaptive_steps": 2.2549019607843137 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json b/runs/ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json new file mode 100644 index 0000000..c3329bd --- /dev/null +++ b/runs/ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0", + "view": "sgc", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 30, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 39.7, + "dev": "cuda:3", + "ep": 40, + "val": { + "rocauc": 0.9522055162799961 + }, + "val_adaptive": { + "rocauc": 0.9463307776560788 + }, + "test": { + "rocauc": 0.6266396604938272 + }, + "test_adaptive": { + "rocauc": 0.6264467592592592 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.303921568627451, + "fixed_steps": 8.0, + "adaptive_steps": 2.7892156862745097 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_tag_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbbbp_tag_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..98c445b --- /dev/null +++ b/runs/ogbg-molbbbp_tag_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_tag_classic_T0_ns1_h128_e100_s0", + "view": "tag", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 19.7, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.9476252115901622 + }, + "test": { + "rocauc": 0.6099537037037036 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_tag_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbbbp_tag_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..e80c891 --- /dev/null +++ b/runs/ogbg-molbbbp_tag_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_tag_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "tag", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 30.0, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.9459324902917455 + }, + "test": { + "rocauc": 0.6419753086419753 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..f082d73 --- /dev/null +++ b/runs/ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "tag", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 44.0, + "dev": "cuda:3", + "ep": 30, + "val": { + "rocauc": 0.9405556108732449 + }, + "val_adaptive": { + "rocauc": 0.9485213581599123 + }, + "test": { + "rocauc": 0.635030864197531 + }, + "test_adaptive": { + "rocauc": 0.6146797839506173 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0098039215686274, + "fixed_steps": 8.0, + "adaptive_steps": 2.014705882352941 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..c20a688 --- /dev/null +++ b/runs/ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "tag", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 49.7, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.9496166484118291 + }, + "val_adaptive": { + "rocauc": 0.9541969531016629 + }, + "test": { + "rocauc": 0.6579861111111112 + }, + "test_adaptive": { + "rocauc": 0.6550925925925926 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.2549019607843137, + "fixed_steps": 8.0, + "adaptive_steps": 2.6176470588235294 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json b/runs/ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json new file mode 100644 index 0000000..7925593 --- /dev/null +++ b/runs/ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0", + "view": "tag", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 30, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 42.1, + "dev": "cuda:3", + "ep": 70, + "val": { + "rocauc": 0.9534999502140795 + }, + "val_adaptive": { + "rocauc": 0.949317932888579 + }, + "test": { + "rocauc": 0.6597222222222222 + }, + "test_adaptive": { + "rocauc": 0.6678240740740741 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.426470588235294, + "fixed_steps": 8.0, + "adaptive_steps": 3.2450980392156863 +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_transformer_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molbbbp_transformer_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..c83499c --- /dev/null +++ b/runs/ogbg-molbbbp_transformer_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_transformer_classic_T0_ns1_h128_e100_s0", + "view": "transformer", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 34.3, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.9495170765707458 + }, + "test": { + "rocauc": 0.6156442901234568 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molbbbp_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..a2dfef3 --- /dev/null +++ b/runs/ogbg-molbbbp_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_transformer_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "transformer", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 36.9, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.9354774469779946 + }, + "test": { + "rocauc": 0.6221064814814815 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molbbbp_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molbbbp_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..4016f9f --- /dev/null +++ b/runs/ogbg-molbbbp_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molbbbp", + "tag": "ogbg-molbbbp_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "transformer", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 54.8, + "dev": "cuda:0", + "ep": 90, + "val": { + "rocauc": 0.9397590361445782 + }, + "val_adaptive": { + "rocauc": 0.9337847256795778 + }, + "test": { + "rocauc": 0.642554012345679 + }, + "test_adaptive": { + "rocauc": 0.6309799382716049 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.1323529411764706, + "fixed_steps": 8.0, + "adaptive_steps": 2.2254901960784315 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_appnp_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molclintox_appnp_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..fa5411b --- /dev/null +++ b/runs/ogbg-molclintox_appnp_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_appnp_classic_T0_ns1_h128_e100_s0", + "view": "appnp", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 16.0, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.8515931251846744 + }, + "test": { + "rocauc": 0.9184287352726515 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molclintox_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..e276b4d --- /dev/null +++ b/runs/ogbg-molclintox_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_appnp_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "appnp", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 30.3, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.9029408385042188 + }, + "test": { + "rocauc": 0.8898090223473396 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..a53086c --- /dev/null +++ b/runs/ogbg-molclintox_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "appnp", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 34.7, + "dev": "cuda:3", + "ep": 100, + "val": { + "rocauc": 0.9391148757345941 + }, + "val_adaptive": { + "rocauc": 0.9443087429002922 + }, + "test": { + "rocauc": 0.8412244117749279 + }, + "test_adaptive": { + "rocauc": 0.9026361519480067 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0, + "fixed_steps": 8.0, + "adaptive_steps": 2.0405405405405403 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..fbc1d3b --- /dev/null +++ b/runs/ogbg-molclintox_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "appnp", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 36.2, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.9156406973308382 + }, + "val_adaptive": { + "rocauc": 0.9228938901474113 + }, + "test": { + "rocauc": 0.7779932575678588 + }, + "test_adaptive": { + "rocauc": 0.886122406422688 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.1621621621621623, + "fixed_steps": 8.0, + "adaptive_steps": 2.1621621621621623 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_arma_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molclintox_arma_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..a9bdee1 --- /dev/null +++ b/runs/ogbg-molclintox_arma_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_arma_classic_T0_ns1_h128_e100_s0", + "view": "arma", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 19.3, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.9462941987589875 + }, + "test": { + "rocauc": 0.8678231327981094 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_arma_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molclintox_arma_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..7488260 --- /dev/null +++ b/runs/ogbg-molclintox_arma_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_arma_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "arma", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 32.7, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.9135288420499689 + }, + "test": { + "rocauc": 0.8863352796024051 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..22fa6a2 --- /dev/null +++ b/runs/ogbg-molclintox_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "arma", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 36.6, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.942323287041597 + }, + "val_adaptive": { + "rocauc": 0.9228060671722643 + }, + "test": { + "rocauc": 0.8458372432488792 + }, + "test_adaptive": { + "rocauc": 0.8651226844611268 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.831081081081081, + "fixed_steps": 8.0, + "adaptive_steps": 2.722972972972973 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_cheb_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molclintox_cheb_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..d0d3745 --- /dev/null +++ b/runs/ogbg-molclintox_cheb_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_cheb_classic_T0_ns1_h128_e100_s0", + "view": "cheb", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 17.0, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.8927886667323287 + }, + "test": { + "rocauc": 0.9152165224342266 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molclintox_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..7495809 --- /dev/null +++ b/runs/ogbg-molclintox_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_cheb_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "cheb", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 20.5, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.8816384319905446 + }, + "test": { + "rocauc": 0.8982283738226811 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..93e0496 --- /dev/null +++ b/runs/ogbg-molclintox_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "cheb", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 36.3, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.9172116615778587 + }, + "val_adaptive": { + "rocauc": 0.9370415969007518 + }, + "test": { + "rocauc": 0.906584297779168 + }, + "test_adaptive": { + "rocauc": 0.9058335939943698 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.25, + "fixed_steps": 8.0, + "adaptive_steps": 2.97972972972973 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_film_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molclintox_film_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..4ba9e9c --- /dev/null +++ b/runs/ogbg-molclintox_film_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_film_classic_T0_ns1_h128_e100_s0", + "view": "film", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 23.7, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.9048138481237074 + }, + "test": { + "rocauc": 0.7730589441490285 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_film_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molclintox_film_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..4eb4dec --- /dev/null +++ b/runs/ogbg-molclintox_film_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_film_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "film", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 29.8, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.9453700055812732 + }, + "test": { + "rocauc": 0.8429647586278803 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..6777e2e --- /dev/null +++ b/runs/ogbg-molclintox_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "film", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 33.2, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.8531673725335697 + }, + "val_adaptive": { + "rocauc": 0.8860451754817951 + }, + "test": { + "rocauc": 0.8229512042539882 + }, + "test_adaptive": { + "rocauc": 0.8409142251416258 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.385135135135135, + "fixed_steps": 8.0, + "adaptive_steps": 3.5675675675675675 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_gatv2_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molclintox_gatv2_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..12a30aa --- /dev/null +++ b/runs/ogbg-molclintox_gatv2_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_gatv2_classic_T0_ns1_h128_e100_s0", + "view": "gatv2", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 33.2, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.9514880659246856 + }, + "test": { + "rocauc": 0.849258853786536 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molclintox_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..603df56 --- /dev/null +++ b/runs/ogbg-molclintox_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_gatv2_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gatv2", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 38.6, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.9350807643061164 + }, + "test": { + "rocauc": 0.8328163556111632 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..673fe03 --- /dev/null +++ b/runs/ogbg-molclintox_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gatv2", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 43.6, + "dev": "cuda:1", + "ep": 100, + "val": { + "rocauc": 0.9506763189861781 + }, + "val_adaptive": { + "rocauc": 0.956720509537411 + }, + "test": { + "rocauc": 0.8617905675459633 + }, + "test_adaptive": { + "rocauc": 0.834407256803253 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.2837837837837838, + "fixed_steps": 8.0, + "adaptive_steps": 2.3378378378378377 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_gcn_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molclintox_gcn_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..acfb767 --- /dev/null +++ b/runs/ogbg-molclintox_gcn_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_gcn_classic_T0_ns1_h128_e100_s0", + "view": "gcn", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 11.4, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.9318477297350538 + }, + "test": { + "rocauc": 0.8932080422618427 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molclintox_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..b003dfe --- /dev/null +++ b/runs/ogbg-molclintox_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_gcn_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gcn", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 19.6, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.909733576282872 + }, + "test": { + "rocauc": 0.8791896917248809 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..349dbe6 --- /dev/null +++ b/runs/ogbg-molclintox_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gcn", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 29.6, + "dev": "cuda:3", + "ep": 90, + "val": { + "rocauc": 0.9758757674250633 + }, + "val_adaptive": { + "rocauc": 0.9734405266095407 + }, + "test": { + "rocauc": 0.8739825530879644 + }, + "test_adaptive": { + "rocauc": 0.8682749452611824 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0, + "fixed_steps": 8.0, + "adaptive_steps": 2.054054054054054 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..011ded7 --- /dev/null +++ b/runs/ogbg-molclintox_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gcn", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 32.0, + "dev": "cuda:1", + "ep": 90, + "val": { + "rocauc": 0.9460307298335469 + }, + "val_adaptive": { + "rocauc": 0.943858957943465 + }, + "test": { + "rocauc": 0.8712221527126125 + }, + "test_adaptive": { + "rocauc": 0.8801906301046121 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.1621621621621623, + "fixed_steps": 8.0, + "adaptive_steps": 2.2027027027027026 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_gen_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molclintox_gen_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..297cd3e --- /dev/null +++ b/runs/ogbg-molclintox_gen_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_gen_classic_T0_ns1_h128_e100_s0", + "view": "gen", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 16.4, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.9820184510325356 + }, + "test": { + "rocauc": 0.8127689153025406 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_gen_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molclintox_gen_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..053b21b --- /dev/null +++ b/runs/ogbg-molclintox_gen_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_gen_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gen", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 31.7, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.9398880462260745 + }, + "test": { + "rocauc": 0.8194027386786223 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..2a4d418 --- /dev/null +++ b/runs/ogbg-molclintox_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gen", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 34.1, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.962652253849437 + }, + "val_adaptive": { + "rocauc": 0.9578942184575987 + }, + "test": { + "rocauc": 0.7993926597852152 + }, + "test_adaptive": { + "rocauc": 0.8024780175859313 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.3716216216216215, + "fixed_steps": 8.0, + "adaptive_steps": 2.52027027027027 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_gin_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molclintox_gin_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..13498e1 --- /dev/null +++ b/runs/ogbg-molclintox_gin_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_gin_classic_T0_ns1_h128_e100_s0", + "view": "gin", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 20.0, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.9547104304146558 + }, + "test": { + "rocauc": 0.8586383067459077 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_gin_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molclintox_gin_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..2eb5ad6 --- /dev/null +++ b/runs/ogbg-molclintox_gin_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_gin_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gin", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 29.9, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.9163892445582587 + }, + "test": { + "rocauc": 0.8788013067806625 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..ed5f58b --- /dev/null +++ b/runs/ogbg-molclintox_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 30.7, + "dev": "cuda:3", + "ep": 60, + "val": { + "rocauc": 0.925691092944614 + }, + "val_adaptive": { + "rocauc": 0.9147025509701566 + }, + "test": { + "rocauc": 0.880287943558197 + }, + "test_adaptive": { + "rocauc": 0.8739417161922636 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0405405405405403, + "fixed_steps": 8.0, + "adaptive_steps": 2.0675675675675675 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..9a23f3d --- /dev/null +++ b/runs/ogbg-molclintox_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 33.1, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.9599674972914409 + }, + "val_adaptive": { + "rocauc": 0.9615909911684559 + }, + "test": { + "rocauc": 0.8033521009279533 + }, + "test_adaptive": { + "rocauc": 0.8111476036562055 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.2432432432432434, + "fixed_steps": 8.0, + "adaptive_steps": 2.7094594594594597 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_gine_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molclintox_gine_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..52546fb --- /dev/null +++ b/runs/ogbg-molclintox_gine_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_gine_classic_T0_ns1_h128_e100_s0", + "view": "gine", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 12.0, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.9352564102564103 + }, + "test": { + "rocauc": 0.8869330622458556 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_gine_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molclintox_gine_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..7876dc1 --- /dev/null +++ b/runs/ogbg-molclintox_gine_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_gine_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gine", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 29.8, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.9225425982468236 + }, + "test": { + "rocauc": 0.8839597886907865 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..a0e4e2a --- /dev/null +++ b/runs/ogbg-molclintox_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gine", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 33.1, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.9456195213237466 + }, + "val_adaptive": { + "rocauc": 0.9196715256574411 + }, + "test": { + "rocauc": 0.9048100649914852 + }, + "test_adaptive": { + "rocauc": 0.9068831891008932 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.2162162162162162, + "fixed_steps": 8.0, + "adaptive_steps": 2.2972972972972974 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_graphconv_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molclintox_graphconv_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..bd2e92c --- /dev/null +++ b/runs/ogbg-molclintox_graphconv_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_graphconv_classic_T0_ns1_h128_e100_s0", + "view": "graphconv", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 10.2, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.8917274040513478 + }, + "test": { + "rocauc": 0.850132937128558 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molclintox_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..a57218f --- /dev/null +++ b/runs/ogbg-molclintox_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_graphconv_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "graphconv", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 25.2, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.849372106766473 + }, + "test": { + "rocauc": 0.8185512459597539 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..41d1eab --- /dev/null +++ b/runs/ogbg-molclintox_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphconv", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 28.6, + "dev": "cuda:3", + "ep": 40, + "val": { + "rocauc": 0.8659657244164286 + }, + "val_adaptive": { + "rocauc": 0.8802505006730359 + }, + "test": { + "rocauc": 0.805447815660515 + }, + "test_adaptive": { + "rocauc": 0.8240981128140966 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.141891891891892, + "fixed_steps": 8.0, + "adaptive_steps": 2.2094594594594597 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..f19044a --- /dev/null +++ b/runs/ogbg-molclintox_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphconv", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 30.4, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.9574583866837387 + }, + "val_adaptive": { + "rocauc": 0.9313733215141666 + }, + "test": { + "rocauc": 0.881274111145866 + }, + "test_adaptive": { + "rocauc": 0.8484968546901609 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.2837837837837838, + "fixed_steps": 8.0, + "adaptive_steps": 2.4121621621621623 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_graphsage_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molclintox_graphsage_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..5eb0922 --- /dev/null +++ b/runs/ogbg-molclintox_graphsage_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_graphsage_classic_T0_ns1_h128_e100_s0", + "view": "graphsage", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 10.6, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.9143020125414492 + }, + "test": { + "rocauc": 0.8881694644284572 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molclintox_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..89cf219 --- /dev/null +++ b/runs/ogbg-molclintox_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_graphsage_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "graphsage", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 26.4, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.957908171640566 + }, + "test": { + "rocauc": 0.8664451047857367 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..dbcc610 --- /dev/null +++ b/runs/ogbg-molclintox_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphsage", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 31.5, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.9516390886109196 + }, + "val_adaptive": { + "rocauc": 0.9448955973603861 + }, + "test": { + "rocauc": 0.88216296527995 + }, + "test_adaptive": { + "rocauc": 0.8780280123727106 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.5067567567567566, + "fixed_steps": 8.0, + "adaptive_steps": 2.4324324324324325 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_mf_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molclintox_mf_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..4574369 --- /dev/null +++ b/runs/ogbg-molclintox_mf_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_mf_classic_T0_ns1_h128_e100_s0", + "view": "mf", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 51.1, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.9251534850126399 + }, + "test": { + "rocauc": 0.8369808501025267 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_mf_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molclintox_mf_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..4bb8f7a --- /dev/null +++ b/runs/ogbg-molclintox_mf_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_mf_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "mf", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 55.6, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.9147271742342165 + }, + "test": { + "rocauc": 0.804700587356202 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..9b5ba68 --- /dev/null +++ b/runs/ogbg-molclintox_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "mf", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 52.8, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.9416239863422963 + }, + "val_adaptive": { + "rocauc": 0.9153386519583703 + }, + "test": { + "rocauc": 0.852654398220554 + }, + "test_adaptive": { + "rocauc": 0.8698067632850242 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.1554054054054053, + "fixed_steps": 8.0, + "adaptive_steps": 2.5675675675675675 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_pna_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molclintox_pna_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..3a82461 --- /dev/null +++ b/runs/ogbg-molclintox_pna_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_pna_classic_T0_ns1_h128_e100_s0", + "view": "pna", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 36.9, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.9285867887980563 + }, + "test": { + "rocauc": 0.8602891599763668 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_pna_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molclintox_pna_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..67f69a4 --- /dev/null +++ b/runs/ogbg-molclintox_pna_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_pna_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "pna", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 36.7, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.9064094356347877 + }, + "test": { + "rocauc": 0.8734968546901609 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..c61b6bf --- /dev/null +++ b/runs/ogbg-molclintox_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "pna", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 39.9, + "dev": "cuda:3", + "ep": 100, + "val": { + "rocauc": 0.8294650185495256 + }, + "val_adaptive": { + "rocauc": 0.8032921304048065 + }, + "test": { + "rocauc": 0.9034242171480207 + }, + "test_adaptive": { + "rocauc": 0.9194748548986897 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.054054054054054, + "fixed_steps": 8.0, + "adaptive_steps": 2.22972972972973 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..86c137d --- /dev/null +++ b/runs/ogbg-molclintox_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "pna", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 43.0, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.874143110410716 + }, + "val_adaptive": { + "rocauc": 0.8983059194326799 + }, + "test": { + "rocauc": 0.8539203419872797 + }, + "test_adaptive": { + "rocauc": 0.8613908872901679 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.5337837837837838, + "fixed_steps": 8.0, + "adaptive_steps": 3.675675675675676 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_resgated_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molclintox_resgated_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..4256fd6 --- /dev/null +++ b/runs/ogbg-molclintox_resgated_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_resgated_classic_T0_ns1_h128_e100_s0", + "view": "resgated", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 17.1, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.9243803145211595 + }, + "test": { + "rocauc": 0.9184252597921663 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molclintox_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..480b881 --- /dev/null +++ b/runs/ogbg-molclintox_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_resgated_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "resgated", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 34.7, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.9055377720870679 + }, + "test": { + "rocauc": 0.8978999409168318 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..8b41b3c --- /dev/null +++ b/runs/ogbg-molclintox_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "resgated", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 33.3, + "dev": "cuda:3", + "ep": 80, + "val": { + "rocauc": 0.9116172559834532 + }, + "val_adaptive": { + "rocauc": 0.8987942808365345 + }, + "test": { + "rocauc": 0.8402903763945366 + }, + "test_adaptive": { + "rocauc": 0.8415754353039308 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.027027027027027, + "fixed_steps": 8.0, + "adaptive_steps": 2.0337837837837838 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..dd54b34 --- /dev/null +++ b/runs/ogbg-molclintox_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "resgated", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 33.7, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.957693949243245 + }, + "val_adaptive": { + "rocauc": 0.9453946288453331 + }, + "test": { + "rocauc": 0.8777291210509853 + }, + "test_adaptive": { + "rocauc": 0.8950795885031105 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.1554054054054053, + "fixed_steps": 8.0, + "adaptive_steps": 2.2567567567567566 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_sgc_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molclintox_sgc_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..47d3ae9 --- /dev/null +++ b/runs/ogbg-molclintox_sgc_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_sgc_classic_T0_ns1_h128_e100_s0", + "view": "sgc", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 13.1, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.9194852096260546 + }, + "test": { + "rocauc": 0.8985793973516839 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molclintox_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..038547d --- /dev/null +++ b/runs/ogbg-molclintox_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_sgc_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "sgc", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 23.6, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.9219696969696969 + }, + "test": { + "rocauc": 0.9054147985959059 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..d8fc57c --- /dev/null +++ b/runs/ogbg-molclintox_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "sgc", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 31.0, + "dev": "cuda:3", + "ep": 70, + "val": { + "rocauc": 0.9309095833743721 + }, + "val_adaptive": { + "rocauc": 0.9393258150300403 + }, + "test": { + "rocauc": 0.8809821707851111 + }, + "test_adaptive": { + "rocauc": 0.9033008375907969 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0135135135135136, + "fixed_steps": 8.0, + "adaptive_steps": 2.0878378378378377 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..360e0bc --- /dev/null +++ b/runs/ogbg-molclintox_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "sgc", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 32.9, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.9152647821661906 + }, + "val_adaptive": { + "rocauc": 0.8952731540759709 + }, + "test": { + "rocauc": 0.8882589580509506 + }, + "test_adaptive": { + "rocauc": 0.8904589371980676 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.310810810810811, + "fixed_steps": 8.0, + "adaptive_steps": 2.25 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_tag_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molclintox_tag_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..aa7648f --- /dev/null +++ b/runs/ogbg-molclintox_tag_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_tag_classic_T0_ns1_h128_e100_s0", + "view": "tag", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 23.4, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.923656390557799 + }, + "test": { + "rocauc": 0.7998149306641643 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_tag_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molclintox_tag_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..4a0238f --- /dev/null +++ b/runs/ogbg-molclintox_tag_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_tag_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "tag", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 30.9, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.9182762073607145 + }, + "test": { + "rocauc": 0.8432784207416675 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..492182a --- /dev/null +++ b/runs/ogbg-molclintox_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "tag", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 33.2, + "dev": "cuda:3", + "ep": 30, + "val": { + "rocauc": 0.8678740273810697 + }, + "val_adaptive": { + "rocauc": 0.8684116353130438 + }, + "test": { + "rocauc": 0.8432636499496056 + }, + "test_adaptive": { + "rocauc": 0.8344932749452612 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0, + "fixed_steps": 8.0, + "adaptive_steps": 2.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..b488b39 --- /dev/null +++ b/runs/ogbg-molclintox_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "tag", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 35.5, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.9001050592599888 + }, + "val_adaptive": { + "rocauc": 0.8796882694770018 + }, + "test": { + "rocauc": 0.8008871163938415 + }, + "test_adaptive": { + "rocauc": 0.8083576616967296 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.47972972972973, + "fixed_steps": 8.0, + "adaptive_steps": 2.5945945945945947 +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_transformer_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molclintox_transformer_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..605855f --- /dev/null +++ b/runs/ogbg-molclintox_transformer_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_transformer_classic_T0_ns1_h128_e100_s0", + "view": "transformer", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 29.2, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.9270511178961884 + }, + "test": { + "rocauc": 0.8763771591422514 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molclintox_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..50ba6e4 --- /dev/null +++ b/runs/ogbg-molclintox_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_transformer_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "transformer", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 38.6, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.9321957385337667 + }, + "test": { + "rocauc": 0.8521686998227505 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molclintox_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molclintox_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..4389deb --- /dev/null +++ b/runs/ogbg-molclintox_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molclintox", + "tag": "ogbg-molclintox_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "transformer", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 41.0, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.8521414031977412 + }, + "val_adaptive": { + "rocauc": 0.8862561147772415 + }, + "test": { + "rocauc": 0.7332707746846001 + }, + "test_adaptive": { + "rocauc": 0.7908464532721649 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.310810810810811, + "fixed_steps": 8.0, + "adaptive_steps": 3.2567567567567566 +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_appnp_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molesol_appnp_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..6a47cc6 --- /dev/null +++ b/runs/ogbg-molesol_appnp_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_appnp_classic_T0_ns1_h128_e100_s0", + "view": "appnp", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 11.3, + "dev": "cuda:1", + "ep": 50, + "val": { + "rmse": 1.608295202255249 + }, + "test": { + "rmse": 1.5212217569351196 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molesol_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..719533d --- /dev/null +++ b/runs/ogbg-molesol_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_appnp_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "appnp", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 17.4, + "dev": "cuda:1", + "ep": 100, + "val": { + "rmse": 1.4195600748062134 + }, + "test": { + "rmse": 1.4928637742996216 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molesol_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..0885895 --- /dev/null +++ b/runs/ogbg-molesol_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "appnp", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 26.7, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 1.6270278692245483 + }, + "val_adaptive": { + "rmse": 1.2530083656311035 + }, + "test": { + "rmse": 1.2973164319992065 + }, + "test_adaptive": { + "rmse": 1.0733075141906738 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.743362831858407, + "fixed_steps": 8.0, + "adaptive_steps": 2.814159292035398 +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_arma_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molesol_arma_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..7ce93b8 --- /dev/null +++ b/runs/ogbg-molesol_arma_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_arma_classic_T0_ns1_h128_e100_s0", + "view": "arma", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 11.5, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 1.0194642543792725 + }, + "test": { + "rmse": 1.0665998458862305 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_arma_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molesol_arma_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..5beccfd --- /dev/null +++ b/runs/ogbg-molesol_arma_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_arma_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "arma", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 17.6, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 1.003442406654358 + }, + "test": { + "rmse": 1.1272348165512085 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molesol_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..818213d --- /dev/null +++ b/runs/ogbg-molesol_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "arma", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 26.9, + "dev": "cuda:1", + "ep": 50, + "val": { + "rmse": 1.3099640607833862 + }, + "val_adaptive": { + "rmse": 1.0777862071990967 + }, + "test": { + "rmse": 1.5309946537017822 + }, + "test_adaptive": { + "rmse": 1.038582682609558 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.4867256637168142, + "fixed_steps": 8.0, + "adaptive_steps": 2.575221238938053 +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_cheb_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molesol_cheb_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..30b1a7a --- /dev/null +++ b/runs/ogbg-molesol_cheb_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_cheb_classic_T0_ns1_h128_e100_s0", + "view": "cheb", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 10.8, + "dev": "cuda:1", + "ep": 60, + "val": { + "rmse": 0.9649985432624817 + }, + "test": { + "rmse": 0.8722475171089172 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molesol_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..ce5887e --- /dev/null +++ b/runs/ogbg-molesol_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_cheb_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "cheb", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 14.6, + "dev": "cuda:1", + "ep": 40, + "val": { + "rmse": 0.9198977947235107 + }, + "test": { + "rmse": 0.8840651512145996 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molesol_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..826de97 --- /dev/null +++ b/runs/ogbg-molesol_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "cheb", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 26.8, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 1.0643402338027954 + }, + "val_adaptive": { + "rmse": 0.918844997882843 + }, + "test": { + "rmse": 1.0342040061950684 + }, + "test_adaptive": { + "rmse": 0.8497806787490845 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.424778761061947, + "fixed_steps": 8.0, + "adaptive_steps": 2.601769911504425 +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_film_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molesol_film_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..db08bfe --- /dev/null +++ b/runs/ogbg-molesol_film_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_film_classic_T0_ns1_h128_e100_s0", + "view": "film", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 9.3, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 1.0717737674713135 + }, + "test": { + "rmse": 1.2896088361740112 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_film_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molesol_film_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..f4729c2 --- /dev/null +++ b/runs/ogbg-molesol_film_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_film_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "film", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 14.6, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 1.0196408033370972 + }, + "test": { + "rmse": 1.084921956062317 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molesol_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..5af1876 --- /dev/null +++ b/runs/ogbg-molesol_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "film", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 24.9, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 1.3673769235610962 + }, + "val_adaptive": { + "rmse": 1.275072455406189 + }, + "test": { + "rmse": 1.3647929430007935 + }, + "test_adaptive": { + "rmse": 1.128640055656433 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 4.0, + "fixed_steps": 8.0, + "adaptive_steps": 3.6106194690265485 +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_gatv2_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molesol_gatv2_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..5fab56a --- /dev/null +++ b/runs/ogbg-molesol_gatv2_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_gatv2_classic_T0_ns1_h128_e100_s0", + "view": "gatv2", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 16.1, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 1.0367836952209473 + }, + "test": { + "rmse": 0.9878302216529846 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molesol_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..ab55e2b --- /dev/null +++ b/runs/ogbg-molesol_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_gatv2_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gatv2", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 17.5, + "dev": "cuda:1", + "ep": 40, + "val": { + "rmse": 1.001816987991333 + }, + "test": { + "rmse": 0.9779817461967468 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molesol_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..896ce8b --- /dev/null +++ b/runs/ogbg-molesol_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gatv2", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 30.2, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 0.9842343926429749 + }, + "val_adaptive": { + "rmse": 0.9415140748023987 + }, + "test": { + "rmse": 0.9534291625022888 + }, + "test_adaptive": { + "rmse": 0.8805939555168152 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.5929203539823007, + "fixed_steps": 8.0, + "adaptive_steps": 2.4867256637168142 +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_gcn_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molesol_gcn_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..8498f5c --- /dev/null +++ b/runs/ogbg-molesol_gcn_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_gcn_classic_T0_ns1_h128_e100_s0", + "view": "gcn", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 7.7, + "dev": "cuda:1", + "ep": 40, + "val": { + "rmse": 1.0408910512924194 + }, + "test": { + "rmse": 1.1161426305770874 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molesol_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..c279b31 --- /dev/null +++ b/runs/ogbg-molesol_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_gcn_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gcn", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 11.3, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 0.9590842127799988 + }, + "test": { + "rmse": 0.9305291175842285 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molesol_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..37245f5 --- /dev/null +++ b/runs/ogbg-molesol_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gcn", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 23.8, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 1.0293915271759033 + }, + "val_adaptive": { + "rmse": 0.8799248337745667 + }, + "test": { + "rmse": 1.2572919130325317 + }, + "test_adaptive": { + "rmse": 0.9221709370613098 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.7876106194690267, + "fixed_steps": 8.0, + "adaptive_steps": 2.7168141592920354 +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_gen_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molesol_gen_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..8598a27 --- /dev/null +++ b/runs/ogbg-molesol_gen_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_gen_classic_T0_ns1_h128_e100_s0", + "view": "gen", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 9.5, + "dev": "cuda:1", + "ep": 40, + "val": { + "rmse": 1.0088852643966675 + }, + "test": { + "rmse": 0.8762271404266357 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_gen_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molesol_gen_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..ac5af1b --- /dev/null +++ b/runs/ogbg-molesol_gen_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_gen_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gen", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 15.9, + "dev": "cuda:1", + "ep": 50, + "val": { + "rmse": 1.0026726722717285 + }, + "test": { + "rmse": 0.920613169670105 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molesol_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..610ce8f --- /dev/null +++ b/runs/ogbg-molesol_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gen", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 25.3, + "dev": "cuda:1", + "ep": 60, + "val": { + "rmse": 1.1622369289398193 + }, + "val_adaptive": { + "rmse": 1.0015885829925537 + }, + "test": { + "rmse": 1.4459298849105835 + }, + "test_adaptive": { + "rmse": 1.0918991565704346 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.690265486725664, + "fixed_steps": 8.0, + "adaptive_steps": 2.6106194690265485 +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_gin_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molesol_gin_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..3656879 --- /dev/null +++ b/runs/ogbg-molesol_gin_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_gin_classic_T0_ns1_h128_e100_s0", + "view": "gin", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 8.7, + "dev": "cuda:1", + "ep": 60, + "val": { + "rmse": 1.0186669826507568 + }, + "test": { + "rmse": 0.9899855852127075 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_gin_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molesol_gin_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..24aa419 --- /dev/null +++ b/runs/ogbg-molesol_gin_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_gin_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gin", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 14.8, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 0.9646593928337097 + }, + "test": { + "rmse": 1.0798395872116089 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molesol_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..12913d5 --- /dev/null +++ b/runs/ogbg-molesol_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 29.9, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 1.4046697616577148 + }, + "val_adaptive": { + "rmse": 0.9466085433959961 + }, + "test": { + "rmse": 2.065119504928589 + }, + "test_adaptive": { + "rmse": 0.9663381576538086 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.8849557522123894, + "fixed_steps": 8.0, + "adaptive_steps": 2.982300884955752 +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_gine_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molesol_gine_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..71039a3 --- /dev/null +++ b/runs/ogbg-molesol_gine_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_gine_classic_T0_ns1_h128_e100_s0", + "view": "gine", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 13.2, + "dev": "cuda:1", + "ep": 100, + "val": { + "rmse": 1.0286154747009277 + }, + "test": { + "rmse": 1.0806611776351929 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_gine_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molesol_gine_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..3eb0ea1 --- /dev/null +++ b/runs/ogbg-molesol_gine_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_gine_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gine", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 13.6, + "dev": "cuda:1", + "ep": 100, + "val": { + "rmse": 1.0580767393112183 + }, + "test": { + "rmse": 1.0950747728347778 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molesol_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..6ea7888 --- /dev/null +++ b/runs/ogbg-molesol_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gine", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 23.3, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 1.3110343217849731 + }, + "val_adaptive": { + "rmse": 1.0165117979049683 + }, + "test": { + "rmse": 2.039428472518921 + }, + "test_adaptive": { + "rmse": 1.099277138710022 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.5132743362831858, + "fixed_steps": 8.0, + "adaptive_steps": 2.8849557522123894 +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_graphconv_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molesol_graphconv_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..247fa49 --- /dev/null +++ b/runs/ogbg-molesol_graphconv_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_graphconv_classic_T0_ns1_h128_e100_s0", + "view": "graphconv", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 7.0, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 0.9740990400314331 + }, + "test": { + "rmse": 0.9732325673103333 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molesol_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..ece0df6 --- /dev/null +++ b/runs/ogbg-molesol_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_graphconv_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "graphconv", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 10.7, + "dev": "cuda:1", + "ep": 40, + "val": { + "rmse": 1.0048154592514038 + }, + "test": { + "rmse": 0.9968388080596924 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molesol_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..e0dd2ba --- /dev/null +++ b/runs/ogbg-molesol_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphconv", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 22.9, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 1.148048996925354 + }, + "val_adaptive": { + "rmse": 1.0027403831481934 + }, + "test": { + "rmse": 1.2080546617507935 + }, + "test_adaptive": { + "rmse": 1.0046480894088745 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.150442477876106, + "fixed_steps": 8.0, + "adaptive_steps": 2.743362831858407 +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_graphsage_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molesol_graphsage_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..a2f7308 --- /dev/null +++ b/runs/ogbg-molesol_graphsage_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_graphsage_classic_T0_ns1_h128_e100_s0", + "view": "graphsage", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 7.1, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 0.9680215120315552 + }, + "test": { + "rmse": 1.0037521123886108 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molesol_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..de80ece --- /dev/null +++ b/runs/ogbg-molesol_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_graphsage_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "graphsage", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 11.6, + "dev": "cuda:1", + "ep": 20, + "val": { + "rmse": 0.9934180974960327 + }, + "test": { + "rmse": 1.0794438123703003 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molesol_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..eb74c8c --- /dev/null +++ b/runs/ogbg-molesol_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphsage", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 23.8, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 1.1587085723876953 + }, + "val_adaptive": { + "rmse": 0.9203268885612488 + }, + "test": { + "rmse": 1.3228503465652466 + }, + "test_adaptive": { + "rmse": 0.9323515295982361 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.4070796460176993, + "fixed_steps": 8.0, + "adaptive_steps": 2.398230088495575 +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_mf_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molesol_mf_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..ebb24ff --- /dev/null +++ b/runs/ogbg-molesol_mf_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_mf_classic_T0_ns1_h128_e100_s0", + "view": "mf", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 22.8, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 1.1494333744049072 + }, + "test": { + "rmse": 1.0638543367385864 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_mf_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molesol_mf_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..a46243a --- /dev/null +++ b/runs/ogbg-molesol_mf_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_mf_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "mf", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 41.5, + "dev": "cuda:1", + "ep": 40, + "val": { + "rmse": 1.055277943611145 + }, + "test": { + "rmse": 1.0367581844329834 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molesol_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..05d9465 --- /dev/null +++ b/runs/ogbg-molesol_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "mf", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 39.1, + "dev": "cuda:1", + "ep": 60, + "val": { + "rmse": 1.0765037536621094 + }, + "val_adaptive": { + "rmse": 1.0629757642745972 + }, + "test": { + "rmse": 1.0843762159347534 + }, + "test_adaptive": { + "rmse": 0.9588797688484192 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.690265486725664, + "fixed_steps": 8.0, + "adaptive_steps": 3.4070796460176993 +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_pna_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molesol_pna_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..c49f0b7 --- /dev/null +++ b/runs/ogbg-molesol_pna_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_pna_classic_T0_ns1_h128_e100_s0", + "view": "pna", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 18.9, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 0.911565363407135 + }, + "test": { + "rmse": 0.9152661561965942 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_pna_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molesol_pna_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..53395fa --- /dev/null +++ b/runs/ogbg-molesol_pna_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_pna_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "pna", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 25.1, + "dev": "cuda:1", + "ep": 50, + "val": { + "rmse": 0.9840529561042786 + }, + "test": { + "rmse": 0.9092428088188171 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molesol_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..a4f70e0 --- /dev/null +++ b/runs/ogbg-molesol_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "pna", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 32.0, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 1.280998706817627 + }, + "val_adaptive": { + "rmse": 1.0270553827285767 + }, + "test": { + "rmse": 1.4175682067871094 + }, + "test_adaptive": { + "rmse": 0.9829455614089966 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.4601769911504423, + "fixed_steps": 8.0, + "adaptive_steps": 2.601769911504425 +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_resgated_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molesol_resgated_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..ffa3eaf --- /dev/null +++ b/runs/ogbg-molesol_resgated_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_resgated_classic_T0_ns1_h128_e100_s0", + "view": "resgated", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 9.9, + "dev": "cuda:1", + "ep": 60, + "val": { + "rmse": 0.9491544961929321 + }, + "test": { + "rmse": 0.8908001780509949 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molesol_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..626ef87 --- /dev/null +++ b/runs/ogbg-molesol_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_resgated_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "resgated", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 24.6, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 0.9873355627059937 + }, + "test": { + "rmse": 0.8825017213821411 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molesol_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..27c5012 --- /dev/null +++ b/runs/ogbg-molesol_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "resgated", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 25.8, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 1.093890905380249 + }, + "val_adaptive": { + "rmse": 0.9799346327781677 + }, + "test": { + "rmse": 1.0833443403244019 + }, + "test_adaptive": { + "rmse": 0.9181241989135742 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.274336283185841, + "fixed_steps": 8.0, + "adaptive_steps": 3.230088495575221 +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_sgc_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molesol_sgc_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..5fcc1d3 --- /dev/null +++ b/runs/ogbg-molesol_sgc_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_sgc_classic_T0_ns1_h128_e100_s0", + "view": "sgc", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 9.6, + "dev": "cuda:1", + "ep": 100, + "val": { + "rmse": 1.061699628829956 + }, + "test": { + "rmse": 0.9779573082923889 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molesol_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..6c40242 --- /dev/null +++ b/runs/ogbg-molesol_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_sgc_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "sgc", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 11.6, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 1.0129139423370361 + }, + "test": { + "rmse": 0.9372893571853638 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molesol_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..868b5df --- /dev/null +++ b/runs/ogbg-molesol_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "sgc", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 23.9, + "dev": "cuda:1", + "ep": 60, + "val": { + "rmse": 1.0345253944396973 + }, + "val_adaptive": { + "rmse": 1.0311837196350098 + }, + "test": { + "rmse": 1.0465621948242188 + }, + "test_adaptive": { + "rmse": 0.9780674576759338 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.4070796460176993, + "fixed_steps": 8.0, + "adaptive_steps": 3.2831858407079646 +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_tag_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molesol_tag_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..bdab4c4 --- /dev/null +++ b/runs/ogbg-molesol_tag_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_tag_classic_T0_ns1_h128_e100_s0", + "view": "tag", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 10.5, + "dev": "cuda:1", + "ep": 30, + "val": { + "rmse": 0.9323490858078003 + }, + "test": { + "rmse": 0.9677547216415405 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_tag_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molesol_tag_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..317fb16 --- /dev/null +++ b/runs/ogbg-molesol_tag_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_tag_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "tag", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 16.3, + "dev": "cuda:1", + "ep": 50, + "val": { + "rmse": 0.9035957455635071 + }, + "test": { + "rmse": 0.9462130665779114 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molesol_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..0e155a1 --- /dev/null +++ b/runs/ogbg-molesol_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "tag", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 25.9, + "dev": "cuda:1", + "ep": 100, + "val": { + "rmse": 1.0871219635009766 + }, + "val_adaptive": { + "rmse": 0.9639987349510193 + }, + "test": { + "rmse": 1.2508167028427124 + }, + "test_adaptive": { + "rmse": 1.01895010471344 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.3893805309734515, + "fixed_steps": 8.0, + "adaptive_steps": 2.353982300884956 +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_transformer_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molesol_transformer_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..ff4f947 --- /dev/null +++ b/runs/ogbg-molesol_transformer_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_transformer_classic_T0_ns1_h128_e100_s0", + "view": "transformer", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 11.8, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 0.9397740960121155 + }, + "test": { + "rmse": 0.9491862058639526 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_transformer_classic_T0_ns1_h128_e1_s0.json b/runs/ogbg-molesol_transformer_classic_T0_ns1_h128_e1_s0.json new file mode 100644 index 0000000..25d89f4 --- /dev/null +++ b/runs/ogbg-molesol_transformer_classic_T0_ns1_h128_e1_s0.json @@ -0,0 +1,37 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_transformer_classic_T0_ns1_h128_e1_s0", + "view": "transformer", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 1, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 1, + "max_eval_batches": 1, + "metric": "rmse", + "sec": 0.8, + "dev": "cuda", + "ep": 1, + "val": { + "rmse": 4.1780009269714355 + }, + "test": { + "rmse": 4.270694255828857 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molesol_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..31a2397 --- /dev/null +++ b/runs/ogbg-molesol_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_transformer_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "transformer", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 24.7, + "dev": "cuda:1", + "ep": 30, + "val": { + "rmse": 0.9840657114982605 + }, + "test": { + "rmse": 1.0003974437713623 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molesol_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molesol_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..1c215f6 --- /dev/null +++ b/runs/ogbg-molesol_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molesol", + "tag": "ogbg-molesol_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "transformer", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 28.3, + "dev": "cuda:1", + "ep": 40, + "val": { + "rmse": 1.066428780555725 + }, + "val_adaptive": { + "rmse": 1.0112154483795166 + }, + "test": { + "rmse": 0.9533939361572266 + }, + "test_adaptive": { + "rmse": 0.8505216836929321 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.185840707964602, + "fixed_steps": 8.0, + "adaptive_steps": 2.2831858407079646 +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_appnp_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molfreesolv_appnp_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..746e804 --- /dev/null +++ b/runs/ogbg-molfreesolv_appnp_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_appnp_classic_T0_ns1_h128_e100_s0", + "view": "appnp", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 6.7, + "dev": "cuda:1", + "ep": 10, + "val": { + "rmse": 6.046187400817871 + }, + "test": { + "rmse": 4.647761821746826 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molfreesolv_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..11c5a38 --- /dev/null +++ b/runs/ogbg-molfreesolv_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_appnp_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "appnp", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 9.0, + "dev": "cuda:1", + "ep": 10, + "val": { + "rmse": 5.559294700622559 + }, + "test": { + "rmse": 3.654918670654297 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_arma_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molfreesolv_arma_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..472f3ab --- /dev/null +++ b/runs/ogbg-molfreesolv_arma_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_arma_classic_T0_ns1_h128_e100_s0", + "view": "arma", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 11.1, + "dev": "cuda:1", + "ep": 60, + "val": { + "rmse": 4.26617956161499 + }, + "test": { + "rmse": 2.9769132137298584 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_arma_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molfreesolv_arma_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..72a427a --- /dev/null +++ b/runs/ogbg-molfreesolv_arma_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_arma_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "arma", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 16.4, + "dev": "cuda:1", + "ep": 10, + "val": { + "rmse": 5.068253993988037 + }, + "test": { + "rmse": 3.6822547912597656 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_cheb_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molfreesolv_cheb_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..5613bf2 --- /dev/null +++ b/runs/ogbg-molfreesolv_cheb_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_cheb_classic_T0_ns1_h128_e100_s0", + "view": "cheb", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 6.6, + "dev": "cuda:1", + "ep": 50, + "val": { + "rmse": 2.9480721950531006 + }, + "test": { + "rmse": 2.2430641651153564 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molfreesolv_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..864eff5 --- /dev/null +++ b/runs/ogbg-molfreesolv_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_cheb_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "cheb", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 8.9, + "dev": "cuda:1", + "ep": 50, + "val": { + "rmse": 3.0142416954040527 + }, + "test": { + "rmse": 2.2398786544799805 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_film_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molfreesolv_film_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..13f4682 --- /dev/null +++ b/runs/ogbg-molfreesolv_film_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_film_classic_T0_ns1_h128_e100_s0", + "view": "film", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 5.9, + "dev": "cuda:1", + "ep": 30, + "val": { + "rmse": 3.1545956134796143 + }, + "test": { + "rmse": 2.9581117630004883 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_film_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molfreesolv_film_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..8371249 --- /dev/null +++ b/runs/ogbg-molfreesolv_film_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_film_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "film", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 13.1, + "dev": "cuda:1", + "ep": 20, + "val": { + "rmse": 3.2952098846435547 + }, + "test": { + "rmse": 3.304159164428711 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_gatv2_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molfreesolv_gatv2_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..a1f6fad --- /dev/null +++ b/runs/ogbg-molfreesolv_gatv2_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_gatv2_classic_T0_ns1_h128_e100_s0", + "view": "gatv2", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 10.3, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 4.208639144897461 + }, + "test": { + "rmse": 2.7368204593658447 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molfreesolv_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..84f9f46 --- /dev/null +++ b/runs/ogbg-molfreesolv_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_gatv2_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gatv2", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 13.0, + "dev": "cuda:1", + "ep": 100, + "val": { + "rmse": 3.9983770847320557 + }, + "test": { + "rmse": 2.5965566635131836 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_gcn_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molfreesolv_gcn_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..8553aee --- /dev/null +++ b/runs/ogbg-molfreesolv_gcn_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_gcn_classic_T0_ns1_h128_e100_s0", + "view": "gcn", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 4.7, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 3.7172489166259766 + }, + "test": { + "rmse": 2.4850735664367676 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molfreesolv_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..06a4ed7 --- /dev/null +++ b/runs/ogbg-molfreesolv_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_gcn_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gcn", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 7.1, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 3.5887632369995117 + }, + "test": { + "rmse": 2.4443516731262207 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_gen_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molfreesolv_gen_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..a0ef0ee --- /dev/null +++ b/runs/ogbg-molfreesolv_gen_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_gen_classic_T0_ns1_h128_e100_s0", + "view": "gen", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 5.8, + "dev": "cuda:1", + "ep": 40, + "val": { + "rmse": 3.9998085498809814 + }, + "test": { + "rmse": 2.558762788772583 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_gen_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molfreesolv_gen_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..9c5f0a0 --- /dev/null +++ b/runs/ogbg-molfreesolv_gen_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_gen_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gen", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 11.4, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 4.300873279571533 + }, + "test": { + "rmse": 2.9063339233398438 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_gin_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molfreesolv_gin_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..e1db15f --- /dev/null +++ b/runs/ogbg-molfreesolv_gin_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_gin_classic_T0_ns1_h128_e100_s0", + "view": "gin", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 4.9, + "dev": "cuda:1", + "ep": 40, + "val": { + "rmse": 4.018989086151123 + }, + "test": { + "rmse": 3.4898324012756348 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_gin_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molfreesolv_gin_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..1f527f0 --- /dev/null +++ b/runs/ogbg-molfreesolv_gin_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_gin_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gin", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 12.1, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 3.9742789268493652 + }, + "test": { + "rmse": 3.4291605949401855 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_gine_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molfreesolv_gine_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..21a7f6a --- /dev/null +++ b/runs/ogbg-molfreesolv_gine_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_gine_classic_T0_ns1_h128_e100_s0", + "view": "gine", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 5.0, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 3.296074151992798 + }, + "test": { + "rmse": 3.144200086593628 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_gine_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molfreesolv_gine_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..20e37b9 --- /dev/null +++ b/runs/ogbg-molfreesolv_gine_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_gine_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gine", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 11.5, + "dev": "cuda:1", + "ep": 100, + "val": { + "rmse": 4.446825981140137 + }, + "test": { + "rmse": 3.740544319152832 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_graphconv_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molfreesolv_graphconv_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..fecde17 --- /dev/null +++ b/runs/ogbg-molfreesolv_graphconv_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_graphconv_classic_T0_ns1_h128_e100_s0", + "view": "graphconv", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 4.2, + "dev": "cuda:1", + "ep": 20, + "val": { + "rmse": 2.5313968658447266 + }, + "test": { + "rmse": 2.7952840328216553 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molfreesolv_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..ead7559 --- /dev/null +++ b/runs/ogbg-molfreesolv_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_graphconv_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "graphconv", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 7.2, + "dev": "cuda:1", + "ep": 40, + "val": { + "rmse": 2.9106228351593018 + }, + "test": { + "rmse": 3.142881155014038 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_graphsage_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molfreesolv_graphsage_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..4f2daf7 --- /dev/null +++ b/runs/ogbg-molfreesolv_graphsage_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_graphsage_classic_T0_ns1_h128_e100_s0", + "view": "graphsage", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 4.4, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 3.5022244453430176 + }, + "test": { + "rmse": 2.2976508140563965 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molfreesolv_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..7aa2f03 --- /dev/null +++ b/runs/ogbg-molfreesolv_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_graphsage_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "graphsage", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 6.9, + "dev": "cuda:1", + "ep": 30, + "val": { + "rmse": 3.7380001544952393 + }, + "test": { + "rmse": 2.193081855773926 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_mf_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molfreesolv_mf_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..a5b647c --- /dev/null +++ b/runs/ogbg-molfreesolv_mf_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_mf_classic_T0_ns1_h128_e100_s0", + "view": "mf", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 24.2, + "dev": "cuda:1", + "ep": 30, + "val": { + "rmse": 2.737367630004883 + }, + "test": { + "rmse": 2.8884994983673096 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_mf_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molfreesolv_mf_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..29a8bef --- /dev/null +++ b/runs/ogbg-molfreesolv_mf_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_mf_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "mf", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 24.8, + "dev": "cuda:1", + "ep": 40, + "val": { + "rmse": 2.5060386657714844 + }, + "test": { + "rmse": 3.1891541481018066 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_pna_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molfreesolv_pna_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..81ea6ec --- /dev/null +++ b/runs/ogbg-molfreesolv_pna_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_pna_classic_T0_ns1_h128_e100_s0", + "view": "pna", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 13.6, + "dev": "cuda:1", + "ep": 40, + "val": { + "rmse": 2.3625338077545166 + }, + "test": { + "rmse": 2.2610387802124023 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_pna_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molfreesolv_pna_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..de0fee4 --- /dev/null +++ b/runs/ogbg-molfreesolv_pna_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_pna_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "pna", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 16.4, + "dev": "cuda:1", + "ep": 40, + "val": { + "rmse": 3.3333704471588135 + }, + "test": { + "rmse": 2.4279491901397705 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_resgated_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molfreesolv_resgated_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..9187a7a --- /dev/null +++ b/runs/ogbg-molfreesolv_resgated_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_resgated_classic_T0_ns1_h128_e100_s0", + "view": "resgated", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 8.1, + "dev": "cuda:1", + "ep": 50, + "val": { + "rmse": 2.4772303104400635 + }, + "test": { + "rmse": 2.0041325092315674 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molfreesolv_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..7efe491 --- /dev/null +++ b/runs/ogbg-molfreesolv_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_resgated_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "resgated", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 14.0, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 3.0919928550720215 + }, + "test": { + "rmse": 2.0244016647338867 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_sgc_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molfreesolv_sgc_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..08ba938 --- /dev/null +++ b/runs/ogbg-molfreesolv_sgc_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_sgc_classic_T0_ns1_h128_e100_s0", + "view": "sgc", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 5.0, + "dev": "cuda:1", + "ep": 50, + "val": { + "rmse": 3.9146761894226074 + }, + "test": { + "rmse": 2.4146173000335693 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molfreesolv_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..d6ec5dc --- /dev/null +++ b/runs/ogbg-molfreesolv_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_sgc_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "sgc", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 7.4, + "dev": "cuda:1", + "ep": 50, + "val": { + "rmse": 3.9261200428009033 + }, + "test": { + "rmse": 2.4886999130249023 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_tag_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molfreesolv_tag_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..1d73b02 --- /dev/null +++ b/runs/ogbg-molfreesolv_tag_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_tag_classic_T0_ns1_h128_e100_s0", + "view": "tag", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 6.7, + "dev": "cuda:1", + "ep": 20, + "val": { + "rmse": 2.687361001968384 + }, + "test": { + "rmse": 2.3825674057006836 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_tag_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molfreesolv_tag_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..ab5daea --- /dev/null +++ b/runs/ogbg-molfreesolv_tag_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_tag_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "tag", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 9.9, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 2.735919952392578 + }, + "test": { + "rmse": 2.0588314533233643 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_transformer_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molfreesolv_transformer_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..7842d4a --- /dev/null +++ b/runs/ogbg-molfreesolv_transformer_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_transformer_classic_T0_ns1_h128_e100_s0", + "view": "transformer", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 8.5, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 4.094240665435791 + }, + "test": { + "rmse": 2.3205413818359375 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molfreesolv_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molfreesolv_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..ad17542 --- /dev/null +++ b/runs/ogbg-molfreesolv_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molfreesolv", + "tag": "ogbg-molfreesolv_transformer_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "transformer", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 10.4, + "dev": "cuda:1", + "ep": 60, + "val": { + "rmse": 4.417959690093994 + }, + "test": { + "rmse": 2.432546377182007 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_appnp_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molhiv_appnp_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..40a3758 --- /dev/null +++ b/runs/ogbg-molhiv_appnp_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_appnp_classic_T0_ns1_h128_e100_s0", + "view": "appnp", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 450.5, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.7674851190476192 + }, + "test": { + "rocauc": 0.7000000000000001 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_appnp_classic_T0_ns1_h128_e100_s1.json b/runs/ogbg-molhiv_appnp_classic_T0_ns1_h128_e100_s1.json new file mode 100644 index 0000000..96c1ef5 --- /dev/null +++ b/runs/ogbg-molhiv_appnp_classic_T0_ns1_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_appnp_classic_T0_ns1_h128_e100_s1", + "view": "appnp", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 474.4, + "dev": "cuda:0", + "ep": 20, + "val": { + "rocauc": 0.6934707524985303 + }, + "test": { + "rocauc": 0.7044149172444427 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_appnp_classic_T0_ns1_h128_e100_s2.json b/runs/ogbg-molhiv_appnp_classic_T0_ns1_h128_e100_s2.json new file mode 100644 index 0000000..0f7a3cf --- /dev/null +++ b/runs/ogbg-molhiv_appnp_classic_T0_ns1_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_appnp_classic_T0_ns1_h128_e100_s2", + "view": "appnp", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 479.4, + "dev": "cuda:0", + "ep": 20, + "val": { + "rocauc": 0.7213342641583382 + }, + "test": { + "rocauc": 0.690191004075011 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..f0c1da1 --- /dev/null +++ b/runs/ogbg-molhiv_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_appnp_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "appnp", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 802.7, + "dev": "cuda:0", + "ep": 60, + "val": { + "rocauc": 0.7573179992161474 + }, + "test": { + "rocauc": 0.7228548253152822 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_appnp_fixed-rrog_T1_ns3_h128_e100_s1.json b/runs/ogbg-molhiv_appnp_fixed-rrog_T1_ns3_h128_e100_s1.json new file mode 100644 index 0000000..c5de3ef --- /dev/null +++ b/runs/ogbg-molhiv_appnp_fixed-rrog_T1_ns3_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_appnp_fixed-rrog_T1_ns3_h128_e100_s1", + "view": "appnp", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 925.6, + "dev": "cuda:0", + "ep": 60, + "val": { + "rocauc": 0.75122170781893 + }, + "test": { + "rocauc": 0.7448212595840012 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_appnp_fixed-rrog_T1_ns3_h128_e100_s2.json b/runs/ogbg-molhiv_appnp_fixed-rrog_T1_ns3_h128_e100_s2.json new file mode 100644 index 0000000..ff308ee --- /dev/null +++ b/runs/ogbg-molhiv_appnp_fixed-rrog_T1_ns3_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_appnp_fixed-rrog_T1_ns3_h128_e100_s2", + "view": "appnp", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 793.0, + "dev": "cuda:0", + "ep": 20, + "val": { + "rocauc": 0.7619568146188516 + }, + "test": { + "rocauc": 0.72329708955368 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_appnp_fixed-rrog_T3_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_appnp_fixed-rrog_T3_ns3_h128_e100_s0.json new file mode 100644 index 0000000..08a5659 --- /dev/null +++ b/runs/ogbg-molhiv_appnp_fixed-rrog_T3_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_appnp_fixed-rrog_T3_ns3_h128_e100_s0", + "view": "appnp", + "compute": "fixed-rrog", + "T": 3, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 961.4, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.7203422006662747 + }, + "test": { + "rocauc": 0.682502558952471 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..c2f9d23 --- /dev/null +++ b/runs/ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "appnp", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 1000.9, + "dev": "cuda:3", + "ep": 50, + "val": { + "rocauc": 0.7323571918479326 + }, + "val_adaptive": { + "rocauc": 0.7404314863805603 + }, + "test": { + "rocauc": 0.7487070047702736 + }, + "test_adaptive": { + "rocauc": 0.7287433129260897 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0034038414782396, + "fixed_steps": 8.0, + "adaptive_steps": 2.0063214198881596 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..8fdd38b --- /dev/null +++ b/runs/ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "appnp", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1126.6, + "dev": "cuda:0", + "ep": 70, + "val": { + "rocauc": 0.7378778414658045 + }, + "val_adaptive": { + "rocauc": 0.7123046492259455 + }, + "test": { + "rocauc": 0.6883099325981575 + }, + "test_adaptive": { + "rocauc": 0.7290619749319223 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.098468271334792, + "fixed_steps": 8.0, + "adaptive_steps": 2.102358375881352 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json b/runs/ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json new file mode 100644 index 0000000..9017bc3 --- /dev/null +++ b/runs/ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0", + "view": "appnp", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 30, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 967.3, + "dev": "cuda:3", + "ep": 40, + "val": { + "rocauc": 0.720568783068783 + }, + "val_adaptive": { + "rocauc": 0.6885012492651382 + }, + "test": { + "rocauc": 0.7274165202108962 + }, + "test_adaptive": { + "rocauc": 0.747511539427181 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.1568198395331875, + "fixed_steps": 8.0, + "adaptive_steps": 2.2569900316070997 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_arma_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molhiv_arma_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..85391c2 --- /dev/null +++ b/runs/ogbg-molhiv_arma_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_arma_classic_T0_ns1_h128_e100_s0", + "view": "arma", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 830.5, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.7872115667254557 + }, + "test": { + "rocauc": 0.7296336352575368 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_arma_classic_T0_ns1_h128_e100_s1.json b/runs/ogbg-molhiv_arma_classic_T0_ns1_h128_e100_s1.json new file mode 100644 index 0000000..f68ee33 --- /dev/null +++ b/runs/ogbg-molhiv_arma_classic_T0_ns1_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_arma_classic_T0_ns1_h128_e100_s1", + "view": "arma", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 872.0, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.7766081226729374 + }, + "test": { + "rocauc": 0.7197338689430077 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_arma_classic_T0_ns1_h128_e100_s2.json b/runs/ogbg-molhiv_arma_classic_T0_ns1_h128_e100_s2.json new file mode 100644 index 0000000..fa28286 --- /dev/null +++ b/runs/ogbg-molhiv_arma_classic_T0_ns1_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_arma_classic_T0_ns1_h128_e100_s2", + "view": "arma", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 881.8, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.7759957378012934 + }, + "test": { + "rocauc": 0.7694818362656676 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_arma_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_arma_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..0580718 --- /dev/null +++ b/runs/ogbg-molhiv_arma_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_arma_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "arma", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 833.4, + "dev": "cuda:0", + "ep": 60, + "val": { + "rocauc": 0.7956441064079952 + }, + "test": { + "rocauc": 0.6966917089939937 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_arma_fixed-rrog_T1_ns3_h128_e100_s1.json b/runs/ogbg-molhiv_arma_fixed-rrog_T1_ns3_h128_e100_s1.json new file mode 100644 index 0000000..0bf9e9d --- /dev/null +++ b/runs/ogbg-molhiv_arma_fixed-rrog_T1_ns3_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_arma_fixed-rrog_T1_ns3_h128_e100_s1", + "view": "arma", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1127.4, + "dev": "cuda:0", + "ep": 60, + "val": { + "rocauc": 0.7571649029982364 + }, + "test": { + "rocauc": 0.6928774213484231 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_arma_fixed-rrog_T1_ns3_h128_e100_s2.json b/runs/ogbg-molhiv_arma_fixed-rrog_T1_ns3_h128_e100_s2.json new file mode 100644 index 0000000..304dd63 --- /dev/null +++ b/runs/ogbg-molhiv_arma_fixed-rrog_T1_ns3_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_arma_fixed-rrog_T1_ns3_h128_e100_s2", + "view": "arma", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1125.5, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.7940457818930041 + }, + "test": { + "rocauc": 0.7463856003399061 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_arma_fixed-rrog_T3_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_arma_fixed-rrog_T3_ns3_h128_e100_s0.json new file mode 100644 index 0000000..bd8e351 --- /dev/null +++ b/runs/ogbg-molhiv_arma_fixed-rrog_T3_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_arma_fixed-rrog_T3_ns3_h128_e100_s0", + "view": "arma", + "compute": "fixed-rrog", + "T": 3, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 1229.7, + "dev": "cuda:1", + "ep": 90, + "val": { + "rocauc": 0.7926495443856555 + }, + "test": { + "rocauc": 0.7317541860599857 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..b541793 --- /dev/null +++ b/runs/ogbg-molhiv_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "arma", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1181.9, + "dev": "cuda:0", + "ep": 100, + "val": { + "rocauc": 0.7861153978052127 + }, + "val_adaptive": { + "rocauc": 0.765070791691162 + }, + "test": { + "rocauc": 0.7306939106587612 + }, + "test_adaptive": { + "rocauc": 0.7378782904266208 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0566496474592753, + "fixed_steps": 8.0, + "adaptive_steps": 2.085825431558473 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..62c5c5c --- /dev/null +++ b/runs/ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s0", + "view": "cheb", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 429.1, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.783120835782873 + }, + "test": { + "rocauc": 0.7281735838853589 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s1.json b/runs/ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s1.json new file mode 100644 index 0000000..c8c48a9 --- /dev/null +++ b/runs/ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s1", + "view": "cheb", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 440.1, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.7577895355673133 + }, + "test": { + "rocauc": 0.7291006006295989 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s2.json b/runs/ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s2.json new file mode 100644 index 0000000..25f58ff --- /dev/null +++ b/runs/ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_cheb_classic_T0_ns1_h128_e100_s2", + "view": "cheb", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 450.5, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.7987825788751715 + }, + "test": { + "rocauc": 0.7219181521466231 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..4d6939c --- /dev/null +++ b/runs/ogbg-molhiv_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_cheb_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "cheb", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 570.2, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.794682662159514 + }, + "test": { + "rocauc": 0.7290194866644778 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_cheb_fixed-rrog_T1_ns3_h128_e100_s1.json b/runs/ogbg-molhiv_cheb_fixed-rrog_T1_ns3_h128_e100_s1.json new file mode 100644 index 0000000..e4e897e --- /dev/null +++ b/runs/ogbg-molhiv_cheb_fixed-rrog_T1_ns3_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_cheb_fixed-rrog_T1_ns3_h128_e100_s1", + "view": "cheb", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 905.2, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.7655423280423279 + }, + "test": { + "rocauc": 0.7438594797118523 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_cheb_fixed-rrog_T1_ns3_h128_e100_s2.json b/runs/ogbg-molhiv_cheb_fixed-rrog_T1_ns3_h128_e100_s2.json new file mode 100644 index 0000000..62dc770 --- /dev/null +++ b/runs/ogbg-molhiv_cheb_fixed-rrog_T1_ns3_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_cheb_fixed-rrog_T1_ns3_h128_e100_s2", + "view": "cheb", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 822.8, + "dev": "cuda:0", + "ep": 60, + "val": { + "rocauc": 0.8092084313149128 + }, + "test": { + "rocauc": 0.7313505475192645 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_cheb_fixed-rrog_T3_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_cheb_fixed-rrog_T3_ns3_h128_e100_s0.json new file mode 100644 index 0000000..b0f4487 --- /dev/null +++ b/runs/ogbg-molhiv_cheb_fixed-rrog_T3_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_cheb_fixed-rrog_T3_ns3_h128_e100_s0", + "view": "cheb", + "compute": "fixed-rrog", + "T": 3, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 957.8, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.7734757740544776 + }, + "test": { + "rocauc": 0.7425713126943356 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..1ef9c3e --- /dev/null +++ b/runs/ogbg-molhiv_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "cheb", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1117.5, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.7825329463060945 + }, + "val_adaptive": { + "rocauc": 0.7969699196551049 + }, + "test": { + "rocauc": 0.7205932907163135 + }, + "test_adaptive": { + "rocauc": 0.7218775951640628 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.2144420131291027, + "fixed_steps": 8.0, + "adaptive_steps": 2.2939460247994163 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_film_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molhiv_film_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..6feff27 --- /dev/null +++ b/runs/ogbg-molhiv_film_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_film_classic_T0_ns1_h128_e100_s0", + "view": "film", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 684.6, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.7921535126396236 + }, + "test": { + "rocauc": 0.7842136773595473 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_film_classic_T0_ns1_h128_e100_s1.json b/runs/ogbg-molhiv_film_classic_T0_ns1_h128_e100_s1.json new file mode 100644 index 0000000..8e0aa76 --- /dev/null +++ b/runs/ogbg-molhiv_film_classic_T0_ns1_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_film_classic_T0_ns1_h128_e100_s1", + "view": "film", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 738.2, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.7384259259259259 + }, + "test": { + "rocauc": 0.7277853956237085 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_film_classic_T0_ns1_h128_e100_s2.json b/runs/ogbg-molhiv_film_classic_T0_ns1_h128_e100_s2.json new file mode 100644 index 0000000..0e4ea69 --- /dev/null +++ b/runs/ogbg-molhiv_film_classic_T0_ns1_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_film_classic_T0_ns1_h128_e100_s2", + "view": "film", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 707.7, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.8214622525965118 + }, + "test": { + "rocauc": 0.7396087216825356 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_film_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_film_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..a874862 --- /dev/null +++ b/runs/ogbg-molhiv_film_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_film_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "film", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 723.6, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.8251457475994514 + }, + "test": { + "rocauc": 0.7725487166611946 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_film_fixed-rrog_T1_ns3_h128_e100_s1.json b/runs/ogbg-molhiv_film_fixed-rrog_T1_ns3_h128_e100_s1.json new file mode 100644 index 0000000..95b90c4 --- /dev/null +++ b/runs/ogbg-molhiv_film_fixed-rrog_T1_ns3_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_film_fixed-rrog_T1_ns3_h128_e100_s1", + "view": "film", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 978.0, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.7767214138741916 + }, + "test": { + "rocauc": 0.721711504664053 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_film_fixed-rrog_T1_ns3_h128_e100_s2.json b/runs/ogbg-molhiv_film_fixed-rrog_T1_ns3_h128_e100_s2.json new file mode 100644 index 0000000..2af945e --- /dev/null +++ b/runs/ogbg-molhiv_film_fixed-rrog_T1_ns3_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_film_fixed-rrog_T1_ns3_h128_e100_s2", + "view": "film", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 990.1, + "dev": "cuda:0", + "ep": 60, + "val": { + "rocauc": 0.8191688712522045 + }, + "test": { + "rocauc": 0.7626895073292261 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_film_fixed-rrog_T3_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_film_fixed-rrog_T3_ns3_h128_e100_s0.json new file mode 100644 index 0000000..be80ab8 --- /dev/null +++ b/runs/ogbg-molhiv_film_fixed-rrog_T3_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_film_fixed-rrog_T3_ns3_h128_e100_s0", + "view": "film", + "compute": "fixed-rrog", + "T": 3, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 1072.1, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.7633101851851851 + }, + "test": { + "rocauc": 0.7727785395623709 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..8c45ebb --- /dev/null +++ b/runs/ogbg-molhiv_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "film", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1076.0, + "dev": "cuda:0", + "ep": 90, + "val": { + "rocauc": 0.8150199637468156 + }, + "val_adaptive": { + "rocauc": 0.8101515040172447 + }, + "test": { + "rocauc": 0.7415303501419496 + }, + "test_adaptive": { + "rocauc": 0.7291546766063463 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.137855579868709, + "fixed_steps": 8.0, + "adaptive_steps": 2.2144420131291027 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gatv2_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molhiv_gatv2_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..c3f6d33 --- /dev/null +++ b/runs/ogbg-molhiv_gatv2_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gatv2_classic_T0_ns1_h128_e100_s0", + "view": "gatv2", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 725.9, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.7834576474622771 + }, + "test": { + "rocauc": 0.75625253481141 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gatv2_classic_T0_ns1_h128_e100_s1.json b/runs/ogbg-molhiv_gatv2_classic_T0_ns1_h128_e100_s1.json new file mode 100644 index 0000000..1c65b7a --- /dev/null +++ b/runs/ogbg-molhiv_gatv2_classic_T0_ns1_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gatv2_classic_T0_ns1_h128_e100_s1", + "view": "gatv2", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1027.7, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.7755777851263962 + }, + "test": { + "rocauc": 0.7039629965816258 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gatv2_classic_T0_ns1_h128_e100_s2.json b/runs/ogbg-molhiv_gatv2_classic_T0_ns1_h128_e100_s2.json new file mode 100644 index 0000000..73c6073 --- /dev/null +++ b/runs/ogbg-molhiv_gatv2_classic_T0_ns1_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gatv2_classic_T0_ns1_h128_e100_s2", + "view": "gatv2", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1040.1, + "dev": "cuda:0", + "ep": 20, + "val": { + "rocauc": 0.793114956888105 + }, + "test": { + "rocauc": 0.7273817570829874 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gatv2_classic_T0_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_gatv2_classic_T0_ns3_h128_e100_s0.json new file mode 100644 index 0000000..4b32e81 --- /dev/null +++ b/runs/ogbg-molhiv_gatv2_classic_T0_ns3_h128_e100_s0.json @@ -0,0 +1,32 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gatv2_classic_T0_ns3_h128_e100_s0", + "view": "gatv2", + "compute": "classic", + "T": 0, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_exploration_prob": 0.1, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "metric": "rocauc", + "sec": 592.5, + "dev": "cuda", + "ep": 40, + "val": { + "rocauc": 0.7634357240838722 + }, + "test": { + "rocauc": 0.6885629309179396 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..e62c1ef --- /dev/null +++ b/runs/ogbg-molhiv_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gatv2_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gatv2", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 973.3, + "dev": "cuda:0", + "ep": 30, + "val": { + "rocauc": 0.8049003037428963 + }, + "test": { + "rocauc": 0.7485679522586377 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gatv2_fixed-rrog_T1_ns3_h128_e100_s1.json b/runs/ogbg-molhiv_gatv2_fixed-rrog_T1_ns3_h128_e100_s1.json new file mode 100644 index 0000000..4351ea8 --- /dev/null +++ b/runs/ogbg-molhiv_gatv2_fixed-rrog_T1_ns3_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gatv2_fixed-rrog_T1_ns3_h128_e100_s1", + "view": "gatv2", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1274.2, + "dev": "cuda:0", + "ep": 70, + "val": { + "rocauc": 0.7392587693513621 + }, + "test": { + "rocauc": 0.7076787886981208 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gatv2_fixed-rrog_T1_ns3_h128_e100_s2.json b/runs/ogbg-molhiv_gatv2_fixed-rrog_T1_ns3_h128_e100_s2.json new file mode 100644 index 0000000..f276429 --- /dev/null +++ b/runs/ogbg-molhiv_gatv2_fixed-rrog_T1_ns3_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gatv2_fixed-rrog_T1_ns3_h128_e100_s2", + "view": "gatv2", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1272.1, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.7761641436409955 + }, + "test": { + "rocauc": 0.724479035902586 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gatv2_fixed-rrog_T3_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_gatv2_fixed-rrog_T3_ns3_h128_e100_s0.json new file mode 100644 index 0000000..db451de --- /dev/null +++ b/runs/ogbg-molhiv_gatv2_fixed-rrog_T3_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gatv2_fixed-rrog_T3_ns3_h128_e100_s0", + "view": "gatv2", + "compute": "fixed-rrog", + "T": 3, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 1115.2, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.7835464432686655 + }, + "test": { + "rocauc": 0.746617354525966 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..cfc5f77 --- /dev/null +++ b/runs/ogbg-molhiv_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gatv2", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1245.0, + "dev": "cuda:0", + "ep": 60, + "val": { + "rocauc": 0.7722111992945326 + }, + "val_adaptive": { + "rocauc": 0.7736227464236723 + }, + "test": { + "rocauc": 0.7005330346279379 + }, + "test_adaptive": { + "rocauc": 0.7209988605419185 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.102358375881352, + "fixed_steps": 8.0, + "adaptive_steps": 2.161196207148067 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gcn_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molhiv_gcn_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..ddad80a --- /dev/null +++ b/runs/ogbg-molhiv_gcn_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gcn_classic_T0_ns1_h128_e100_s0", + "view": "gcn", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 315.1, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.7754323437193807 + }, + "test": { + "rocauc": 0.719778288495336 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gcn_classic_T0_ns1_h128_e100_s1.json b/runs/ogbg-molhiv_gcn_classic_T0_ns1_h128_e100_s1.json new file mode 100644 index 0000000..3b56de3 --- /dev/null +++ b/runs/ogbg-molhiv_gcn_classic_T0_ns1_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gcn_classic_T0_ns1_h128_e100_s1", + "view": "gcn", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 335.9, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.774963869292573 + }, + "test": { + "rocauc": 0.7313544100890322 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gcn_classic_T0_ns1_h128_e100_s2.json b/runs/ogbg-molhiv_gcn_classic_T0_ns1_h128_e100_s2.json new file mode 100644 index 0000000..465a3b3 --- /dev/null +++ b/runs/ogbg-molhiv_gcn_classic_T0_ns1_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gcn_classic_T0_ns1_h128_e100_s2", + "view": "gcn", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 336.6, + "dev": "cuda:0", + "ep": 30, + "val": { + "rocauc": 0.7749179404271997 + }, + "test": { + "rocauc": 0.7569246219509841 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gcn_classic_T0_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_gcn_classic_T0_ns3_h128_e100_s0.json new file mode 100644 index 0000000..f4dd13f --- /dev/null +++ b/runs/ogbg-molhiv_gcn_classic_T0_ns3_h128_e100_s0.json @@ -0,0 +1,32 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gcn_classic_T0_ns3_h128_e100_s0", + "view": "gcn", + "compute": "classic", + "T": 0, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_exploration_prob": 0.1, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "metric": "rocauc", + "sec": 342.7, + "dev": "cuda", + "ep": 50, + "val": { + "rocauc": 0.7599512541642173 + }, + "test": { + "rocauc": 0.7072114177562332 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..ea60520 --- /dev/null +++ b/runs/ogbg-molhiv_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gcn_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gcn", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 506.8, + "dev": "cuda:0", + "ep": 60, + "val": { + "rocauc": 0.783344356261023 + }, + "test": { + "rocauc": 0.7447787713165569 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gcn_fixed-rrog_T1_ns3_h128_e100_s1.json b/runs/ogbg-molhiv_gcn_fixed-rrog_T1_ns3_h128_e100_s1.json new file mode 100644 index 0000000..a731208 --- /dev/null +++ b/runs/ogbg-molhiv_gcn_fixed-rrog_T1_ns3_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gcn_fixed-rrog_T1_ns3_h128_e100_s1", + "view": "gcn", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 718.5, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.7912043160885752 + }, + "test": { + "rocauc": 0.7217501303617297 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gcn_fixed-rrog_T1_ns3_h128_e100_s2.json b/runs/ogbg-molhiv_gcn_fixed-rrog_T1_ns3_h128_e100_s2.json new file mode 100644 index 0000000..c625a4c --- /dev/null +++ b/runs/ogbg-molhiv_gcn_fixed-rrog_T1_ns3_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gcn_fixed-rrog_T1_ns3_h128_e100_s2", + "view": "gcn", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 727.8, + "dev": "cuda:0", + "ep": 30, + "val": { + "rocauc": 0.7741386806780326 + }, + "test": { + "rocauc": 0.7494157863226405 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gcn_fixed-rrog_T3_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_gcn_fixed-rrog_T3_ns3_h128_e100_s0.json new file mode 100644 index 0000000..342d210 --- /dev/null +++ b/runs/ogbg-molhiv_gcn_fixed-rrog_T3_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gcn_fixed-rrog_T3_ns3_h128_e100_s0", + "view": "gcn", + "compute": "fixed-rrog", + "T": 3, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 627.4, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.7454683519498334 + }, + "test": { + "rocauc": 0.7482879159504818 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..bd771f2 --- /dev/null +++ b/runs/ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gcn", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 866.3, + "dev": "cuda:3", + "ep": 90, + "val": { + "rocauc": 0.7712620027434841 + }, + "val_adaptive": { + "rocauc": 0.7554318538114835 + }, + "test": { + "rocauc": 0.7476081036713725 + }, + "test_adaptive": { + "rocauc": 0.7387782691824871 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.00024313153416, + "fixed_steps": 8.0, + "adaptive_steps": 2.012156576707999 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..12d5541 --- /dev/null +++ b/runs/ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gcn", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 926.0, + "dev": "cuda:0", + "ep": 100, + "val": { + "rocauc": 0.76521164021164 + }, + "val_adaptive": { + "rocauc": 0.7598471487360376 + }, + "test": { + "rocauc": 0.7279630738330211 + }, + "test_adaptive": { + "rocauc": 0.7195040460418316 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0923899829807926, + "fixed_steps": 8.0, + "adaptive_steps": 2.1412594213469487 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json b/runs/ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json new file mode 100644 index 0000000..ca2203e --- /dev/null +++ b/runs/ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0", + "view": "gcn", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 30, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 836.2, + "dev": "cuda:3", + "ep": 80, + "val": { + "rocauc": 0.7437720458553793 + }, + "val_adaptive": { + "rocauc": 0.7528353419557123 + }, + "test": { + "rocauc": 0.7537553834566137 + }, + "test_adaptive": { + "rocauc": 0.7804708472546787 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.090201799173353, + "fixed_steps": 8.0, + "adaptive_steps": 2.135910527595429 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gen_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molhiv_gen_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..2ba76fb --- /dev/null +++ b/runs/ogbg-molhiv_gen_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gen_classic_T0_ns1_h128_e100_s0", + "view": "gen", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 576.3, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.7530159954928474 + }, + "test": { + "rocauc": 0.7313524788041483 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gen_classic_T0_ns1_h128_e100_s1.json b/runs/ogbg-molhiv_gen_classic_T0_ns1_h128_e100_s1.json new file mode 100644 index 0000000..6917858 --- /dev/null +++ b/runs/ogbg-molhiv_gen_classic_T0_ns1_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gen_classic_T0_ns1_h128_e100_s1", + "view": "gen", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 747.3, + "dev": "cuda:0", + "ep": 90, + "val": { + "rocauc": 0.7787851508916324 + }, + "test": { + "rocauc": 0.7435079858629947 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gen_classic_T0_ns1_h128_e100_s2.json b/runs/ogbg-molhiv_gen_classic_T0_ns1_h128_e100_s2.json new file mode 100644 index 0000000..7b0261b --- /dev/null +++ b/runs/ogbg-molhiv_gen_classic_T0_ns1_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gen_classic_T0_ns1_h128_e100_s2", + "view": "gen", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 693.8, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.7559125759357241 + }, + "test": { + "rocauc": 0.7565596091079395 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gen_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_gen_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..520759b --- /dev/null +++ b/runs/ogbg-molhiv_gen_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gen_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gen", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 658.9, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.77400548696845 + }, + "test": { + "rocauc": 0.7589563336487767 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gen_fixed-rrog_T1_ns3_h128_e100_s1.json b/runs/ogbg-molhiv_gen_fixed-rrog_T1_ns3_h128_e100_s1.json new file mode 100644 index 0000000..533c8bf --- /dev/null +++ b/runs/ogbg-molhiv_gen_fixed-rrog_T1_ns3_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gen_fixed-rrog_T1_ns3_h128_e100_s1", + "view": "gen", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 994.9, + "dev": "cuda:0", + "ep": 30, + "val": { + "rocauc": 0.7575843866353126 + }, + "test": { + "rocauc": 0.7301454257517527 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gen_fixed-rrog_T1_ns3_h128_e100_s2.json b/runs/ogbg-molhiv_gen_fixed-rrog_T1_ns3_h128_e100_s2.json new file mode 100644 index 0000000..ebb7a88 --- /dev/null +++ b/runs/ogbg-molhiv_gen_fixed-rrog_T1_ns3_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gen_fixed-rrog_T1_ns3_h128_e100_s2", + "view": "gen", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 989.1, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.7676060650597687 + }, + "test": { + "rocauc": 0.7570231174800596 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gen_fixed-rrog_T3_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_gen_fixed-rrog_T3_ns3_h128_e100_s0.json new file mode 100644 index 0000000..9a03ebd --- /dev/null +++ b/runs/ogbg-molhiv_gen_fixed-rrog_T3_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gen_fixed-rrog_T3_ns3_h128_e100_s0", + "view": "gen", + "compute": "fixed-rrog", + "T": 3, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 1109.1, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.8127970066627475 + }, + "test": { + "rocauc": 0.7631375654222755 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..3cadcd3 --- /dev/null +++ b/runs/ogbg-molhiv_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gen", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1088.2, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.769011488340192 + }, + "val_adaptive": { + "rocauc": 0.7765683176562805 + }, + "test": { + "rocauc": 0.7434075590490352 + }, + "test_adaptive": { + "rocauc": 0.7426736707931786 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.1043034281546316, + "fixed_steps": 8.0, + "adaptive_steps": 2.178215414539266 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molhiv_gin_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..4f5aa1a --- /dev/null +++ b/runs/ogbg-molhiv_gin_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_classic_T0_ns1_h128_e100_s0", + "view": "gin", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 345.2, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.816746889084852 + }, + "test": { + "rocauc": 0.7723980764402558 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_classic_T0_ns1_h128_e100_s1.json b/runs/ogbg-molhiv_gin_classic_T0_ns1_h128_e100_s1.json new file mode 100644 index 0000000..a3016cb --- /dev/null +++ b/runs/ogbg-molhiv_gin_classic_T0_ns1_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_classic_T0_ns1_h128_e100_s1", + "view": "gin", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 648.9, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.7888619439545366 + }, + "test": { + "rocauc": 0.7680604105911663 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_classic_T0_ns1_h128_e100_s2.json b/runs/ogbg-molhiv_gin_classic_T0_ns1_h128_e100_s2.json new file mode 100644 index 0000000..1441a04 --- /dev/null +++ b/runs/ogbg-molhiv_gin_classic_T0_ns1_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_classic_T0_ns1_h128_e100_s2", + "view": "gin", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 634.3, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.8099769743288261 + }, + "test": { + "rocauc": 0.7394638753162479 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_classic_T0_ns1_h128_e300_s0.json b/runs/ogbg-molhiv_gin_classic_T0_ns1_h128_e300_s0.json new file mode 100644 index 0000000..55013c8 --- /dev/null +++ b/runs/ogbg-molhiv_gin_classic_T0_ns1_h128_e300_s0.json @@ -0,0 +1,35 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_classic_T0_ns1_h128_e300_s0", + "view": "gin", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 300, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "metric": "rocauc", + "sec": 917.5, + "dev": "cuda", + "ep": 90, + "val": { + "rocauc": 0.7655147707231041 + }, + "test": { + "rocauc": 0.7153121922014716 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_classic_T0_ns1_h128_e300_s1.json b/runs/ogbg-molhiv_gin_classic_T0_ns1_h128_e300_s1.json new file mode 100644 index 0000000..4cea082 --- /dev/null +++ b/runs/ogbg-molhiv_gin_classic_T0_ns1_h128_e300_s1.json @@ -0,0 +1,36 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_classic_T0_ns1_h128_e300_s1", + "view": "gin", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 300, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "metric": "rocauc", + "sec": 2128.1, + "dev": "cuda", + "ep": 70, + "val": { + "rocauc": 0.8101576278659612 + }, + "test": { + "rocauc": 0.755140114718322 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_fixed-rrog_T1_ns2_h32_e1_ema0.999_s992.json b/runs/ogbg-molhiv_gin_fixed-rrog_T1_ns2_h32_e1_ema0.999_s992.json new file mode 100644 index 0000000..db07dca --- /dev/null +++ b/runs/ogbg-molhiv_gin_fixed-rrog_T1_ns2_h32_e1_ema0.999_s992.json @@ -0,0 +1,36 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_fixed-rrog_T1_ns2_h32_e1_ema0.999_s992", + "view": "gin", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 2, + "hidden": 32, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 1, + "eval_every": 1, + "lr": 0.001, + "bs": 64, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "ema": 0.999, + "seed": 992, + "num_workers": 0, + "max_train_batches": 1, + "max_eval_batches": 1, + "metric": "rocauc", + "sec": 0.8, + "dev": "cuda", + "ep": 1, + "val": { + "rocauc": 0.7509920634920635 + }, + "test": { + "rocauc": 0.7348790322580645 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_gin_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..a5da14d --- /dev/null +++ b/runs/ogbg-molhiv_gin_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gin", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 622.0, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.7710048010973936 + }, + "test": { + "rocauc": 0.7667761061434172 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_fixed-rrog_T1_ns3_h128_e100_s1.json b/runs/ogbg-molhiv_gin_fixed-rrog_T1_ns3_h128_e100_s1.json new file mode 100644 index 0000000..fe35c37 --- /dev/null +++ b/runs/ogbg-molhiv_gin_fixed-rrog_T1_ns3_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_fixed-rrog_T1_ns3_h128_e100_s1", + "view": "gin", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 880.4, + "dev": "cuda:0", + "ep": 90, + "val": { + "rocauc": 0.7900285371350186 + }, + "test": { + "rocauc": 0.7325170435890999 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_fixed-rrog_T1_ns3_h128_e100_s2.json b/runs/ogbg-molhiv_gin_fixed-rrog_T1_ns3_h128_e100_s2.json new file mode 100644 index 0000000..b9cba39 --- /dev/null +++ b/runs/ogbg-molhiv_gin_fixed-rrog_T1_ns3_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_fixed-rrog_T1_ns3_h128_e100_s2", + "view": "gin", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 899.5, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.7518616500097983 + }, + "test": { + "rocauc": 0.7650823693002955 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_fixed-rrog_T2_ns3_h32_e1_s126.json b/runs/ogbg-molhiv_gin_fixed-rrog_T2_ns3_h32_e1_s126.json new file mode 100644 index 0000000..f3d97d9 --- /dev/null +++ b/runs/ogbg-molhiv_gin_fixed-rrog_T2_ns3_h32_e1_s126.json @@ -0,0 +1,32 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_fixed-rrog_T2_ns3_h32_e1_s126", + "compute": "fixed-rrog", + "T": 2, + "n_sup": 3, + "hidden": 32, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 1, + "eval_every": 1, + "lr": 0.001, + "bs": 64, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_exploration_prob": 0.1, + "seed": 126, + "num_workers": 0, + "max_train_batches": 2, + "max_eval_batches": 0, + "view": "gin", + "metric": "rocauc", + "sec": 1.4, + "dev": "cuda", + "ep": 1, + "val": { + "rocauc": 0.3287190133254948 + }, + "test": { + "rocauc": 0.2735761602193939 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_fixed-rrog_T3_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_gin_fixed-rrog_T3_ns3_h128_e100_s0.json new file mode 100644 index 0000000..0d48148 --- /dev/null +++ b/runs/ogbg-molhiv_gin_fixed-rrog_T3_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_fixed-rrog_T3_ns3_h128_e100_s0", + "view": "gin", + "compute": "fixed-rrog", + "T": 3, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 605.6, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.7523760533019792 + }, + "test": { + "rocauc": 0.7324378609088626 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_fixed-rrog_T3_ns3_h128_e300_s0.json b/runs/ogbg-molhiv_gin_fixed-rrog_T3_ns3_h128_e300_s0.json new file mode 100644 index 0000000..1c2a0f0 --- /dev/null +++ b/runs/ogbg-molhiv_gin_fixed-rrog_T3_ns3_h128_e300_s0.json @@ -0,0 +1,35 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_fixed-rrog_T3_ns3_h128_e300_s0", + "view": "gin", + "compute": "fixed-rrog", + "T": 3, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 300, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "metric": "rocauc", + "sec": 2635.6, + "dev": "cuda", + "ep": 50, + "val": { + "rocauc": 0.7650432343719381 + }, + "test": { + "rocauc": 0.7796751578825393 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_fixed-rrog_T3_ns3_h128_e300_s1.json b/runs/ogbg-molhiv_gin_fixed-rrog_T3_ns3_h128_e300_s1.json new file mode 100644 index 0000000..ec0f43c --- /dev/null +++ b/runs/ogbg-molhiv_gin_fixed-rrog_T3_ns3_h128_e300_s1.json @@ -0,0 +1,36 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_fixed-rrog_T3_ns3_h128_e300_s1", + "view": "gin", + "compute": "fixed-rrog", + "T": 3, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 300, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "metric": "rocauc", + "sec": 4091.5, + "dev": "cuda", + "ep": 150, + "val": { + "rocauc": 0.7921565745639819 + }, + "test": { + "rocauc": 0.7489503466656366 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..e44721a --- /dev/null +++ b/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_h128_e100_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_rrog-act_T1_ns3_h128_e100_s0", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 4, + "halt_target": "loss", + "halt_loss_threshold": 0.1, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 30, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "metric": "rocauc", + "sec": 2703.5, + "dev": "cuda", + "ep": 30, + "val": { + "rocauc": 0.7663414902998235 + }, + "val_adaptive": { + "rocauc": 0.7663414902998235 + }, + "test": { + "rocauc": 0.7403561289325787 + }, + "test_adaptive": { + "rocauc": 0.7403561289325788 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 8.0, + "fixed_steps": 8.0, + "adaptive_steps": 8.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_h32_e1_s126.json b/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_h32_e1_s126.json new file mode 100644 index 0000000..a27d24a --- /dev/null +++ b/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_h32_e1_s126.json @@ -0,0 +1,37 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_rrog-act_T1_ns3_h32_e1_s126", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 32, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 1, + "eval_every": 1, + "lr": 0.001, + "bs": 64, + "lam_q": 1.0, + "halt_max_steps": 2, + "halt_exploration_prob": 0.1, + "seed": 126, + "num_workers": 0, + "max_train_batches": 2, + "max_eval_batches": 0, + "view": "gin", + "metric": "rocauc", + "sec": 1.6, + "dev": "cuda", + "ep": 1, + "val": { + "rocauc": 0.3300999412110523 + }, + "test": { + "rocauc": 0.26874408544004325 + }, + "test_adaptive": { + "rocauc": 0.26874408544004325 + }, + "fixed_steps": 2.0, + "adaptive_steps": 2.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_h32_e1_s127.json b/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_h32_e1_s127.json new file mode 100644 index 0000000..9c6997a --- /dev/null +++ b/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_h32_e1_s127.json @@ -0,0 +1,40 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_rrog-act_T1_ns3_h32_e1_s127", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 32, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 1, + "eval_every": 1, + "lr": 0.001, + "bs": 64, + "lam_q": 1.0, + "halt_max_steps": 4, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "seed": 127, + "num_workers": 0, + "max_train_batches": 2, + "max_eval_batches": 0, + "metric": "rocauc", + "sec": 1.7, + "dev": "cuda", + "ep": 1, + "val": { + "rocauc": 0.329166054281795 + }, + "test": { + "rocauc": 0.29172830684254236 + }, + "test_adaptive": { + "rocauc": 0.29172830684254236 + }, + "fixed_steps": 4.0, + "adaptive_steps": 4.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_h32_e1_s991.json b/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_h32_e1_s991.json new file mode 100644 index 0000000..3bf4288 --- /dev/null +++ b/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_h32_e1_s991.json @@ -0,0 +1,45 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_rrog-act_T1_ns3_h32_e1_s991", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 32, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 1, + "eval_every": 1, + "lr": 0.001, + "bs": 64, + "lam_q": 1.0, + "halt_max_steps": 4, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "seed": 991, + "num_workers": 0, + "max_train_batches": 1, + "max_eval_batches": 1, + "metric": "rocauc", + "sec": 0.8, + "dev": "cuda", + "ep": 1, + "val": { + "rocauc": 0.3015873015873016 + }, + "val_adaptive": { + "rocauc": 0.3015873015873016 + }, + "test": { + "rocauc": 0.22933467741935482 + }, + "test_adaptive": { + "rocauc": 0.22933467741935482 + }, + "fixed_val_steps": 4.0, + "adaptive_val_steps": 4.0, + "fixed_steps": 4.0, + "adaptive_steps": 4.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_h32_e1_s993.json b/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_h32_e1_s993.json new file mode 100644 index 0000000..1df4e9c --- /dev/null +++ b/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_h32_e1_s993.json @@ -0,0 +1,46 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_rrog-act_T1_ns3_h32_e1_s993", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 32, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 1, + "eval_every": 1, + "lr": 0.001, + "bs": 64, + "lam_q": 1.0, + "halt_max_steps": 4, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "ema": 0.0, + "seed": 993, + "num_workers": 0, + "max_train_batches": 1, + "max_eval_batches": 1, + "metric": "rocauc", + "sec": 0.9, + "dev": "cuda", + "ep": 1, + "val": { + "rocauc": 0.28174603174603174 + }, + "val_adaptive": { + "rocauc": 0.28174603174603174 + }, + "test": { + "rocauc": 0.21370967741935482 + }, + "test_adaptive": { + "rocauc": 0.21370967741935482 + }, + "fixed_val_steps": 4.0, + "adaptive_val_steps": 4.0, + "fixed_steps": 4.0, + "adaptive_steps": 4.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_h32_e1_s994.json b/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_h32_e1_s994.json new file mode 100644 index 0000000..e505b47 --- /dev/null +++ b/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_h32_e1_s994.json @@ -0,0 +1,46 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_rrog-act_T1_ns3_h32_e1_s994", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 32, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 1, + "eval_every": 1, + "lr": 0.001, + "bs": 64, + "lam_q": 0.1, + "halt_max_steps": 4, + "halt_min_steps": 3, + "halt_target": "loss", + "halt_loss_threshold": 0.1, + "halt_exploration_prob": 0.1, + "ema": 0.0, + "seed": 994, + "num_workers": 0, + "max_train_batches": 1, + "max_eval_batches": 1, + "metric": "rocauc", + "sec": 0.9, + "dev": "cuda", + "ep": 1, + "val": { + "rocauc": 0.26884920634920634 + }, + "val_adaptive": { + "rocauc": 0.26884920634920634 + }, + "test": { + "rocauc": 0.2479838709677419 + }, + "test_adaptive": { + "rocauc": 0.2479838709677419 + }, + "fixed_val_steps": 4.0, + "adaptive_val_steps": 4.0, + "fixed_steps": 4.0, + "adaptive_steps": 4.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..98afada --- /dev/null +++ b/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 890.8, + "dev": "cuda:3", + "ep": 100, + "val": { + "rocauc": 0.7412490201842054 + }, + "val_adaptive": { + "rocauc": 0.7575966343327454 + }, + "test": { + "rocauc": 0.7254234342107805 + }, + "test_adaptive": { + "rocauc": 0.7567005929044593 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0, + "fixed_steps": 8.0, + "adaptive_steps": 2.00024313153416 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..6456e52 --- /dev/null +++ b/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 938.6, + "dev": "cuda:0", + "ep": 90, + "val": { + "rocauc": 0.7622844405251813 + }, + "val_adaptive": { + "rocauc": 0.7816266166960611 + }, + "test": { + "rocauc": 0.728463276617934 + }, + "test_adaptive": { + "rocauc": 0.7414685490256668 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.111597374179431, + "fixed_steps": 8.0, + "adaptive_steps": 2.1835643082907854 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json b/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json new file mode 100644 index 0000000..2abc8ba --- /dev/null +++ b/runs/ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 30, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 856.3, + "dev": "cuda:3", + "ep": 70, + "val": { + "rocauc": 0.774284122085048 + }, + "val_adaptive": { + "rocauc": 0.7713324270037233 + }, + "test": { + "rocauc": 0.6994457212383399 + }, + "test_adaptive": { + "rocauc": 0.6907394889820196 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0615122781424753, + "fixed_steps": 8.0, + "adaptive_steps": 2.0816921954777534 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_view-only_T0_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_gin_view-only_T0_ns3_h128_e100_s0.json new file mode 100644 index 0000000..b5a3b6b --- /dev/null +++ b/runs/ogbg-molhiv_gin_view-only_T0_ns3_h128_e100_s0.json @@ -0,0 +1,32 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_view-only_T0_ns3_h128_e100_s0", + "compute": "view-only", + "T": 0, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_exploration_prob": 0.1, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "view": "gin", + "metric": "rocauc", + "sec": 361.6, + "dev": "cuda", + "ep": 70, + "val": { + "rocauc": 0.8085501175778953 + }, + "test": { + "rocauc": 0.7444832847293305 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gin_view-only_T0_ns3_h32_e1_s126.json b/runs/ogbg-molhiv_gin_view-only_T0_ns3_h32_e1_s126.json new file mode 100644 index 0000000..7477bf9 --- /dev/null +++ b/runs/ogbg-molhiv_gin_view-only_T0_ns3_h32_e1_s126.json @@ -0,0 +1,32 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gin_view-only_T0_ns3_h32_e1_s126", + "compute": "view-only", + "T": 0, + "n_sup": 3, + "hidden": 32, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 1, + "eval_every": 1, + "lr": 0.001, + "bs": 64, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_exploration_prob": 0.1, + "seed": 126, + "num_workers": 0, + "max_train_batches": 2, + "max_eval_batches": 0, + "view": "gin", + "metric": "rocauc", + "sec": 1.4, + "dev": "cuda", + "ep": 1, + "val": { + "rocauc": 0.33753735547717034 + }, + "test": { + "rocauc": 0.27185345410301476 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gine_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molhiv_gine_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..1d75215 --- /dev/null +++ b/runs/ogbg-molhiv_gine_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gine_classic_T0_ns1_h128_e100_s0", + "view": "gine", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 453.6, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.7942448069762884 + }, + "test": { + "rocauc": 0.7445141852874717 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gine_classic_T0_ns1_h128_e100_s1.json b/runs/ogbg-molhiv_gine_classic_T0_ns1_h128_e100_s1.json new file mode 100644 index 0000000..d88283d --- /dev/null +++ b/runs/ogbg-molhiv_gine_classic_T0_ns1_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gine_classic_T0_ns1_h128_e100_s1", + "view": "gine", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 658.5, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.763098912404468 + }, + "test": { + "rocauc": 0.7342204368566407 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gine_classic_T0_ns1_h128_e100_s2.json b/runs/ogbg-molhiv_gine_classic_T0_ns1_h128_e100_s2.json new file mode 100644 index 0000000..9f1f6de --- /dev/null +++ b/runs/ogbg-molhiv_gine_classic_T0_ns1_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gine_classic_T0_ns1_h128_e100_s2", + "view": "gine", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 656.1, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.7786351165980796 + }, + "test": { + "rocauc": 0.7729069700071457 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gine_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_gine_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..6bfee5b --- /dev/null +++ b/runs/ogbg-molhiv_gine_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gine_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gine", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 627.5, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.7489589457182049 + }, + "test": { + "rocauc": 0.7375634909905561 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gine_fixed-rrog_T1_ns3_h128_e100_s1.json b/runs/ogbg-molhiv_gine_fixed-rrog_T1_ns3_h128_e100_s1.json new file mode 100644 index 0000000..3f9fb8a --- /dev/null +++ b/runs/ogbg-molhiv_gine_fixed-rrog_T1_ns3_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gine_fixed-rrog_T1_ns3_h128_e100_s1", + "view": "gine", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 889.7, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.7576823682147755 + }, + "test": { + "rocauc": 0.7671121497132043 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gine_fixed-rrog_T1_ns3_h128_e100_s2.json b/runs/ogbg-molhiv_gine_fixed-rrog_T1_ns3_h128_e100_s2.json new file mode 100644 index 0000000..2c42092 --- /dev/null +++ b/runs/ogbg-molhiv_gine_fixed-rrog_T1_ns3_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gine_fixed-rrog_T1_ns3_h128_e100_s2", + "view": "gine", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 904.4, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.7872697432882618 + }, + "test": { + "rocauc": 0.7010158558488964 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gine_fixed-rrog_T3_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_gine_fixed-rrog_T3_ns3_h128_e100_s0.json new file mode 100644 index 0000000..d906f24 --- /dev/null +++ b/runs/ogbg-molhiv_gine_fixed-rrog_T3_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gine_fixed-rrog_T3_ns3_h128_e100_s0", + "view": "gine", + "compute": "fixed-rrog", + "T": 3, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 662.2, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.7574588477366255 + }, + "test": { + "rocauc": 0.7400818864790746 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..b9f1b79 --- /dev/null +++ b/runs/ogbg-molhiv_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gine", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 953.5, + "dev": "cuda:0", + "ep": 60, + "val": { + "rocauc": 0.7427218058005095 + }, + "val_adaptive": { + "rocauc": 0.7543601802861062 + }, + "test": { + "rocauc": 0.7216728789663763 + }, + "test_adaptive": { + "rocauc": 0.7219567778442999 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.1692195477753464, + "fixed_steps": 8.0, + "adaptive_steps": 2.1913445173839046 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_graphconv_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molhiv_graphconv_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..7c060a9 --- /dev/null +++ b/runs/ogbg-molhiv_graphconv_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_graphconv_classic_T0_ns1_h128_e100_s0", + "view": "graphconv", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 296.8, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.7706618655692731 + }, + "test": { + "rocauc": 0.7108113327796983 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_graphconv_classic_T0_ns1_h128_e100_s1.json b/runs/ogbg-molhiv_graphconv_classic_T0_ns1_h128_e100_s1.json new file mode 100644 index 0000000..d2362dd --- /dev/null +++ b/runs/ogbg-molhiv_graphconv_classic_T0_ns1_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_graphconv_classic_T0_ns1_h128_e100_s1", + "view": "graphconv", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 354.5, + "dev": "cuda:0", + "ep": 20, + "val": { + "rocauc": 0.7911185822065452 + }, + "test": { + "rocauc": 0.7552501979567006 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_graphconv_classic_T0_ns1_h128_e100_s2.json b/runs/ogbg-molhiv_graphconv_classic_T0_ns1_h128_e100_s2.json new file mode 100644 index 0000000..c49b184 --- /dev/null +++ b/runs/ogbg-molhiv_graphconv_classic_T0_ns1_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_graphconv_classic_T0_ns1_h128_e100_s2", + "view": "graphconv", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 386.2, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.7350884283754655 + }, + "test": { + "rocauc": 0.7330423530775024 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..9cf349f --- /dev/null +++ b/runs/ogbg-molhiv_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_graphconv_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "graphconv", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 614.9, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.7816847932588673 + }, + "test": { + "rocauc": 0.7492632148168176 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_graphconv_fixed-rrog_T1_ns3_h128_e100_s1.json b/runs/ogbg-molhiv_graphconv_fixed-rrog_T1_ns3_h128_e100_s1.json new file mode 100644 index 0000000..ae03725 --- /dev/null +++ b/runs/ogbg-molhiv_graphconv_fixed-rrog_T1_ns3_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_graphconv_fixed-rrog_T1_ns3_h128_e100_s1", + "view": "graphconv", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 813.7, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.7784422153635117 + }, + "test": { + "rocauc": 0.7098244462040595 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_graphconv_fixed-rrog_T1_ns3_h128_e100_s2.json b/runs/ogbg-molhiv_graphconv_fixed-rrog_T1_ns3_h128_e100_s2.json new file mode 100644 index 0000000..a338cbd --- /dev/null +++ b/runs/ogbg-molhiv_graphconv_fixed-rrog_T1_ns3_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_graphconv_fixed-rrog_T1_ns3_h128_e100_s2", + "view": "graphconv", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 812.9, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.7665068342151675 + }, + "test": { + "rocauc": 0.7325112497344484 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_graphconv_fixed-rrog_T3_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_graphconv_fixed-rrog_T3_ns3_h128_e100_s0.json new file mode 100644 index 0000000..a0f771a --- /dev/null +++ b/runs/ogbg-molhiv_graphconv_fixed-rrog_T3_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_graphconv_fixed-rrog_T3_ns3_h128_e100_s0", + "view": "graphconv", + "compute": "fixed-rrog", + "T": 3, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 897.2, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.7712528169704094 + }, + "test": { + "rocauc": 0.6979180748952278 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..d08e17a --- /dev/null +++ b/runs/ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphconv", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 840.7, + "dev": "cuda:3", + "ep": 80, + "val": { + "rocauc": 0.7484965951401137 + }, + "val_adaptive": { + "rocauc": 0.7407682980599647 + }, + "test": { + "rocauc": 0.722140249908264 + }, + "test_adaptive": { + "rocauc": 0.7285405280132873 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0, + "fixed_steps": 8.0, + "adaptive_steps": 2.00024313153416 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..fe8fbdd --- /dev/null +++ b/runs/ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphconv", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 896.5, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.7790944052518126 + }, + "val_adaptive": { + "rocauc": 0.7738033999608073 + }, + "test": { + "rocauc": 0.7510651036134339 + }, + "test_adaptive": { + "rocauc": 0.7493443287819387 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.2103087770483834, + "fixed_steps": 8.0, + "adaptive_steps": 2.2287867736445417 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json b/runs/ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json new file mode 100644 index 0000000..635d338 --- /dev/null +++ b/runs/ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0", + "view": "graphconv", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 30, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 804.7, + "dev": "cuda:3", + "ep": 80, + "val": { + "rocauc": 0.7537722908093278 + }, + "val_adaptive": { + "rocauc": 0.7665435773074663 + }, + "test": { + "rocauc": 0.7703277390447865 + }, + "test_adaptive": { + "rocauc": 0.764460495567701 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0651592511548746, + "fixed_steps": 8.0, + "adaptive_steps": 2.0678336980306344 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_graphsage_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molhiv_graphsage_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..4803bd6 --- /dev/null +++ b/runs/ogbg-molhiv_graphsage_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_graphsage_classic_T0_ns1_h128_e100_s0", + "view": "graphsage", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 295.9, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.7968596903782088 + }, + "test": { + "rocauc": 0.7625118291199134 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_graphsage_classic_T0_ns1_h128_e100_s1.json b/runs/ogbg-molhiv_graphsage_classic_T0_ns1_h128_e100_s1.json new file mode 100644 index 0000000..43bf748 --- /dev/null +++ b/runs/ogbg-molhiv_graphsage_classic_T0_ns1_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_graphsage_classic_T0_ns1_h128_e100_s1", + "view": "graphsage", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 326.7, + "dev": "cuda:0", + "ep": 20, + "val": { + "rocauc": 0.7860541593180482 + }, + "test": { + "rocauc": 0.7280480503679099 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_graphsage_classic_T0_ns1_h128_e100_s2.json b/runs/ogbg-molhiv_graphsage_classic_T0_ns1_h128_e100_s2.json new file mode 100644 index 0000000..9ccf7e4 --- /dev/null +++ b/runs/ogbg-molhiv_graphsage_classic_T0_ns1_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_graphsage_classic_T0_ns1_h128_e100_s2", + "view": "graphsage", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 321.7, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.7765070791691162 + }, + "test": { + "rocauc": 0.7610942660151799 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_graphsage_classic_T0_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_graphsage_classic_T0_ns3_h128_e100_s0.json new file mode 100644 index 0000000..b76d130 --- /dev/null +++ b/runs/ogbg-molhiv_graphsage_classic_T0_ns3_h128_e100_s0.json @@ -0,0 +1,32 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_graphsage_classic_T0_ns3_h128_e100_s0", + "view": "graphsage", + "compute": "classic", + "T": 0, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_exploration_prob": 0.1, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "metric": "rocauc", + "sec": 333.7, + "dev": "cuda", + "ep": 40, + "val": { + "rocauc": 0.7715559474818734 + }, + "test": { + "rocauc": 0.7522837443751327 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..3f9f5d9 --- /dev/null +++ b/runs/ogbg-molhiv_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_graphsage_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "graphsage", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 545.5, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.7893457280031354 + }, + "test": { + "rocauc": 0.7632959307827497 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_graphsage_fixed-rrog_T1_ns3_h128_e100_s1.json b/runs/ogbg-molhiv_graphsage_fixed-rrog_T1_ns3_h128_e100_s1.json new file mode 100644 index 0000000..f8b906b --- /dev/null +++ b/runs/ogbg-molhiv_graphsage_fixed-rrog_T1_ns3_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_graphsage_fixed-rrog_T1_ns3_h128_e100_s1", + "view": "graphsage", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 839.5, + "dev": "cuda:0", + "ep": 20, + "val": { + "rocauc": 0.7888068293160886 + }, + "test": { + "rocauc": 0.709044207110991 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_graphsage_fixed-rrog_T1_ns3_h128_e100_s2.json b/runs/ogbg-molhiv_graphsage_fixed-rrog_T1_ns3_h128_e100_s2.json new file mode 100644 index 0000000..c0bc09c --- /dev/null +++ b/runs/ogbg-molhiv_graphsage_fixed-rrog_T1_ns3_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_graphsage_fixed-rrog_T1_ns3_h128_e100_s2", + "view": "graphsage", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 824.9, + "dev": "cuda:0", + "ep": 70, + "val": { + "rocauc": 0.7798445767195766 + }, + "test": { + "rocauc": 0.7146430019892235 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_graphsage_fixed-rrog_T3_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_graphsage_fixed-rrog_T3_ns3_h128_e100_s0.json new file mode 100644 index 0000000..a143dfa --- /dev/null +++ b/runs/ogbg-molhiv_graphsage_fixed-rrog_T3_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_graphsage_fixed-rrog_T3_ns3_h128_e100_s0", + "view": "graphsage", + "compute": "fixed-rrog", + "T": 3, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 556.3, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.7586759626690183 + }, + "test": { + "rocauc": 0.7641070704339598 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..44b1b4e --- /dev/null +++ b/runs/ogbg-molhiv_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphsage", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 898.2, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.7724224720752498 + }, + "val_adaptive": { + "rocauc": 0.7656556192435822 + }, + "test": { + "rocauc": 0.7540721141775624 + }, + "test_adaptive": { + "rocauc": 0.7493028061569362 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.1356673960612693, + "fixed_steps": 8.0, + "adaptive_steps": 2.225382932166302 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_mf_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molhiv_mf_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..f609023 --- /dev/null +++ b/runs/ogbg-molhiv_mf_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_mf_classic_T0_ns1_h128_e100_s0", + "view": "mf", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 1531.1, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.784538506760729 + }, + "test": { + "rocauc": 0.7073504702678692 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_mf_classic_T0_ns1_h128_e100_s1.json b/runs/ogbg-molhiv_mf_classic_T0_ns1_h128_e100_s1.json new file mode 100644 index 0000000..45239b6 --- /dev/null +++ b/runs/ogbg-molhiv_mf_classic_T0_ns1_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_mf_classic_T0_ns1_h128_e100_s1", + "view": "mf", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1549.6, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.757284318048207 + }, + "test": { + "rocauc": 0.7282353850016416 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_mf_classic_T0_ns1_h128_e100_s2.json b/runs/ogbg-molhiv_mf_classic_T0_ns1_h128_e100_s2.json new file mode 100644 index 0000000..0a54ab0 --- /dev/null +++ b/runs/ogbg-molhiv_mf_classic_T0_ns1_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_mf_classic_T0_ns1_h128_e100_s2", + "view": "mf", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1696.8, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.7735645698608662 + }, + "test": { + "rocauc": 0.769927963073833 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_mf_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_mf_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..a4a8bc9 --- /dev/null +++ b/runs/ogbg-molhiv_mf_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_mf_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "mf", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1416.9, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.7754017244757985 + }, + "test": { + "rocauc": 0.7114583132157826 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_mf_fixed-rrog_T1_ns3_h128_e100_s1.json b/runs/ogbg-molhiv_mf_fixed-rrog_T1_ns3_h128_e100_s1.json new file mode 100644 index 0000000..e0f745e --- /dev/null +++ b/runs/ogbg-molhiv_mf_fixed-rrog_T1_ns3_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_mf_fixed-rrog_T1_ns3_h128_e100_s1", + "view": "mf", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1730.2, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.796195252792475 + }, + "test": { + "rocauc": 0.7153228142683327 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_mf_fixed-rrog_T1_ns3_h128_e100_s2.json b/runs/ogbg-molhiv_mf_fixed-rrog_T1_ns3_h128_e100_s2.json new file mode 100644 index 0000000..bbce3ca --- /dev/null +++ b/runs/ogbg-molhiv_mf_fixed-rrog_T1_ns3_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_mf_fixed-rrog_T1_ns3_h128_e100_s2", + "view": "mf", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1742.8, + "dev": "cuda:0", + "ep": 20, + "val": { + "rocauc": 0.7763417352537723 + }, + "test": { + "rocauc": 0.7111811738349525 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_mf_fixed-rrog_T3_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_mf_fixed-rrog_T3_ns3_h128_e100_s0.json new file mode 100644 index 0000000..6a5fba2 --- /dev/null +++ b/runs/ogbg-molhiv_mf_fixed-rrog_T3_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_mf_fixed-rrog_T3_ns3_h128_e100_s0", + "view": "mf", + "compute": "fixed-rrog", + "T": 3, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 1787.2, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.7930782137958065 + }, + "test": { + "rocauc": 0.7216728789663763 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..996bd57 --- /dev/null +++ b/runs/ogbg-molhiv_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "mf", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1677.8, + "dev": "cuda:0", + "ep": 70, + "val": { + "rocauc": 0.8046522878698804 + }, + "val_adaptive": { + "rocauc": 0.7827258475406624 + }, + "test": { + "rocauc": 0.7416423646652118 + }, + "test_adaptive": { + "rocauc": 0.7333127329612392 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.146851446632628, + "fixed_steps": 8.0, + "adaptive_steps": 2.1964502796012644 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_pna_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molhiv_pna_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..098ce44 --- /dev/null +++ b/runs/ogbg-molhiv_pna_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_pna_classic_T0_ns1_h128_e100_s0", + "view": "pna", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 1145.0, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.7779523074661963 + }, + "test": { + "rocauc": 0.7647926765677203 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_pna_classic_T0_ns1_h128_e100_s1.json b/runs/ogbg-molhiv_pna_classic_T0_ns1_h128_e100_s1.json new file mode 100644 index 0000000..2918d26 --- /dev/null +++ b/runs/ogbg-molhiv_pna_classic_T0_ns1_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_pna_classic_T0_ns1_h128_e100_s1", + "view": "pna", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1188.6, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.7983079805996471 + }, + "test": { + "rocauc": 0.7485834025377083 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_pna_classic_T0_ns1_h128_e100_s2.json b/runs/ogbg-molhiv_pna_classic_T0_ns1_h128_e100_s2.json new file mode 100644 index 0000000..8ad1de4 --- /dev/null +++ b/runs/ogbg-molhiv_pna_classic_T0_ns1_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_pna_classic_T0_ns1_h128_e100_s2", + "view": "pna", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1211.3, + "dev": "cuda:0", + "ep": 70, + "val": { + "rocauc": 0.8066731579463061 + }, + "test": { + "rocauc": 0.7427663724676027 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_pna_classic_T0_ns1_h128_e1_s0.json b/runs/ogbg-molhiv_pna_classic_T0_ns1_h128_e1_s0.json new file mode 100644 index 0000000..7ad454c --- /dev/null +++ b/runs/ogbg-molhiv_pna_classic_T0_ns1_h128_e1_s0.json @@ -0,0 +1,37 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_pna_classic_T0_ns1_h128_e1_s0", + "view": "pna", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 1, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 1, + "max_eval_batches": 1, + "metric": "rocauc", + "sec": 0.8, + "dev": "cuda", + "ep": 1, + "val": { + "rocauc": 0.7509920634920635 + }, + "test": { + "rocauc": 0.719758064516129 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_pna_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_pna_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..d37c7d3 --- /dev/null +++ b/runs/ogbg-molhiv_pna_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_pna_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "pna", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 906.5, + "dev": "cuda:0", + "ep": 60, + "val": { + "rocauc": 0.8096554722712129 + }, + "test": { + "rocauc": 0.7601633867011722 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_pna_fixed-rrog_T1_ns3_h128_e100_s1.json b/runs/ogbg-molhiv_pna_fixed-rrog_T1_ns3_h128_e100_s1.json new file mode 100644 index 0000000..e5b3dd1 --- /dev/null +++ b/runs/ogbg-molhiv_pna_fixed-rrog_T1_ns3_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_pna_fixed-rrog_T1_ns3_h128_e100_s1", + "view": "pna", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1459.2, + "dev": "cuda:0", + "ep": 70, + "val": { + "rocauc": 0.8510281941994904 + }, + "test": { + "rocauc": 0.7524633538693293 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_pna_fixed-rrog_T1_ns3_h128_e100_s2.json b/runs/ogbg-molhiv_pna_fixed-rrog_T1_ns3_h128_e100_s2.json new file mode 100644 index 0000000..19f20d0 --- /dev/null +++ b/runs/ogbg-molhiv_pna_fixed-rrog_T1_ns3_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_pna_fixed-rrog_T1_ns3_h128_e100_s2", + "view": "pna", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1461.8, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.7816358024691358 + }, + "test": { + "rocauc": 0.7382085401417564 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_pna_fixed-rrog_T3_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_pna_fixed-rrog_T3_ns3_h128_e100_s0.json new file mode 100644 index 0000000..783fd88 --- /dev/null +++ b/runs/ogbg-molhiv_pna_fixed-rrog_T3_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_pna_fixed-rrog_T3_ns3_h128_e100_s0", + "view": "pna", + "compute": "fixed-rrog", + "T": 3, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 1420.7, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.7890395355673133 + }, + "test": { + "rocauc": 0.7629792000618011 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..dcd2b40 --- /dev/null +++ b/runs/ogbg-molhiv_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "pna", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 1165.2, + "dev": "cuda:3", + "ep": 70, + "val": { + "rocauc": 0.7384932882618068 + }, + "val_adaptive": { + "rocauc": 0.7678234616892025 + }, + "test": { + "rocauc": 0.7185075030417737 + }, + "test_adaptive": { + "rocauc": 0.7421078043222156 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.00048626306832, + "fixed_steps": 8.0, + "adaptive_steps": 2.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..6c7fb03 --- /dev/null +++ b/runs/ogbg-molhiv_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "pna", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1400.2, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.7487599206349206 + }, + "val_adaptive": { + "rocauc": 0.7203820056829315 + }, + "test": { + "rocauc": 0.6730373317368046 + }, + "test_adaptive": { + "rocauc": 0.6877382722725429 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.034038414782397, + "fixed_steps": 8.0, + "adaptive_steps": 2.0588378312667155 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_resgated_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molhiv_resgated_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..625c1ea --- /dev/null +++ b/runs/ogbg-molhiv_resgated_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_resgated_classic_T0_ns1_h128_e100_s0", + "view": "resgated", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 731.8, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.8143738977072311 + }, + "test": { + "rocauc": 0.7241738928909403 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_resgated_classic_T0_ns1_h128_e100_s1.json b/runs/ogbg-molhiv_resgated_classic_T0_ns1_h128_e100_s1.json new file mode 100644 index 0000000..260a7dc --- /dev/null +++ b/runs/ogbg-molhiv_resgated_classic_T0_ns1_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_resgated_classic_T0_ns1_h128_e100_s1", + "view": "resgated", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 749.6, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.7860449735449736 + }, + "test": { + "rocauc": 0.715921512582321 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_resgated_classic_T0_ns1_h128_e100_s2.json b/runs/ogbg-molhiv_resgated_classic_T0_ns1_h128_e100_s2.json new file mode 100644 index 0000000..2bc4a4f --- /dev/null +++ b/runs/ogbg-molhiv_resgated_classic_T0_ns1_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_resgated_classic_T0_ns1_h128_e100_s2", + "view": "resgated", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 782.8, + "dev": "cuda:0", + "ep": 10, + "val": { + "rocauc": 0.7885404418969234 + }, + "test": { + "rocauc": 0.7547480638869041 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..73a87a9 --- /dev/null +++ b/runs/ogbg-molhiv_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_resgated_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "resgated", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 712.4, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.7922576180678031 + }, + "test": { + "rocauc": 0.7226559029722475 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_resgated_fixed-rrog_T1_ns3_h128_e100_s1.json b/runs/ogbg-molhiv_resgated_fixed-rrog_T1_ns3_h128_e100_s1.json new file mode 100644 index 0000000..b31ca8b --- /dev/null +++ b/runs/ogbg-molhiv_resgated_fixed-rrog_T1_ns3_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_resgated_fixed-rrog_T1_ns3_h128_e100_s1", + "view": "resgated", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1027.0, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.8151638741916519 + }, + "test": { + "rocauc": 0.7581278124336122 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_resgated_fixed-rrog_T1_ns3_h128_e100_s2.json b/runs/ogbg-molhiv_resgated_fixed-rrog_T1_ns3_h128_e100_s2.json new file mode 100644 index 0000000..aabf825 --- /dev/null +++ b/runs/ogbg-molhiv_resgated_fixed-rrog_T1_ns3_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_resgated_fixed-rrog_T1_ns3_h128_e100_s2", + "view": "resgated", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1026.6, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.7987029688418578 + }, + "test": { + "rocauc": 0.7339867513856969 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_resgated_fixed-rrog_T3_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_resgated_fixed-rrog_T3_ns3_h128_e100_s0.json new file mode 100644 index 0000000..1ad3cf3 --- /dev/null +++ b/runs/ogbg-molhiv_resgated_fixed-rrog_T3_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_resgated_fixed-rrog_T3_ns3_h128_e100_s0", + "view": "resgated", + "compute": "fixed-rrog", + "T": 3, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 1139.9, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.8173500881834216 + }, + "test": { + "rocauc": 0.7054809865003185 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..ef45220 --- /dev/null +++ b/runs/ogbg-molhiv_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "resgated", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 954.4, + "dev": "cuda:3", + "ep": 40, + "val": { + "rocauc": 0.8009657309425828 + }, + "val_adaptive": { + "rocauc": 0.7896488585145993 + }, + "test": { + "rocauc": 0.7787017903010873 + }, + "test_adaptive": { + "rocauc": 0.7875702504876494 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0, + "fixed_steps": 8.0, + "adaptive_steps": 2.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..52afe84 --- /dev/null +++ b/runs/ogbg-molhiv_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "resgated", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1059.4, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.8030723349010386 + }, + "val_adaptive": { + "rocauc": 0.7952827993337253 + }, + "test": { + "rocauc": 0.7502983835145524 + }, + "test_adaptive": { + "rocauc": 0.7566658297765504 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.099927060539752, + "fixed_steps": 8.0, + "adaptive_steps": 2.2205203014831025 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_sgc_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molhiv_sgc_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..53f4e1d --- /dev/null +++ b/runs/ogbg-molhiv_sgc_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_sgc_classic_T0_ns1_h128_e100_s0", + "view": "sgc", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 349.7, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.7478597148736037 + }, + "test": { + "rocauc": 0.7019100407501111 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_sgc_classic_T0_ns1_h128_e100_s1.json b/runs/ogbg-molhiv_sgc_classic_T0_ns1_h128_e100_s1.json new file mode 100644 index 0000000..0375109 --- /dev/null +++ b/runs/ogbg-molhiv_sgc_classic_T0_ns1_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_sgc_classic_T0_ns1_h128_e100_s1", + "view": "sgc", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 367.1, + "dev": "cuda:0", + "ep": 30, + "val": { + "rocauc": 0.7691676464824613 + }, + "test": { + "rocauc": 0.7100407501110487 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_sgc_classic_T0_ns1_h128_e100_s2.json b/runs/ogbg-molhiv_sgc_classic_T0_ns1_h128_e100_s2.json new file mode 100644 index 0000000..c8af7ef --- /dev/null +++ b/runs/ogbg-molhiv_sgc_classic_T0_ns1_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_sgc_classic_T0_ns1_h128_e100_s2", + "view": "sgc", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 366.8, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.7927750832843425 + }, + "test": { + "rocauc": 0.6994457212383398 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..6113561 --- /dev/null +++ b/runs/ogbg-molhiv_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_sgc_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "sgc", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 524.9, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.7659097589653145 + }, + "test": { + "rocauc": 0.7135769327333474 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_sgc_fixed-rrog_T1_ns3_h128_e100_s1.json b/runs/ogbg-molhiv_sgc_fixed-rrog_T1_ns3_h128_e100_s1.json new file mode 100644 index 0000000..de5740d --- /dev/null +++ b/runs/ogbg-molhiv_sgc_fixed-rrog_T1_ns3_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_sgc_fixed-rrog_T1_ns3_h128_e100_s1", + "view": "sgc", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 669.2, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.7603952331961592 + }, + "test": { + "rocauc": 0.675208095946233 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_sgc_fixed-rrog_T1_ns3_h128_e100_s2.json b/runs/ogbg-molhiv_sgc_fixed-rrog_T1_ns3_h128_e100_s2.json new file mode 100644 index 0000000..51be4d8 --- /dev/null +++ b/runs/ogbg-molhiv_sgc_fixed-rrog_T1_ns3_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_sgc_fixed-rrog_T1_ns3_h128_e100_s2", + "view": "sgc", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 763.4, + "dev": "cuda:0", + "ep": 20, + "val": { + "rocauc": 0.7665741965510485 + }, + "test": { + "rocauc": 0.7427122964908555 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_sgc_fixed-rrog_T3_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_sgc_fixed-rrog_T3_ns3_h128_e100_s0.json new file mode 100644 index 0000000..e89cf0f --- /dev/null +++ b/runs/ogbg-molhiv_sgc_fixed-rrog_T3_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_sgc_fixed-rrog_T3_ns3_h128_e100_s0", + "view": "sgc", + "compute": "fixed-rrog", + "T": 3, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 907.7, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.7481720311581422 + }, + "test": { + "rocauc": 0.7177311265184728 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..284a8c9 --- /dev/null +++ b/runs/ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "sgc", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 894.1, + "dev": "cuda:3", + "ep": 30, + "val": { + "rocauc": 0.7378227268273565 + }, + "val_adaptive": { + "rocauc": 0.7460286841073879 + }, + "test": { + "rocauc": 0.7035709457502076 + }, + "test_adaptive": { + "rocauc": 0.724386334228162 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0328227571115973, + "fixed_steps": 8.0, + "adaptive_steps": 2.0269876002917577 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..f332c6f --- /dev/null +++ b/runs/ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "sgc", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1011.3, + "dev": "cuda:0", + "ep": 50, + "val": { + "rocauc": 0.7352782676856752 + }, + "val_adaptive": { + "rocauc": 0.7147756221830296 + }, + "test": { + "rocauc": 0.6961702620753587 + }, + "test_adaptive": { + "rocauc": 0.7016995306977732 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.088743009968393, + "fixed_steps": 8.0, + "adaptive_steps": 2.0795040116703136 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json b/runs/ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json new file mode 100644 index 0000000..0e3a623 --- /dev/null +++ b/runs/ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0", + "view": "sgc", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 30, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 866.6, + "dev": "cuda:3", + "ep": 90, + "val": { + "rocauc": 0.7396537575935725 + }, + "val_adaptive": { + "rocauc": 0.7572414511071918 + }, + "test": { + "rocauc": 0.7500666293284923 + }, + "test_adaptive": { + "rocauc": 0.7314046234960119 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.102358375881352, + "fixed_steps": 8.0, + "adaptive_steps": 2.136883053732069 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_tag_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molhiv_tag_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..5729c3d --- /dev/null +++ b/runs/ogbg-molhiv_tag_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_tag_classic_T0_ns1_h128_e100_s0", + "view": "tag", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 590.5, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.7528292181069958 + }, + "test": { + "rocauc": 0.7255354487340427 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_tag_classic_T0_ns1_h128_e100_s1.json b/runs/ogbg-molhiv_tag_classic_T0_ns1_h128_e100_s1.json new file mode 100644 index 0000000..bf5a55b --- /dev/null +++ b/runs/ogbg-molhiv_tag_classic_T0_ns1_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_tag_classic_T0_ns1_h128_e100_s1", + "view": "tag", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 616.8, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.7339157113462669 + }, + "test": { + "rocauc": 0.7487765310260917 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_tag_classic_T0_ns1_h128_e100_s2.json b/runs/ogbg-molhiv_tag_classic_T0_ns1_h128_e100_s2.json new file mode 100644 index 0000000..b9406c3 --- /dev/null +++ b/runs/ogbg-molhiv_tag_classic_T0_ns1_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_tag_classic_T0_ns1_h128_e100_s2", + "view": "tag", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 658.9, + "dev": "cuda:0", + "ep": 30, + "val": { + "rocauc": 0.7595807613168722 + }, + "test": { + "rocauc": 0.7552386102473976 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_tag_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_tag_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..ea17c1a --- /dev/null +++ b/runs/ogbg-molhiv_tag_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_tag_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "tag", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 646.4, + "dev": "cuda:0", + "ep": 90, + "val": { + "rocauc": 0.7717029198510681 + }, + "test": { + "rocauc": 0.7181154522103554 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_tag_fixed-rrog_T1_ns3_h128_e100_s1.json b/runs/ogbg-molhiv_tag_fixed-rrog_T1_ns3_h128_e100_s1.json new file mode 100644 index 0000000..e132ac4 --- /dev/null +++ b/runs/ogbg-molhiv_tag_fixed-rrog_T1_ns3_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_tag_fixed-rrog_T1_ns3_h128_e100_s1", + "view": "tag", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 884.1, + "dev": "cuda:0", + "ep": 60, + "val": { + "rocauc": 0.7412612678816383 + }, + "test": { + "rocauc": 0.7289634794028468 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_tag_fixed-rrog_T1_ns3_h128_e100_s2.json b/runs/ogbg-molhiv_tag_fixed-rrog_T1_ns3_h128_e100_s2.json new file mode 100644 index 0000000..aad79c1 --- /dev/null +++ b/runs/ogbg-molhiv_tag_fixed-rrog_T1_ns3_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_tag_fixed-rrog_T1_ns3_h128_e100_s2", + "view": "tag", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 952.1, + "dev": "cuda:0", + "ep": 70, + "val": { + "rocauc": 0.753107853223594 + }, + "test": { + "rocauc": 0.7545375538345662 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_tag_fixed-rrog_T3_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_tag_fixed-rrog_T3_ns3_h128_e100_s0.json new file mode 100644 index 0000000..547c08d --- /dev/null +++ b/runs/ogbg-molhiv_tag_fixed-rrog_T3_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_tag_fixed-rrog_T3_ns3_h128_e100_s0", + "view": "tag", + "compute": "fixed-rrog", + "T": 3, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 1148.5, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.7803834754066236 + }, + "test": { + "rocauc": 0.7351764228741382 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..15e4e59 --- /dev/null +++ b/runs/ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "tag", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 961.8, + "dev": "cuda:3", + "ep": 70, + "val": { + "rocauc": 0.7326450127376054 + }, + "val_adaptive": { + "rocauc": 0.7643696110131295 + }, + "test": { + "rocauc": 0.759611039224396 + }, + "test_adaptive": { + "rocauc": 0.7786419204696885 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0, + "fixed_steps": 8.0, + "adaptive_steps": 2.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..5a4ca43 --- /dev/null +++ b/runs/ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "tag", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1109.5, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.7567852243778168 + }, + "val_adaptive": { + "rocauc": 0.7644706545169508 + }, + "test": { + "rocauc": 0.7480619556190734 + }, + "test_adaptive": { + "rocauc": 0.7477104617702157 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.138098711402869, + "fixed_steps": 8.0, + "adaptive_steps": 2.225869195234622 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json b/runs/ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json new file mode 100644 index 0000000..7496c27 --- /dev/null +++ b/runs/ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0", + "view": "tag", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 30, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 948.7, + "dev": "cuda:3", + "ep": 60, + "val": { + "rocauc": 0.7298433519498334 + }, + "val_adaptive": { + "rocauc": 0.714129556143445 + }, + "test": { + "rocauc": 0.6791286042604143 + }, + "test_adaptive": { + "rocauc": 0.7162469340852469 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.2890833941162168, + "fixed_steps": 8.0, + "adaptive_steps": 2.4831023583758816 +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_transformer_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molhiv_transformer_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..b662527 --- /dev/null +++ b/runs/ogbg-molhiv_transformer_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_transformer_classic_T0_ns1_h128_e100_s0", + "view": "transformer", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 906.4, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.7617332941407015 + }, + "test": { + "rocauc": 0.7547248884682979 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_transformer_classic_T0_ns1_h128_e100_s1.json b/runs/ogbg-molhiv_transformer_classic_T0_ns1_h128_e100_s1.json new file mode 100644 index 0000000..4d0b540 --- /dev/null +++ b/runs/ogbg-molhiv_transformer_classic_T0_ns1_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_transformer_classic_T0_ns1_h128_e100_s1", + "view": "transformer", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 917.2, + "dev": "cuda:0", + "ep": 30, + "val": { + "rocauc": 0.7767152900254751 + }, + "test": { + "rocauc": 0.7883891152783947 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_transformer_classic_T0_ns1_h128_e100_s2.json b/runs/ogbg-molhiv_transformer_classic_T0_ns1_h128_e100_s2.json new file mode 100644 index 0000000..84cf314 --- /dev/null +++ b/runs/ogbg-molhiv_transformer_classic_T0_ns1_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_transformer_classic_T0_ns1_h128_e100_s2", + "view": "transformer", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 927.8, + "dev": "cuda:0", + "ep": 30, + "val": { + "rocauc": 0.7618435234175974 + }, + "test": { + "rocauc": 0.7711736418239055 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_transformer_classic_T0_ns1_h128_e1_s0.json b/runs/ogbg-molhiv_transformer_classic_T0_ns1_h128_e1_s0.json new file mode 100644 index 0000000..567d135 --- /dev/null +++ b/runs/ogbg-molhiv_transformer_classic_T0_ns1_h128_e1_s0.json @@ -0,0 +1,37 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_transformer_classic_T0_ns1_h128_e1_s0", + "view": "transformer", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 1, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 1, + "max_eval_batches": 1, + "metric": "rocauc", + "sec": 0.8, + "dev": "cuda", + "ep": 1, + "val": { + "rocauc": 0.28769841269841273 + }, + "test": { + "rocauc": 0.27368951612903225 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..9fcb322 --- /dev/null +++ b/runs/ogbg-molhiv_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_transformer_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "transformer", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 883.0, + "dev": "cuda:0", + "ep": 30, + "val": { + "rocauc": 0.7838158926121889 + }, + "test": { + "rocauc": 0.7647501883002762 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_transformer_fixed-rrog_T1_ns3_h128_e100_s1.json b/runs/ogbg-molhiv_transformer_fixed-rrog_T1_ns3_h128_e100_s1.json new file mode 100644 index 0000000..4961b21 --- /dev/null +++ b/runs/ogbg-molhiv_transformer_fixed-rrog_T1_ns3_h128_e100_s1.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_transformer_fixed-rrog_T1_ns3_h128_e100_s1", + "view": "transformer", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 1, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1165.4, + "dev": "cuda:0", + "ep": 70, + "val": { + "rocauc": 0.7651320301783265 + }, + "test": { + "rocauc": 0.749757623747079 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_transformer_fixed-rrog_T1_ns3_h128_e100_s2.json b/runs/ogbg-molhiv_transformer_fixed-rrog_T1_ns3_h128_e100_s2.json new file mode 100644 index 0000000..1bb42aa --- /dev/null +++ b/runs/ogbg-molhiv_transformer_fixed-rrog_T1_ns3_h128_e100_s2.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_transformer_fixed-rrog_T1_ns3_h128_e100_s2", + "view": "transformer", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 2, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1182.1, + "dev": "cuda:0", + "ep": 40, + "val": { + "rocauc": 0.8043399715853421 + }, + "test": { + "rocauc": 0.7765908959230575 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_transformer_fixed-rrog_T3_ns3_h128_e100_s0.json b/runs/ogbg-molhiv_transformer_fixed-rrog_T3_ns3_h128_e100_s0.json new file mode 100644 index 0000000..bf85cdc --- /dev/null +++ b/runs/ogbg-molhiv_transformer_fixed-rrog_T3_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_transformer_fixed-rrog_T3_ns3_h128_e100_s0", + "view": "transformer", + "compute": "fixed-rrog", + "T": 3, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 1246.4, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.8088103811483441 + }, + "test": { + "rocauc": 0.7413024585256572 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molhiv_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molhiv_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..a054aac --- /dev/null +++ b/runs/ogbg-molhiv_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molhiv", + "tag": "ogbg-molhiv_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "transformer", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 1172.8, + "dev": "cuda:0", + "ep": 60, + "val": { + "rocauc": 0.7813418577307466 + }, + "val_adaptive": { + "rocauc": 0.7825329463060944 + }, + "test": { + "rocauc": 0.7294279534174086 + }, + "test_adaptive": { + "rocauc": 0.7396338283860252 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.1475808412351083, + "fixed_steps": 8.0, + "adaptive_steps": 2.215171407731583 +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_appnp_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-mollipo_appnp_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..76b378b --- /dev/null +++ b/runs/ogbg-mollipo_appnp_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_appnp_classic_T0_ns1_h128_e100_s0", + "view": "appnp", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 43.5, + "dev": "cuda:1", + "ep": 100, + "val": { + "rmse": 0.9014809727668762 + }, + "test": { + "rmse": 0.9070075154304504 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-mollipo_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..b9f9086 --- /dev/null +++ b/runs/ogbg-mollipo_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_appnp_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "appnp", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 63.2, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 0.8392646908760071 + }, + "test": { + "rmse": 0.9173930287361145 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-mollipo_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..2966335 --- /dev/null +++ b/runs/ogbg-mollipo_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "appnp", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 102.5, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 1.1389226913452148 + }, + "val_adaptive": { + "rmse": 0.8501057624816895 + }, + "test": { + "rmse": 1.0732718706130981 + }, + "test_adaptive": { + "rmse": 0.8331995606422424 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.3333333333333335, + "fixed_steps": 8.0, + "adaptive_steps": 2.2404761904761905 +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_arma_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-mollipo_arma_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..dac8f21 --- /dev/null +++ b/runs/ogbg-mollipo_arma_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_arma_classic_T0_ns1_h128_e100_s0", + "view": "arma", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 67.1, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 0.7324715852737427 + }, + "test": { + "rmse": 0.7294970750808716 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_arma_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-mollipo_arma_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..b2c75d3 --- /dev/null +++ b/runs/ogbg-mollipo_arma_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_arma_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "arma", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 98.7, + "dev": "cuda:1", + "ep": 50, + "val": { + "rmse": 0.7172609567642212 + }, + "test": { + "rmse": 0.7547623515129089 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-mollipo_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..926cb7f --- /dev/null +++ b/runs/ogbg-mollipo_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "arma", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 102.6, + "dev": "cuda:1", + "ep": 10, + "val": { + "rmse": 108.34754180908203 + }, + "val_adaptive": { + "rmse": 108.19417572021484 + }, + "test": { + "rmse": 1.5814603567123413 + }, + "test_adaptive": { + "rmse": 1.2714992761611938 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 6.180952380952381, + "fixed_steps": 8.0, + "adaptive_steps": 6.019047619047619 +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_cheb_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-mollipo_cheb_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..fbbe6be --- /dev/null +++ b/runs/ogbg-mollipo_cheb_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_cheb_classic_T0_ns1_h128_e100_s0", + "view": "cheb", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 41.9, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 0.7188113927841187 + }, + "test": { + "rmse": 0.7179734706878662 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-mollipo_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..5eba1b4 --- /dev/null +++ b/runs/ogbg-mollipo_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_cheb_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "cheb", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 66.9, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 0.6990480422973633 + }, + "test": { + "rmse": 0.7132058143615723 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-mollipo_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..45d681b --- /dev/null +++ b/runs/ogbg-mollipo_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "cheb", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 101.8, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 0.7458768486976624 + }, + "val_adaptive": { + "rmse": 0.7055894136428833 + }, + "test": { + "rmse": 0.8054617643356323 + }, + "test_adaptive": { + "rmse": 0.7404536604881287 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.0476190476190474, + "fixed_steps": 8.0, + "adaptive_steps": 2.033333333333333 +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_film_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-mollipo_film_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..1488ae4 --- /dev/null +++ b/runs/ogbg-mollipo_film_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_film_classic_T0_ns1_h128_e100_s0", + "view": "film", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 52.4, + "dev": "cuda:1", + "ep": 100, + "val": { + "rmse": 0.7620365619659424 + }, + "test": { + "rmse": 0.7370873689651489 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_film_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-mollipo_film_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..8cf3938 --- /dev/null +++ b/runs/ogbg-mollipo_film_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_film_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "film", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 85.7, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 0.8122015595436096 + }, + "test": { + "rmse": 0.7353013753890991 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-mollipo_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..9388427 --- /dev/null +++ b/runs/ogbg-mollipo_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "film", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 95.0, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 0.9863712787628174 + }, + "val_adaptive": { + "rmse": 0.8663719296455383 + }, + "test": { + "rmse": 0.9712099432945251 + }, + "test_adaptive": { + "rmse": 0.834499180316925 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.2738095238095237, + "fixed_steps": 8.0, + "adaptive_steps": 3.211904761904762 +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_gatv2_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-mollipo_gatv2_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..a1373e9 --- /dev/null +++ b/runs/ogbg-mollipo_gatv2_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_gatv2_classic_T0_ns1_h128_e100_s0", + "view": "gatv2", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 70.6, + "dev": "cuda:1", + "ep": 40, + "val": { + "rmse": 0.6864758729934692 + }, + "test": { + "rmse": 0.7307590842247009 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-mollipo_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..14353de --- /dev/null +++ b/runs/ogbg-mollipo_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_gatv2_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gatv2", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 115.7, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 0.7079874277114868 + }, + "test": { + "rmse": 0.733400285243988 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-mollipo_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..a77b001 --- /dev/null +++ b/runs/ogbg-mollipo_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gatv2", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 120.6, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 0.8837260603904724 + }, + "val_adaptive": { + "rmse": 0.7446271181106567 + }, + "test": { + "rmse": 0.9250612854957581 + }, + "test_adaptive": { + "rmse": 0.7935744524002075 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.4, + "fixed_steps": 8.0, + "adaptive_steps": 2.2928571428571427 +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_gcn_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-mollipo_gcn_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..a639220 --- /dev/null +++ b/runs/ogbg-mollipo_gcn_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_gcn_classic_T0_ns1_h128_e100_s0", + "view": "gcn", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 32.4, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 0.7378985285758972 + }, + "test": { + "rmse": 0.782814621925354 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-mollipo_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..625b0a6 --- /dev/null +++ b/runs/ogbg-mollipo_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_gcn_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gcn", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 46.3, + "dev": "cuda:1", + "ep": 60, + "val": { + "rmse": 0.773021936416626 + }, + "test": { + "rmse": 0.7758824825286865 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-mollipo_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..9a246e2 --- /dev/null +++ b/runs/ogbg-mollipo_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gcn", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 93.3, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 0.9103560447692871 + }, + "val_adaptive": { + "rmse": 0.7345834970474243 + }, + "test": { + "rmse": 0.9299253225326538 + }, + "test_adaptive": { + "rmse": 0.8009624481201172 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.566666666666667, + "fixed_steps": 8.0, + "adaptive_steps": 2.4785714285714286 +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_gen_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-mollipo_gen_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..8f45cbc --- /dev/null +++ b/runs/ogbg-mollipo_gen_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_gen_classic_T0_ns1_h128_e100_s0", + "view": "gen", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 60.8, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 0.7046297788619995 + }, + "test": { + "rmse": 0.7378753423690796 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_gen_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-mollipo_gen_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..bb1fc48 --- /dev/null +++ b/runs/ogbg-mollipo_gen_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_gen_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gen", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 77.5, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 0.6594089865684509 + }, + "test": { + "rmse": 0.7455868124961853 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-mollipo_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..995ad42 --- /dev/null +++ b/runs/ogbg-mollipo_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gen", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 98.0, + "dev": "cuda:1", + "ep": 30, + "val": { + "rmse": 0.9299842715263367 + }, + "val_adaptive": { + "rmse": 0.9338786602020264 + }, + "test": { + "rmse": 0.9385538101196289 + }, + "test_adaptive": { + "rmse": 0.9375044107437134 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 4.366666666666666, + "fixed_steps": 8.0, + "adaptive_steps": 4.252380952380952 +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_gin_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-mollipo_gin_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..254e616 --- /dev/null +++ b/runs/ogbg-mollipo_gin_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_gin_classic_T0_ns1_h128_e100_s0", + "view": "gin", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 56.5, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 0.6853910684585571 + }, + "test": { + "rmse": 0.7389819622039795 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_gin_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-mollipo_gin_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..b09bc85 --- /dev/null +++ b/runs/ogbg-mollipo_gin_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_gin_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gin", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 72.8, + "dev": "cuda:1", + "ep": 100, + "val": { + "rmse": 0.6748515367507935 + }, + "test": { + "rmse": 0.7072575688362122 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-mollipo_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..1b9fab2 --- /dev/null +++ b/runs/ogbg-mollipo_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 90.2, + "dev": "cuda:1", + "ep": 100, + "val": { + "rmse": 0.8872742652893066 + }, + "val_adaptive": { + "rmse": 0.7704845070838928 + }, + "test": { + "rmse": 1.0246026515960693 + }, + "test_adaptive": { + "rmse": 0.8618570566177368 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.7214285714285715, + "fixed_steps": 8.0, + "adaptive_steps": 2.5404761904761903 +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_gine_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-mollipo_gine_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..91316a4 --- /dev/null +++ b/runs/ogbg-mollipo_gine_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_gine_classic_T0_ns1_h128_e100_s0", + "view": "gine", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 63.4, + "dev": "cuda:1", + "ep": 100, + "val": { + "rmse": 0.6614735722541809 + }, + "test": { + "rmse": 0.7341321706771851 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_gine_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-mollipo_gine_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..47fb60b --- /dev/null +++ b/runs/ogbg-mollipo_gine_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_gine_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gine", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 74.6, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 0.7167647480964661 + }, + "test": { + "rmse": 0.731584906578064 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-mollipo_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..ac12e4d --- /dev/null +++ b/runs/ogbg-mollipo_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gine", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 92.7, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 0.8773280382156372 + }, + "val_adaptive": { + "rmse": 0.750048041343689 + }, + "test": { + "rmse": 0.9709947109222412 + }, + "test_adaptive": { + "rmse": 0.8221004605293274 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.5023809523809524, + "fixed_steps": 8.0, + "adaptive_steps": 2.395238095238095 +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_graphconv_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-mollipo_graphconv_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..3056f46 --- /dev/null +++ b/runs/ogbg-mollipo_graphconv_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_graphconv_classic_T0_ns1_h128_e100_s0", + "view": "graphconv", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 42.0, + "dev": "cuda:1", + "ep": 100, + "val": { + "rmse": 0.7177638411521912 + }, + "test": { + "rmse": 0.729673445224762 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-mollipo_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..8691e5a --- /dev/null +++ b/runs/ogbg-mollipo_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_graphconv_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "graphconv", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 79.8, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 0.737244188785553 + }, + "test": { + "rmse": 0.7395755052566528 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-mollipo_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..a7f11fb --- /dev/null +++ b/runs/ogbg-mollipo_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphconv", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 87.3, + "dev": "cuda:1", + "ep": 100, + "val": { + "rmse": 0.9623555541038513 + }, + "val_adaptive": { + "rmse": 0.7365044355392456 + }, + "test": { + "rmse": 0.9985842704772949 + }, + "test_adaptive": { + "rmse": 0.7662481665611267 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.2, + "fixed_steps": 8.0, + "adaptive_steps": 2.123809523809524 +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_graphsage_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-mollipo_graphsage_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..4ccb844 --- /dev/null +++ b/runs/ogbg-mollipo_graphsage_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_graphsage_classic_T0_ns1_h128_e100_s0", + "view": "graphsage", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 41.2, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 0.7239025831222534 + }, + "test": { + "rmse": 0.7783035635948181 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-mollipo_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..3c63ef7 --- /dev/null +++ b/runs/ogbg-mollipo_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_graphsage_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "graphsage", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 66.9, + "dev": "cuda:1", + "ep": 40, + "val": { + "rmse": 0.718391478061676 + }, + "test": { + "rmse": 0.7720211148262024 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-mollipo_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..41d7bdf --- /dev/null +++ b/runs/ogbg-mollipo_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphsage", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 89.0, + "dev": "cuda:1", + "ep": 10, + "val": { + "rmse": 1.0741798877716064 + }, + "val_adaptive": { + "rmse": 0.9657984375953674 + }, + "test": { + "rmse": 1.1165450811386108 + }, + "test_adaptive": { + "rmse": 0.9747765064239502 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 5.630952380952381, + "fixed_steps": 8.0, + "adaptive_steps": 5.461904761904762 +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_mf_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-mollipo_mf_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..ad2b2d7 --- /dev/null +++ b/runs/ogbg-mollipo_mf_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_mf_classic_T0_ns1_h128_e100_s0", + "view": "mf", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 113.2, + "dev": "cuda:1", + "ep": 50, + "val": { + "rmse": 0.712922215461731 + }, + "test": { + "rmse": 0.7404878735542297 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_mf_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-mollipo_mf_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..a781542 --- /dev/null +++ b/runs/ogbg-mollipo_mf_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_mf_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "mf", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 129.1, + "dev": "cuda:1", + "ep": 100, + "val": { + "rmse": 0.7049701809883118 + }, + "test": { + "rmse": 0.710095226764679 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-mollipo_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..057addc --- /dev/null +++ b/runs/ogbg-mollipo_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "mf", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 148.1, + "dev": "cuda:1", + "ep": 20, + "val": { + "rmse": 1.005599021911621 + }, + "val_adaptive": { + "rmse": 0.9785529971122742 + }, + "test": { + "rmse": 0.9820316433906555 + }, + "test_adaptive": { + "rmse": 0.9414123892784119 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 4.330952380952381, + "fixed_steps": 8.0, + "adaptive_steps": 4.321428571428571 +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_pna_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-mollipo_pna_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..ec34057 --- /dev/null +++ b/runs/ogbg-mollipo_pna_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_pna_classic_T0_ns1_h128_e100_s0", + "view": "pna", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 92.1, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 0.7179175019264221 + }, + "test": { + "rmse": 0.7749425172805786 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_pna_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-mollipo_pna_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..7173b7c --- /dev/null +++ b/runs/ogbg-mollipo_pna_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_pna_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "pna", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 108.3, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 0.7465738654136658 + }, + "test": { + "rmse": 0.7908006310462952 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-mollipo_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..d6ee79c --- /dev/null +++ b/runs/ogbg-mollipo_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "pna", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 119.6, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 0.914740264415741 + }, + "val_adaptive": { + "rmse": 0.8654114603996277 + }, + "test": { + "rmse": 0.9266903400421143 + }, + "test_adaptive": { + "rmse": 0.8750127553939819 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 4.819047619047619, + "fixed_steps": 8.0, + "adaptive_steps": 4.614285714285714 +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_resgated_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-mollipo_resgated_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..5493265 --- /dev/null +++ b/runs/ogbg-mollipo_resgated_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_resgated_classic_T0_ns1_h128_e100_s0", + "view": "resgated", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 72.5, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 0.6720540523529053 + }, + "test": { + "rmse": 0.7270413041114807 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-mollipo_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..27e4416 --- /dev/null +++ b/runs/ogbg-mollipo_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_resgated_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "resgated", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 86.6, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 0.6766338348388672 + }, + "test": { + "rmse": 0.7144215703010559 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-mollipo_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..63ca690 --- /dev/null +++ b/runs/ogbg-mollipo_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "resgated", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 98.4, + "dev": "cuda:1", + "ep": 100, + "val": { + "rmse": 0.8307315111160278 + }, + "val_adaptive": { + "rmse": 0.6797361373901367 + }, + "test": { + "rmse": 0.882472038269043 + }, + "test_adaptive": { + "rmse": 0.7250288128852844 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.15, + "fixed_steps": 8.0, + "adaptive_steps": 2.1166666666666667 +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_sgc_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-mollipo_sgc_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..4c4c616 --- /dev/null +++ b/runs/ogbg-mollipo_sgc_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_sgc_classic_T0_ns1_h128_e100_s0", + "view": "sgc", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 34.6, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 0.750457763671875 + }, + "test": { + "rmse": 0.817555844783783 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-mollipo_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..1648b69 --- /dev/null +++ b/runs/ogbg-mollipo_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_sgc_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "sgc", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 72.1, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 0.7536844611167908 + }, + "test": { + "rmse": 0.7490182518959045 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-mollipo_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..3480ed6 --- /dev/null +++ b/runs/ogbg-mollipo_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "sgc", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 91.7, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 0.9196410775184631 + }, + "val_adaptive": { + "rmse": 0.754634439945221 + }, + "test": { + "rmse": 1.0144816637039185 + }, + "test_adaptive": { + "rmse": 0.8478080630302429 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.4571428571428573, + "fixed_steps": 8.0, + "adaptive_steps": 2.3452380952380953 +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_tag_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-mollipo_tag_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..90c373d --- /dev/null +++ b/runs/ogbg-mollipo_tag_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_tag_classic_T0_ns1_h128_e100_s0", + "view": "tag", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 43.9, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 0.6691507697105408 + }, + "test": { + "rmse": 0.7226714491844177 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_tag_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-mollipo_tag_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..711ec49 --- /dev/null +++ b/runs/ogbg-mollipo_tag_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_tag_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "tag", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 86.6, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 0.6743124723434448 + }, + "test": { + "rmse": 0.7200686931610107 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-mollipo_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..58ef508 --- /dev/null +++ b/runs/ogbg-mollipo_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "tag", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 99.7, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 0.8615076541900635 + }, + "val_adaptive": { + "rmse": 0.7453644275665283 + }, + "test": { + "rmse": 0.9196054935455322 + }, + "test_adaptive": { + "rmse": 0.8038428425788879 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.4285714285714284, + "fixed_steps": 8.0, + "adaptive_steps": 2.35 +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_transformer_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-mollipo_transformer_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..ece8648 --- /dev/null +++ b/runs/ogbg-mollipo_transformer_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_transformer_classic_T0_ns1_h128_e100_s0", + "view": "transformer", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 78.7, + "dev": "cuda:1", + "ep": 80, + "val": { + "rmse": 0.6809519529342651 + }, + "test": { + "rmse": 0.7346181273460388 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-mollipo_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..6d1cd1f --- /dev/null +++ b/runs/ogbg-mollipo_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_transformer_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "transformer", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 74.7, + "dev": "cuda:1", + "ep": 90, + "val": { + "rmse": 0.6688172817230225 + }, + "test": { + "rmse": 0.7396050095558167 + } +}
\ No newline at end of file diff --git a/runs/ogbg-mollipo_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-mollipo_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..68661c7 --- /dev/null +++ b/runs/ogbg-mollipo_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-mollipo", + "tag": "ogbg-mollipo_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "transformer", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rmse", + "sec": 120.0, + "dev": "cuda:1", + "ep": 70, + "val": { + "rmse": 0.8665701150894165 + }, + "val_adaptive": { + "rmse": 0.7386842966079712 + }, + "test": { + "rmse": 0.892951488494873 + }, + "test_adaptive": { + "rmse": 0.7886161804199219 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.388095238095238, + "fixed_steps": 8.0, + "adaptive_steps": 2.316666666666667 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_appnp_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molsider_appnp_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..368fdba --- /dev/null +++ b/runs/ogbg-molsider_appnp_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_appnp_classic_T0_ns1_h128_e100_s0", + "view": "appnp", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 14.7, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.5886184927786781 + }, + "test": { + "rocauc": 0.6003864841212386 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molsider_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..bfcac49 --- /dev/null +++ b/runs/ogbg-molsider_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_appnp_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "appnp", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 18.6, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.5937589012949048 + }, + "test": { + "rocauc": 0.5905116380584287 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..5583b1d --- /dev/null +++ b/runs/ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "appnp", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 30.7, + "dev": "cuda:3", + "ep": 100, + "val": { + "rocauc": 0.593345692093345 + }, + "val_adaptive": { + "rocauc": 0.5909592523154833 + }, + "test": { + "rocauc": 0.5966615384995925 + }, + "test_adaptive": { + "rocauc": 0.5964163493356076 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 7.846153846153846, + "fixed_steps": 8.0, + "adaptive_steps": 7.888111888111888 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..9ade287 --- /dev/null +++ b/runs/ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "appnp", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 33.0, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.58009596629467 + }, + "val_adaptive": { + "rocauc": 0.5742882792923651 + }, + "test": { + "rocauc": 0.6009364115000575 + }, + "test_adaptive": { + "rocauc": 0.5959003553252203 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 7.181818181818182, + "fixed_steps": 8.0, + "adaptive_steps": 7.27972027972028 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json b/runs/ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json new file mode 100644 index 0000000..fe13ef7 --- /dev/null +++ b/runs/ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0", + "view": "appnp", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 30, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 30.5, + "dev": "cuda:3", + "ep": 100, + "val": { + "rocauc": 0.5873882396417854 + }, + "val_adaptive": { + "rocauc": 0.5735267285871073 + }, + "test": { + "rocauc": 0.5819785573765826 + }, + "test_adaptive": { + "rocauc": 0.5894161989454557 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 7.034965034965035, + "fixed_steps": 8.0, + "adaptive_steps": 7.13986013986014 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_arma_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molsider_arma_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..082b9ed --- /dev/null +++ b/runs/ogbg-molsider_arma_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_arma_classic_T0_ns1_h128_e100_s0", + "view": "arma", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 16.0, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.627268343131736 + }, + "test": { + "rocauc": 0.6158698228431547 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_arma_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molsider_arma_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..8ba623d --- /dev/null +++ b/runs/ogbg-molsider_arma_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_arma_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "arma", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 27.1, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.634361816858312 + }, + "test": { + "rocauc": 0.6140829013811058 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..d17eca1 --- /dev/null +++ b/runs/ogbg-molsider_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "arma", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 33.7, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.6604919913889579 + }, + "val_adaptive": { + "rocauc": 0.6602801296309839 + }, + "test": { + "rocauc": 0.5589855993934405 + }, + "test_adaptive": { + "rocauc": 0.5580832949005652 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 7.93006993006993, + "fixed_steps": 8.0, + "adaptive_steps": 7.895104895104895 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_cheb_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molsider_cheb_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..ff70dc1 --- /dev/null +++ b/runs/ogbg-molsider_cheb_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_cheb_classic_T0_ns1_h128_e100_s0", + "view": "cheb", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 14.1, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.6237482002412537 + }, + "test": { + "rocauc": 0.6033376509930031 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molsider_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..9f33571 --- /dev/null +++ b/runs/ogbg-molsider_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_cheb_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "cheb", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 18.3, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.626299014853098 + }, + "test": { + "rocauc": 0.609583177772403 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..c6089dd --- /dev/null +++ b/runs/ogbg-molsider_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "cheb", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 30.5, + "dev": "cuda:0", + "ep": 90, + "val": { + "rocauc": 0.6409076943311921 + }, + "val_adaptive": { + "rocauc": 0.6415746496399081 + }, + "test": { + "rocauc": 0.6149744329414113 + }, + "test_adaptive": { + "rocauc": 0.6144652607315165 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 7.881118881118881, + "fixed_steps": 8.0, + "adaptive_steps": 7.8671328671328675 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_film_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molsider_film_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..710fa5c --- /dev/null +++ b/runs/ogbg-molsider_film_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_film_classic_T0_ns1_h128_e100_s0", + "view": "film", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 12.6, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.6024369569728498 + }, + "test": { + "rocauc": 0.5898473664808705 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_film_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molsider_film_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..3354a5b --- /dev/null +++ b/runs/ogbg-molsider_film_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_film_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "film", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 23.5, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.5862480936504801 + }, + "test": { + "rocauc": 0.5974246609585021 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..581bd15 --- /dev/null +++ b/runs/ogbg-molsider_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "film", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 31.0, + "dev": "cuda:0", + "ep": 100, + "val": { + "rocauc": 0.5407876481859505 + }, + "val_adaptive": { + "rocauc": 0.5407876481859505 + }, + "test": { + "rocauc": 0.5825278400429263 + }, + "test_adaptive": { + "rocauc": 0.5825278400429263 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 8.0, + "fixed_steps": 8.0, + "adaptive_steps": 8.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_gatv2_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molsider_gatv2_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..ddbf7c3 --- /dev/null +++ b/runs/ogbg-molsider_gatv2_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_gatv2_classic_T0_ns1_h128_e100_s0", + "view": "gatv2", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 21.3, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.6071193037623003 + }, + "test": { + "rocauc": 0.6013146804327355 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molsider_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..260596d --- /dev/null +++ b/runs/ogbg-molsider_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_gatv2_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gatv2", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 35.6, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.6462276348941932 + }, + "test": { + "rocauc": 0.6000090607166413 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..e6631f1 --- /dev/null +++ b/runs/ogbg-molsider_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gatv2", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 39.2, + "dev": "cuda:0", + "ep": 100, + "val": { + "rocauc": 0.5777678714357024 + }, + "val_adaptive": { + "rocauc": 0.5777678714357024 + }, + "test": { + "rocauc": 0.6337321824820535 + }, + "test_adaptive": { + "rocauc": 0.6339582691134998 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 8.0, + "fixed_steps": 8.0, + "adaptive_steps": 7.958041958041958 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_gcn_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molsider_gcn_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..6c59b26 --- /dev/null +++ b/runs/ogbg-molsider_gcn_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_gcn_classic_T0_ns1_h128_e100_s0", + "view": "gcn", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 11.7, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.6292912980815916 + }, + "test": { + "rocauc": 0.6086409341357526 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molsider_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..8d3e9b4 --- /dev/null +++ b/runs/ogbg-molsider_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_gcn_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gcn", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 22.4, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.6255728102145075 + }, + "test": { + "rocauc": 0.6117391432513807 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..5d57b8c --- /dev/null +++ b/runs/ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gcn", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 26.1, + "dev": "cuda:3", + "ep": 100, + "val": { + "rocauc": 0.6334288171779305 + }, + "val_adaptive": { + "rocauc": 0.6341982682695585 + }, + "test": { + "rocauc": 0.6299766632454395 + }, + "test_adaptive": { + "rocauc": 0.6305843217920319 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 7.965034965034965, + "fixed_steps": 8.0, + "adaptive_steps": 7.909090909090909 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..2fb3f9d --- /dev/null +++ b/runs/ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gcn", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 28.7, + "dev": "cuda:0", + "ep": 90, + "val": { + "rocauc": 0.634553246023819 + }, + "val_adaptive": { + "rocauc": 0.6346375313343606 + }, + "test": { + "rocauc": 0.6445134528927392 + }, + "test_adaptive": { + "rocauc": 0.644509359822436 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 7.979020979020979, + "fixed_steps": 8.0, + "adaptive_steps": 7.93006993006993 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json b/runs/ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json new file mode 100644 index 0000000..ef48131 --- /dev/null +++ b/runs/ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0", + "view": "gcn", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 30, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 26.8, + "dev": "cuda:3", + "ep": 90, + "val": { + "rocauc": 0.6317896497739357 + }, + "val_adaptive": { + "rocauc": 0.6317861803509764 + }, + "test": { + "rocauc": 0.640011295277304 + }, + "test_adaptive": { + "rocauc": 0.6402407710265505 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 7.986013986013986, + "fixed_steps": 8.0, + "adaptive_steps": 7.937062937062937 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_gen_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molsider_gen_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..12ae0cb --- /dev/null +++ b/runs/ogbg-molsider_gen_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_gen_classic_T0_ns1_h128_e100_s0", + "view": "gen", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 15.4, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.6519400080762945 + }, + "test": { + "rocauc": 0.5853709823208472 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_gen_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molsider_gen_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..72b6125 --- /dev/null +++ b/runs/ogbg-molsider_gen_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_gen_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gen", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 21.6, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.634456224198147 + }, + "test": { + "rocauc": 0.6052572461025753 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..ca6ed4d --- /dev/null +++ b/runs/ogbg-molsider_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gen", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 30.8, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.6114344272964439 + }, + "val_adaptive": { + "rocauc": 0.6114344272964439 + }, + "test": { + "rocauc": 0.6071293608886619 + }, + "test_adaptive": { + "rocauc": 0.6071293608886619 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 8.0, + "fixed_steps": 8.0, + "adaptive_steps": 8.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_gin_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molsider_gin_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..b981888 --- /dev/null +++ b/runs/ogbg-molsider_gin_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_gin_classic_T0_ns1_h128_e100_s0", + "view": "gin", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 19.4, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.6225119550298882 + }, + "test": { + "rocauc": 0.5748427490288601 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_gin_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molsider_gin_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..467f5eb --- /dev/null +++ b/runs/ogbg-molsider_gin_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_gin_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gin", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 27.3, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.6046415841313262 + }, + "test": { + "rocauc": 0.6022262654061706 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..e86468f --- /dev/null +++ b/runs/ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 27.2, + "dev": "cuda:3", + "ep": 80, + "val": { + "rocauc": 0.6075447846476244 + }, + "val_adaptive": { + "rocauc": 0.6075447846476244 + }, + "test": { + "rocauc": 0.5810477512085702 + }, + "test_adaptive": { + "rocauc": 0.5810477512085702 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 8.0, + "fixed_steps": 8.0, + "adaptive_steps": 8.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..997d805 --- /dev/null +++ b/runs/ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 29.7, + "dev": "cuda:0", + "ep": 70, + "val": { + "rocauc": 0.5941723817458207 + }, + "val_adaptive": { + "rocauc": 0.5941723817458207 + }, + "test": { + "rocauc": 0.5949106211087469 + }, + "test_adaptive": { + "rocauc": 0.5949106211087469 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 8.0, + "fixed_steps": 8.0, + "adaptive_steps": 8.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json b/runs/ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json new file mode 100644 index 0000000..9293344 --- /dev/null +++ b/runs/ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 30, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 26.8, + "dev": "cuda:3", + "ep": 80, + "val": { + "rocauc": 0.6024836436339023 + }, + "val_adaptive": { + "rocauc": 0.6024836436339023 + }, + "test": { + "rocauc": 0.5932734621249586 + }, + "test_adaptive": { + "rocauc": 0.5932734621249586 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 8.0, + "fixed_steps": 8.0, + "adaptive_steps": 8.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_gine_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molsider_gine_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..d103d31 --- /dev/null +++ b/runs/ogbg-molsider_gine_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_gine_classic_T0_ns1_h128_e100_s0", + "view": "gine", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 18.0, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.6326628393175155 + }, + "test": { + "rocauc": 0.5494595931506057 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_gine_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molsider_gine_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..b344579 --- /dev/null +++ b/runs/ogbg-molsider_gine_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_gine_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gine", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 27.1, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.6151020149803161 + }, + "test": { + "rocauc": 0.6150033205476824 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..916957b --- /dev/null +++ b/runs/ogbg-molsider_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gine", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 29.6, + "dev": "cuda:0", + "ep": 100, + "val": { + "rocauc": 0.6117392254931898 + }, + "val_adaptive": { + "rocauc": 0.6117392254931898 + }, + "test": { + "rocauc": 0.6143023355631505 + }, + "test_adaptive": { + "rocauc": 0.6147815453760646 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 8.0, + "fixed_steps": 8.0, + "adaptive_steps": 7.958041958041958 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_graphconv_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molsider_graphconv_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..fb39a85 --- /dev/null +++ b/runs/ogbg-molsider_graphconv_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_graphconv_classic_T0_ns1_h128_e100_s0", + "view": "graphconv", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 10.5, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.5920839065175088 + }, + "test": { + "rocauc": 0.6151152605717433 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molsider_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..a06fefa --- /dev/null +++ b/runs/ogbg-molsider_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_graphconv_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "graphconv", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 24.3, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.6010260045148574 + }, + "test": { + "rocauc": 0.5962935439480032 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..4ba72f4 --- /dev/null +++ b/runs/ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphconv", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 26.4, + "dev": "cuda:3", + "ep": 100, + "val": { + "rocauc": 0.6223441276640819 + }, + "val_adaptive": { + "rocauc": 0.6223441276640819 + }, + "test": { + "rocauc": 0.622244619371397 + }, + "test_adaptive": { + "rocauc": 0.622244619371397 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 8.0, + "fixed_steps": 8.0, + "adaptive_steps": 8.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..7ef209d --- /dev/null +++ b/runs/ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphconv", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 28.2, + "dev": "cuda:0", + "ep": 100, + "val": { + "rocauc": 0.6139745501285409 + }, + "val_adaptive": { + "rocauc": 0.6130151408852765 + }, + "test": { + "rocauc": 0.6068834635828694 + }, + "test_adaptive": { + "rocauc": 0.6064255172013142 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 7.965034965034965, + "fixed_steps": 8.0, + "adaptive_steps": 7.916083916083916 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json b/runs/ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json new file mode 100644 index 0000000..8510c0e --- /dev/null +++ b/runs/ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0", + "view": "graphconv", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 30, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 25.9, + "dev": "cuda:3", + "ep": 100, + "val": { + "rocauc": 0.6164847255453625 + }, + "val_adaptive": { + "rocauc": 0.6162473905508215 + }, + "test": { + "rocauc": 0.6344146740580251 + }, + "test_adaptive": { + "rocauc": 0.6358083894071243 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 7.951048951048951, + "fixed_steps": 8.0, + "adaptive_steps": 7.916083916083916 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_graphsage_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molsider_graphsage_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..67f10a7 --- /dev/null +++ b/runs/ogbg-molsider_graphsage_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_graphsage_classic_T0_ns1_h128_e100_s0", + "view": "graphsage", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 10.7, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.621744356636161 + }, + "test": { + "rocauc": 0.5807259430259354 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molsider_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..2edaf8f --- /dev/null +++ b/runs/ogbg-molsider_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_graphsage_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "graphsage", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 24.2, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.62323063286361 + }, + "test": { + "rocauc": 0.5860528009903617 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..d25e223 --- /dev/null +++ b/runs/ogbg-molsider_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphsage", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 28.5, + "dev": "cuda:0", + "ep": 100, + "val": { + "rocauc": 0.6149561902831908 + }, + "val_adaptive": { + "rocauc": 0.6146122799151246 + }, + "test": { + "rocauc": 0.6082036653138152 + }, + "test_adaptive": { + "rocauc": 0.6072637395395359 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 7.965034965034965, + "fixed_steps": 8.0, + "adaptive_steps": 7.923076923076923 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_mf_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molsider_mf_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..8d860a9 --- /dev/null +++ b/runs/ogbg-molsider_mf_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_mf_classic_T0_ns1_h128_e100_s0", + "view": "mf", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 44.5, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.6202255900567958 + }, + "test": { + "rocauc": 0.586091595334005 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_mf_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molsider_mf_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..e4006b4 --- /dev/null +++ b/runs/ogbg-molsider_mf_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_mf_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "mf", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 49.3, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.6189914567323086 + }, + "test": { + "rocauc": 0.598312638550014 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..b283c1b --- /dev/null +++ b/runs/ogbg-molsider_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "mf", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 50.2, + "dev": "cuda:0", + "ep": 80, + "val": { + "rocauc": 0.630007512812611 + }, + "val_adaptive": { + "rocauc": 0.6292030327805646 + }, + "test": { + "rocauc": 0.5843445908586726 + }, + "test_adaptive": { + "rocauc": 0.5856297203566897 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 7.958041958041958, + "fixed_steps": 8.0, + "adaptive_steps": 7.8671328671328675 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_pna_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molsider_pna_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..ccb8fdd --- /dev/null +++ b/runs/ogbg-molsider_pna_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_pna_classic_T0_ns1_h128_e100_s0", + "view": "pna", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 30.5, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.6218537848171463 + }, + "test": { + "rocauc": 0.5964761418261523 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_pna_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molsider_pna_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..c94cfbf --- /dev/null +++ b/runs/ogbg-molsider_pna_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_pna_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "pna", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 27.1, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.6057840094519997 + }, + "test": { + "rocauc": 0.5721280929989979 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..3f2d308 --- /dev/null +++ b/runs/ogbg-molsider_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "pna", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 35.2, + "dev": "cuda:3", + "ep": 70, + "val": { + "rocauc": 0.5869831648034167 + }, + "val_adaptive": { + "rocauc": 0.5869831648034167 + }, + "test": { + "rocauc": 0.5961753244813196 + }, + "test_adaptive": { + "rocauc": 0.5962142801036087 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 8.0, + "fixed_steps": 8.0, + "adaptive_steps": 7.958041958041958 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..780196c --- /dev/null +++ b/runs/ogbg-molsider_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "pna", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 40.1, + "dev": "cuda:0", + "ep": 60, + "val": { + "rocauc": 0.5810212759423172 + }, + "val_adaptive": { + "rocauc": 0.5810212759423172 + }, + "test": { + "rocauc": 0.5397701280540309 + }, + "test_adaptive": { + "rocauc": 0.5397701280540309 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 8.0, + "fixed_steps": 8.0, + "adaptive_steps": 8.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_resgated_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molsider_resgated_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..400fd8d --- /dev/null +++ b/runs/ogbg-molsider_resgated_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_resgated_classic_T0_ns1_h128_e100_s0", + "view": "resgated", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 23.5, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.6209450264359846 + }, + "test": { + "rocauc": 0.5910349402024013 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molsider_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..bc7861b --- /dev/null +++ b/runs/ogbg-molsider_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_resgated_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "resgated", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 28.0, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.6204543981100222 + }, + "test": { + "rocauc": 0.5960257361986486 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..df6194b --- /dev/null +++ b/runs/ogbg-molsider_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "resgated", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 29.0, + "dev": "cuda:3", + "ep": 80, + "val": { + "rocauc": 0.6260140078552355 + }, + "val_adaptive": { + "rocauc": 0.6260140078552355 + }, + "test": { + "rocauc": 0.6259436225287444 + }, + "test_adaptive": { + "rocauc": 0.6259436225287444 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 8.0, + "fixed_steps": 8.0, + "adaptive_steps": 8.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..abb91ed --- /dev/null +++ b/runs/ogbg-molsider_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "resgated", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 33.3, + "dev": "cuda:0", + "ep": 100, + "val": { + "rocauc": 0.609727680398977 + }, + "val_adaptive": { + "rocauc": 0.6097204004899107 + }, + "test": { + "rocauc": 0.6245839801623748 + }, + "test_adaptive": { + "rocauc": 0.624652550767547 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 7.965034965034965, + "fixed_steps": 8.0, + "adaptive_steps": 7.951048951048951 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_sgc_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molsider_sgc_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..1ce0296 --- /dev/null +++ b/runs/ogbg-molsider_sgc_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_sgc_classic_T0_ns1_h128_e100_s0", + "view": "sgc", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 12.2, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.6173711459877224 + }, + "test": { + "rocauc": 0.6042590538050838 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molsider_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..e656a13 --- /dev/null +++ b/runs/ogbg-molsider_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_sgc_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "sgc", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 15.3, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.6151272572948054 + }, + "test": { + "rocauc": 0.6417135077812745 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..168f5f7 --- /dev/null +++ b/runs/ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "sgc", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 27.6, + "dev": "cuda:3", + "ep": 90, + "val": { + "rocauc": 0.5979570667859507 + }, + "val_adaptive": { + "rocauc": 0.5979570667859507 + }, + "test": { + "rocauc": 0.6336766486024191 + }, + "test_adaptive": { + "rocauc": 0.6336766486024191 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 8.0, + "fixed_steps": 8.0, + "adaptive_steps": 8.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..5d4ff80 --- /dev/null +++ b/runs/ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "sgc", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 28.8, + "dev": "cuda:0", + "ep": 100, + "val": { + "rocauc": 0.5865936638036943 + }, + "val_adaptive": { + "rocauc": 0.5867267792720899 + }, + "test": { + "rocauc": 0.624583829207758 + }, + "test_adaptive": { + "rocauc": 0.6241791163198843 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 7.909090909090909, + "fixed_steps": 8.0, + "adaptive_steps": 7.881118881118881 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json b/runs/ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json new file mode 100644 index 0000000..d0a03a9 --- /dev/null +++ b/runs/ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0", + "view": "sgc", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 30, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 27.3, + "dev": "cuda:3", + "ep": 90, + "val": { + "rocauc": 0.6291378293840166 + }, + "val_adaptive": { + "rocauc": 0.6291378293840166 + }, + "test": { + "rocauc": 0.622805287595805 + }, + "test_adaptive": { + "rocauc": 0.6223183091184133 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 8.0, + "fixed_steps": 8.0, + "adaptive_steps": 7.916083916083916 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_tag_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molsider_tag_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..eb6b8b5 --- /dev/null +++ b/runs/ogbg-molsider_tag_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_tag_classic_T0_ns1_h128_e100_s0", + "view": "tag", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 17.7, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.6438543175768482 + }, + "test": { + "rocauc": 0.6143146363395369 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_tag_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molsider_tag_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..84cef00 --- /dev/null +++ b/runs/ogbg-molsider_tag_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_tag_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "tag", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 26.7, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.6410300955419639 + }, + "test": { + "rocauc": 0.6101942928754263 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..1df72cf --- /dev/null +++ b/runs/ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "tag", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 28.8, + "dev": "cuda:3", + "ep": 90, + "val": { + "rocauc": 0.5904624057788478 + }, + "val_adaptive": { + "rocauc": 0.5904624057788478 + }, + "test": { + "rocauc": 0.621622401806624 + }, + "test_adaptive": { + "rocauc": 0.621622401806624 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 8.0, + "fixed_steps": 8.0, + "adaptive_steps": 8.0 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..49d5a4e --- /dev/null +++ b/runs/ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "tag", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 31.0, + "dev": "cuda:0", + "ep": 90, + "val": { + "rocauc": 0.6329113613630306 + }, + "val_adaptive": { + "rocauc": 0.6329113613630306 + }, + "test": { + "rocauc": 0.6060675375955825 + }, + "test_adaptive": { + "rocauc": 0.6066839663477379 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 8.0, + "fixed_steps": 8.0, + "adaptive_steps": 7.909090909090909 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json b/runs/ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json new file mode 100644 index 0000000..3d9f183 --- /dev/null +++ b/runs/ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw30_h128_e100_s0", + "view": "tag", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 30, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 29.4, + "dev": "cuda:3", + "ep": 90, + "val": { + "rocauc": 0.6105933624956364 + }, + "val_adaptive": { + "rocauc": 0.6109901064049895 + }, + "test": { + "rocauc": 0.624320975867962 + }, + "test_adaptive": { + "rocauc": 0.6243824341662988 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 7.979020979020979, + "fixed_steps": 8.0, + "adaptive_steps": 7.958041958041958 +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_transformer_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-molsider_transformer_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..2a3c823 --- /dev/null +++ b/runs/ogbg-molsider_transformer_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_transformer_classic_T0_ns1_h128_e100_s0", + "view": "transformer", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 22.0, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.6159576666835939 + }, + "test": { + "rocauc": 0.5979944408282211 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-molsider_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..53c8c7b --- /dev/null +++ b/runs/ogbg-molsider_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_transformer_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "transformer", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 33.7, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.6315255937485902 + }, + "test": { + "rocauc": 0.6190391448308609 + } +}
\ No newline at end of file diff --git a/runs/ogbg-molsider_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-molsider_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..dde9320 --- /dev/null +++ b/runs/ogbg-molsider_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-molsider", + "tag": "ogbg-molsider_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "transformer", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:0", + "metric": "rocauc", + "sec": 34.8, + "dev": "cuda:0", + "ep": 100, + "val": { + "rocauc": 0.6287543036419472 + }, + "val_adaptive": { + "rocauc": 0.6287543036419472 + }, + "test": { + "rocauc": 0.621503855814713 + }, + "test_adaptive": { + "rocauc": 0.6212391169096168 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 8.0, + "fixed_steps": 8.0, + "adaptive_steps": 7.951048951048951 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_appnp_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-moltox21_appnp_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..e67e2be --- /dev/null +++ b/runs/ogbg-moltox21_appnp_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_appnp_classic_T0_ns1_h128_e100_s0", + "view": "appnp", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 73.9, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.7254553558600404 + }, + "test": { + "rocauc": 0.7158488769446065 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-moltox21_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..f86a36c --- /dev/null +++ b/runs/ogbg-moltox21_appnp_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_appnp_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "appnp", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 101.4, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.7279951275996247 + }, + "test": { + "rocauc": 0.7153555287245948 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..4034e03 --- /dev/null +++ b/runs/ogbg-moltox21_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "appnp", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 173.4, + "dev": "cuda:3", + "ep": 70, + "val": { + "rocauc": 0.7237576716525247 + }, + "val_adaptive": { + "rocauc": 0.7380700499699439 + }, + "test": { + "rocauc": 0.6822930471359431 + }, + "test_adaptive": { + "rocauc": 0.7137838364459371 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.521072796934866, + "fixed_steps": 8.0, + "adaptive_steps": 2.63265306122449 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..0059379 --- /dev/null +++ b/runs/ogbg-moltox21_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_appnp_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "appnp", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 187.9, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.7171412864790295 + }, + "val_adaptive": { + "rocauc": 0.7327556114043223 + }, + "test": { + "rocauc": 0.7196990667216929 + }, + "test_adaptive": { + "rocauc": 0.7331958989125181 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.5925925925925926, + "fixed_steps": 8.0, + "adaptive_steps": 2.586734693877551 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_arma_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-moltox21_arma_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..1ee54ec --- /dev/null +++ b/runs/ogbg-moltox21_arma_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_arma_classic_T0_ns1_h128_e100_s0", + "view": "arma", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 91.6, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.7798972501326612 + }, + "test": { + "rocauc": 0.7222812510383411 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_arma_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-moltox21_arma_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..3f4c8e0 --- /dev/null +++ b/runs/ogbg-moltox21_arma_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_arma_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "arma", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 166.1, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.7770957435163162 + }, + "test": { + "rocauc": 0.7208970968150412 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..5724d7f --- /dev/null +++ b/runs/ogbg-moltox21_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_arma_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "arma", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 186.4, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.7574890736647663 + }, + "val_adaptive": { + "rocauc": 0.775690305262 + }, + "test": { + "rocauc": 0.7161943072626955 + }, + "test_adaptive": { + "rocauc": 0.7237147258339075 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.859514687100894, + "fixed_steps": 8.0, + "adaptive_steps": 2.868622448979592 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_cheb_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-moltox21_cheb_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..12898a7 --- /dev/null +++ b/runs/ogbg-moltox21_cheb_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_cheb_classic_T0_ns1_h128_e100_s0", + "view": "cheb", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 69.4, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.7834436091147085 + }, + "test": { + "rocauc": 0.7300685430388674 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-moltox21_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..d3d5445 --- /dev/null +++ b/runs/ogbg-moltox21_cheb_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_cheb_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "cheb", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 104.5, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.7709868045619044 + }, + "test": { + "rocauc": 0.7285529943614071 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..2e092fd --- /dev/null +++ b/runs/ogbg-moltox21_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_cheb_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "cheb", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 185.5, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.7823963460925124 + }, + "val_adaptive": { + "rocauc": 0.7879834258076394 + }, + "test": { + "rocauc": 0.7195427399764524 + }, + "test_adaptive": { + "rocauc": 0.7202976536434207 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.9233716475095783, + "fixed_steps": 8.0, + "adaptive_steps": 3.014030612244898 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_film_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-moltox21_film_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..4578ed2 --- /dev/null +++ b/runs/ogbg-moltox21_film_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_film_classic_T0_ns1_h128_e100_s0", + "view": "film", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 66.4, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.7701993310949509 + }, + "test": { + "rocauc": 0.7160313530552065 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_film_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-moltox21_film_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..8867da4 --- /dev/null +++ b/runs/ogbg-moltox21_film_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_film_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "film", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 158.1, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.7726742190325983 + }, + "test": { + "rocauc": 0.7369411241728653 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..689f7e9 --- /dev/null +++ b/runs/ogbg-moltox21_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_film_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "film", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 176.1, + "dev": "cuda:1", + "ep": 100, + "val": { + "rocauc": 0.7512888457712221 + }, + "val_adaptive": { + "rocauc": 0.7554952063699445 + }, + "test": { + "rocauc": 0.6885051838242511 + }, + "test_adaptive": { + "rocauc": 0.6897262581951776 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.7701149425287355, + "fixed_steps": 8.0, + "adaptive_steps": 3.55484693877551 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_gatv2_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-moltox21_gatv2_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..5061166 --- /dev/null +++ b/runs/ogbg-moltox21_gatv2_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_gatv2_classic_T0_ns1_h128_e100_s0", + "view": "gatv2", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 147.3, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.7627170708797383 + }, + "test": { + "rocauc": 0.7159809011324226 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-moltox21_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..6c51af8 --- /dev/null +++ b/runs/ogbg-moltox21_gatv2_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_gatv2_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gatv2", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 185.0, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.7761905248713933 + }, + "test": { + "rocauc": 0.7302941629609098 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..1cce6dc --- /dev/null +++ b/runs/ogbg-moltox21_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_gatv2_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gatv2", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 203.5, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.767354951757618 + }, + "val_adaptive": { + "rocauc": 0.7642537921042755 + }, + "test": { + "rocauc": 0.7155377552729235 + }, + "test_adaptive": { + "rocauc": 0.7172144629316312 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 4.051085568326948, + "fixed_steps": 8.0, + "adaptive_steps": 4.042091836734694 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_gcn_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-moltox21_gcn_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..527a199 --- /dev/null +++ b/runs/ogbg-moltox21_gcn_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_gcn_classic_T0_ns1_h128_e100_s0", + "view": "gcn", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 54.3, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.7580202023804351 + }, + "test": { + "rocauc": 0.7170910489918559 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-moltox21_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..d3e7425 --- /dev/null +++ b/runs/ogbg-moltox21_gcn_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_gcn_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gcn", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 88.5, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.7587559779881515 + }, + "test": { + "rocauc": 0.7230304767127982 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..a485530 --- /dev/null +++ b/runs/ogbg-moltox21_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gcn", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 151.6, + "dev": "cuda:3", + "ep": 60, + "val": { + "rocauc": 0.7655200134252199 + }, + "val_adaptive": { + "rocauc": 0.7704335014770737 + }, + "test": { + "rocauc": 0.7134396419831454 + }, + "test_adaptive": { + "rocauc": 0.7234036772214454 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.763729246487867, + "fixed_steps": 8.0, + "adaptive_steps": 3.764030612244898 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..29b4288 --- /dev/null +++ b/runs/ogbg-moltox21_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_gcn_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gcn", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 162.5, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.7677478126932855 + }, + "val_adaptive": { + "rocauc": 0.7736865486612903 + }, + "test": { + "rocauc": 0.7135675459281269 + }, + "test_adaptive": { + "rocauc": 0.7247326710130202 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.111111111111111, + "fixed_steps": 8.0, + "adaptive_steps": 3.2589285714285716 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_gen_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-moltox21_gen_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..7f6fb10 --- /dev/null +++ b/runs/ogbg-moltox21_gen_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_gen_classic_T0_ns1_h128_e100_s0", + "view": "gen", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 78.9, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.783453783540323 + }, + "test": { + "rocauc": 0.744374172706925 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_gen_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-moltox21_gen_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..360cd3e --- /dev/null +++ b/runs/ogbg-moltox21_gen_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_gen_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gen", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 117.0, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.7757089729043948 + }, + "test": { + "rocauc": 0.7312107536918231 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..5cbc62c --- /dev/null +++ b/runs/ogbg-moltox21_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_gen_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gen", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 178.7, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.7548045767051833 + }, + "val_adaptive": { + "rocauc": 0.7602314361456579 + }, + "test": { + "rocauc": 0.7300226043604717 + }, + "test_adaptive": { + "rocauc": 0.7365872982320871 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.4980842911877397, + "fixed_steps": 8.0, + "adaptive_steps": 3.433673469387755 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_gin_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-moltox21_gin_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..726b2d6 --- /dev/null +++ b/runs/ogbg-moltox21_gin_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_gin_classic_T0_ns1_h128_e100_s0", + "view": "gin", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 57.1, + "dev": "cuda:1", + "ep": 90, + "val": { + "rocauc": 0.769011087128982 + }, + "test": { + "rocauc": 0.724182297150406 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_gin_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-moltox21_gin_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..4b8b59a --- /dev/null +++ b/runs/ogbg-moltox21_gin_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_gin_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gin", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 121.7, + "dev": "cuda:1", + "ep": 90, + "val": { + "rocauc": 0.7717759383538949 + }, + "test": { + "rocauc": 0.7236697240762989 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..823ec7a --- /dev/null +++ b/runs/ogbg-moltox21_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_gin_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 154.0, + "dev": "cuda:3", + "ep": 100, + "val": { + "rocauc": 0.7611296131897838 + }, + "val_adaptive": { + "rocauc": 0.7693611012667105 + }, + "test": { + "rocauc": 0.7089667909334546 + }, + "test_adaptive": { + "rocauc": 0.7126552901719999 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.9029374201787994, + "fixed_steps": 8.0, + "adaptive_steps": 3.826530612244898 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..aead826 --- /dev/null +++ b/runs/ogbg-moltox21_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_gin_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gin", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 165.4, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.763406691780224 + }, + "val_adaptive": { + "rocauc": 0.7610743280654823 + }, + "test": { + "rocauc": 0.7044116432874441 + }, + "test_adaptive": { + "rocauc": 0.7111955163056712 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 4.261813537675606, + "fixed_steps": 8.0, + "adaptive_steps": 4.165816326530612 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_gine_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-moltox21_gine_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..7885bc7 --- /dev/null +++ b/runs/ogbg-moltox21_gine_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_gine_classic_T0_ns1_h128_e100_s0", + "view": "gine", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 62.2, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.7743797903105913 + }, + "test": { + "rocauc": 0.7328494551753418 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_gine_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-moltox21_gine_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..a4aae8c --- /dev/null +++ b/runs/ogbg-moltox21_gine_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_gine_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "gine", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 135.7, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.7622004073608938 + }, + "test": { + "rocauc": 0.7193472376632882 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..31febfa --- /dev/null +++ b/runs/ogbg-moltox21_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_gine_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "gine", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 167.2, + "dev": "cuda:1", + "ep": 100, + "val": { + "rocauc": 0.7616493170582249 + }, + "val_adaptive": { + "rocauc": 0.7553437800330051 + }, + "test": { + "rocauc": 0.7120140634942237 + }, + "test_adaptive": { + "rocauc": 0.7177387150880706 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 4.040868454661558, + "fixed_steps": 8.0, + "adaptive_steps": 3.931122448979592 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_graphconv_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-moltox21_graphconv_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..a40d6c8 --- /dev/null +++ b/runs/ogbg-moltox21_graphconv_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_graphconv_classic_T0_ns1_h128_e100_s0", + "view": "graphconv", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 47.9, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.7831111293212308 + }, + "test": { + "rocauc": 0.7147413214946693 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-moltox21_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..f7adae0 --- /dev/null +++ b/runs/ogbg-moltox21_graphconv_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_graphconv_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "graphconv", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 74.0, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.7820316625768228 + }, + "test": { + "rocauc": 0.7313192526985618 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..fea9604 --- /dev/null +++ b/runs/ogbg-moltox21_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphconv", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 150.6, + "dev": "cuda:3", + "ep": 80, + "val": { + "rocauc": 0.7816268997660386 + }, + "val_adaptive": { + "rocauc": 0.7820017395110807 + }, + "test": { + "rocauc": 0.7115162457844392 + }, + "test_adaptive": { + "rocauc": 0.7190898385325345 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.136653895274585, + "fixed_steps": 8.0, + "adaptive_steps": 3.205357142857143 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..c4a5898 --- /dev/null +++ b/runs/ogbg-moltox21_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_graphconv_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphconv", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 154.5, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.7640586359961631 + }, + "val_adaptive": { + "rocauc": 0.7663420116444204 + }, + "test": { + "rocauc": 0.721040156330531 + }, + "test_adaptive": { + "rocauc": 0.732265876016213 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 4.116219667943806, + "fixed_steps": 8.0, + "adaptive_steps": 4.089285714285714 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_graphsage_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-moltox21_graphsage_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..5c3b0e1 --- /dev/null +++ b/runs/ogbg-moltox21_graphsage_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_graphsage_classic_T0_ns1_h128_e100_s0", + "view": "graphsage", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 53.4, + "dev": "cuda:1", + "ep": 10, + "val": { + "rocauc": 0.7708912322116328 + }, + "test": { + "rocauc": 0.719565697251165 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-moltox21_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..0974e73 --- /dev/null +++ b/runs/ogbg-moltox21_graphsage_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_graphsage_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "graphsage", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 109.2, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.7696559719157566 + }, + "test": { + "rocauc": 0.7204917205278893 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..ecf7fe3 --- /dev/null +++ b/runs/ogbg-moltox21_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_graphsage_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "graphsage", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 157.1, + "dev": "cuda:1", + "ep": 60, + "val": { + "rocauc": 0.7791810357079593 + }, + "val_adaptive": { + "rocauc": 0.7752032549288592 + }, + "test": { + "rocauc": 0.7217088253529022 + }, + "test_adaptive": { + "rocauc": 0.7282454305579198 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.289910600255428, + "fixed_steps": 8.0, + "adaptive_steps": 3.3903061224489797 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_mf_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-moltox21_mf_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..2a15684 --- /dev/null +++ b/runs/ogbg-moltox21_mf_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_mf_classic_T0_ns1_h128_e100_s0", + "view": "mf", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 201.7, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.7772586253147277 + }, + "test": { + "rocauc": 0.7280600105159073 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_mf_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-moltox21_mf_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..46d96d7 --- /dev/null +++ b/runs/ogbg-moltox21_mf_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_mf_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "mf", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 253.4, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.7694895755359669 + }, + "test": { + "rocauc": 0.7278719227082299 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..6a5891d --- /dev/null +++ b/runs/ogbg-moltox21_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_mf_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "mf", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 268.8, + "dev": "cuda:1", + "ep": 70, + "val": { + "rocauc": 0.76555289309204 + }, + "val_adaptive": { + "rocauc": 0.773660744169849 + }, + "test": { + "rocauc": 0.7235855082035453 + }, + "test_adaptive": { + "rocauc": 0.7314152133751847 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.9693486590038316, + "fixed_steps": 8.0, + "adaptive_steps": 2.9566326530612246 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_pna_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-moltox21_pna_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..4c2d43b --- /dev/null +++ b/runs/ogbg-moltox21_pna_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_pna_classic_T0_ns1_h128_e100_s0", + "view": "pna", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 166.1, + "dev": "cuda:1", + "ep": 90, + "val": { + "rocauc": 0.7659664923974269 + }, + "test": { + "rocauc": 0.6945744978582721 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_pna_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-moltox21_pna_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..aaa52d0 --- /dev/null +++ b/runs/ogbg-moltox21_pna_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_pna_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "pna", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 193.5, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.7744523976361245 + }, + "test": { + "rocauc": 0.7348793665704174 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..cf4acb8 --- /dev/null +++ b/runs/ogbg-moltox21_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_pna_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "pna", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 205.2, + "dev": "cuda:3", + "ep": 90, + "val": { + "rocauc": 0.7547109180572619 + }, + "val_adaptive": { + "rocauc": 0.7606431147410224 + }, + "test": { + "rocauc": 0.6948890646179361 + }, + "test_adaptive": { + "rocauc": 0.7075025478713003 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 4.104725415070242, + "fixed_steps": 8.0, + "adaptive_steps": 4.220663265306122 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..617451b --- /dev/null +++ b/runs/ogbg-moltox21_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_pna_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "pna", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 225.3, + "dev": "cuda:1", + "ep": 90, + "val": { + "rocauc": 0.7624732674125697 + }, + "val_adaptive": { + "rocauc": 0.7580383954116433 + }, + "test": { + "rocauc": 0.7137965144412185 + }, + "test_adaptive": { + "rocauc": 0.7200143809038219 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.94125159642401, + "fixed_steps": 8.0, + "adaptive_steps": 4.058673469387755 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_resgated_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-moltox21_resgated_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..ea1e3a5 --- /dev/null +++ b/runs/ogbg-moltox21_resgated_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_resgated_classic_T0_ns1_h128_e100_s0", + "view": "resgated", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 112.2, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.7950359690969749 + }, + "test": { + "rocauc": 0.7275455467914984 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-moltox21_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..a0487e9 --- /dev/null +++ b/runs/ogbg-moltox21_resgated_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_resgated_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "resgated", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 132.6, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.7886618095832292 + }, + "test": { + "rocauc": 0.7379821725919018 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..d8ffa6c --- /dev/null +++ b/runs/ogbg-moltox21_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "resgated", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 164.5, + "dev": "cuda:3", + "ep": 80, + "val": { + "rocauc": 0.7796493691111651 + }, + "val_adaptive": { + "rocauc": 0.7827018664501287 + }, + "test": { + "rocauc": 0.7201514791915015 + }, + "test_adaptive": { + "rocauc": 0.7223894069034307 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.037037037037037, + "fixed_steps": 8.0, + "adaptive_steps": 3.0778061224489797 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..0b95cc6 --- /dev/null +++ b/runs/ogbg-moltox21_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_resgated_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "resgated", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 182.4, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.7737227459288354 + }, + "val_adaptive": { + "rocauc": 0.7802426119319206 + }, + "test": { + "rocauc": 0.7454181481867773 + }, + "test_adaptive": { + "rocauc": 0.7448724120402496 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 2.805874840357599, + "fixed_steps": 8.0, + "adaptive_steps": 2.7767857142857144 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_sgc_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-moltox21_sgc_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..f1633aa --- /dev/null +++ b/runs/ogbg-moltox21_sgc_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_sgc_classic_T0_ns1_h128_e100_s0", + "view": "sgc", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 58.3, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.7611119280457176 + }, + "test": { + "rocauc": 0.7239907988668123 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-moltox21_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..98b0b4c --- /dev/null +++ b/runs/ogbg-moltox21_sgc_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_sgc_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "sgc", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 83.3, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.7505837592258088 + }, + "test": { + "rocauc": 0.7354997840876948 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..01edb4b --- /dev/null +++ b/runs/ogbg-moltox21_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "sgc", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 157.6, + "dev": "cuda:3", + "ep": 90, + "val": { + "rocauc": 0.7779156296831152 + }, + "val_adaptive": { + "rocauc": 0.7785071142176457 + }, + "test": { + "rocauc": 0.7359551442188313 + }, + "test_adaptive": { + "rocauc": 0.7477856114096909 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.401021711366539, + "fixed_steps": 8.0, + "adaptive_steps": 3.485969387755102 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..1fbd5a4 --- /dev/null +++ b/runs/ogbg-moltox21_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_sgc_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "sgc", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 167.6, + "dev": "cuda:1", + "ep": 100, + "val": { + "rocauc": 0.7668620788836082 + }, + "val_adaptive": { + "rocauc": 0.7636415510723298 + }, + "test": { + "rocauc": 0.7261733029463184 + }, + "test_adaptive": { + "rocauc": 0.7330710041428746 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.206896551724138, + "fixed_steps": 8.0, + "adaptive_steps": 3.260204081632653 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_tag_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-moltox21_tag_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..4adf9bb --- /dev/null +++ b/runs/ogbg-moltox21_tag_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_tag_classic_T0_ns1_h128_e100_s0", + "view": "tag", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 93.4, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.7865543605336435 + }, + "test": { + "rocauc": 0.7415570498308578 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_tag_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-moltox21_tag_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..560afdf --- /dev/null +++ b/runs/ogbg-moltox21_tag_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_tag_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "tag", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 122.8, + "dev": "cuda:1", + "ep": 50, + "val": { + "rocauc": 0.7838617216718421 + }, + "test": { + "rocauc": 0.7341723374058734 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..3a2f6ea --- /dev/null +++ b/runs/ogbg-moltox21_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_tag_rrog-act_T1_ns3_stream_hm8_hmin2_exact_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "tag", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "exact", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:3", + "metric": "rocauc", + "sec": 168.4, + "dev": "cuda:3", + "ep": 100, + "val": { + "rocauc": 0.7700778158549199 + }, + "val_adaptive": { + "rocauc": 0.7732723159984056 + }, + "test": { + "rocauc": 0.7162575064186166 + }, + "test_adaptive": { + "rocauc": 0.7254468026027986 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.5019157088122603, + "fixed_steps": 8.0, + "adaptive_steps": 3.506377551020408 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..7a13be9 --- /dev/null +++ b/runs/ogbg-moltox21_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_tag_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "tag", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 184.9, + "dev": "cuda:1", + "ep": 80, + "val": { + "rocauc": 0.7791811026208421 + }, + "val_adaptive": { + "rocauc": 0.783698445795415 + }, + "test": { + "rocauc": 0.7194750067722034 + }, + "test_adaptive": { + "rocauc": 0.7225403729796881 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 3.2835249042145596, + "fixed_steps": 8.0, + "adaptive_steps": 3.318877551020408 +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_transformer_classic_T0_ns1_h128_e100_s0.json b/runs/ogbg-moltox21_transformer_classic_T0_ns1_h128_e100_s0.json new file mode 100644 index 0000000..ec63ce7 --- /dev/null +++ b/runs/ogbg-moltox21_transformer_classic_T0_ns1_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_transformer_classic_T0_ns1_h128_e100_s0", + "view": "transformer", + "compute": "classic", + "T": 0, + "n_sup": 1, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 133.1, + "dev": "cuda:1", + "ep": 30, + "val": { + "rocauc": 0.7656017658932041 + }, + "test": { + "rocauc": 0.7309364489214464 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json b/runs/ogbg-moltox21_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json new file mode 100644 index 0000000..ff3555e --- /dev/null +++ b/runs/ogbg-moltox21_transformer_fixed-rrog_T1_ns3_h128_e100_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_transformer_fixed-rrog_T1_ns3_h128_e100_s0", + "view": "transformer", + "compute": "fixed-rrog", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "halt_max_steps": 8, + "halt_min_steps": 1, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 185.2, + "dev": "cuda:1", + "ep": 20, + "val": { + "rocauc": 0.7761466167802987 + }, + "test": { + "rocauc": 0.7291784660085319 + } +}
\ No newline at end of file diff --git a/runs/ogbg-moltox21_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json b/runs/ogbg-moltox21_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json new file mode 100644 index 0000000..fd0a552 --- /dev/null +++ b/runs/ogbg-moltox21_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0.json @@ -0,0 +1,49 @@ +{ + "dataset": "ogbg-moltox21", + "tag": "ogbg-moltox21_transformer_rrog-act_T1_ns3_stream_hm8_hmin2_loss0.2_lq0.1_hex0.1_qw0_h128_e100_s0", + "view": "transformer", + "compute": "rrog-act", + "T": 1, + "n_sup": 3, + "hidden": 128, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 100, + "eval_every": 10, + "lr": 0.001, + "bs": 128, + "lam_q": 0.1, + "halt_max_steps": 8, + "halt_min_steps": 2, + "halt_target": "loss", + "halt_loss_threshold": 0.2, + "halt_exploration_prob": 0.1, + "q_warmup_epochs": 0, + "act_train_mode": "stream", + "ema": 0.0, + "seed": 0, + "num_workers": 0, + "max_train_batches": 0, + "max_eval_batches": 0, + "device": "cuda:1", + "metric": "rocauc", + "sec": 191.2, + "dev": "cuda:1", + "ep": 40, + "val": { + "rocauc": 0.7839946999002233 + }, + "val_adaptive": { + "rocauc": 0.7907058937976815 + }, + "test": { + "rocauc": 0.723701343716436 + }, + "test_adaptive": { + "rocauc": 0.724166086603444 + }, + "fixed_val_steps": 8.0, + "adaptive_val_steps": 4.2005108556832695, + "fixed_steps": 8.0, + "adaptive_steps": 4.32780612244898 +}
\ No newline at end of file diff --git a/runs/pe2_sweep.log b/runs/pe2_sweep.log new file mode 100644 index 0000000..9c83802 --- /dev/null +++ b/runs/pe2_sweep.log @@ -0,0 +1,97 @@ +host=timan1.cs.illinois.edu gpu=0 start=2026-06-16T12:46:37-05:00 +===== seed=0 full gsn ===== +ep20 solve_rate=0.000 mean_conflicts=89.71 +ep40 solve_rate=0.023 mean_conflicts=149.88 +ep60 solve_rate=0.113 mean_conflicts=86.64 +ep80 solve_rate=0.643 mean_conflicts=2.77 +ep100 solve_rate=0.587 mean_conflicts=8.41 +ep120 solve_rate=0.170 mean_conflicts=37.12 +ep140 solve_rate=0.053 mean_conflicts=54.13 +ep150 solve_rate=0.037 mean_conflicts=58.30 +[color_full_gsn_n50_k3_p0.2_T3_ns3_s0] best solve_rate=0.6433 mean_conflicts=2.77 @ep80 (153.5s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_gsn_n50_k3_p0.2_T3_ns3_s0.pt +[full] LE n=300 fail_rate=0.36 | lambda1 SOLVED mean -0.3404 (n=193) | UNSOLVED mean +0.0177 (n=107) | sep=+0.3580 | AUROC(fail|lambda1)=0.898 | mean_lambda1=-0.2127 +[pe=gsn s0] deterministic solve_rate = 0.627 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.853 0.733 0.613 0.623 0.888 + wrote /home/yurenh2/rrog/runs/ptrm_color_full_gsn_n50_k3_p0.2_T3_ns3_s0.json +===== seed=1 full gsn ===== +ep20 solve_rate=0.000 mean_conflicts=64.37 +ep40 solve_rate=0.130 mean_conflicts=24.72 +ep60 solve_rate=0.073 mean_conflicts=52.57 +ep80 solve_rate=0.533 mean_conflicts=19.95 +ep100 solve_rate=0.143 mean_conflicts=81.78 +ep120 solve_rate=0.080 mean_conflicts=67.85 +ep140 solve_rate=0.033 mean_conflicts=97.71 +ep150 solve_rate=0.010 mean_conflicts=121.37 +[color_full_gsn_n50_k3_p0.2_T3_ns3_s1] best solve_rate=0.5333 mean_conflicts=19.95 @ep80 (150.6s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_gsn_n50_k3_p0.2_T3_ns3_s1.pt +[full] LE n=300 fail_rate=0.47 | lambda1 SOLVED mean -0.2563 (n=160) | UNSOLVED mean +0.0329 (n=140) | sep=+0.2893 | AUROC(fail|lambda1)=0.854 | mean_lambda1=-0.1213 +[pe=gsn s1] deterministic solve_rate = 0.527 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.787 0.640 0.527 0.524 0.862 + wrote /home/yurenh2/rrog/runs/ptrm_color_full_gsn_n50_k3_p0.2_T3_ns3_s1.json +===== seed=2 full gsn ===== +ep20 solve_rate=0.000 mean_conflicts=73.69 +ep40 solve_rate=0.140 mean_conflicts=28.86 +ep60 solve_rate=0.350 mean_conflicts=19.34 +ep80 solve_rate=0.650 mean_conflicts=9.43 +ep100 solve_rate=0.460 mean_conflicts=16.59 +ep120 solve_rate=0.110 mean_conflicts=54.56 +ep140 solve_rate=0.030 mean_conflicts=77.26 +ep150 solve_rate=0.023 mean_conflicts=86.61 +[color_full_gsn_n50_k3_p0.2_T3_ns3_s2] best solve_rate=0.65 mean_conflicts=9.427 @ep80 (154.1s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_gsn_n50_k3_p0.2_T3_ns3_s2.pt +[full] LE n=300 fail_rate=0.35 | lambda1 SOLVED mean -0.3873 (n=195) | UNSOLVED mean -0.0600 (n=105) | sep=+0.3273 | AUROC(fail|lambda1)=0.839 | mean_lambda1=-0.2727 +[pe=gsn s2] deterministic solve_rate = 0.627 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.827 0.713 0.627 0.625 0.863 + wrote /home/yurenh2/rrog/runs/ptrm_color_full_gsn_n50_k3_p0.2_T3_ns3_s2.json +===== seed=3 full gsn ===== +ep20 solve_rate=0.000 mean_conflicts=105.31 +ep40 solve_rate=0.190 mean_conflicts=13.04 +ep60 solve_rate=0.097 mean_conflicts=53.37 +ep80 solve_rate=0.577 mean_conflicts=7.48 +ep100 solve_rate=0.417 mean_conflicts=31.46 +ep120 solve_rate=0.180 mean_conflicts=58.09 +ep140 solve_rate=0.110 mean_conflicts=83.96 +ep150 solve_rate=0.103 mean_conflicts=93.02 +[color_full_gsn_n50_k3_p0.2_T3_ns3_s3] best solve_rate=0.5767 mean_conflicts=7.477 @ep80 (150.0s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_gsn_n50_k3_p0.2_T3_ns3_s3.pt +[full] LE n=300 fail_rate=0.42 | lambda1 SOLVED mean -0.2939 (n=173) | UNSOLVED mean +0.0027 (n=127) | sep=+0.2966 | AUROC(fail|lambda1)=0.857 | mean_lambda1=-0.1684 +[pe=gsn s3] deterministic solve_rate = 0.573 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.807 0.660 0.573 0.565 0.865 + wrote /home/yurenh2/rrog/runs/ptrm_color_full_gsn_n50_k3_p0.2_T3_ns3_s3.json +===== seed=4 full gsn ===== +ep20 solve_rate=0.000 mean_conflicts=96.19 +ep40 solve_rate=0.140 mean_conflicts=21.32 +ep60 solve_rate=0.140 mean_conflicts=43.18 +ep80 solve_rate=0.367 mean_conflicts=17.62 +ep100 solve_rate=0.577 mean_conflicts=7.39 +ep120 solve_rate=0.163 mean_conflicts=76.12 +ep140 solve_rate=0.040 mean_conflicts=100.85 +ep150 solve_rate=0.040 mean_conflicts=104.33 +[color_full_gsn_n50_k3_p0.2_T3_ns3_s4] best solve_rate=0.5767 mean_conflicts=7.393 @ep100 (153.1s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_gsn_n50_k3_p0.2_T3_ns3_s4.pt +[full] LE n=300 fail_rate=0.42 | lambda1 SOLVED mean -0.3064 (n=173) | UNSOLVED mean +0.0036 (n=127) | sep=+0.3100 | AUROC(fail|lambda1)=0.890 | mean_lambda1=-0.1751 +[pe=gsn s4] deterministic solve_rate = 0.620 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.847 0.740 0.627 0.635 0.896 + wrote /home/yurenh2/rrog/runs/ptrm_color_full_gsn_n50_k3_p0.2_T3_ns3_s4.json +===== AGGREGATE (all pe: none/rwse/gsn) ===== +=== best solve_rate (deterministic, EMA) === + ('1step', 'none'): 0.293±0.062 (n=5) + ('full', 'gsn'): 0.596±0.044 (n=5) + ('full', 'none'): 0.457±0.087 (n=5) + ('full', 'rwse'): 0.503±0.064 (n=5) +=== LE AUROC(fail|lambda1) === + ('1step', 'none'): 0.821±0.036 (n=5) + ('full', 'gsn'): 0.868±0.023 (n=5) + ('full', 'none'): 0.868±0.032 (n=5) + ('full', 'rwse'): 0.837±0.041 (n=5) +=== PTRM sigma=0.2 === + ('full', 'gsn'): det 0.595±0.039 (n=5) | pass@K 0.824±0.025 (n=5) | lambda-sel 0.697±0.040 (n=5) | AUROC 0.875±0.014 (n=5) + ('full', 'none'): det 0.480±0.088 (n=5) | pass@K 0.739±0.113 (n=5) | lambda-sel 0.600±0.110 (n=5) | AUROC 0.853±0.023 (n=5) + ('full', 'rwse'): det 0.521±0.065 (n=5) | pass@K 0.883±0.075 (n=5) | lambda-sel 0.736±0.088 (n=5) | AUROC 0.837±0.028 (n=5) +done=2026-06-16T13:05:45-05:00 diff --git a/runs/pe3_sweep.log b/runs/pe3_sweep.log new file mode 100644 index 0000000..8092566 --- /dev/null +++ b/runs/pe3_sweep.log @@ -0,0 +1,220 @@ +host=timan1.cs.illinois.edu gpu=0 start=2026-06-16T13:42:05-05:00 +===== seed=0 #3 full sub ===== +/home/yurenh2/rrog/diag/train_color.py:86: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +ep20 solve_rate=0.000 mean_conflicts=56.87 +ep40 solve_rate=0.280 mean_conflicts=13.94 +ep60 solve_rate=0.207 mean_conflicts=44.20 +ep80 solve_rate=0.440 mean_conflicts=39.18 +ep100 solve_rate=0.710 mean_conflicts=1.94 +ep120 solve_rate=0.643 mean_conflicts=7.74 +ep140 solve_rate=0.530 mean_conflicts=26.79 +ep150 solve_rate=0.500 mean_conflicts=28.63 +[color_full_sub_n50_k3_p0.2_T3_ns3_s0] best solve_rate=0.71 mean_conflicts=1.94 @ep100 (155.3s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_sub_n50_k3_p0.2_T3_ns3_s0.pt +/home/yurenh2/rrog/diag/train_color.py:86: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +[full] LE n=300 fail_rate=0.29 | lambda1 SOLVED mean -0.3371 (n=213) | UNSOLVED mean +0.0344 (n=87) | sep=+0.3714 | AUROC(fail|lambda1)=0.885 | mean_lambda1=-0.2293 +/home/yurenh2/rrog/diag/train_color.py:86: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +[pe=sub s0] deterministic solve_rate = 0.733 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.920 0.860 0.727 0.732 0.912 + wrote /home/yurenh2/rrog/runs/ptrm_color_full_sub_n50_k3_p0.2_T3_ns3_s0.json +===== seed=0 #4 full none --contract ===== +ep20 solve_rate=0.000 mean_conflicts=163.48 +ep40 solve_rate=0.000 mean_conflicts=146.81 +ep60 solve_rate=0.000 mean_conflicts=135.64 +ep80 solve_rate=0.000 mean_conflicts=126.22 +ep100 solve_rate=0.000 mean_conflicts=113.24 +ep120 solve_rate=0.000 mean_conflicts=91.74 +ep140 solve_rate=0.000 mean_conflicts=88.39 +ep150 solve_rate=0.000 mean_conflicts=87.80 +[color_full_none_ctr_n50_k3_p0.2_T3_ns3_s0] best solve_rate=0.0 mean_conflicts=163.477 @ep20 (207.1s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s0.pt +[full] LE n=300 fail_rate=1.00 | lambda1 SOLVED mean +nan (n=0) | UNSOLVED mean -0.6308 (n=300) | sep=+nan | AUROC(fail|lambda1)=nan | mean_lambda1=-0.6308 +[pe=none s0] deterministic solve_rate = 0.000 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.000 0.000 0.000 0.000 nan + wrote /home/yurenh2/rrog/runs/ptrm_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s0.json +===== seed=1 #3 full sub ===== +/home/yurenh2/rrog/diag/train_color.py:86: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +ep20 solve_rate=0.000 mean_conflicts=99.67 +ep40 solve_rate=0.210 mean_conflicts=28.08 +ep60 solve_rate=0.233 mean_conflicts=59.81 +ep80 solve_rate=0.570 mean_conflicts=7.48 +ep100 solve_rate=0.303 mean_conflicts=60.79 +ep120 solve_rate=0.187 mean_conflicts=69.15 +ep140 solve_rate=0.107 mean_conflicts=63.47 +ep150 solve_rate=0.107 mean_conflicts=64.31 +[color_full_sub_n50_k3_p0.2_T3_ns3_s1] best solve_rate=0.57 mean_conflicts=7.483 @ep80 (148.6s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_sub_n50_k3_p0.2_T3_ns3_s1.pt +/home/yurenh2/rrog/diag/train_color.py:86: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +[full] LE n=300 fail_rate=0.43 | lambda1 SOLVED mean -0.3139 (n=171) | UNSOLVED mean +0.0323 (n=129) | sep=+0.3462 | AUROC(fail|lambda1)=0.928 | mean_lambda1=-0.1650 +/home/yurenh2/rrog/diag/train_color.py:86: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +[pe=sub s1] deterministic solve_rate = 0.540 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.867 0.713 0.540 0.570 0.893 + wrote /home/yurenh2/rrog/runs/ptrm_color_full_sub_n50_k3_p0.2_T3_ns3_s1.json +===== seed=1 #4 full none --contract ===== +ep20 solve_rate=0.000 mean_conflicts=107.59 +ep40 solve_rate=0.000 mean_conflicts=97.27 +ep60 solve_rate=0.000 mean_conflicts=84.15 +ep80 solve_rate=0.000 mean_conflicts=75.86 +ep100 solve_rate=0.000 mean_conflicts=99.62 +ep120 solve_rate=0.000 mean_conflicts=163.03 +ep140 solve_rate=0.000 mean_conflicts=162.94 +ep150 solve_rate=0.000 mean_conflicts=162.62 +[color_full_none_ctr_n50_k3_p0.2_T3_ns3_s1] best solve_rate=0.0 mean_conflicts=107.593 @ep20 (206.4s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s1.pt +[full] LE n=300 fail_rate=1.00 | lambda1 SOLVED mean +nan (n=0) | UNSOLVED mean -1.0479 (n=300) | sep=+nan | AUROC(fail|lambda1)=nan | mean_lambda1=-1.0479 +[pe=none s1] deterministic solve_rate = 0.000 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.000 0.000 0.000 0.000 nan + wrote /home/yurenh2/rrog/runs/ptrm_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s1.json +===== seed=2 #3 full sub ===== +/home/yurenh2/rrog/diag/train_color.py:86: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +ep20 solve_rate=0.000 mean_conflicts=143.77 +ep40 solve_rate=0.280 mean_conflicts=19.26 +ep60 solve_rate=0.520 mean_conflicts=15.04 +ep80 solve_rate=0.670 mean_conflicts=3.32 +ep100 solve_rate=0.620 mean_conflicts=20.58 +ep120 solve_rate=0.403 mean_conflicts=60.92 +ep140 solve_rate=0.390 mean_conflicts=58.32 +ep150 solve_rate=0.377 mean_conflicts=55.34 +[color_full_sub_n50_k3_p0.2_T3_ns3_s2] best solve_rate=0.67 mean_conflicts=3.317 @ep80 (152.1s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_sub_n50_k3_p0.2_T3_ns3_s2.pt +/home/yurenh2/rrog/diag/train_color.py:86: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +[full] LE n=300 fail_rate=0.33 | lambda1 SOLVED mean -0.3650 (n=201) | UNSOLVED mean +0.0472 (n=99) | sep=+0.4122 | AUROC(fail|lambda1)=0.937 | mean_lambda1=-0.2290 +/home/yurenh2/rrog/diag/train_color.py:86: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +[pe=sub s2] deterministic solve_rate = 0.707 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.893 0.800 0.700 0.688 0.919 + wrote /home/yurenh2/rrog/runs/ptrm_color_full_sub_n50_k3_p0.2_T3_ns3_s2.json +===== seed=2 #4 full none --contract ===== +ep20 solve_rate=0.000 mean_conflicts=102.42 +ep40 solve_rate=0.000 mean_conflicts=89.46 +ep60 solve_rate=0.000 mean_conflicts=83.90 +ep80 solve_rate=0.000 mean_conflicts=90.79 +ep100 solve_rate=0.000 mean_conflicts=92.59 +ep120 solve_rate=0.000 mean_conflicts=84.45 +ep140 solve_rate=0.000 mean_conflicts=76.00 +ep150 solve_rate=0.000 mean_conflicts=69.42 +[color_full_none_ctr_n50_k3_p0.2_T3_ns3_s2] best solve_rate=0.0 mean_conflicts=102.423 @ep20 (208.2s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s2.pt +[full] LE n=300 fail_rate=1.00 | lambda1 SOLVED mean +nan (n=0) | UNSOLVED mean -0.9886 (n=300) | sep=+nan | AUROC(fail|lambda1)=nan | mean_lambda1=-0.9886 +[pe=none s2] deterministic solve_rate = 0.000 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.000 0.000 0.000 0.000 nan + wrote /home/yurenh2/rrog/runs/ptrm_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s2.json +===== seed=3 #3 full sub ===== +/home/yurenh2/rrog/diag/train_color.py:86: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +ep20 solve_rate=0.000 mean_conflicts=109.49 +ep40 solve_rate=0.253 mean_conflicts=27.50 +ep60 solve_rate=0.203 mean_conflicts=33.37 +ep80 solve_rate=0.227 mean_conflicts=59.83 +ep100 solve_rate=0.043 mean_conflicts=81.74 +ep120 solve_rate=0.080 mean_conflicts=75.93 +ep140 solve_rate=0.170 mean_conflicts=56.67 +ep150 solve_rate=0.087 mean_conflicts=85.03 +[color_full_sub_n50_k3_p0.2_T3_ns3_s3] best solve_rate=0.2533 mean_conflicts=27.497 @ep40 (152.2s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_sub_n50_k3_p0.2_T3_ns3_s3.pt +/home/yurenh2/rrog/diag/train_color.py:86: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +[full] LE n=300 fail_rate=0.75 | lambda1 SOLVED mean -0.3797 (n=76) | UNSOLVED mean -0.1929 (n=224) | sep=+0.1869 | AUROC(fail|lambda1)=0.805 | mean_lambda1=-0.2402 +/home/yurenh2/rrog/diag/train_color.py:86: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +[pe=sub s3] deterministic solve_rate = 0.280 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.380 0.260 0.260 0.247 0.831 + wrote /home/yurenh2/rrog/runs/ptrm_color_full_sub_n50_k3_p0.2_T3_ns3_s3.json +===== seed=3 #4 full none --contract ===== +ep20 solve_rate=0.000 mean_conflicts=125.59 +ep40 solve_rate=0.000 mean_conflicts=118.58 +ep60 solve_rate=0.000 mean_conflicts=84.82 +ep80 solve_rate=0.000 mean_conflicts=65.44 +ep100 solve_rate=0.000 mean_conflicts=59.09 +ep120 solve_rate=0.000 mean_conflicts=61.66 +ep140 solve_rate=0.000 mean_conflicts=62.53 +ep150 solve_rate=0.000 mean_conflicts=63.31 +[color_full_none_ctr_n50_k3_p0.2_T3_ns3_s3] best solve_rate=0.0 mean_conflicts=125.593 @ep20 (206.2s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s3.pt +[full] LE n=300 fail_rate=1.00 | lambda1 SOLVED mean +nan (n=0) | UNSOLVED mean -0.5765 (n=300) | sep=+nan | AUROC(fail|lambda1)=nan | mean_lambda1=-0.5765 +[pe=none s3] deterministic solve_rate = 0.000 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.000 0.000 0.000 0.000 nan + wrote /home/yurenh2/rrog/runs/ptrm_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s3.json +===== seed=4 #3 full sub ===== +/home/yurenh2/rrog/diag/train_color.py:86: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +ep20 solve_rate=0.000 mean_conflicts=157.73 +ep40 solve_rate=0.140 mean_conflicts=24.79 +ep60 solve_rate=0.120 mean_conflicts=98.35 +ep80 solve_rate=0.623 mean_conflicts=4.32 +ep100 solve_rate=0.540 mean_conflicts=16.64 +ep120 solve_rate=0.380 mean_conflicts=41.04 +ep140 solve_rate=0.390 mean_conflicts=44.34 +ep150 solve_rate=0.387 mean_conflicts=43.48 +[color_full_sub_n50_k3_p0.2_T3_ns3_s4] best solve_rate=0.6233 mean_conflicts=4.323 @ep80 (152.1s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_sub_n50_k3_p0.2_T3_ns3_s4.pt +/home/yurenh2/rrog/diag/train_color.py:86: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +[full] LE n=300 fail_rate=0.38 | lambda1 SOLVED mean -0.3913 (n=187) | UNSOLVED mean +0.0144 (n=113) | sep=+0.4057 | AUROC(fail|lambda1)=0.940 | mean_lambda1=-0.2385 +/home/yurenh2/rrog/diag/train_color.py:86: RuntimeWarning: invalid value encountered in divide + clus = np.where(deg > 1, tri / (deg * (deg - 1) / 2.0), 0.0) +[pe=sub s4] deterministic solve_rate = 0.647 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.907 0.793 0.647 0.645 0.914 + wrote /home/yurenh2/rrog/runs/ptrm_color_full_sub_n50_k3_p0.2_T3_ns3_s4.json +===== seed=4 #4 full none --contract ===== +ep20 solve_rate=0.000 mean_conflicts=156.35 +ep40 solve_rate=0.000 mean_conflicts=121.15 +ep60 solve_rate=0.000 mean_conflicts=82.09 +ep80 solve_rate=0.000 mean_conflicts=80.90 +ep100 solve_rate=0.000 mean_conflicts=81.51 +ep120 solve_rate=0.000 mean_conflicts=80.79 +ep140 solve_rate=0.000 mean_conflicts=74.61 +ep150 solve_rate=0.000 mean_conflicts=73.39 +[color_full_none_ctr_n50_k3_p0.2_T3_ns3_s4] best solve_rate=0.0 mean_conflicts=156.353 @ep20 (208.3s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s4.pt +[full] LE n=300 fail_rate=1.00 | lambda1 SOLVED mean +nan (n=0) | UNSOLVED mean -0.7751 (n=300) | sep=+nan | AUROC(fail|lambda1)=nan | mean_lambda1=-0.7751 +[pe=none s4] deterministic solve_rate = 0.000 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.000 0.000 0.000 0.000 nan + wrote /home/yurenh2/rrog/runs/ptrm_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s4.json +===== AGGREGATE ===== +=== best solve_rate (deterministic, EMA) === + ('1step', 'none', '-'): 0.293±0.062 (n=5) + ('full', 'gsn', '-'): 0.596±0.044 (n=5) + ('full', 'none', '-'): 0.457±0.087 (n=5) + ('full', 'none', 'ctr'): 0.000±0.000 (n=5) + ('full', 'rwse', '-'): 0.503±0.064 (n=5) + ('full', 'sub', '-'): 0.565±0.163 (n=5) +=== LE AUROC(fail|lambda1) === + ('1step', 'none', '-'): 0.821±0.036 (n=5) + ('full', 'gsn', '-'): 0.868±0.023 (n=5) + ('full', 'none', '-'): 0.868±0.032 (n=5) + ('full', 'none', 'ctr'): nan±nan (n=5) + ('full', 'rwse', '-'): 0.837±0.041 (n=5) + ('full', 'sub', '-'): 0.899±0.051 (n=5) +=== LE mean_lambda1 (forced-contraction dose) === + ('1step', 'none', '-'): -0.051±0.092 (n=5) + ('full', 'gsn', '-'): -0.190±0.051 (n=5) + ('full', 'none', '-'): -0.197±0.032 (n=5) + ('full', 'none', 'ctr'): -0.804±0.188 (n=5) + ('full', 'rwse', '-'): -0.011±0.075 (n=5) + ('full', 'sub', '-'): -0.220±0.028 (n=5) +=== PTRM sigma=0.2 === + ('full', 'gsn', '-'): det 0.595±0.039 (n=5) | pass@K 0.824±0.025 (n=5) | lambda-sel 0.697±0.040 (n=5) | AUROC 0.875±0.014 (n=5) + ('full', 'none', '-'): det 0.480±0.088 (n=5) | pass@K 0.739±0.113 (n=5) | lambda-sel 0.600±0.110 (n=5) | AUROC 0.853±0.023 (n=5) + ('full', 'none', 'ctr'): det 0.000±0.000 (n=5) | pass@K 0.000±0.000 (n=5) | lambda-sel 0.000±0.000 (n=5) | AUROC nan±nan (n=5) + ('full', 'rwse', '-'): det 0.521±0.065 (n=5) | pass@K 0.883±0.075 (n=5) | lambda-sel 0.736±0.088 (n=5) | AUROC 0.837±0.028 (n=5) + ('full', 'sub', '-'): det 0.581±0.165 (n=5) | pass@K 0.793±0.207 (n=5) | lambda-sel 0.685±0.218 (n=5) | AUROC 0.894±0.033 (n=5) +done=2026-06-16T14:24:48-05:00 diff --git a/runs/pe_sweep.log b/runs/pe_sweep.log new file mode 100644 index 0000000..d147d94 --- /dev/null +++ b/runs/pe_sweep.log @@ -0,0 +1,66 @@ +host=timan1.cs.illinois.edu gpu=0 start=2026-06-16T11:31:39-05:00 +===== train full pe=none ===== +ep20 solve_rate=0.000 mean_conflicts=122.82 +ep40 solve_rate=0.167 mean_conflicts=60.87 +ep60 solve_rate=0.187 mean_conflicts=64.07 +ep80 solve_rate=0.313 mean_conflicts=23.74 +ep100 solve_rate=0.093 mean_conflicts=77.11 +ep120 solve_rate=0.060 mean_conflicts=69.50 +ep140 solve_rate=0.113 mean_conflicts=38.00 +ep150 solve_rate=0.103 mean_conflicts=39.66 +[color_full_none_n50_k3_p0.2_T3_ns3_s0] best solve_rate=0.3133 mean_conflicts=23.737 @ep80 (152.8s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_none_n50_k3_p0.2_T3_ns3_s0.pt +===== train full pe=rwse ===== +ep20 solve_rate=0.000 mean_conflicts=71.30 +ep40 solve_rate=0.193 mean_conflicts=29.00 +ep60 solve_rate=0.177 mean_conflicts=37.01 +ep80 solve_rate=0.483 mean_conflicts=6.12 +ep100 solve_rate=0.543 mean_conflicts=7.36 +ep120 solve_rate=0.497 mean_conflicts=13.22 +ep140 solve_rate=0.373 mean_conflicts=49.20 +ep150 solve_rate=0.363 mean_conflicts=50.49 +[color_full_rwse_n50_k3_p0.2_T3_ns3_s0] best solve_rate=0.5433 mean_conflicts=7.357 @ep100 (152.9s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_rwse_n50_k3_p0.2_T3_ns3_s0.pt +===== LE (full, both pe) ===== +[full] LE n=300 fail_rate=0.69 | lambda1 SOLVED mean -0.2724 (n=94) | UNSOLVED mean -0.0750 (n=206) | sep=+0.1974 | AUROC(fail|lambda1)=0.823 | mean_lambda1=-0.1369 +Traceback (most recent call last): + File "/home/yurenh2/rrog/diag/train_color.py", line 254, in <module> + main() + ~~~~^^ + File "/home/yurenh2/rrog/diag/train_color.py", line 202, in main + run_le(model, te, dev, c['n_sup'] * c['T']) + ~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ + File "/home/yurenh2/rrog/diag/train_color.py", line 159, in run_le + col = model(xin, ei)[-1].argmax(-1) + ~~~~~^^^^^^^^^ + File "/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl + return self._call_impl(*args, **kwargs) + ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ + File "/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch/nn/modules/module.py", line 1787, in _call_impl + return forward_call(*args, **kwargs) + File "/home/yurenh2/rrog/diag/train_color.py", line 106, in forward + h0 = self.lin_in(xin) + File "/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl + return self._call_impl(*args, **kwargs) + ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ + File "/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch/nn/modules/module.py", line 1787, in _call_impl + return forward_call(*args, **kwargs) + File "/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch/nn/modules/linear.py", line 134, in forward + return F.linear(input, self.weight, self.bias) + ~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ +RuntimeError: mat1 and mat2 shapes cannot be multiplied (50x8 and 24x128) +!! le rwse failed +===== PTRM noise + lambda-select (both pe) ===== +--- pe=none --- +[pe=none] deterministic solve_rate = 0.327 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.1 0.560 0.440 0.353 0.323 0.820 + 0.2 0.747 0.520 0.307 0.313 0.817 + 0.4 0.860 0.620 0.300 0.292 0.777 +--- pe=rwse --- +[pe=rwse] deterministic solve_rate = 0.593 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.1 0.840 0.720 0.593 0.595 0.850 + 0.2 0.927 0.767 0.540 0.579 0.838 + 0.4 0.973 0.860 0.540 0.509 0.831 +done=2026-06-16T11:41:49-05:00 diff --git a/runs/pna_sweep.log b/runs/pna_sweep.log new file mode 100644 index 0000000..21ecfa1 --- /dev/null +++ b/runs/pna_sweep.log @@ -0,0 +1,142 @@ +PNA start gpu=0 2026-06-17T03:30:41-05:00 +== pna s0 == +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 solve_rate=0.027 mean_conflicts=13.04 +ep40 solve_rate=0.693 mean_conflicts=1.50 +ep60 solve_rate=0.867 mean_conflicts=0.58 +ep80 solve_rate=0.877 mean_conflicts=0.49 +ep100 solve_rate=0.913 mean_conflicts=0.26 +ep120 solve_rate=0.913 mean_conflicts=0.33 +ep140 solve_rate=0.920 mean_conflicts=0.32 +ep150 solve_rate=0.920 mean_conflicts=0.35 +[color_pna_full_none_n50_k3_p0.2_T3_ns3_s0] best solve_rate=0.92 @ep140 (718.5s) + wrote /home/yurenh2/rrog/runs/ckpt_color_pna_full_none_n50_k3_p0.2_T3_ns3_s0.pt +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +[pna/full] LE n=300 fail=0.08 | SOLVED -0.150 UNSOLVED +0.171 sep=+0.321 AUROC=0.867 mean_lam=-0.124 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +[pe=none s0] deterministic solve_rate = 0.920 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.980 0.913 0.920 0.910 0.819 + wrote /home/yurenh2/rrog/runs/ptrm_color_pna_full_none_n50_k3_p0.2_T3_ns3_s0.json +== pna s1 == +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 solve_rate=0.020 mean_conflicts=17.71 +ep40 solve_rate=0.687 mean_conflicts=1.50 +ep60 solve_rate=0.817 mean_conflicts=0.69 +ep80 solve_rate=0.893 mean_conflicts=0.43 +ep100 solve_rate=0.917 mean_conflicts=0.27 +ep120 solve_rate=0.917 mean_conflicts=0.31 +ep140 solve_rate=0.927 mean_conflicts=0.24 +ep150 solve_rate=0.943 mean_conflicts=0.15 +[color_pna_full_none_n50_k3_p0.2_T3_ns3_s1] best solve_rate=0.9433 @ep150 (718.2s) + wrote /home/yurenh2/rrog/runs/ckpt_color_pna_full_none_n50_k3_p0.2_T3_ns3_s1.pt +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +[pna/full] LE n=300 fail=0.06 | SOLVED -0.164 UNSOLVED -0.019 sep=+0.145 AUROC=0.727 mean_lam=-0.155 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +[pe=none s1] deterministic solve_rate = 0.940 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.987 0.967 0.953 0.933 0.794 + wrote /home/yurenh2/rrog/runs/ptrm_color_pna_full_none_n50_k3_p0.2_T3_ns3_s1.json +== pna s2 == +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 solve_rate=0.017 mean_conflicts=13.94 +ep40 solve_rate=0.737 mean_conflicts=1.15 +ep60 solve_rate=0.820 mean_conflicts=0.68 +ep80 solve_rate=0.883 mean_conflicts=0.41 +ep100 solve_rate=0.913 mean_conflicts=0.30 +ep120 solve_rate=0.907 mean_conflicts=0.30 +ep140 solve_rate=0.903 mean_conflicts=0.29 +ep150 solve_rate=0.917 mean_conflicts=0.20 +[color_pna_full_none_n50_k3_p0.2_T3_ns3_s2] best solve_rate=0.9167 @ep150 (714.9s) + wrote /home/yurenh2/rrog/runs/ckpt_color_pna_full_none_n50_k3_p0.2_T3_ns3_s2.pt +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +[pna/full] LE n=300 fail=0.08 | SOLVED -0.204 UNSOLVED +0.008 sep=+0.212 AUROC=0.773 mean_lam=-0.186 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +[pe=none s2] deterministic solve_rate = 0.940 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 1.000 0.947 0.953 0.934 0.800 + wrote /home/yurenh2/rrog/runs/ptrm_color_pna_full_none_n50_k3_p0.2_T3_ns3_s2.json +== pna s3 == +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 solve_rate=0.003 mean_conflicts=34.24 +ep40 solve_rate=0.747 mean_conflicts=1.30 +ep60 solve_rate=0.827 mean_conflicts=0.66 +ep80 solve_rate=0.893 mean_conflicts=0.47 +ep100 solve_rate=0.897 mean_conflicts=0.47 +ep120 solve_rate=0.913 mean_conflicts=0.28 +ep140 solve_rate=0.943 mean_conflicts=0.20 +ep150 solve_rate=0.933 mean_conflicts=0.19 +[color_pna_full_none_n50_k3_p0.2_T3_ns3_s3] best solve_rate=0.9433 @ep140 (614.3s) + wrote /home/yurenh2/rrog/runs/ckpt_color_pna_full_none_n50_k3_p0.2_T3_ns3_s3.pt +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +[pna/full] LE n=300 fail=0.06 | SOLVED -0.162 UNSOLVED +0.039 sep=+0.201 AUROC=0.756 mean_lam=-0.150 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +[pe=none s3] deterministic solve_rate = 0.960 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.993 0.987 0.933 0.945 0.885 + wrote /home/yurenh2/rrog/runs/ptrm_color_pna_full_none_n50_k3_p0.2_T3_ns3_s3.json +== pna s4 == +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +ep20 solve_rate=0.007 mean_conflicts=24.65 +ep40 solve_rate=0.717 mean_conflicts=1.45 +ep60 solve_rate=0.827 mean_conflicts=0.60 +ep80 solve_rate=0.913 mean_conflicts=0.37 +ep100 solve_rate=0.920 mean_conflicts=0.28 +ep120 solve_rate=0.897 mean_conflicts=0.31 +ep140 solve_rate=0.897 mean_conflicts=0.36 +ep150 solve_rate=0.923 mean_conflicts=0.29 +[color_pna_full_none_n50_k3_p0.2_T3_ns3_s4] best solve_rate=0.9233 @ep150 (702.2s) + wrote /home/yurenh2/rrog/runs/ckpt_color_pna_full_none_n50_k3_p0.2_T3_ns3_s4.pt +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +[pna/full] LE n=300 fail=0.08 | SOLVED -0.137 UNSOLVED +0.070 sep=+0.207 AUROC=0.778 mean_lam=-0.121 +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='min')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +/home/yurenh2/miniconda3/lib/python3.13/site-packages/torch_geometric/utils/_scatter.py:91: UserWarning: The usage of `scatter(reduce='max')` can be accelerated via the 'torch-scatter' package, but it was not found + warnings.warn( +[pe=none s4] deterministic solve_rate = 0.947 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.993 0.973 0.920 0.935 0.844 + wrote /home/yurenh2/rrog/runs/ptrm_color_pna_full_none_n50_k3_p0.2_T3_ns3_s4.json +donePNA=2026-06-17T04:49:08-05:00 diff --git a/runs/ppgn_sweep.log b/runs/ppgn_sweep.log new file mode 100644 index 0000000..dd5e672 --- /dev/null +++ b/runs/ppgn_sweep.log @@ -0,0 +1,57 @@ +PPGN start gpu=1 2026-06-17T03:36:55-05:00 +== ppgn s0 == +ep20 solve=0.727 +ep40 solve=0.867 +ep60 solve=0.887 +ep80 solve=0.913 +ep100 solve=0.923 +ep120 solve=0.907 +ep140 solve=0.897 +ep150 solve=0.897 +[ppgn/full] solve=0.923 | LE AUROC=0.857 mean_lam=-0.025 | PTRM det=0.953 passK=0.987 lamsel=0.967 (645s) + wrote color_/le_color_/ptrm_color_ ppgn_full_none_n50_k3_p0.2_T3_ns3_s0 +== ppgn s1 == +ep20 solve=0.700 +ep40 solve=0.880 +ep60 solve=0.903 +ep80 solve=0.903 +ep100 solve=0.930 +ep120 solve=0.920 +ep140 solve=0.917 +ep150 solve=0.917 +[ppgn/full] solve=0.930 | LE AUROC=0.753 mean_lam=-0.010 | PTRM det=0.967 passK=0.987 lamsel=0.953 (639s) + wrote color_/le_color_/ptrm_color_ ppgn_full_none_n50_k3_p0.2_T3_ns3_s1 +== ppgn s2 == +ep20 solve=0.723 +ep40 solve=0.877 +ep60 solve=0.907 +ep80 solve=0.920 +ep100 solve=0.933 +ep120 solve=0.910 +ep140 solve=0.917 +ep150 solve=0.927 +[ppgn/full] solve=0.933 | LE AUROC=0.779 mean_lam=-0.011 | PTRM det=0.967 passK=0.973 lamsel=0.967 (639s) + wrote color_/le_color_/ptrm_color_ ppgn_full_none_n50_k3_p0.2_T3_ns3_s2 +== ppgn s3 == +ep20 solve=0.667 +ep40 solve=0.847 +ep60 solve=0.900 +ep80 solve=0.913 +ep100 solve=0.930 +ep120 solve=0.937 +ep140 solve=0.937 +ep150 solve=0.947 +[ppgn/full] solve=0.947 | LE AUROC=0.770 mean_lam=+0.014 | PTRM det=0.967 passK=0.987 lamsel=0.973 (640s) + wrote color_/le_color_/ptrm_color_ ppgn_full_none_n50_k3_p0.2_T3_ns3_s3 +== ppgn s4 == +ep20 solve=0.647 +ep40 solve=0.823 +ep60 solve=0.880 +ep80 solve=0.897 +ep100 solve=0.923 +ep120 solve=0.917 +ep140 solve=0.893 +ep150 solve=0.893 +[ppgn/full] solve=0.923 | LE AUROC=0.728 mean_lam=-0.039 | PTRM det=0.960 passK=0.980 lamsel=0.960 (639s) + wrote color_/le_color_/ptrm_color_ ppgn_full_none_n50_k3_p0.2_T3_ns3_s4 +donePPGN=2026-06-17T04:31:04-05:00 diff --git a/runs/ptrm_color.log b/runs/ptrm_color.log new file mode 100644 index 0000000..67dac38 --- /dev/null +++ b/runs/ptrm_color.log @@ -0,0 +1,7 @@ +deterministic solve_rate = 0.540 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.05 0.600 0.567 0.527 0.537 0.871 + 0.1 0.627 0.573 0.507 0.521 0.872 + 0.2 0.720 0.593 0.493 0.505 0.870 + 0.4 0.820 0.647 0.467 0.472 0.845 +done=2026-06-16T11:01:53-05:00 diff --git a/runs/ptrm_color_cin_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/ptrm_color_cin_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..871294d --- /dev/null +++ b/runs/ptrm_color_cin_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1 @@ +{"conv": "cin", "pe": "none", "grad_mode": "full", "contract": false, "seed": 0, "det": 0.4733333333333334, "sigmas": {"0.2": {"passk": 0.47333333333333333, "lamsel": 0.47333333333333333, "random": 0.47333333333333333}}}
\ No newline at end of file diff --git a/runs/ptrm_color_cin_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/ptrm_color_cin_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..7acd118 --- /dev/null +++ b/runs/ptrm_color_cin_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1 @@ +{"conv": "cin", "pe": "none", "grad_mode": "full", "contract": false, "seed": 1, "det": 0.5533333333333333, "sigmas": {"0.2": {"passk": 0.5533333333333333, "lamsel": 0.5533333333333333, "random": 0.5533333333333333}}}
\ No newline at end of file diff --git a/runs/ptrm_color_cin_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/ptrm_color_cin_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..8c7783b --- /dev/null +++ b/runs/ptrm_color_cin_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1 @@ +{"conv": "cin", "pe": "none", "grad_mode": "full", "contract": false, "seed": 2, "det": 0.5666666666666667, "sigmas": {"0.2": {"passk": 0.5666666666666667, "lamsel": 0.5666666666666667, "random": 0.5666666666666667}}}
\ No newline at end of file diff --git a/runs/ptrm_color_cin_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/ptrm_color_cin_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..c64955d --- /dev/null +++ b/runs/ptrm_color_cin_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1 @@ +{"conv": "cin", "pe": "none", "grad_mode": "full", "contract": false, "seed": 3, "det": 0.5866666666666667, "sigmas": {"0.2": {"passk": 0.5866666666666667, "lamsel": 0.5866666666666667, "random": 0.5866666666666667}}}
\ No newline at end of file diff --git a/runs/ptrm_color_cin_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/ptrm_color_cin_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..8457967 --- /dev/null +++ b/runs/ptrm_color_cin_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1 @@ +{"conv": "cin", "pe": "none", "grad_mode": "full", "contract": false, "seed": 4, "det": 0.5266666666666666, "sigmas": {"0.2": {"passk": 0.5266666666666666, "lamsel": 0.5266666666666666, "random": 0.5266666666666666}}}
\ No newline at end of file diff --git a/runs/ptrm_color_esan_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/ptrm_color_esan_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..0a4625a --- /dev/null +++ b/runs/ptrm_color_esan_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1 @@ +{"conv": "esan", "pe": "none", "grad_mode": "full", "contract": false, "seed": 0, "det": 0.5133333333333333, "sigmas": {"0.2": {"passk": 0.5133333333333333, "lamsel": 0.5133333333333333, "random": 0.5133333333333333}}}
\ No newline at end of file diff --git a/runs/ptrm_color_esan_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/ptrm_color_esan_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..01e2418 --- /dev/null +++ b/runs/ptrm_color_esan_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1 @@ +{"conv": "esan", "pe": "none", "grad_mode": "full", "contract": false, "seed": 1, "det": 0.45333333333333337, "sigmas": {"0.2": {"passk": 0.4533333333333333, "lamsel": 0.4533333333333333, "random": 0.4533333333333333}}}
\ No newline at end of file diff --git a/runs/ptrm_color_esan_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/ptrm_color_esan_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..e72c48a --- /dev/null +++ b/runs/ptrm_color_esan_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1 @@ +{"conv": "esan", "pe": "none", "grad_mode": "full", "contract": false, "seed": 2, "det": 0.7733333333333333, "sigmas": {"0.2": {"passk": 0.7733333333333333, "lamsel": 0.7733333333333333, "random": 0.7733333333333333}}}
\ No newline at end of file diff --git a/runs/ptrm_color_esan_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/ptrm_color_esan_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..7cad929 --- /dev/null +++ b/runs/ptrm_color_esan_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1 @@ +{"conv": "esan", "pe": "none", "grad_mode": "full", "contract": false, "seed": 3, "det": 0.6133333333333333, "sigmas": {"0.2": {"passk": 0.6133333333333333, "lamsel": 0.6133333333333333, "random": 0.6133333333333333}}}
\ No newline at end of file diff --git a/runs/ptrm_color_esan_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/ptrm_color_esan_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..5741e75 --- /dev/null +++ b/runs/ptrm_color_esan_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1 @@ +{"conv": "esan", "pe": "none", "grad_mode": "full", "contract": false, "seed": 4, "det": 0.72, "sigmas": {"0.2": {"passk": 0.72, "lamsel": 0.72, "random": 0.72}}}
\ No newline at end of file diff --git a/runs/ptrm_color_full_gsn_n50_k3_p0.2_T3_ns3_s0.json b/runs/ptrm_color_full_gsn_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..e7ccd9f --- /dev/null +++ b/runs/ptrm_color_full_gsn_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,15 @@ +{ + "pe": "gsn", + "seed": 0, + "grad_mode": "full", + "det": 0.6266666666666667, + "sigmas": { + "0.2": { + "passk": 0.8533333333333334, + "lamsel": 0.7333333333333333, + "random": 0.6133333333333333, + "perRoll": 0.6233333333333333, + "auroc": 0.8884251810136766 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_gsn_n50_k3_p0.2_T3_ns3_s1.json b/runs/ptrm_color_full_gsn_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..41fae0b --- /dev/null +++ b/runs/ptrm_color_full_gsn_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,15 @@ +{ + "pe": "gsn", + "seed": 1, + "grad_mode": "full", + "det": 0.5266666666666666, + "sigmas": { + "0.2": { + "passk": 0.7866666666666666, + "lamsel": 0.64, + "random": 0.5266666666666666, + "perRoll": 0.5241666666666667, + "auroc": 0.862321423102303 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_gsn_n50_k3_p0.2_T3_ns3_s2.json b/runs/ptrm_color_full_gsn_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..5db7789 --- /dev/null +++ b/runs/ptrm_color_full_gsn_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,15 @@ +{ + "pe": "gsn", + "seed": 2, + "grad_mode": "full", + "det": 0.6266666666666667, + "sigmas": { + "0.2": { + "passk": 0.8266666666666667, + "lamsel": 0.7133333333333334, + "random": 0.6266666666666667, + "perRoll": 0.6245833333333334, + "auroc": 0.8630370672568245 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_gsn_n50_k3_p0.2_T3_ns3_s3.json b/runs/ptrm_color_full_gsn_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..fa8268e --- /dev/null +++ b/runs/ptrm_color_full_gsn_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,15 @@ +{ + "pe": "gsn", + "seed": 3, + "grad_mode": "full", + "det": 0.5733333333333334, + "sigmas": { + "0.2": { + "passk": 0.8066666666666666, + "lamsel": 0.66, + "random": 0.5733333333333334, + "perRoll": 0.5645833333333333, + "auroc": 0.8653351930648494 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_gsn_n50_k3_p0.2_T3_ns3_s4.json b/runs/ptrm_color_full_gsn_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..f9b9749 --- /dev/null +++ b/runs/ptrm_color_full_gsn_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,15 @@ +{ + "pe": "gsn", + "seed": 4, + "grad_mode": "full", + "det": 0.62, + "sigmas": { + "0.2": { + "passk": 0.8466666666666667, + "lamsel": 0.74, + "random": 0.6266666666666667, + "perRoll": 0.6354166666666666, + "auroc": 0.8955960655737706 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s0.json b/runs/ptrm_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..b2d510c --- /dev/null +++ b/runs/ptrm_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,16 @@ +{ + "pe": "none", + "seed": 0, + "grad_mode": "full", + "contract": true, + "det": 0.0, + "sigmas": { + "0.2": { + "passk": 0.0, + "lamsel": 0.0, + "random": 0.0, + "perRoll": 0.0, + "auroc": NaN + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s1.json b/runs/ptrm_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..fd60315 --- /dev/null +++ b/runs/ptrm_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,16 @@ +{ + "pe": "none", + "seed": 1, + "grad_mode": "full", + "contract": true, + "det": 0.0, + "sigmas": { + "0.2": { + "passk": 0.0, + "lamsel": 0.0, + "random": 0.0, + "perRoll": 0.0, + "auroc": NaN + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s2.json b/runs/ptrm_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..8fd27b1 --- /dev/null +++ b/runs/ptrm_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,16 @@ +{ + "pe": "none", + "seed": 2, + "grad_mode": "full", + "contract": true, + "det": 0.0, + "sigmas": { + "0.2": { + "passk": 0.0, + "lamsel": 0.0, + "random": 0.0, + "perRoll": 0.0, + "auroc": NaN + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s3.json b/runs/ptrm_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..f957227 --- /dev/null +++ b/runs/ptrm_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,16 @@ +{ + "pe": "none", + "seed": 3, + "grad_mode": "full", + "contract": true, + "det": 0.0, + "sigmas": { + "0.2": { + "passk": 0.0, + "lamsel": 0.0, + "random": 0.0, + "perRoll": 0.0, + "auroc": NaN + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s4.json b/runs/ptrm_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..b073283 --- /dev/null +++ b/runs/ptrm_color_full_none_ctr_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,16 @@ +{ + "pe": "none", + "seed": 4, + "grad_mode": "full", + "contract": true, + "det": 0.0, + "sigmas": { + "0.2": { + "passk": 0.0, + "lamsel": 0.0, + "random": 0.0, + "perRoll": 0.0, + "auroc": NaN + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/ptrm_color_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..6aba919 --- /dev/null +++ b/runs/ptrm_color_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,15 @@ +{ + "pe": "none", + "seed": 0, + "grad_mode": "full", + "det": 0.6266666666666667, + "sigmas": { + "0.2": { + "passk": 0.9, + "lamsel": 0.7733333333333333, + "random": 0.64, + "perRoll": 0.5954166666666667, + "auroc": 0.8829923628472736 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/ptrm_color_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..704aa9b --- /dev/null +++ b/runs/ptrm_color_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,15 @@ +{ + "pe": "none", + "seed": 1, + "grad_mode": "full", + "det": 0.48, + "sigmas": { + "0.2": { + "passk": 0.74, + "lamsel": 0.5933333333333334, + "random": 0.44, + "perRoll": 0.4558333333333333, + "auroc": 0.8691883334126559 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/ptrm_color_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..8b223e1 --- /dev/null +++ b/runs/ptrm_color_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,15 @@ +{ + "pe": "none", + "seed": 2, + "grad_mode": "full", + "det": 0.44666666666666666, + "sigmas": { + "0.2": { + "passk": 0.7733333333333333, + "lamsel": 0.62, + "random": 0.4666666666666667, + "perRoll": 0.4345833333333333, + "auroc": 0.8206013914569601 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/ptrm_color_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..1dec48a --- /dev/null +++ b/runs/ptrm_color_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,15 @@ +{ + "pe": "none", + "seed": 3, + "grad_mode": "full", + "det": 0.49333333333333335, + "sigmas": { + "0.2": { + "passk": 0.7333333333333333, + "lamsel": 0.5866666666666667, + "random": 0.49333333333333335, + "perRoll": 0.4716666666666667, + "auroc": 0.8563686448707517 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/ptrm_color_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..4b91166 --- /dev/null +++ b/runs/ptrm_color_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,15 @@ +{ + "pe": "none", + "seed": 4, + "grad_mode": "full", + "det": 0.35333333333333333, + "sigmas": { + "0.2": { + "passk": 0.5466666666666666, + "lamsel": 0.4266666666666667, + "random": 0.37333333333333335, + "perRoll": 0.35791666666666666, + "auroc": 0.834668838325959 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_rwse_n50_k3_p0.2_T3_ns3_s0.json b/runs/ptrm_color_full_rwse_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..1cb1224 --- /dev/null +++ b/runs/ptrm_color_full_rwse_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,15 @@ +{ + "pe": "rwse", + "seed": 0, + "grad_mode": "full", + "det": 0.4066666666666667, + "sigmas": { + "0.2": { + "passk": 0.74, + "lamsel": 0.5866666666666667, + "random": 0.49333333333333335, + "perRoll": 0.42625, + "auroc": 0.8078394458322773 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_rwse_n50_k3_p0.2_T3_ns3_s1.json b/runs/ptrm_color_full_rwse_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..1918714 --- /dev/null +++ b/runs/ptrm_color_full_rwse_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,15 @@ +{ + "pe": "rwse", + "seed": 1, + "grad_mode": "full", + "det": 0.5466666666666666, + "sigmas": { + "0.2": { + "passk": 0.9466666666666667, + "lamsel": 0.7266666666666667, + "random": 0.5533333333333333, + "perRoll": 0.5070833333333333, + "auroc": 0.8140779642581045 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_rwse_n50_k3_p0.2_T3_ns3_s2.json b/runs/ptrm_color_full_rwse_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..59d1b2a --- /dev/null +++ b/runs/ptrm_color_full_rwse_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,15 @@ +{ + "pe": "rwse", + "seed": 2, + "grad_mode": "full", + "det": 0.6, + "sigmas": { + "0.2": { + "passk": 0.8933333333333333, + "lamsel": 0.7866666666666666, + "random": 0.5733333333333334, + "perRoll": 0.55625, + "auroc": 0.8734314501239648 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_rwse_n50_k3_p0.2_T3_ns3_s3.json b/runs/ptrm_color_full_rwse_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..f3c83d4 --- /dev/null +++ b/runs/ptrm_color_full_rwse_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,15 @@ +{ + "pe": "rwse", + "seed": 3, + "grad_mode": "full", + "det": 0.5066666666666667, + "sigmas": { + "0.2": { + "passk": 0.8933333333333333, + "lamsel": 0.7266666666666667, + "random": 0.47333333333333333, + "perRoll": 0.4970833333333333, + "auroc": 0.8230412007075241 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_rwse_n50_k3_p0.2_T3_ns3_s4.json b/runs/ptrm_color_full_rwse_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..d41321f --- /dev/null +++ b/runs/ptrm_color_full_rwse_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,15 @@ +{ + "pe": "rwse", + "seed": 4, + "grad_mode": "full", + "det": 0.5466666666666666, + "sigmas": { + "0.2": { + "passk": 0.94, + "lamsel": 0.8533333333333334, + "random": 0.49333333333333335, + "perRoll": 0.5575, + "auroc": 0.8680135063999166 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_sub_n50_k3_p0.2_T3_ns3_s0.json b/runs/ptrm_color_full_sub_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..31cc229 --- /dev/null +++ b/runs/ptrm_color_full_sub_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,16 @@ +{ + "pe": "sub", + "seed": 0, + "grad_mode": "full", + "contract": false, + "det": 0.7333333333333333, + "sigmas": { + "0.2": { + "passk": 0.92, + "lamsel": 0.86, + "random": 0.7266666666666667, + "perRoll": 0.7316666666666667, + "auroc": 0.9117701155930333 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_sub_n50_k3_p0.2_T3_ns3_s1.json b/runs/ptrm_color_full_sub_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..ab49809 --- /dev/null +++ b/runs/ptrm_color_full_sub_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,16 @@ +{ + "pe": "sub", + "seed": 1, + "grad_mode": "full", + "contract": false, + "det": 0.54, + "sigmas": { + "0.2": { + "passk": 0.8666666666666667, + "lamsel": 0.7133333333333334, + "random": 0.54, + "perRoll": 0.5695833333333333, + "auroc": 0.8928419932993937 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_sub_n50_k3_p0.2_T3_ns3_s2.json b/runs/ptrm_color_full_sub_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..58177d5 --- /dev/null +++ b/runs/ptrm_color_full_sub_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,16 @@ +{ + "pe": "sub", + "seed": 2, + "grad_mode": "full", + "contract": false, + "det": 0.7066666666666667, + "sigmas": { + "0.2": { + "passk": 0.8933333333333333, + "lamsel": 0.8, + "random": 0.7, + "perRoll": 0.6879166666666666, + "auroc": 0.9192786020367153 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_sub_n50_k3_p0.2_T3_ns3_s3.json b/runs/ptrm_color_full_sub_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..dfe302e --- /dev/null +++ b/runs/ptrm_color_full_sub_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,16 @@ +{ + "pe": "sub", + "seed": 3, + "grad_mode": "full", + "contract": false, + "det": 0.28, + "sigmas": { + "0.2": { + "passk": 0.38, + "lamsel": 0.26, + "random": 0.26, + "perRoll": 0.24666666666666667, + "auroc": 0.8310353010643388 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_full_sub_n50_k3_p0.2_T3_ns3_s4.json b/runs/ptrm_color_full_sub_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..ed96dea --- /dev/null +++ b/runs/ptrm_color_full_sub_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,16 @@ +{ + "pe": "sub", + "seed": 4, + "grad_mode": "full", + "contract": false, + "det": 0.6466666666666666, + "sigmas": { + "0.2": { + "passk": 0.9066666666666666, + "lamsel": 0.7933333333333333, + "random": 0.6466666666666666, + "perRoll": 0.6445833333333333, + "auroc": 0.9136490018498156 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gat_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/ptrm_color_gat_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..654be97 --- /dev/null +++ b/runs/ptrm_color_gat_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,17 @@ +{ + "conv": "gat", + "pe": "none", + "seed": 0, + "grad_mode": "full", + "contract": false, + "det": 0.006666666666666667, + "sigmas": { + "0.2": { + "passk": 0.04666666666666667, + "lamsel": 0.02, + "random": 0.02666666666666667, + "perRoll": 0.02, + "auroc": 0.20287698412698413 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gat_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/ptrm_color_gat_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..4bf9cab --- /dev/null +++ b/runs/ptrm_color_gat_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,17 @@ +{ + "conv": "gat", + "pe": "none", + "seed": 1, + "grad_mode": "full", + "contract": false, + "det": 0.013333333333333334, + "sigmas": { + "0.2": { + "passk": 0.03333333333333333, + "lamsel": 0.02, + "random": 0.013333333333333334, + "perRoll": 0.014166666666666666, + "auroc": 0.17698025955944507 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gat_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/ptrm_color_gat_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..8a6bd7b --- /dev/null +++ b/runs/ptrm_color_gat_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,17 @@ +{ + "conv": "gat", + "pe": "none", + "seed": 2, + "grad_mode": "full", + "contract": false, + "det": 0.006666666666666667, + "sigmas": { + "0.2": { + "passk": 0.03333333333333333, + "lamsel": 0.013333333333333334, + "random": 0.02, + "perRoll": 0.0125, + "auroc": 0.2478621659634318 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gat_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/ptrm_color_gat_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..1ec43f4 --- /dev/null +++ b/runs/ptrm_color_gat_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,17 @@ +{ + "conv": "gat", + "pe": "none", + "seed": 3, + "grad_mode": "full", + "contract": false, + "det": 0.11333333333333333, + "sigmas": { + "0.2": { + "passk": 0.22, + "lamsel": 0.11333333333333333, + "random": 0.11333333333333333, + "perRoll": 0.10541666666666667, + "auroc": 0.6144615798126258 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gat_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/ptrm_color_gat_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..0cc60ce --- /dev/null +++ b/runs/ptrm_color_gat_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,17 @@ +{ + "conv": "gat", + "pe": "none", + "seed": 4, + "grad_mode": "full", + "contract": false, + "det": 0.13333333333333333, + "sigmas": { + "0.2": { + "passk": 0.22666666666666666, + "lamsel": 0.14666666666666667, + "random": 0.12, + "perRoll": 0.11333333333333333, + "auroc": 0.4537676912870411 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/ptrm_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..a48eef3 --- /dev/null +++ b/runs/ptrm_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,17 @@ +{ + "conv": "gcn", + "pe": "none", + "seed": 0, + "grad_mode": "full", + "contract": false, + "det": 0.0, + "sigmas": { + "0.2": { + "passk": 0.0, + "lamsel": 0.0, + "random": 0.0, + "perRoll": 0.0, + "auroc": NaN + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/ptrm_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..b14d8f5 --- /dev/null +++ b/runs/ptrm_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,17 @@ +{ + "conv": "gcn", + "pe": "none", + "seed": 1, + "grad_mode": "full", + "contract": false, + "det": 0.0, + "sigmas": { + "0.2": { + "passk": 0.006666666666666667, + "lamsel": 0.0, + "random": 0.0, + "perRoll": 0.0004166666666666667, + "auroc": 0.940808670279283 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/ptrm_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..fe87e26 --- /dev/null +++ b/runs/ptrm_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,17 @@ +{ + "conv": "gcn", + "pe": "none", + "seed": 2, + "grad_mode": "full", + "contract": false, + "det": 0.006666666666666667, + "sigmas": { + "0.2": { + "passk": 0.006666666666666667, + "lamsel": 0.006666666666666667, + "random": 0.0, + "perRoll": 0.0025, + "auroc": 0.5626566416040101 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/ptrm_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..af2a103 --- /dev/null +++ b/runs/ptrm_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,17 @@ +{ + "conv": "gcn", + "pe": "none", + "seed": 3, + "grad_mode": "full", + "contract": false, + "det": 0.006666666666666667, + "sigmas": { + "0.2": { + "passk": 0.013333333333333334, + "lamsel": 0.0, + "random": 0.006666666666666667, + "perRoll": 0.00375, + "auroc": 0.6968725312514522 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/ptrm_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..419d757 --- /dev/null +++ b/runs/ptrm_color_gcn_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,17 @@ +{ + "conv": "gcn", + "pe": "none", + "seed": 4, + "grad_mode": "full", + "contract": false, + "det": 0.0, + "sigmas": { + "0.2": { + "passk": 0.006666666666666667, + "lamsel": 0.0, + "random": 0.0, + "perRoll": 0.0008333333333333334, + "auroc": 0.06234361968306923 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gin_full_all_n50_k3_p0.2_T3_ns3_s0.json b/runs/ptrm_color_gin_full_all_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..99119c2 --- /dev/null +++ b/runs/ptrm_color_gin_full_all_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,17 @@ +{ + "conv": "gin", + "pe": "all", + "seed": 0, + "grad_mode": "full", + "contract": false, + "det": 0.6933333333333334, + "sigmas": { + "0.2": { + "passk": 0.8866666666666667, + "lamsel": 0.8333333333333334, + "random": 0.6933333333333334, + "perRoll": 0.6941666666666667, + "auroc": 0.8982764768032554 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gin_full_all_n50_k3_p0.2_T3_ns3_s1.json b/runs/ptrm_color_gin_full_all_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..a703c1d --- /dev/null +++ b/runs/ptrm_color_gin_full_all_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,17 @@ +{ + "conv": "gin", + "pe": "all", + "seed": 1, + "grad_mode": "full", + "contract": false, + "det": 0.76, + "sigmas": { + "0.2": { + "passk": 0.94, + "lamsel": 0.82, + "random": 0.7733333333333333, + "perRoll": 0.7354166666666667, + "auroc": 0.8783663090272357 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gin_full_all_n50_k3_p0.2_T3_ns3_s2.json b/runs/ptrm_color_gin_full_all_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..ea4f20a --- /dev/null +++ b/runs/ptrm_color_gin_full_all_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,17 @@ +{ + "conv": "gin", + "pe": "all", + "seed": 2, + "grad_mode": "full", + "contract": false, + "det": 0.32666666666666666, + "sigmas": { + "0.2": { + "passk": 0.46, + "lamsel": 0.32666666666666666, + "random": 0.28, + "perRoll": 0.30291666666666667, + "auroc": 0.6564342979484012 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gin_full_all_n50_k3_p0.2_T3_ns3_s3.json b/runs/ptrm_color_gin_full_all_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..21b9d62 --- /dev/null +++ b/runs/ptrm_color_gin_full_all_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,17 @@ +{ + "conv": "gin", + "pe": "all", + "seed": 3, + "grad_mode": "full", + "contract": false, + "det": 0.4666666666666667, + "sigmas": { + "0.2": { + "passk": 0.76, + "lamsel": 0.6266666666666667, + "random": 0.4266666666666667, + "perRoll": 0.45625, + "auroc": 0.8906062037474413 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gin_full_all_n50_k3_p0.2_T3_ns3_s4.json b/runs/ptrm_color_gin_full_all_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..631b63f --- /dev/null +++ b/runs/ptrm_color_gin_full_all_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,17 @@ +{ + "conv": "gin", + "pe": "all", + "seed": 4, + "grad_mode": "full", + "contract": false, + "det": 0.5933333333333334, + "sigmas": { + "0.2": { + "passk": 0.7866666666666666, + "lamsel": 0.7066666666666667, + "random": 0.5666666666666667, + "perRoll": 0.575, + "auroc": 0.9012666950838306 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s0.json b/runs/ptrm_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..e8b66bb --- /dev/null +++ b/runs/ptrm_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,17 @@ +{ + "conv": "gin", + "pe": "lappe", + "seed": 0, + "grad_mode": "full", + "contract": false, + "det": 0.42, + "sigmas": { + "0.2": { + "passk": 0.76, + "lamsel": 0.6, + "random": 0.38666666666666666, + "perRoll": 0.3779166666666667, + "auroc": 0.8389898910830477 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s1.json b/runs/ptrm_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..a054d9e --- /dev/null +++ b/runs/ptrm_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,17 @@ +{ + "conv": "gin", + "pe": "lappe", + "seed": 1, + "grad_mode": "full", + "contract": false, + "det": 0.62, + "sigmas": { + "0.2": { + "passk": 0.9266666666666666, + "lamsel": 0.7866666666666666, + "random": 0.5733333333333334, + "perRoll": 0.5829166666666666, + "auroc": 0.8634389199078263 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s2.json b/runs/ptrm_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..a92273c --- /dev/null +++ b/runs/ptrm_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,17 @@ +{ + "conv": "gin", + "pe": "lappe", + "seed": 2, + "grad_mode": "full", + "contract": false, + "det": 0.41333333333333333, + "sigmas": { + "0.2": { + "passk": 0.76, + "lamsel": 0.54, + "random": 0.3933333333333333, + "perRoll": 0.40041666666666664, + "auroc": 0.8344894961887482 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s3.json b/runs/ptrm_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..f4e112d --- /dev/null +++ b/runs/ptrm_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,17 @@ +{ + "conv": "gin", + "pe": "lappe", + "seed": 3, + "grad_mode": "full", + "contract": false, + "det": 0.5666666666666667, + "sigmas": { + "0.2": { + "passk": 0.8533333333333334, + "lamsel": 0.7266666666666667, + "random": 0.52, + "perRoll": 0.5191666666666667, + "auroc": 0.8635606210236708 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s4.json b/runs/ptrm_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..1412f8a --- /dev/null +++ b/runs/ptrm_color_gin_full_lappe_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,17 @@ +{ + "conv": "gin", + "pe": "lappe", + "seed": 4, + "grad_mode": "full", + "contract": false, + "det": 0.34, + "sigmas": { + "0.2": { + "passk": 0.7533333333333333, + "lamsel": 0.5066666666666667, + "random": 0.30666666666666664, + "perRoll": 0.3333333333333333, + "auroc": 0.78412109375 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gps_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/ptrm_color_gps_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..5e7e845 --- /dev/null +++ b/runs/ptrm_color_gps_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,17 @@ +{ + "conv": "gps", + "pe": "none", + "seed": 0, + "grad_mode": "full", + "contract": false, + "det": 0.94, + "sigmas": { + "0.2": { + "passk": 0.9866666666666667, + "lamsel": 0.96, + "random": 0.92, + "perRoll": 0.9245833333333333, + "auroc": 0.8191261306795405 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gps_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/ptrm_color_gps_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..f6d82a8 --- /dev/null +++ b/runs/ptrm_color_gps_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,17 @@ +{ + "conv": "gps", + "pe": "none", + "seed": 1, + "grad_mode": "full", + "contract": false, + "det": 0.94, + "sigmas": { + "0.2": { + "passk": 0.9866666666666667, + "lamsel": 0.9533333333333334, + "random": 0.96, + "perRoll": 0.9383333333333334, + "auroc": 0.8573040180500215 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gps_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/ptrm_color_gps_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..763a720 --- /dev/null +++ b/runs/ptrm_color_gps_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,17 @@ +{ + "conv": "gps", + "pe": "none", + "seed": 2, + "grad_mode": "full", + "contract": false, + "det": 0.9533333333333334, + "sigmas": { + "0.2": { + "passk": 0.98, + "lamsel": 0.9533333333333334, + "random": 0.9266666666666666, + "perRoll": 0.9345833333333333, + "auroc": 0.8720889618373937 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gps_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/ptrm_color_gps_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..15a4af2 --- /dev/null +++ b/runs/ptrm_color_gps_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,17 @@ +{ + "conv": "gps", + "pe": "none", + "seed": 3, + "grad_mode": "full", + "contract": false, + "det": 0.9333333333333333, + "sigmas": { + "0.2": { + "passk": 0.9866666666666667, + "lamsel": 0.9733333333333334, + "random": 0.9533333333333334, + "perRoll": 0.9395833333333333, + "auroc": 0.8657756709228535 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_gps_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/ptrm_color_gps_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..37d6217 --- /dev/null +++ b/runs/ptrm_color_gps_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,17 @@ +{ + "conv": "gps", + "pe": "none", + "seed": 4, + "grad_mode": "full", + "contract": false, + "det": 0.96, + "sigmas": { + "0.2": { + "passk": 0.9933333333333333, + "lamsel": 0.9666666666666667, + "random": 0.9466666666666667, + "perRoll": 0.9520833333333333, + "auroc": 0.9001503187137284 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_pna_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/ptrm_color_pna_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..cb7503a --- /dev/null +++ b/runs/ptrm_color_pna_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,17 @@ +{ + "conv": "pna", + "pe": "none", + "seed": 0, + "grad_mode": "full", + "contract": false, + "det": 0.92, + "sigmas": { + "0.2": { + "passk": 0.98, + "lamsel": 0.9133333333333333, + "random": 0.92, + "perRoll": 0.9095833333333333, + "auroc": 0.8190162356373399 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_pna_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/ptrm_color_pna_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..43eab37 --- /dev/null +++ b/runs/ptrm_color_pna_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,17 @@ +{ + "conv": "pna", + "pe": "none", + "seed": 1, + "grad_mode": "full", + "contract": false, + "det": 0.94, + "sigmas": { + "0.2": { + "passk": 0.9866666666666667, + "lamsel": 0.9666666666666667, + "random": 0.9533333333333334, + "perRoll": 0.9329166666666666, + "auroc": 0.7938964544397871 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_pna_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/ptrm_color_pna_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..a7ea67f --- /dev/null +++ b/runs/ptrm_color_pna_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,17 @@ +{ + "conv": "pna", + "pe": "none", + "seed": 2, + "grad_mode": "full", + "contract": false, + "det": 0.94, + "sigmas": { + "0.2": { + "passk": 1.0, + "lamsel": 0.9466666666666667, + "random": 0.9533333333333334, + "perRoll": 0.93375, + "auroc": 0.7995644352392097 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_pna_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/ptrm_color_pna_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..a6a2b71 --- /dev/null +++ b/runs/ptrm_color_pna_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,17 @@ +{ + "conv": "pna", + "pe": "none", + "seed": 3, + "grad_mode": "full", + "contract": false, + "det": 0.96, + "sigmas": { + "0.2": { + "passk": 0.9933333333333333, + "lamsel": 0.9866666666666667, + "random": 0.9333333333333333, + "perRoll": 0.945, + "auroc": 0.8850709475709475 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_pna_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/ptrm_color_pna_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..a162925 --- /dev/null +++ b/runs/ptrm_color_pna_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,17 @@ +{ + "conv": "pna", + "pe": "none", + "seed": 4, + "grad_mode": "full", + "contract": false, + "det": 0.9466666666666667, + "sigmas": { + "0.2": { + "passk": 0.9933333333333333, + "lamsel": 0.9733333333333334, + "random": 0.92, + "perRoll": 0.935, + "auroc": 0.8440056675350792 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/ptrm_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..fd253fa --- /dev/null +++ b/runs/ptrm_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,17 @@ +{ + "conv": "ppgn", + "pe": "none", + "grad_mode": "full", + "contract": false, + "seed": 0, + "det": 0.9533333333333334, + "sigmas": { + "0.2": { + "passk": 0.9866666666666667, + "lamsel": 0.9666666666666667, + "random": 0.9466666666666667, + "perRoll": 0.9445833333333333, + "auroc": 0.8244442159655867 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/ptrm_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..1cb63f5 --- /dev/null +++ b/runs/ptrm_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,17 @@ +{ + "conv": "ppgn", + "pe": "none", + "grad_mode": "full", + "contract": false, + "seed": 1, + "det": 0.9666666666666667, + "sigmas": { + "0.2": { + "passk": 0.9866666666666667, + "lamsel": 0.9533333333333334, + "random": 0.9333333333333333, + "perRoll": 0.9533333333333334, + "auroc": 0.8222792832167831 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/ptrm_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..b8ec6f3 --- /dev/null +++ b/runs/ptrm_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,17 @@ +{ + "conv": "ppgn", + "pe": "none", + "grad_mode": "full", + "contract": false, + "seed": 2, + "det": 0.9666666666666667, + "sigmas": { + "0.2": { + "passk": 0.9733333333333334, + "lamsel": 0.9666666666666667, + "random": 0.96, + "perRoll": 0.95625, + "auroc": 0.79279593318809 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/ptrm_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..0c0cbd5 --- /dev/null +++ b/runs/ptrm_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,17 @@ +{ + "conv": "ppgn", + "pe": "none", + "grad_mode": "full", + "contract": false, + "seed": 3, + "det": 0.9666666666666667, + "sigmas": { + "0.2": { + "passk": 0.9866666666666667, + "lamsel": 0.9733333333333334, + "random": 0.9533333333333334, + "perRoll": 0.9595833333333333, + "auroc": 0.7407639519944851 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/ptrm_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..f03ea8a --- /dev/null +++ b/runs/ptrm_color_ppgn_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,17 @@ +{ + "conv": "ppgn", + "pe": "none", + "grad_mode": "full", + "contract": false, + "seed": 4, + "det": 0.96, + "sigmas": { + "0.2": { + "passk": 0.98, + "lamsel": 0.96, + "random": 0.9533333333333334, + "perRoll": 0.9570833333333333, + "auroc": 0.7987074740797411 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_sage_full_none_n50_k3_p0.2_T3_ns3_s0.json b/runs/ptrm_color_sage_full_none_n50_k3_p0.2_T3_ns3_s0.json new file mode 100644 index 0000000..3149f14 --- /dev/null +++ b/runs/ptrm_color_sage_full_none_n50_k3_p0.2_T3_ns3_s0.json @@ -0,0 +1,17 @@ +{ + "conv": "sage", + "pe": "none", + "seed": 0, + "grad_mode": "full", + "contract": false, + "det": 0.7466666666666667, + "sigmas": { + "0.2": { + "passk": 0.9533333333333334, + "lamsel": 0.8133333333333334, + "random": 0.7666666666666667, + "perRoll": 0.7625, + "auroc": 0.7712002684306394 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_sage_full_none_n50_k3_p0.2_T3_ns3_s1.json b/runs/ptrm_color_sage_full_none_n50_k3_p0.2_T3_ns3_s1.json new file mode 100644 index 0000000..afb5102 --- /dev/null +++ b/runs/ptrm_color_sage_full_none_n50_k3_p0.2_T3_ns3_s1.json @@ -0,0 +1,17 @@ +{ + "conv": "sage", + "pe": "none", + "seed": 1, + "grad_mode": "full", + "contract": false, + "det": 0.8266666666666667, + "sigmas": { + "0.2": { + "passk": 0.9733333333333334, + "lamsel": 0.8733333333333333, + "random": 0.7933333333333333, + "perRoll": 0.7808333333333334, + "auroc": 0.7023538028900586 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_sage_full_none_n50_k3_p0.2_T3_ns3_s2.json b/runs/ptrm_color_sage_full_none_n50_k3_p0.2_T3_ns3_s2.json new file mode 100644 index 0000000..4f2366a --- /dev/null +++ b/runs/ptrm_color_sage_full_none_n50_k3_p0.2_T3_ns3_s2.json @@ -0,0 +1,17 @@ +{ + "conv": "sage", + "pe": "none", + "seed": 2, + "grad_mode": "full", + "contract": false, + "det": 0.8466666666666667, + "sigmas": { + "0.2": { + "passk": 0.98, + "lamsel": 0.9066666666666666, + "random": 0.8333333333333334, + "perRoll": 0.8204166666666667, + "auroc": 0.7895241675199938 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_sage_full_none_n50_k3_p0.2_T3_ns3_s3.json b/runs/ptrm_color_sage_full_none_n50_k3_p0.2_T3_ns3_s3.json new file mode 100644 index 0000000..b978b19 --- /dev/null +++ b/runs/ptrm_color_sage_full_none_n50_k3_p0.2_T3_ns3_s3.json @@ -0,0 +1,17 @@ +{ + "conv": "sage", + "pe": "none", + "seed": 3, + "grad_mode": "full", + "contract": false, + "det": 0.8133333333333334, + "sigmas": { + "0.2": { + "passk": 0.9533333333333334, + "lamsel": 0.88, + "random": 0.78, + "perRoll": 0.8016666666666666, + "auroc": 0.750294816471287 + } + } +}
\ No newline at end of file diff --git a/runs/ptrm_color_sage_full_none_n50_k3_p0.2_T3_ns3_s4.json b/runs/ptrm_color_sage_full_none_n50_k3_p0.2_T3_ns3_s4.json new file mode 100644 index 0000000..b4daa33 --- /dev/null +++ b/runs/ptrm_color_sage_full_none_n50_k3_p0.2_T3_ns3_s4.json @@ -0,0 +1,17 @@ +{ + "conv": "sage", + "pe": "none", + "seed": 4, + "grad_mode": "full", + "contract": false, + "det": 0.84, + "sigmas": { + "0.2": { + "passk": 0.9866666666666667, + "lamsel": 0.8933333333333333, + "random": 0.8466666666666667, + "perRoll": 0.8345833333333333, + "auroc": 0.7519149487355867 + } + } +}
\ No newline at end of file diff --git a/runs/real_gcn_L5_rni0_s0.json b/runs/real_gcn_L5_rni0_s0.json new file mode 100644 index 0000000..b9ec4df --- /dev/null +++ b/runs/real_gcn_L5_rni0_s0.json @@ -0,0 +1,18 @@ +{ + "dataset": "Peptides-struct", + "tag": "gcn_L5_rni0_s0", + "conv": "gcn", + "layers": 5, + "hidden": 128, + "rni": 0, + "epochs": 150, + "lr": 0.001, + "bs": 128, + "seed": 0, + "sec": 161.5, + "dev": "cuda", + "ep": 150, + "train_mae": 0.244050630256077, + "val_mae": 0.25049042685914025, + "test_mae": 0.2555193755450103 +}
\ No newline at end of file diff --git a/runs/real_gin_L10_rni0_s0.json b/runs/real_gin_L10_rni0_s0.json new file mode 100644 index 0000000..3b028b8 --- /dev/null +++ b/runs/real_gin_L10_rni0_s0.json @@ -0,0 +1,18 @@ +{ + "dataset": "Peptides-struct", + "tag": "gin_L10_rni0_s0", + "conv": "gin", + "layers": 10, + "hidden": 128, + "rni": 0, + "epochs": 150, + "lr": 0.001, + "bs": 128, + "seed": 0, + "sec": 243.5, + "dev": "cuda", + "ep": 135, + "train_mae": 0.2384826198831858, + "val_mae": 0.24895160110156447, + "test_mae": 0.2550770111042328 +}
\ No newline at end of file diff --git a/runs/real_gin_L3_rni0_s0.json b/runs/real_gin_L3_rni0_s0.json new file mode 100644 index 0000000..8ec6c07 --- /dev/null +++ b/runs/real_gin_L3_rni0_s0.json @@ -0,0 +1,18 @@ +{ + "dataset": "Peptides-struct", + "tag": "gin_L3_rni0_s0", + "conv": "gin", + "layers": 3, + "hidden": 128, + "rni": 0, + "epochs": 3, + "lr": 0.001, + "bs": 128, + "seed": 0, + "sec": 3.9, + "dev": "cuda", + "ep": 3, + "train_mae": 0.347590095878069, + "val_mae": 0.33667740190109574, + "test_mae": 0.3489650007594344 +}
\ No newline at end of file diff --git a/runs/real_gin_L3_rni16_s0.json b/runs/real_gin_L3_rni16_s0.json new file mode 100644 index 0000000..357741b --- /dev/null +++ b/runs/real_gin_L3_rni16_s0.json @@ -0,0 +1,18 @@ +{ + "dataset": "Peptides-struct", + "tag": "gin_L3_rni16_s0", + "conv": "gin", + "layers": 3, + "hidden": 128, + "rni": 16, + "epochs": 3, + "lr": 0.001, + "bs": 128, + "seed": 0, + "sec": 3.7, + "dev": "cuda", + "ep": 3, + "train_mae": 0.40587605805157545, + "val_mae": 0.39079357209850374, + "test_mae": 0.40458849098375466 +}
\ No newline at end of file diff --git a/runs/real_gin_L5_rni0_s0.json b/runs/real_gin_L5_rni0_s0.json new file mode 100644 index 0000000..08391be --- /dev/null +++ b/runs/real_gin_L5_rni0_s0.json @@ -0,0 +1,18 @@ +{ + "dataset": "Peptides-struct", + "tag": "gin_L5_rni0_s0", + "conv": "gin", + "layers": 5, + "hidden": 128, + "rni": 0, + "epochs": 150, + "lr": 0.001, + "bs": 128, + "seed": 0, + "sec": 161.1, + "dev": "cuda", + "ep": 135, + "train_mae": 0.23827263818608818, + "val_mae": 0.24697842829861874, + "test_mae": 0.25350159751862633 +}
\ No newline at end of file diff --git a/runs/real_gin_L5_rni16_s0.json b/runs/real_gin_L5_rni16_s0.json new file mode 100644 index 0000000..db6b7fc --- /dev/null +++ b/runs/real_gin_L5_rni16_s0.json @@ -0,0 +1,18 @@ +{ + "dataset": "Peptides-struct", + "tag": "gin_L5_rni16_s0", + "conv": "gin", + "layers": 5, + "hidden": 128, + "rni": 16, + "epochs": 150, + "lr": 0.001, + "bs": 128, + "seed": 0, + "sec": 167.8, + "dev": "cuda", + "ep": 150, + "train_mae": 0.236489369612221, + "val_mae": 0.24831518891272308, + "test_mae": 0.25482755748563857 +}
\ No newline at end of file diff --git a/runs/real_sweep_20260616_081956.log b/runs/real_sweep_20260616_081956.log new file mode 100644 index 0000000..bbf5d41 --- /dev/null +++ b/runs/real_sweep_20260616_081956.log @@ -0,0 +1,54 @@ +host=timan1.cs.illinois.edu gpu=0 start=2026-06-16T08:19:56-05:00 +===== --conv gin --layers 5 --rni 0 ===== +ep15 val_mae=0.4472 +ep30 val_mae=0.2721 +ep45 val_mae=0.2886 +ep60 val_mae=0.2730 +ep75 val_mae=0.2963 +ep90 val_mae=0.2586 +ep105 val_mae=0.2562 +ep120 val_mae=0.2491 +ep135 val_mae=0.2470 +ep150 val_mae=0.2474 +[gin_L5_rni0_s0] train_mae=0.2383 val_mae=0.2470 test_mae=0.2535 @ep135 (161.1s) + wrote /home/yurenh2/rrog/runs/real_gin_L5_rni0_s0.json +===== --conv gin --layers 10 --rni 0 ===== +ep15 val_mae=0.3038 +ep30 val_mae=0.6204 +ep45 val_mae=0.2929 +ep60 val_mae=0.2667 +ep75 val_mae=0.2624 +ep90 val_mae=0.2608 +ep105 val_mae=0.2526 +ep120 val_mae=0.2511 +ep135 val_mae=0.2490 +ep150 val_mae=0.2492 +[gin_L10_rni0_s0] train_mae=0.2385 val_mae=0.2490 test_mae=0.2551 @ep135 (243.5s) + wrote /home/yurenh2/rrog/runs/real_gin_L10_rni0_s0.json +===== --conv gin --layers 5 --rni 16 ===== +ep15 val_mae=0.4952 +ep30 val_mae=0.2769 +ep45 val_mae=0.2618 +ep60 val_mae=0.2594 +ep75 val_mae=0.2753 +ep90 val_mae=0.2532 +ep105 val_mae=0.2523 +ep120 val_mae=0.2506 +ep135 val_mae=0.2488 +ep150 val_mae=0.2483 +[gin_L5_rni16_s0] train_mae=0.2365 val_mae=0.2483 test_mae=0.2548 @ep150 (167.8s) + wrote /home/yurenh2/rrog/runs/real_gin_L5_rni16_s0.json +===== --conv gcn --layers 5 --rni 0 ===== +ep15 val_mae=0.2776 +ep30 val_mae=0.2730 +ep45 val_mae=0.2642 +ep60 val_mae=0.2619 +ep75 val_mae=0.2570 +ep90 val_mae=0.2570 +ep105 val_mae=0.2533 +ep120 val_mae=0.2520 +ep135 val_mae=0.2513 +ep150 val_mae=0.2505 +[gcn_L5_rni0_s0] train_mae=0.2441 val_mae=0.2505 test_mae=0.2555 @ep150 (161.5s) + wrote /home/yurenh2/rrog/runs/real_gcn_L5_rni0_s0.json +done=2026-06-16T08:33:03-05:00 diff --git a/runs/rec_1step_sig0.0_K1_bestq_T3_ns3_s0.json b/runs/rec_1step_sig0.0_K1_bestq_T3_ns3_s0.json new file mode 100644 index 0000000..dc1db82 --- /dev/null +++ b/runs/rec_1step_sig0.0_K1_bestq_T3_ns3_s0.json @@ -0,0 +1,35 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_1step_sig0.0_K1_bestq_T3_ns3_s0", + "grad_mode": "1step", + "sigma": 0.0, + "K": 1, + "select": "bestq", + "T": 3, + "n_sup": 3, + "hidden": 128, + "epochs": 200, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "seed": 0, + "sec": 168.0, + "dev": "cuda", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 80, + "val_mae": [ + 0.19435928761959076, + 0.2852666974067688 + ], + "test_mae": [ + 0.2114018052816391, + 0.29347068071365356 + ], + "test_mae_oracle": [ + 0.2114018052816391, + 0.29347068071365356 + ] +}
\ No newline at end of file diff --git a/runs/rec_full_sig0.0_K1_bestq_T3_ns3_s0.json b/runs/rec_full_sig0.0_K1_bestq_T3_ns3_s0.json new file mode 100644 index 0000000..ea7b4fa --- /dev/null +++ b/runs/rec_full_sig0.0_K1_bestq_T3_ns3_s0.json @@ -0,0 +1,35 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_full_sig0.0_K1_bestq_T3_ns3_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "bestq", + "T": 3, + "n_sup": 3, + "hidden": 128, + "epochs": 200, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "seed": 0, + "sec": 209.3, + "dev": "cuda", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 140, + "val_mae": [ + 0.1493159532546997, + 0.20290319621562958 + ], + "test_mae": [ + 0.14498460292816162, + 0.197983056306839 + ], + "test_mae_oracle": [ + 0.14498460292816162, + 0.197983056306839 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_appnp_full_sig0.0_K1_none_T0_ns1_trace_s0.json b/runs/rec_rrog_appnp_full_sig0.0_K1_none_T0_ns1_trace_s0.json new file mode 100644 index 0000000..1672f92 --- /dev/null +++ b/runs/rec_rrog_appnp_full_sig0.0_K1_none_T0_ns1_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_appnp_full_sig0.0_K1_none_T0_ns1_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 0, + "n_sup": 1, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "appnp", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 149.8, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 140, + "val_mae": [ + 0.516572117805481, + 0.487392783164978 + ], + "test_mae": [ + 0.5241897702217102, + 0.49413174390792847 + ], + "test_mae_oracle": [ + 0.5241897702217102, + 0.49413174390792847 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_appnp_full_sig0.0_K1_none_T1_ns3_trace_s0.json b/runs/rec_rrog_appnp_full_sig0.0_K1_none_T1_ns3_trace_s0.json new file mode 100644 index 0000000..96373c9 --- /dev/null +++ b/runs/rec_rrog_appnp_full_sig0.0_K1_none_T1_ns3_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_appnp_full_sig0.0_K1_none_T1_ns3_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "appnp", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 175.6, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 120, + "val_mae": [ + 0.48746374249458313, + 0.4855128228664398 + ], + "test_mae": [ + 0.4944251477718353, + 0.4900885820388794 + ], + "test_mae_oracle": [ + 0.4944251477718353, + 0.4900885820388794 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_arma_full_sig0.0_K1_none_T0_ns1_trace_s0.json b/runs/rec_rrog_arma_full_sig0.0_K1_none_T0_ns1_trace_s0.json new file mode 100644 index 0000000..045ccf9 --- /dev/null +++ b/runs/rec_rrog_arma_full_sig0.0_K1_none_T0_ns1_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_arma_full_sig0.0_K1_none_T0_ns1_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 0, + "n_sup": 1, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "arma", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 136.4, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.14000031352043152, + 0.2056213617324829 + ], + "test_mae": [ + 0.13872109353542328, + 0.201865091919899 + ], + "test_mae_oracle": [ + 0.13872109353542328, + 0.201865091919899 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_arma_full_sig0.0_K1_none_T1_ns3_trace_s0.json b/runs/rec_rrog_arma_full_sig0.0_K1_none_T1_ns3_trace_s0.json new file mode 100644 index 0000000..65b4a32 --- /dev/null +++ b/runs/rec_rrog_arma_full_sig0.0_K1_none_T1_ns3_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_arma_full_sig0.0_K1_none_T1_ns3_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "arma", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 213.2, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.0940091535449028, + 0.14743280410766602 + ], + "test_mae": [ + 0.10224228352308273, + 0.13551878929138184 + ], + "test_mae_oracle": [ + 0.10224228352308273, + 0.13551878929138184 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_cheb_full_sig0.0_K1_none_T0_ns1_trace_s0.json b/runs/rec_rrog_cheb_full_sig0.0_K1_none_T0_ns1_trace_s0.json new file mode 100644 index 0000000..81e7113 --- /dev/null +++ b/runs/rec_rrog_cheb_full_sig0.0_K1_none_T0_ns1_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_cheb_full_sig0.0_K1_none_T0_ns1_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 0, + "n_sup": 1, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "cheb", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 112.8, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.16218321025371552, + 0.24164889752864838 + ], + "test_mae": [ + 0.14866158366203308, + 0.23999349772930145 + ], + "test_mae_oracle": [ + 0.14866158366203308, + 0.23999349772930145 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_cheb_full_sig0.0_K1_none_T1_ns3_trace_s0.json b/runs/rec_rrog_cheb_full_sig0.0_K1_none_T1_ns3_trace_s0.json new file mode 100644 index 0000000..477b677 --- /dev/null +++ b/runs/rec_rrog_cheb_full_sig0.0_K1_none_T1_ns3_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_cheb_full_sig0.0_K1_none_T1_ns3_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "cheb", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 149.4, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.08989150822162628, + 0.19968892633914948 + ], + "test_mae": [ + 0.08699783682823181, + 0.1959630250930786 + ], + "test_mae_oracle": [ + 0.08699783682823181, + 0.1959630250930786 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_film_full_sig0.0_K1_none_T0_ns1_trace_s0.json b/runs/rec_rrog_film_full_sig0.0_K1_none_T0_ns1_trace_s0.json new file mode 100644 index 0000000..da32094 --- /dev/null +++ b/runs/rec_rrog_film_full_sig0.0_K1_none_T0_ns1_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_film_full_sig0.0_K1_none_T0_ns1_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 0, + "n_sup": 1, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "film", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 102.7, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.18675006926059723, + 0.30383461713790894 + ], + "test_mae": [ + 0.1926984190940857, + 0.3070546090602875 + ], + "test_mae_oracle": [ + 0.1926984190940857, + 0.3070546090602875 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_film_full_sig0.0_K1_none_T1_ns3_trace_s0.json b/runs/rec_rrog_film_full_sig0.0_K1_none_T1_ns3_trace_s0.json new file mode 100644 index 0000000..d5647b0 --- /dev/null +++ b/runs/rec_rrog_film_full_sig0.0_K1_none_T1_ns3_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_film_full_sig0.0_K1_none_T1_ns3_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "film", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 216.1, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.287736177444458, + 0.4021036922931671 + ], + "test_mae": [ + 0.25880178809165955, + 0.40551459789276123 + ], + "test_mae_oracle": [ + 0.25880178809165955, + 0.40551459789276123 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_bestq_T0_ns3_s0.json b/runs/rec_rrog_full_sig0.0_K1_bestq_T0_ns3_s0.json new file mode 100644 index 0000000..288f622 --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_bestq_T0_ns3_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_bestq_T0_ns3_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "bestq", + "T": 0, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 40, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "seed": 0, + "sec": 12.6, + "dev": "cuda", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 40, + "val_mae": [ + 0.5319395661354065, + 0.5700212717056274 + ], + "test_mae": [ + 0.5142009854316711, + 0.5612384080886841 + ], + "test_mae_oracle": [ + 0.5142009854316711, + 0.5612384080886841 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_bestq_T1_ns3_s0.json b/runs/rec_rrog_full_sig0.0_K1_bestq_T1_ns3_s0.json new file mode 100644 index 0000000..c8dab4a --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_bestq_T1_ns3_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_bestq_T1_ns3_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "bestq", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 40, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "seed": 0, + "sec": 21.2, + "dev": "cuda", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 40, + "val_mae": [ + 0.2092578113079071, + 0.27921929955482483 + ], + "test_mae": [ + 0.21319814026355743, + 0.30013495683670044 + ], + "test_mae_oracle": [ + 0.21319814026355743, + 0.30013495683670044 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_bestq_T2_ns2_s7.json b/runs/rec_rrog_full_sig0.0_K1_bestq_T2_ns2_s7.json new file mode 100644 index 0000000..11083e9 --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_bestq_T2_ns2_s7.json @@ -0,0 +1,38 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_bestq_T2_ns2_s7", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "bestq", + "T": 2, + "n_sup": 2, + "hidden": 16, + "agg_layers": 1, + "compute_layers": 2, + "epochs": 1, + "lr": 0.001, + "bs": 4096, + "lam_q": 1.0, + "seed": 7, + "sec": 0.9, + "dev": "cuda", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 1, + "val_mae": [ + 1.9260238409042358, + 1.1891183853149414 + ], + "test_mae": [ + 1.9688374996185303, + 1.1753125190734863 + ], + "test_mae_oracle": [ + 1.9688374996185303, + 1.1753125190734863 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_bestq_T3_ns3_s0.json b/runs/rec_rrog_full_sig0.0_K1_bestq_T3_ns3_s0.json new file mode 100644 index 0000000..6cb172d --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_bestq_T3_ns3_s0.json @@ -0,0 +1,38 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_bestq_T3_ns3_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "bestq", + "T": 3, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 40, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "seed": 0, + "sec": 22.6, + "dev": "cuda", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 40, + "val_mae": [ + 0.21103313565254211, + 0.2831687033176422 + ], + "test_mae": [ + 0.20590344071388245, + 0.28427624702453613 + ], + "test_mae_oracle": [ + 0.20590344071388245, + 0.28427624702453613 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_none_T0_ns1_s0.json b/runs/rec_rrog_full_sig0.0_K1_none_T0_ns1_s0.json new file mode 100644 index 0000000..347b24a --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_none_T0_ns1_s0.json @@ -0,0 +1,44 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_none_T0_ns1_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 0, + "n_sup": 1, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "seed": 0, + "sec": 164.1, + "dev": "cuda", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.11635636538267136, + 0.17483782768249512 + ], + "test_mae": [ + 0.12257809937000275, + 0.17185711860656738 + ], + "test_mae_oracle": [ + 0.12257809937000275, + 0.17185711860656738 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_none_T0_ns1_trace_s0.json b/runs/rec_rrog_full_sig0.0_K1_none_T0_ns1_trace_s0.json new file mode 100644 index 0000000..e349000 --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_none_T0_ns1_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_none_T0_ns1_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 0, + "n_sup": 1, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "gin", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 84.1, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.12561701238155365, + 0.17245306074619293 + ], + "test_mae": [ + 0.10868331044912338, + 0.16380010545253754 + ], + "test_mae_oracle": [ + 0.10868331044912338, + 0.16380010545253754 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_none_T0_ns1_trace_s1.json b/runs/rec_rrog_full_sig0.0_K1_none_T0_ns1_trace_s1.json new file mode 100644 index 0000000..0732284 --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_none_T0_ns1_trace_s1.json @@ -0,0 +1,45 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_none_T0_ns1_trace_s1", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 0, + "n_sup": 1, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 1, + "sec": 144.7, + "dev": "cuda", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.15358196198940277, + 0.19443191587924957 + ], + "test_mae": [ + 0.15405972301959991, + 0.19683459401130676 + ], + "test_mae_oracle": [ + 0.15405972301959991, + 0.19683459401130676 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_none_T0_ns1_trace_s2.json b/runs/rec_rrog_full_sig0.0_K1_none_T0_ns1_trace_s2.json new file mode 100644 index 0000000..d7b31d7 --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_none_T0_ns1_trace_s2.json @@ -0,0 +1,45 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_none_T0_ns1_trace_s2", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 0, + "n_sup": 1, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 2, + "sec": 146.4, + "dev": "cuda", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.1329466551542282, + 0.18285730481147766 + ], + "test_mae": [ + 0.12890464067459106, + 0.18189696967601776 + ], + "test_mae_oracle": [ + 0.12890464067459106, + 0.18189696967601776 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s123.json b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s123.json new file mode 100644 index 0000000..785aa58 --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s123.json @@ -0,0 +1,45 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s123", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 2, + "hidden": 16, + "agg_layers": 2, + "compute_layers": 1, + "epochs": 1, + "lr": 0.001, + "bs": 64, + "lam_q": 1.0, + "act": true, + "halt_max_steps": 2, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "seed": 123, + "sec": 2.1, + "dev": "cuda", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 1, + "val_mae": [ + 0.5426821708679199, + 0.6003275513648987 + ], + "test_mae": [ + 0.5365709662437439, + 0.6183863878250122 + ], + "test_mae_adaptive": [ + 0.5365839600563049, + 0.6184093952178955 + ], + "fixed_steps": 2.0, + "adaptive_steps": 1.998 +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s124.json b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s124.json new file mode 100644 index 0000000..38ec135 --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s124.json @@ -0,0 +1,46 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s124", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 2, + "hidden": 16, + "agg_layers": 2, + "compute_layers": 1, + "epochs": 1, + "lr": 0.001, + "bs": 64, + "lam_q": 1.0, + "act": true, + "halt_max_steps": 2, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "seed": 124, + "sec": 3.3, + "dev": "cuda", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 1, + "val_mae": [ + 0.5413900017738342, + 0.7144505977630615 + ], + "test_mae": [ + 0.5429546236991882, + 0.689839243888855 + ], + "test_mae_adaptive": [ + 0.5429546236991882, + 0.689839243888855 + ], + "fixed_steps": 2.0, + "adaptive_steps": 2.0 +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull2_binary0.3_e1_s125.json b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull2_binary0.3_e1_s125.json new file mode 100644 index 0000000..e958e5d --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull2_binary0.3_e1_s125.json @@ -0,0 +1,46 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull2_binary0.3_e1_s125", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 16, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 1, + "lr": 0.001, + "bs": 64, + "lam_q": 1.0, + "act": true, + "halt_max_steps": 2, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "binary", + "halt_exploration_prob": 0.1, + "seed": 125, + "sec": 3.7, + "dev": "cuda", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 1, + "val_mae": [ + 0.6040546894073486, + 0.6604375243186951 + ], + "test_mae": [ + 0.6179218888282776, + 0.6693928241729736 + ], + "test_mae_adaptive": [ + 0.6178930997848511, + 0.6693146824836731 + ], + "fixed_steps": 2.0, + "adaptive_steps": 1.999 +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_e200_s0.json b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_e200_s0.json new file mode 100644 index 0000000..1b93172 --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_e200_s0.json @@ -0,0 +1,46 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_e200_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": true, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "binary", + "halt_exploration_prob": 0.1, + "seed": 0, + "sec": 369.9, + "dev": "cuda", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 140, + "val_mae": [ + 0.34055304527282715, + 0.31270870566368103 + ], + "test_mae": [ + 0.35694342851638794, + 0.32599586248397827 + ], + "test_mae_adaptive": [ + 0.15837429463863373, + 0.22618268430233002 + ], + "fixed_steps": 8.0, + "adaptive_steps": 1.717 +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_s0.json b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_s0.json new file mode 100644 index 0000000..29112b6 --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_s0.json @@ -0,0 +1,46 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 40, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": true, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "binary", + "halt_exploration_prob": 0.1, + "seed": 0, + "sec": 70.3, + "dev": "cuda", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 40, + "val_mae": [ + 0.3755418062210083, + 0.458046019077301 + ], + "test_mae": [ + 0.3479718565940857, + 0.46119195222854614 + ], + "test_mae_adaptive": [ + 0.2506031394004822, + 0.36558955907821655 + ], + "fixed_steps": 8.0, + "adaptive_steps": 3.227 +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_s0.json b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_s0.json new file mode 100644 index 0000000..a723a4a --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_s0.json @@ -0,0 +1,46 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_none_T1_ns3_act8_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 40, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": true, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "seed": 0, + "sec": 70.9, + "dev": "cuda", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 20, + "val_mae": [ + 0.39113977551460266, + 0.46092846989631653 + ], + "test_mae": [ + 0.38368427753448486, + 0.4671553671360016 + ], + "test_mae_adaptive": [ + 0.33561548590660095, + 0.4454902708530426 + ], + "fixed_steps": 8.0, + "adaptive_steps": 5.9 +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_s0.json b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_s0.json new file mode 100644 index 0000000..0d09206 --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_s0.json @@ -0,0 +1,44 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_none_T1_ns3_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "seed": 0, + "sec": 220.1, + "dev": "cuda", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.11644899100065231, + 0.1973070651292801 + ], + "test_mae": [ + 0.128986656665802, + 0.20789974927902222 + ], + "test_mae_oracle": [ + 0.128986656665802, + 0.20789974927902222 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_trace_s0.json b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_trace_s0.json new file mode 100644 index 0000000..26a0c71 --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_none_T1_ns3_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "gin", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 124.5, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.0887933298945427, + 0.13813777267932892 + ], + "test_mae": [ + 0.08772052079439163, + 0.13452111184597015 + ], + "test_mae_oracle": [ + 0.08772052079439163, + 0.13452111184597015 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_trace_s1.json b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_trace_s1.json new file mode 100644 index 0000000..031e0f3 --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_trace_s1.json @@ -0,0 +1,45 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_none_T1_ns3_trace_s1", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 1, + "sec": 213.1, + "dev": "cuda", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 180, + "val_mae": [ + 0.08802676200866699, + 0.13726426661014557 + ], + "test_mae": [ + 0.08931108564138412, + 0.14095202088356018 + ], + "test_mae_oracle": [ + 0.08931108564138412, + 0.14095202088356018 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_trace_s2.json b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_trace_s2.json new file mode 100644 index 0000000..d6bad92 --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_trace_s2.json @@ -0,0 +1,45 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_none_T1_ns3_trace_s2", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 2, + "sec": 212.0, + "dev": "cuda", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.10446181893348694, + 0.1443730890750885 + ], + "test_mae": [ + 0.10304161161184311, + 0.1481563299894333 + ], + "test_mae_oracle": [ + 0.10304161161184311, + 0.1481563299894333 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_trace_s901.json b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_trace_s901.json new file mode 100644 index 0000000..dd0a8a6 --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_none_T1_ns3_trace_s901.json @@ -0,0 +1,45 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_none_T1_ns3_trace_s901", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 1, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 901, + "sec": 1.8, + "dev": "cuda", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 1, + "val_mae": [ + 0.5376940965652466, + 0.6443222761154175 + ], + "test_mae": [ + 0.5480546355247498, + 0.6407411098480225 + ], + "test_mae_oracle": [ + 0.5480546355247498, + 0.6407411098480225 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_none_T3_ns3_s0.json b/runs/rec_rrog_full_sig0.0_K1_none_T3_ns3_s0.json new file mode 100644 index 0000000..4361116 --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_none_T3_ns3_s0.json @@ -0,0 +1,44 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_none_T3_ns3_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 3, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "seed": 0, + "sec": 224.6, + "dev": "cuda", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 140, + "val_mae": [ + 0.18107640743255615, + 0.2467493712902069 + ], + "test_mae": [ + 0.18975667655467987, + 0.2632835805416107 + ], + "test_mae_oracle": [ + 0.18975667655467987, + 0.2632835805416107 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_full_sig0.0_K1_none_T3_ns3_trace_s0.json b/runs/rec_rrog_full_sig0.0_K1_none_T3_ns3_trace_s0.json new file mode 100644 index 0000000..f56df80 --- /dev/null +++ b/runs/rec_rrog_full_sig0.0_K1_none_T3_ns3_trace_s0.json @@ -0,0 +1,45 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_full_sig0.0_K1_none_T3_ns3_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 3, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "sec": 238.0, + "dev": "cuda", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.094108447432518, + 0.13809734582901 + ], + "test_mae": [ + 0.08507680147886276, + 0.12733697891235352 + ], + "test_mae_oracle": [ + 0.08507680147886276, + 0.12733697891235352 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_gatv2_full_sig0.0_K1_none_T0_ns1_trace_s0.json b/runs/rec_rrog_gatv2_full_sig0.0_K1_none_T0_ns1_trace_s0.json new file mode 100644 index 0000000..6e606fa --- /dev/null +++ b/runs/rec_rrog_gatv2_full_sig0.0_K1_none_T0_ns1_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_gatv2_full_sig0.0_K1_none_T0_ns1_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 0, + "n_sup": 1, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "gatv2", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 113.7, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 180, + "val_mae": [ + 0.1604059338569641, + 0.24803805351257324 + ], + "test_mae": [ + 0.15068109333515167, + 0.25051042437553406 + ], + "test_mae_oracle": [ + 0.15068109333515167, + 0.25051042437553406 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_gatv2_full_sig0.0_K1_none_T1_ns3_trace_s0.json b/runs/rec_rrog_gatv2_full_sig0.0_K1_none_T1_ns3_trace_s0.json new file mode 100644 index 0000000..e1d986c --- /dev/null +++ b/runs/rec_rrog_gatv2_full_sig0.0_K1_none_T1_ns3_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_gatv2_full_sig0.0_K1_none_T1_ns3_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "gatv2", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 160.3, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.10159114748239517, + 0.21391241252422333 + ], + "test_mae": [ + 0.1038370430469513, + 0.20821833610534668 + ], + "test_mae_oracle": [ + 0.1038370430469513, + 0.20821833610534668 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_gcn_full_sig0.0_K1_none_T0_ns1_trace_s0.json b/runs/rec_rrog_gcn_full_sig0.0_K1_none_T0_ns1_trace_s0.json new file mode 100644 index 0000000..4ce1d1f --- /dev/null +++ b/runs/rec_rrog_gcn_full_sig0.0_K1_none_T0_ns1_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_gcn_full_sig0.0_K1_none_T0_ns1_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 0, + "n_sup": 1, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "gcn", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 86.5, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.2706347703933716, + 0.3114604353904724 + ], + "test_mae": [ + 0.2676979601383209, + 0.31771764159202576 + ], + "test_mae_oracle": [ + 0.2676979601383209, + 0.31771764159202576 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_gcn_full_sig0.0_K1_none_T1_ns3_trace_s0.json b/runs/rec_rrog_gcn_full_sig0.0_K1_none_T1_ns3_trace_s0.json new file mode 100644 index 0000000..968f7fc --- /dev/null +++ b/runs/rec_rrog_gcn_full_sig0.0_K1_none_T1_ns3_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_gcn_full_sig0.0_K1_none_T1_ns3_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "gcn", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 121.7, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.17954416573047638, + 0.25849688053131104 + ], + "test_mae": [ + 0.17883898317813873, + 0.28149375319480896 + ], + "test_mae_oracle": [ + 0.17883898317813873, + 0.28149375319480896 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_gen_full_sig0.0_K1_none_T0_ns1_trace_s0.json b/runs/rec_rrog_gen_full_sig0.0_K1_none_T0_ns1_trace_s0.json new file mode 100644 index 0000000..391ab5e --- /dev/null +++ b/runs/rec_rrog_gen_full_sig0.0_K1_none_T0_ns1_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_gen_full_sig0.0_K1_none_T0_ns1_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 0, + "n_sup": 1, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "gen", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 101.3, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.15094247460365295, + 0.24518032371997833 + ], + "test_mae": [ + 0.13968762755393982, + 0.24574218690395355 + ], + "test_mae_oracle": [ + 0.13968762755393982, + 0.24574218690395355 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_gen_full_sig0.0_K1_none_T1_ns3_trace_s0.json b/runs/rec_rrog_gen_full_sig0.0_K1_none_T1_ns3_trace_s0.json new file mode 100644 index 0000000..c25982e --- /dev/null +++ b/runs/rec_rrog_gen_full_sig0.0_K1_none_T1_ns3_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_gen_full_sig0.0_K1_none_T1_ns3_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "gen", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 150.1, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 180, + "val_mae": [ + 0.13552801311016083, + 0.21986626088619232 + ], + "test_mae": [ + 0.12015220522880554, + 0.22031323611736298 + ], + "test_mae_oracle": [ + 0.12015220522880554, + 0.22031323611736298 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_gine_full_sig0.0_K1_none_T0_ns1_trace_s0.json b/runs/rec_rrog_gine_full_sig0.0_K1_none_T0_ns1_trace_s0.json new file mode 100644 index 0000000..b8003bf --- /dev/null +++ b/runs/rec_rrog_gine_full_sig0.0_K1_none_T0_ns1_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_gine_full_sig0.0_K1_none_T0_ns1_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 0, + "n_sup": 1, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "gine", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 100.6, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.09561386704444885, + 0.14305318892002106 + ], + "test_mae": [ + 0.09142361581325531, + 0.1402580887079239 + ], + "test_mae_oracle": [ + 0.09142361581325531, + 0.1402580887079239 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_gine_full_sig0.0_K1_none_T1_ns3_trace_s0.json b/runs/rec_rrog_gine_full_sig0.0_K1_none_T1_ns3_trace_s0.json new file mode 100644 index 0000000..5ecc8f1 --- /dev/null +++ b/runs/rec_rrog_gine_full_sig0.0_K1_none_T1_ns3_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_gine_full_sig0.0_K1_none_T1_ns3_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "gine", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 159.6, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.0580325685441494, + 0.10609347373247147 + ], + "test_mae": [ + 0.05187428742647171, + 0.09901637583971024 + ], + "test_mae_oracle": [ + 0.05187428742647171, + 0.09901637583971024 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_graphconv_full_sig0.0_K1_none_T0_ns1_trace_s0.json b/runs/rec_rrog_graphconv_full_sig0.0_K1_none_T0_ns1_trace_s0.json new file mode 100644 index 0000000..96d5b3a --- /dev/null +++ b/runs/rec_rrog_graphconv_full_sig0.0_K1_none_T0_ns1_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_graphconv_full_sig0.0_K1_none_T0_ns1_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 0, + "n_sup": 1, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "graphconv", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 71.9, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 180, + "val_mae": [ + 0.1471337080001831, + 0.20361122488975525 + ], + "test_mae": [ + 0.14493322372436523, + 0.20126454532146454 + ], + "test_mae_oracle": [ + 0.14493322372436523, + 0.20126454532146454 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_graphconv_full_sig0.0_K1_none_T1_ns3_trace_s0.json b/runs/rec_rrog_graphconv_full_sig0.0_K1_none_T1_ns3_trace_s0.json new file mode 100644 index 0000000..a2ce528 --- /dev/null +++ b/runs/rec_rrog_graphconv_full_sig0.0_K1_none_T1_ns3_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_graphconv_full_sig0.0_K1_none_T1_ns3_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "graphconv", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 119.4, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.07761617749929428, + 0.13153068721294403 + ], + "test_mae": [ + 0.07892274111509323, + 0.1270511895418167 + ], + "test_mae_oracle": [ + 0.07892274111509323, + 0.1270511895418167 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_graphsage_full_sig0.0_K1_none_T0_ns1_trace_s0.json b/runs/rec_rrog_graphsage_full_sig0.0_K1_none_T0_ns1_trace_s0.json new file mode 100644 index 0000000..b468b2a --- /dev/null +++ b/runs/rec_rrog_graphsage_full_sig0.0_K1_none_T0_ns1_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_graphsage_full_sig0.0_K1_none_T0_ns1_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 0, + "n_sup": 1, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "graphsage", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 78.6, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.17156678438186646, + 0.2418467104434967 + ], + "test_mae": [ + 0.16963693499565125, + 0.24828621745109558 + ], + "test_mae_oracle": [ + 0.16963693499565125, + 0.24828621745109558 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_graphsage_full_sig0.0_K1_none_T1_ns3_trace_s0.json b/runs/rec_rrog_graphsage_full_sig0.0_K1_none_T1_ns3_trace_s0.json new file mode 100644 index 0000000..4005b1b --- /dev/null +++ b/runs/rec_rrog_graphsage_full_sig0.0_K1_none_T1_ns3_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_graphsage_full_sig0.0_K1_none_T1_ns3_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "graphsage", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 110.1, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.11123412102460861, + 0.226893350481987 + ], + "test_mae": [ + 0.10119834542274475, + 0.23949070274829865 + ], + "test_mae_oracle": [ + 0.10119834542274475, + 0.23949070274829865 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_mf_full_sig0.0_K1_none_T0_ns1_trace_s0.json b/runs/rec_rrog_mf_full_sig0.0_K1_none_T0_ns1_trace_s0.json new file mode 100644 index 0000000..4a20afb --- /dev/null +++ b/runs/rec_rrog_mf_full_sig0.0_K1_none_T0_ns1_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_mf_full_sig0.0_K1_none_T0_ns1_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 0, + "n_sup": 1, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "mf", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 331.2, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 180, + "val_mae": [ + 0.13346724212169647, + 0.17167781293392181 + ], + "test_mae": [ + 0.1310972422361374, + 0.1719895601272583 + ], + "test_mae_oracle": [ + 0.1310972422361374, + 0.1719895601272583 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_mf_full_sig0.0_K1_none_T1_ns3_trace_s0.json b/runs/rec_rrog_mf_full_sig0.0_K1_none_T1_ns3_trace_s0.json new file mode 100644 index 0000000..d79b7b3 --- /dev/null +++ b/runs/rec_rrog_mf_full_sig0.0_K1_none_T1_ns3_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_mf_full_sig0.0_K1_none_T1_ns3_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "mf", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 327.5, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.07755542546510696, + 0.12109854817390442 + ], + "test_mae": [ + 0.06932510435581207, + 0.12173844128847122 + ], + "test_mae_oracle": [ + 0.06932510435581207, + 0.12173844128847122 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_pna_full_sig0.0_K1_none_T0_ns1_trace_s0.json b/runs/rec_rrog_pna_full_sig0.0_K1_none_T0_ns1_trace_s0.json new file mode 100644 index 0000000..1b1c744 --- /dev/null +++ b/runs/rec_rrog_pna_full_sig0.0_K1_none_T0_ns1_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_pna_full_sig0.0_K1_none_T0_ns1_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 0, + "n_sup": 1, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "pna", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 184.2, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 180, + "val_mae": [ + 0.06923778355121613, + 0.0872422307729721 + ], + "test_mae": [ + 0.06226735562086105, + 0.09160249680280685 + ], + "test_mae_oracle": [ + 0.06226735562086105, + 0.09160249680280685 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_pna_full_sig0.0_K1_none_T1_ns2_trace_s0.json b/runs/rec_rrog_pna_full_sig0.0_K1_none_T1_ns2_trace_s0.json new file mode 100644 index 0000000..eb162c9 --- /dev/null +++ b/runs/rec_rrog_pna_full_sig0.0_K1_none_T1_ns2_trace_s0.json @@ -0,0 +1,46 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_pna_full_sig0.0_K1_none_T1_ns2_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 2, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "pna", + "epochs": 1, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "sec": 2.2, + "dev": "cuda", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 1, + "val_mae": [ + 0.8741163611412048, + 0.8400496244430542 + ], + "test_mae": [ + 0.9354281425476074, + 0.8538893461227417 + ], + "test_mae_oracle": [ + 0.9354281425476074, + 0.8538893461227417 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_pna_full_sig0.0_K1_none_T1_ns3_trace_s0.json b/runs/rec_rrog_pna_full_sig0.0_K1_none_T1_ns3_trace_s0.json new file mode 100644 index 0000000..3cfa054 --- /dev/null +++ b/runs/rec_rrog_pna_full_sig0.0_K1_none_T1_ns3_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_pna_full_sig0.0_K1_none_T1_ns3_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "pna", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 212.1, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.05049829185009003, + 0.0710764154791832 + ], + "test_mae": [ + 0.041653066873550415, + 0.0639614462852478 + ], + "test_mae_oracle": [ + 0.041653066873550415, + 0.0639614462852478 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_resgated_full_sig0.0_K1_none_T0_ns1_trace_s0.json b/runs/rec_rrog_resgated_full_sig0.0_K1_none_T0_ns1_trace_s0.json new file mode 100644 index 0000000..eaa8f9b --- /dev/null +++ b/runs/rec_rrog_resgated_full_sig0.0_K1_none_T0_ns1_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_resgated_full_sig0.0_K1_none_T0_ns1_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 0, + "n_sup": 1, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "resgated", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 102.6, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.1363198459148407, + 0.18200460076332092 + ], + "test_mae": [ + 0.1365387737751007, + 0.18024799227714539 + ], + "test_mae_oracle": [ + 0.1365387737751007, + 0.18024799227714539 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_resgated_full_sig0.0_K1_none_T1_ns3_trace_s0.json b/runs/rec_rrog_resgated_full_sig0.0_K1_none_T1_ns3_trace_s0.json new file mode 100644 index 0000000..51e40bb --- /dev/null +++ b/runs/rec_rrog_resgated_full_sig0.0_K1_none_T1_ns3_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_resgated_full_sig0.0_K1_none_T1_ns3_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "resgated", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 137.8, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 180, + "val_mae": [ + 0.07244974374771118, + 0.11092057079076767 + ], + "test_mae": [ + 0.06887289136648178, + 0.10761728137731552 + ], + "test_mae_oracle": [ + 0.06887289136648178, + 0.10761728137731552 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_sgc_full_sig0.0_K1_none_T0_ns1_trace_s0.json b/runs/rec_rrog_sgc_full_sig0.0_K1_none_T0_ns1_trace_s0.json new file mode 100644 index 0000000..11dab34 --- /dev/null +++ b/runs/rec_rrog_sgc_full_sig0.0_K1_none_T0_ns1_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_sgc_full_sig0.0_K1_none_T0_ns1_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 0, + "n_sup": 1, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "sgc", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 91.8, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.29122766852378845, + 0.33744269609451294 + ], + "test_mae": [ + 0.2915189266204834, + 0.3516658842563629 + ], + "test_mae_oracle": [ + 0.2915189266204834, + 0.3516658842563629 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_sgc_full_sig0.0_K1_none_T1_ns3_trace_s0.json b/runs/rec_rrog_sgc_full_sig0.0_K1_none_T1_ns3_trace_s0.json new file mode 100644 index 0000000..d9f7863 --- /dev/null +++ b/runs/rec_rrog_sgc_full_sig0.0_K1_none_T1_ns3_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_sgc_full_sig0.0_K1_none_T1_ns3_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "sgc", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 124.9, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.19793416559696198, + 0.3029009997844696 + ], + "test_mae": [ + 0.1908223181962967, + 0.3157658874988556 + ], + "test_mae_oracle": [ + 0.1908223181962967, + 0.3157658874988556 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_tag_full_sig0.0_K1_none_T0_ns1_trace_s0.json b/runs/rec_rrog_tag_full_sig0.0_K1_none_T0_ns1_trace_s0.json new file mode 100644 index 0000000..bccb853 --- /dev/null +++ b/runs/rec_rrog_tag_full_sig0.0_K1_none_T0_ns1_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_tag_full_sig0.0_K1_none_T0_ns1_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 0, + "n_sup": 1, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "tag", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 109.9, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.11659888178110123, + 0.17228826880455017 + ], + "test_mae": [ + 0.11192158609628677, + 0.17113320529460907 + ], + "test_mae_oracle": [ + 0.11192158609628677, + 0.17113320529460907 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_tag_full_sig0.0_K1_none_T1_ns3_trace_s0.json b/runs/rec_rrog_tag_full_sig0.0_K1_none_T1_ns3_trace_s0.json new file mode 100644 index 0000000..b4a8256 --- /dev/null +++ b/runs/rec_rrog_tag_full_sig0.0_K1_none_T1_ns3_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_tag_full_sig0.0_K1_none_T1_ns3_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "tag", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 147.1, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.051080916076898575, + 0.08987285196781158 + ], + "test_mae": [ + 0.05129510164260864, + 0.08730053156614304 + ], + "test_mae_oracle": [ + 0.05129510164260864, + 0.08730053156614304 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_transformer_full_sig0.0_K1_none_T0_ns1_trace_s0.json b/runs/rec_rrog_transformer_full_sig0.0_K1_none_T0_ns1_trace_s0.json new file mode 100644 index 0000000..7fad586 --- /dev/null +++ b/runs/rec_rrog_transformer_full_sig0.0_K1_none_T0_ns1_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_transformer_full_sig0.0_K1_none_T0_ns1_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 0, + "n_sup": 1, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "transformer", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 129.3, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 200, + "val_mae": [ + 0.15405215322971344, + 0.2296278476715088 + ], + "test_mae": [ + 0.14875350892543793, + 0.22720274329185486 + ], + "test_mae_oracle": [ + 0.14875350892543793, + 0.22720274329185486 + ] +}
\ No newline at end of file diff --git a/runs/rec_rrog_transformer_full_sig0.0_K1_none_T1_ns3_trace_s0.json b/runs/rec_rrog_transformer_full_sig0.0_K1_none_T1_ns3_trace_s0.json new file mode 100644 index 0000000..629be7d --- /dev/null +++ b/runs/rec_rrog_transformer_full_sig0.0_K1_none_T1_ns3_trace_s0.json @@ -0,0 +1,47 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_rrog_transformer_full_sig0.0_K1_none_T1_ns3_trace_s0", + "grad_mode": "full", + "sigma": 0.0, + "K": 1, + "select": "none", + "T": 1, + "n_sup": 3, + "hidden": 64, + "agg_layers": 5, + "compute_layers": 2, + "view": "transformer", + "epochs": 200, + "lr": 0.001, + "bs": 256, + "lam_q": 1.0, + "act": false, + "halt_max_steps": 8, + "halt_norm_threshold": 0.3, + "halt_temp": 0.1, + "halt_target": "soft", + "halt_exploration_prob": 0.1, + "loss_mode": "trace", + "seed": 0, + "device": "cuda:0", + "sec": 210.2, + "dev": "cuda:0", + "arch": "rrog_once_agg_node_compute", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 180, + "val_mae": [ + 0.09927801787853241, + 0.20996834337711334 + ], + "test_mae": [ + 0.1036745011806488, + 0.2231702208518982 + ], + "test_mae_oracle": [ + 0.1036745011806488, + 0.2231702208518982 + ] +}
\ No newline at end of file diff --git a/runs/rec_sig0.0_K1_bestq_T3_ns3_s0.json b/runs/rec_sig0.0_K1_bestq_T3_ns3_s0.json new file mode 100644 index 0000000..d983501 --- /dev/null +++ b/runs/rec_sig0.0_K1_bestq_T3_ns3_s0.json @@ -0,0 +1,34 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_sig0.0_K1_bestq_T3_ns3_s0", + "sigma": 0.0, + "K": 1, + "select": "bestq", + "T": 3, + "n_sup": 3, + "hidden": 128, + "epochs": 200, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "seed": 0, + "sec": 210.1, + "dev": "cuda", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 140, + "val_mae": [ + 0.14077112078666687, + 0.18784108757972717 + ], + "test_mae": [ + 0.1506122499704361, + 0.19844625890254974 + ], + "test_mae_oracle": [ + 0.1506122499704361, + 0.19844625890254974 + ] +}
\ No newline at end of file diff --git a/runs/rec_sig0.1_K8_bestq_T3_ns3_s0.json b/runs/rec_sig0.1_K8_bestq_T3_ns3_s0.json new file mode 100644 index 0000000..bb6420e --- /dev/null +++ b/runs/rec_sig0.1_K8_bestq_T3_ns3_s0.json @@ -0,0 +1,34 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_sig0.1_K8_bestq_T3_ns3_s0", + "sigma": 0.1, + "K": 8, + "select": "bestq", + "T": 3, + "n_sup": 3, + "hidden": 128, + "epochs": 200, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "seed": 0, + "sec": 211.1, + "dev": "cuda", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 180, + "val_mae": [ + 0.1527794450521469, + 0.26431822776794434 + ], + "test_mae": [ + 0.15733911097049713, + 0.2645413875579834 + ], + "test_mae_oracle": [ + 0.08885522931814194, + 0.1291976273059845 + ] +}
\ No newline at end of file diff --git a/runs/rec_sig0.1_K8_none_T3_ns3_s0.json b/runs/rec_sig0.1_K8_none_T3_ns3_s0.json new file mode 100644 index 0000000..76ceee5 --- /dev/null +++ b/runs/rec_sig0.1_K8_none_T3_ns3_s0.json @@ -0,0 +1,34 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_sig0.1_K8_none_T3_ns3_s0", + "sigma": 0.1, + "K": 8, + "select": "none", + "T": 3, + "n_sup": 3, + "hidden": 128, + "epochs": 200, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "seed": 0, + "sec": 212.0, + "dev": "cuda", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 140, + "val_mae": [ + 0.1645255982875824, + 0.22213539481163025 + ], + "test_mae": [ + 0.16389606893062592, + 0.23174288868904114 + ], + "test_mae_oracle": [ + 0.09854131191968918, + 0.120295949280262 + ] +}
\ No newline at end of file diff --git a/runs/rec_sig0.2_K16_bestq_T3_ns3_s0.json b/runs/rec_sig0.2_K16_bestq_T3_ns3_s0.json new file mode 100644 index 0000000..b59684f --- /dev/null +++ b/runs/rec_sig0.2_K16_bestq_T3_ns3_s0.json @@ -0,0 +1,34 @@ +{ + "dataset": "ZINC-cycle56", + "tag": "rec_sig0.2_K16_bestq_T3_ns3_s0", + "sigma": 0.2, + "K": 16, + "select": "bestq", + "T": 3, + "n_sup": 3, + "hidden": 128, + "epochs": 200, + "lr": 0.001, + "bs": 128, + "lam_q": 1.0, + "seed": 0, + "sec": 207.9, + "dev": "cuda", + "y_std_raw": [ + 0.7805301547050476, + 0.9526597261428833 + ], + "ep": 60, + "val_mae": [ + 0.19973090291023254, + 0.3134014308452606 + ], + "test_mae": [ + 0.20950639247894287, + 0.30515405535697937 + ], + "test_mae_oracle": [ + 0.1255389302968979, + 0.1383717805147171 + ] +}
\ No newline at end of file diff --git a/runs/rec_sweep.log b/runs/rec_sweep.log new file mode 100644 index 0000000..850f373 --- /dev/null +++ b/runs/rec_sweep.log @@ -0,0 +1,54 @@ +host=timan1.cs.illinois.edu gpu=0 start=2026-06-16T09:56:20-05:00 +===== --sigma 0 --K 1 --select bestq ===== +ep20 val_mae=[0.343, 0.416] +ep40 val_mae=[0.271, 0.321] +ep60 val_mae=[0.192, 0.234] +ep80 val_mae=[0.203, 0.245] +ep100 val_mae=[0.289, 0.382] +ep120 val_mae=[0.189, 0.235] +ep140 val_mae=[0.141, 0.188] +ep160 val_mae=[0.131, 0.286] +ep180 val_mae=[0.178, 0.295] +ep200 val_mae=[0.132, 0.244] +[rec_sig0.0_K1_bestq_T3_ns3_s0] test_mae=[0.151, 0.198] oracle@K=[0.151, 0.198] @ep140 (210.1s) + wrote /home/yurenh2/rrog/runs/rec_sig0.0_K1_bestq_T3_ns3_s0.json +===== --sigma 0.1 --K 8 --select none ===== +ep20 val_mae=[0.343, 0.401] +ep40 val_mae=[0.273, 0.304] +ep60 val_mae=[0.324, 0.339] +ep80 val_mae=[0.207, 0.409] +ep100 val_mae=[0.172, 0.261] +ep120 val_mae=[0.199, 0.271] +ep140 val_mae=[0.165, 0.222] +ep160 val_mae=[0.173, 0.258] +ep180 val_mae=[0.204, 0.33] +ep200 val_mae=[0.206, 0.333] +[rec_sig0.1_K8_none_T3_ns3_s0] test_mae=[0.164, 0.232] oracle@K=[0.099, 0.12] @ep140 (212.0s) + wrote /home/yurenh2/rrog/runs/rec_sig0.1_K8_none_T3_ns3_s0.json +===== --sigma 0.1 --K 8 --select bestq ===== +ep20 val_mae=[0.342, 0.419] +ep40 val_mae=[0.276, 0.34] +ep60 val_mae=[0.205, 0.282] +ep80 val_mae=[0.181, 0.507] +ep100 val_mae=[0.198, 0.588] +ep120 val_mae=[0.235, 0.542] +ep140 val_mae=[0.219, 0.428] +ep160 val_mae=[0.16, 0.283] +ep180 val_mae=[0.153, 0.264] +ep200 val_mae=[0.147, 0.291] +[rec_sig0.1_K8_bestq_T3_ns3_s0] test_mae=[0.157, 0.265] oracle@K=[0.089, 0.129] @ep180 (211.1s) + wrote /home/yurenh2/rrog/runs/rec_sig0.1_K8_bestq_T3_ns3_s0.json +===== --sigma 0.2 --K 16 --select bestq ===== +ep20 val_mae=[0.32, 0.384] +ep40 val_mae=[0.295, 0.322] +ep60 val_mae=[0.2, 0.313] +ep80 val_mae=[0.2, 0.331] +ep100 val_mae=[0.332, 0.522] +ep120 val_mae=[0.202, 0.374] +ep140 val_mae=[0.261, 0.339] +ep160 val_mae=[0.261, 0.404] +ep180 val_mae=[0.177, 0.339] +ep200 val_mae=[0.24, 0.356] +[rec_sig0.2_K16_bestq_T3_ns3_s0] test_mae=[0.21, 0.305] oracle@K=[0.126, 0.138] @ep60 (207.9s) + wrote /home/yurenh2/rrog/runs/rec_sig0.2_K16_bestq_T3_ns3_s0.json +done=2026-06-16T10:11:08-05:00 diff --git a/runs/rrog_attn_T1_T3_e80_seed0_20260617_113532.log b/runs/rrog_attn_T1_T3_e80_seed0_20260617_113532.log new file mode 100644 index 0000000..bf7e5c4 --- /dev/null +++ b/runs/rrog_attn_T1_T3_e80_seed0_20260617_113532.log @@ -0,0 +1,8 @@ +===== attn T=1 ===== +ep20 solve_rate=0.000 mean_conflicts=50.67 +ep40 solve_rate=0.000 mean_conflicts=45.77 +ep60 solve_rate=0.000 mean_conflicts=34.93 +ep80 solve_rate=0.000 mean_conflicts=32.84 +[color_rrog_attn_gin_full_none_n50_k3_p0.2_T1_ns3_s0] best solve_rate=0.0 @ep20 (96.3s) + wrote /home/yurenh2/rrog/runs/ckpt_color_rrog_attn_gin_full_none_n50_k3_p0.2_T1_ns3_s0.pt +===== attn T=3 ===== diff --git a/runs/rrog_color_T1_seed0_20260617_113041.log b/runs/rrog_color_T1_seed0_20260617_113041.log new file mode 100644 index 0000000..e275e3e --- /dev/null +++ b/runs/rrog_color_T1_seed0_20260617_113041.log @@ -0,0 +1,10 @@ +ep20 solve_rate=0.000 mean_conflicts=61.33 +ep40 solve_rate=0.000 mean_conflicts=50.18 +ep60 solve_rate=0.000 mean_conflicts=38.73 +ep80 solve_rate=0.000 mean_conflicts=36.58 +ep100 solve_rate=0.000 mean_conflicts=36.11 +ep120 solve_rate=0.000 mean_conflicts=35.95 +ep140 solve_rate=0.000 mean_conflicts=35.86 +ep150 solve_rate=0.000 mean_conflicts=35.80 +[color_rrog_gin_full_none_n50_k3_p0.2_T1_ns3_s0] best solve_rate=0.0 @ep20 (127.8s) + wrote /home/yurenh2/rrog/runs/ckpt_color_rrog_gin_full_none_n50_k3_p0.2_T1_ns3_s0.pt diff --git a/runs/rrog_color_sweep_20260617_112632.log b/runs/rrog_color_sweep_20260617_112632.log new file mode 100644 index 0000000..b3cf032 --- /dev/null +++ b/runs/rrog_color_sweep_20260617_112632.log @@ -0,0 +1,2 @@ +host=timan1.cs.illinois.edu gpu=? start=2026-06-17T11:26:32-05:00 +===== train full ===== diff --git a/runs/rrog_gcn_node_agg4_T3_e150_seed0_20260617_114425.log b/runs/rrog_gcn_node_agg4_T3_e150_seed0_20260617_114425.log new file mode 100644 index 0000000..4bc2865 --- /dev/null +++ b/runs/rrog_gcn_node_agg4_T3_e150_seed0_20260617_114425.log @@ -0,0 +1,5 @@ +ep20 solve_rate=0.000 mean_conflicts=59.14 +ep40 solve_rate=0.000 mean_conflicts=93.71 +ep60 solve_rate=0.000 mean_conflicts=41.06 +ep80 solve_rate=0.000 mean_conflicts=29.80 +ep100 solve_rate=0.000 mean_conflicts=31.36 diff --git a/runs/rrog_node_agg4_T1_e80_seed0_20260617_113927.log b/runs/rrog_node_agg4_T1_e80_seed0_20260617_113927.log new file mode 100644 index 0000000..0dda954 --- /dev/null +++ b/runs/rrog_node_agg4_T1_e80_seed0_20260617_113927.log @@ -0,0 +1,6 @@ +ep20 solve_rate=0.000 mean_conflicts=58.17 +ep40 solve_rate=0.000 mean_conflicts=21.81 +ep60 solve_rate=0.000 mean_conflicts=17.77 +ep80 solve_rate=0.000 mean_conflicts=16.47 +[color_rrog_node_gin_full_none_n50_k3_p0.2_T1_ns3_s0] best solve_rate=0.0 @ep20 (54.3s) + wrote /home/yurenh2/rrog/runs/ckpt_color_rrog_node_gin_full_none_n50_k3_p0.2_T1_ns3_s0.pt diff --git a/runs/rrog_rec_T0_T3_e40_seed0_20260617_114919.log b/runs/rrog_rec_T0_T3_e40_seed0_20260617_114919.log new file mode 100644 index 0000000..c763eae --- /dev/null +++ b/runs/rrog_rec_T0_T3_e40_seed0_20260617_114919.log @@ -0,0 +1,10 @@ +===== rec T=0 ===== +ep20 val_mae=[0.537, 0.59] +ep40 val_mae=[0.532, 0.57] +[rec_rrog_full_sig0.0_K1_bestq_T0_ns3_s0] test_mae=[0.514, 0.561] oracle@K=[0.514, 0.561] @ep40 (12.6s) + wrote /home/yurenh2/rrog/runs/ckpt_rec_rrog_full_sig0.0_K1_bestq_T0_ns3_s0.pt +===== rec T=3 ===== +ep20 val_mae=[0.34, 0.365] +ep40 val_mae=[0.211, 0.283] +[rec_rrog_full_sig0.0_K1_bestq_T3_ns3_s0] test_mae=[0.206, 0.284] oracle@K=[0.206, 0.284] @ep40 (22.6s) + wrote /home/yurenh2/rrog/runs/ckpt_rec_rrog_full_sig0.0_K1_bestq_T3_ns3_s0.pt diff --git a/runs/rrog_rec_T1_e40_seed0_20260617_115020.log b/runs/rrog_rec_T1_e40_seed0_20260617_115020.log new file mode 100644 index 0000000..26fdead --- /dev/null +++ b/runs/rrog_rec_T1_e40_seed0_20260617_115020.log @@ -0,0 +1,4 @@ +ep20 val_mae=[0.339, 0.445] +ep40 val_mae=[0.209, 0.279] +[rec_rrog_full_sig0.0_K1_bestq_T1_ns3_s0] test_mae=[0.213, 0.3] oracle@K=[0.213, 0.3] @ep40 (21.2s) + wrote /home/yurenh2/rrog/runs/ckpt_rec_rrog_full_sig0.0_K1_bestq_T1_ns3_s0.pt diff --git a/runs/rrog_trm_gnn_perf_20260617_112714.log b/runs/rrog_trm_gnn_perf_20260617_112714.log new file mode 100644 index 0000000..ecbdbf4 --- /dev/null +++ b/runs/rrog_trm_gnn_perf_20260617_112714.log @@ -0,0 +1,13 @@ +host=timan1.cs.illinois.edu gpu=? start=2026-06-17T11:27:14-05:00 +===== train full ===== +ep20 solve_rate=0.000 mean_conflicts=66.64 +ep40 solve_rate=0.000 mean_conflicts=50.38 +ep60 solve_rate=0.000 mean_conflicts=39.63 +ep80 solve_rate=0.000 mean_conflicts=37.37 +ep100 solve_rate=0.000 mean_conflicts=36.56 +ep120 solve_rate=0.000 mean_conflicts=36.30 +ep140 solve_rate=0.000 mean_conflicts=36.23 +ep150 solve_rate=0.000 mean_conflicts=36.25 +[color_rrog_gin_full_none_n50_k3_p0.2_T3_ns3_s0] best solve_rate=0.0 @ep20 (141.4s) + wrote /home/yurenh2/rrog/runs/ckpt_color_rrog_gin_full_none_n50_k3_p0.2_T3_ns3_s0.pt +===== train 1step ===== diff --git a/runs/rrog_viewonly_agg4_T0_e150_seed0_20260617_114134.log b/runs/rrog_viewonly_agg4_T0_e150_seed0_20260617_114134.log new file mode 100644 index 0000000..333c591 --- /dev/null +++ b/runs/rrog_viewonly_agg4_T0_e150_seed0_20260617_114134.log @@ -0,0 +1,10 @@ +ep20 solve_rate=0.000 mean_conflicts=81.17 +ep40 solve_rate=0.000 mean_conflicts=18.96 +ep60 solve_rate=0.000 mean_conflicts=16.98 +ep80 solve_rate=0.000 mean_conflicts=15.84 +ep100 solve_rate=0.000 mean_conflicts=15.50 +ep120 solve_rate=0.000 mean_conflicts=15.44 +ep140 solve_rate=0.000 mean_conflicts=15.69 +ep150 solve_rate=0.000 mean_conflicts=15.68 +[color_rrog_node_gin_full_none_n50_k3_p0.2_T0_ns3_s0] best solve_rate=0.0 @ep20 (69.4s) + wrote /home/yurenh2/rrog/runs/ckpt_color_rrog_node_gin_full_none_n50_k3_p0.2_T0_ns3_s0.pt diff --git a/runs/rrog_viewonly_gcn_agg4_T0_e150_seed0_20260617_114257.log b/runs/rrog_viewonly_gcn_agg4_T0_e150_seed0_20260617_114257.log new file mode 100644 index 0000000..b28b107 --- /dev/null +++ b/runs/rrog_viewonly_gcn_agg4_T0_e150_seed0_20260617_114257.log @@ -0,0 +1,10 @@ +ep20 solve_rate=0.000 mean_conflicts=67.89 +ep40 solve_rate=0.000 mean_conflicts=46.29 +ep60 solve_rate=0.000 mean_conflicts=58.42 +ep80 solve_rate=0.000 mean_conflicts=51.36 +ep100 solve_rate=0.000 mean_conflicts=32.18 +ep120 solve_rate=0.007 mean_conflicts=20.98 +ep140 solve_rate=0.003 mean_conflicts=18.32 +ep150 solve_rate=0.003 mean_conflicts=18.08 +[color_rrog_node_gcn_full_none_n50_k3_p0.2_T0_ns3_s0] best solve_rate=0.0067 @ep120 (72.9s) + wrote /home/yurenh2/rrog/runs/ckpt_color_rrog_node_gcn_full_none_n50_k3_p0.2_T0_ns3_s0.pt diff --git a/runs/seeds_sweep.log b/runs/seeds_sweep.log new file mode 100644 index 0000000..7e1b08f --- /dev/null +++ b/runs/seeds_sweep.log @@ -0,0 +1,234 @@ +host=timan1.cs.illinois.edu gpu=0 start=2026-06-16T11:50:28-05:00 +===== seed=0 full none ===== +ep20 solve_rate=0.000 mean_conflicts=114.06 +ep40 solve_rate=0.163 mean_conflicts=61.27 +ep60 solve_rate=0.410 mean_conflicts=17.81 +ep80 solve_rate=0.610 mean_conflicts=4.32 +ep100 solve_rate=0.440 mean_conflicts=16.00 +ep120 solve_rate=0.287 mean_conflicts=19.54 +ep140 solve_rate=0.090 mean_conflicts=59.83 +ep150 solve_rate=0.063 mean_conflicts=70.46 +[color_full_none_n50_k3_p0.2_T3_ns3_s0] best solve_rate=0.61 mean_conflicts=4.323 @ep80 (155.3s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_none_n50_k3_p0.2_T3_ns3_s0.pt +[full] LE n=300 fail_rate=0.39 | lambda1 SOLVED mean -0.3206 (n=183) | UNSOLVED mean +0.0485 (n=117) | sep=+0.3692 | AUROC(fail|lambda1)=0.919 | mean_lambda1=-0.1767 +[pe=none s0] deterministic solve_rate = 0.627 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.900 0.773 0.640 0.595 0.883 + wrote /home/yurenh2/rrog/runs/ptrm_color_full_none_n50_k3_p0.2_T3_ns3_s0.json +===== seed=0 full rwse ===== +ep20 solve_rate=0.000 mean_conflicts=51.22 +ep40 solve_rate=0.083 mean_conflicts=55.16 +ep60 solve_rate=0.203 mean_conflicts=58.38 +ep80 solve_rate=0.350 mean_conflicts=37.23 +ep100 solve_rate=0.383 mean_conflicts=31.48 +ep120 solve_rate=0.203 mean_conflicts=53.56 +ep140 solve_rate=0.273 mean_conflicts=37.79 +ep150 solve_rate=0.280 mean_conflicts=36.98 +[color_full_rwse_n50_k3_p0.2_T3_ns3_s0] best solve_rate=0.3833 mean_conflicts=31.483 @ep100 (153.3s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_rwse_n50_k3_p0.2_T3_ns3_s0.pt +[full] LE n=300 fail_rate=0.62 | lambda1 SOLVED mean -0.1834 (n=115) | UNSOLVED mean +0.0100 (n=185) | sep=+0.1934 | AUROC(fail|lambda1)=0.817 | mean_lambda1=-0.0641 +[pe=rwse s0] deterministic solve_rate = 0.407 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.740 0.587 0.493 0.426 0.808 + wrote /home/yurenh2/rrog/runs/ptrm_color_full_rwse_n50_k3_p0.2_T3_ns3_s0.json +===== seed=0 1step none ===== +ep20 solve_rate=0.000 mean_conflicts=44.63 +ep40 solve_rate=0.123 mean_conflicts=19.01 +ep60 solve_rate=0.200 mean_conflicts=18.33 +ep80 solve_rate=0.067 mean_conflicts=42.81 +ep100 solve_rate=0.027 mean_conflicts=42.48 +ep120 solve_rate=0.087 mean_conflicts=23.53 +ep140 solve_rate=0.100 mean_conflicts=10.46 +ep150 solve_rate=0.127 mean_conflicts=18.32 +[color_1step_none_n50_k3_p0.2_T3_ns3_s0] best solve_rate=0.2 mean_conflicts=18.333 @ep60 (127.1s) + wrote /home/yurenh2/rrog/runs/ckpt_color_1step_none_n50_k3_p0.2_T3_ns3_s0.pt +[1step] LE n=300 fail_rate=0.80 | lambda1 SOLVED mean -0.2978 (n=60) | UNSOLVED mean -0.1209 (n=240) | sep=+0.1769 | AUROC(fail|lambda1)=0.770 | mean_lambda1=-0.1563 +===== seed=1 full none ===== +ep20 solve_rate=0.000 mean_conflicts=76.94 +ep40 solve_rate=0.070 mean_conflicts=41.69 +ep60 solve_rate=0.207 mean_conflicts=33.02 +ep80 solve_rate=0.453 mean_conflicts=11.75 +ep100 solve_rate=0.203 mean_conflicts=21.24 +ep120 solve_rate=0.163 mean_conflicts=19.60 +ep140 solve_rate=0.067 mean_conflicts=41.63 +ep150 solve_rate=0.027 mean_conflicts=50.77 +[color_full_none_n50_k3_p0.2_T3_ns3_s1] best solve_rate=0.4533 mean_conflicts=11.753 @ep80 (151.0s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_none_n50_k3_p0.2_T3_ns3_s1.pt +[full] LE n=300 fail_rate=0.55 | lambda1 SOLVED mean -0.3182 (n=136) | UNSOLVED mean -0.0426 (n=164) | sep=+0.2757 | AUROC(fail|lambda1)=0.864 | mean_lambda1=-0.1675 +[pe=none s1] deterministic solve_rate = 0.480 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.740 0.593 0.440 0.456 0.869 + wrote /home/yurenh2/rrog/runs/ptrm_color_full_none_n50_k3_p0.2_T3_ns3_s1.json +===== seed=1 full rwse ===== +ep20 solve_rate=0.000 mean_conflicts=115.59 +ep40 solve_rate=0.100 mean_conflicts=91.86 +ep60 solve_rate=0.327 mean_conflicts=34.60 +ep80 solve_rate=0.097 mean_conflicts=88.34 +ep100 solve_rate=0.140 mean_conflicts=56.41 +ep120 solve_rate=0.500 mean_conflicts=16.20 +ep140 solve_rate=0.537 mean_conflicts=13.68 +ep150 solve_rate=0.500 mean_conflicts=16.04 +[color_full_rwse_n50_k3_p0.2_T3_ns3_s1] best solve_rate=0.5367 mean_conflicts=13.68 @ep140 (152.1s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_rwse_n50_k3_p0.2_T3_ns3_s1.pt +[full] LE n=300 fail_rate=0.46 | lambda1 SOLVED mean +0.0219 (n=161) | UNSOLVED mean +0.1773 (n=139) | sep=+0.1554 | AUROC(fail|lambda1)=0.774 | mean_lambda1=+0.0939 +[pe=rwse s1] deterministic solve_rate = 0.547 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.947 0.727 0.553 0.507 0.814 + wrote /home/yurenh2/rrog/runs/ptrm_color_full_rwse_n50_k3_p0.2_T3_ns3_s1.json +===== seed=1 1step none ===== +ep20 solve_rate=0.000 mean_conflicts=47.30 +ep40 solve_rate=0.157 mean_conflicts=34.06 +ep60 solve_rate=0.297 mean_conflicts=7.36 +ep80 solve_rate=0.333 mean_conflicts=8.70 +ep100 solve_rate=0.193 mean_conflicts=13.99 +ep120 solve_rate=0.233 mean_conflicts=6.94 +ep140 solve_rate=0.227 mean_conflicts=6.85 +ep150 solve_rate=0.320 mean_conflicts=5.31 +[color_1step_none_n50_k3_p0.2_T3_ns3_s1] best solve_rate=0.3333 mean_conflicts=8.7 @ep80 (123.3s) + wrote /home/yurenh2/rrog/runs/ckpt_color_1step_none_n50_k3_p0.2_T3_ns3_s1.pt +[1step] LE n=300 fail_rate=0.67 | lambda1 SOLVED mean -0.2773 (n=100) | UNSOLVED mean +0.0189 (n=200) | sep=+0.2963 | AUROC(fail|lambda1)=0.846 | mean_lambda1=-0.0798 +===== seed=2 full none ===== +ep20 solve_rate=0.000 mean_conflicts=137.74 +ep40 solve_rate=0.087 mean_conflicts=44.48 +ep60 solve_rate=0.140 mean_conflicts=42.89 +ep80 solve_rate=0.413 mean_conflicts=16.23 +ep100 solve_rate=0.123 mean_conflicts=60.71 +ep120 solve_rate=0.027 mean_conflicts=58.64 +ep140 solve_rate=0.017 mean_conflicts=79.05 +ep150 solve_rate=0.013 mean_conflicts=83.54 +[color_full_none_n50_k3_p0.2_T3_ns3_s2] best solve_rate=0.4133 mean_conflicts=16.23 @ep80 (154.4s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_none_n50_k3_p0.2_T3_ns3_s2.pt +[full] LE n=300 fail_rate=0.59 | lambda1 SOLVED mean -0.2913 (n=124) | UNSOLVED mean -0.0796 (n=176) | sep=+0.2117 | AUROC(fail|lambda1)=0.830 | mean_lambda1=-0.1671 +[pe=none s2] deterministic solve_rate = 0.447 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.773 0.620 0.467 0.435 0.821 + wrote /home/yurenh2/rrog/runs/ptrm_color_full_none_n50_k3_p0.2_T3_ns3_s2.json +===== seed=2 full rwse ===== +ep20 solve_rate=0.000 mean_conflicts=89.84 +ep40 solve_rate=0.110 mean_conflicts=36.78 +ep60 solve_rate=0.400 mean_conflicts=9.39 +ep80 solve_rate=0.560 mean_conflicts=3.40 +ep100 solve_rate=0.463 mean_conflicts=23.90 +ep120 solve_rate=0.550 mean_conflicts=16.37 +ep140 solve_rate=0.557 mean_conflicts=23.72 +ep150 solve_rate=0.510 mean_conflicts=34.19 +[color_full_rwse_n50_k3_p0.2_T3_ns3_s2] best solve_rate=0.56 mean_conflicts=3.4 @ep80 (151.8s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_rwse_n50_k3_p0.2_T3_ns3_s2.pt +[full] LE n=300 fail_rate=0.44 | lambda1 SOLVED mean -0.2328 (n=168) | UNSOLVED mean +0.0707 (n=132) | sep=+0.3034 | AUROC(fail|lambda1)=0.883 | mean_lambda1=-0.0993 +[pe=rwse s2] deterministic solve_rate = 0.600 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.893 0.787 0.573 0.556 0.873 + wrote /home/yurenh2/rrog/runs/ptrm_color_full_rwse_n50_k3_p0.2_T3_ns3_s2.json +===== seed=2 1step none ===== +ep20 solve_rate=0.000 mean_conflicts=38.00 +ep40 solve_rate=0.153 mean_conflicts=18.17 +ep60 solve_rate=0.327 mean_conflicts=7.32 +ep80 solve_rate=0.320 mean_conflicts=5.31 +ep100 solve_rate=0.357 mean_conflicts=4.67 +ep120 solve_rate=0.293 mean_conflicts=7.30 +ep140 solve_rate=0.273 mean_conflicts=7.96 +ep150 solve_rate=0.227 mean_conflicts=10.33 +[color_1step_none_n50_k3_p0.2_T3_ns3_s2] best solve_rate=0.3567 mean_conflicts=4.67 @ep100 (131.6s) + wrote /home/yurenh2/rrog/runs/ckpt_color_1step_none_n50_k3_p0.2_T3_ns3_s2.pt +[1step] LE n=300 fail_rate=0.64 | lambda1 SOLVED mean -0.2153 (n=107) | UNSOLVED mean +0.0916 (n=193) | sep=+0.3069 | AUROC(fail|lambda1)=0.867 | mean_lambda1=-0.0179 +===== seed=3 full none ===== +ep20 solve_rate=0.000 mean_conflicts=62.81 +ep40 solve_rate=0.207 mean_conflicts=33.51 +ep60 solve_rate=0.460 mean_conflicts=15.68 +ep80 solve_rate=0.033 mean_conflicts=114.30 +ep100 solve_rate=0.000 mean_conflicts=82.87 +ep120 solve_rate=0.000 mean_conflicts=85.01 +ep140 solve_rate=0.000 mean_conflicts=77.61 +ep150 solve_rate=0.000 mean_conflicts=79.58 +[color_full_none_n50_k3_p0.2_T3_ns3_s3] best solve_rate=0.46 mean_conflicts=15.68 @ep60 (151.6s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_none_n50_k3_p0.2_T3_ns3_s3.pt +[full] LE n=300 fail_rate=0.54 | lambda1 SOLVED mean -0.4216 (n=138) | UNSOLVED mean -0.0826 (n=162) | sep=+0.3390 | AUROC(fail|lambda1)=0.886 | mean_lambda1=-0.2385 +[pe=none s3] deterministic solve_rate = 0.493 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.733 0.587 0.493 0.472 0.856 + wrote /home/yurenh2/rrog/runs/ptrm_color_full_none_n50_k3_p0.2_T3_ns3_s3.json +===== seed=3 full rwse ===== +ep20 solve_rate=0.000 mean_conflicts=139.52 +ep40 solve_rate=0.043 mean_conflicts=135.26 +ep60 solve_rate=0.313 mean_conflicts=32.37 +ep80 solve_rate=0.370 mean_conflicts=14.78 +ep100 solve_rate=0.490 mean_conflicts=12.46 +ep120 solve_rate=0.067 mean_conflicts=89.87 +ep140 solve_rate=0.137 mean_conflicts=53.29 +ep150 solve_rate=0.127 mean_conflicts=46.23 +[color_full_rwse_n50_k3_p0.2_T3_ns3_s3] best solve_rate=0.49 mean_conflicts=12.46 @ep100 (152.1s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_rwse_n50_k3_p0.2_T3_ns3_s3.pt +[full] LE n=300 fail_rate=0.51 | lambda1 SOLVED mean -0.0438 (n=147) | UNSOLVED mean +0.1618 (n=153) | sep=+0.2056 | AUROC(fail|lambda1)=0.830 | mean_lambda1=+0.0610 +[pe=rwse s3] deterministic solve_rate = 0.507 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.893 0.727 0.473 0.497 0.823 + wrote /home/yurenh2/rrog/runs/ptrm_color_full_rwse_n50_k3_p0.2_T3_ns3_s3.json +===== seed=3 1step none ===== +ep20 solve_rate=0.000 mean_conflicts=54.09 +ep40 solve_rate=0.103 mean_conflicts=17.25 +ep60 solve_rate=0.187 mean_conflicts=28.48 +ep80 solve_rate=0.120 mean_conflicts=29.85 +ep100 solve_rate=0.200 mean_conflicts=16.34 +ep120 solve_rate=0.337 mean_conflicts=7.23 +ep140 solve_rate=0.157 mean_conflicts=16.67 +ep150 solve_rate=0.087 mean_conflicts=19.67 +[color_1step_none_n50_k3_p0.2_T3_ns3_s3] best solve_rate=0.3367 mean_conflicts=7.227 @ep120 (124.3s) + wrote /home/yurenh2/rrog/runs/ckpt_color_1step_none_n50_k3_p0.2_T3_ns3_s3.pt +[1step] LE n=300 fail_rate=0.66 | lambda1 SOLVED mean -0.0124 (n=101) | UNSOLVED mean +0.1694 (n=199) | sep=+0.1818 | AUROC(fail|lambda1)=0.786 | mean_lambda1=+0.1082 +===== seed=4 full none ===== +ep20 solve_rate=0.000 mean_conflicts=67.14 +ep40 solve_rate=0.200 mean_conflicts=24.37 +ep60 solve_rate=0.347 mean_conflicts=27.20 +ep80 solve_rate=0.127 mean_conflicts=41.29 +ep100 solve_rate=0.180 mean_conflicts=35.82 +ep120 solve_rate=0.073 mean_conflicts=66.69 +ep140 solve_rate=0.070 mean_conflicts=74.02 +ep150 solve_rate=0.073 mean_conflicts=81.13 +[color_full_none_n50_k3_p0.2_T3_ns3_s4] best solve_rate=0.3467 mean_conflicts=27.197 @ep60 (149.8s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_none_n50_k3_p0.2_T3_ns3_s4.pt +[full] LE n=300 fail_rate=0.65 | lambda1 SOLVED mean -0.4008 (n=104) | UNSOLVED mean -0.1440 (n=196) | sep=+0.2567 | AUROC(fail|lambda1)=0.842 | mean_lambda1=-0.2330 +[pe=none s4] deterministic solve_rate = 0.353 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.547 0.427 0.373 0.358 0.835 + wrote /home/yurenh2/rrog/runs/ptrm_color_full_none_n50_k3_p0.2_T3_ns3_s4.json +===== seed=4 full rwse ===== +ep20 solve_rate=0.000 mean_conflicts=56.06 +ep40 solve_rate=0.050 mean_conflicts=55.24 +ep60 solve_rate=0.303 mean_conflicts=39.93 +ep80 solve_rate=0.357 mean_conflicts=15.34 +ep100 solve_rate=0.547 mean_conflicts=6.19 +ep120 solve_rate=0.440 mean_conflicts=18.82 +ep140 solve_rate=0.240 mean_conflicts=41.55 +ep150 solve_rate=0.233 mean_conflicts=46.02 +[color_full_rwse_n50_k3_p0.2_T3_ns3_s4] best solve_rate=0.5467 mean_conflicts=6.193 @ep100 (154.2s) + wrote /home/yurenh2/rrog/runs/ckpt_color_full_rwse_n50_k3_p0.2_T3_ns3_s4.pt +[full] LE n=300 fail_rate=0.45 | lambda1 SOLVED mean -0.1742 (n=164) | UNSOLVED mean +0.1084 (n=136) | sep=+0.2827 | AUROC(fail|lambda1)=0.880 | mean_lambda1=-0.0461 +[pe=rwse s4] deterministic solve_rate = 0.547 (n=150, K=16) + sigma pass@K lam-sel random perRoll AUROC(s|-lam) + 0.2 0.940 0.853 0.493 0.557 0.868 + wrote /home/yurenh2/rrog/runs/ptrm_color_full_rwse_n50_k3_p0.2_T3_ns3_s4.json +===== seed=4 1step none ===== +ep20 solve_rate=0.000 mean_conflicts=63.11 +ep40 solve_rate=0.187 mean_conflicts=11.62 +ep60 solve_rate=0.237 mean_conflicts=22.39 +ep80 solve_rate=0.200 mean_conflicts=24.78 +ep100 solve_rate=0.183 mean_conflicts=15.49 +ep120 solve_rate=0.207 mean_conflicts=12.25 +ep140 solve_rate=0.093 mean_conflicts=21.66 +ep150 solve_rate=0.067 mean_conflicts=30.98 +[color_1step_none_n50_k3_p0.2_T3_ns3_s4] best solve_rate=0.2367 mean_conflicts=22.393 @ep60 (120.8s) + wrote /home/yurenh2/rrog/runs/ckpt_color_1step_none_n50_k3_p0.2_T3_ns3_s4.pt +[1step] LE n=300 fail_rate=0.76 | lambda1 SOLVED mean -0.2996 (n=71) | UNSOLVED mean -0.0523 (n=229) | sep=+0.2473 | AUROC(fail|lambda1)=0.835 | mean_lambda1=-0.1108 +===== AGGREGATE ===== +=== best solve_rate (deterministic, EMA) === + ('1step', 'none'): 0.293±0.062 (n=5) + ('full', 'none'): 0.457±0.087 (n=5) + ('full', 'rwse'): 0.503±0.064 (n=5) +=== LE AUROC(fail|lambda1) === + ('1step', 'none'): 0.821±0.036 (n=5) + ('full', 'none'): 0.868±0.032 (n=5) + ('full', 'rwse'): 0.837±0.041 (n=5) +=== PTRM sigma=0.2 === + ('full', 'none'): det 0.480±0.088 (n=5) | pass@K 0.739±0.113 (n=5) | lambda-sel 0.600±0.110 (n=5) | AUROC 0.853±0.023 (n=5) + ('full', 'rwse'): det 0.521±0.065 (n=5) | pass@K 0.883±0.075 (n=5) | lambda-sel 0.736±0.088 (n=5) | AUROC 0.837±0.028 (n=5) +done=2026-06-16T12:41:20-05:00 diff --git a/runs/ttc_rec_rrog_full_sig0.0_K1_bestq_T0_ns3_s0_test.json b/runs/ttc_rec_rrog_full_sig0.0_K1_bestq_T0_ns3_s0_test.json new file mode 100644 index 0000000..e5bc803 --- /dev/null +++ b/runs/ttc_rec_rrog_full_sig0.0_K1_bestq_T0_ns3_s0_test.json @@ -0,0 +1,63 @@ +{ + "ckpt": "runs/ckpt_rec_rrog_full_sig0.0_K1_bestq_T0_ns3_s0.pt", + "split": "test", + "train_T": 0, + "train_n_sup": 3, + "eval_n_sup": 3, + "rows": [ + { + "T_eval": 0, + "n_sup_eval": 3, + "mae": [ + 0.5142010450363159, + 0.5612384080886841 + ], + "mae_sum": 1.075439453125 + }, + { + "T_eval": 1, + "n_sup_eval": 3, + "mae": [ + 0.5142010450363159, + 0.5612384080886841 + ], + "mae_sum": 1.075439453125 + }, + { + "T_eval": 2, + "n_sup_eval": 3, + "mae": [ + 0.5142010450363159, + 0.5612384080886841 + ], + "mae_sum": 1.075439453125 + }, + { + "T_eval": 3, + "n_sup_eval": 3, + "mae": [ + 0.5142010450363159, + 0.5612384080886841 + ], + "mae_sum": 1.075439453125 + }, + { + "T_eval": 5, + "n_sup_eval": 3, + "mae": [ + 0.5142010450363159, + 0.5612384080886841 + ], + "mae_sum": 1.075439453125 + }, + { + "T_eval": 8, + "n_sup_eval": 3, + "mae": [ + 0.5142010450363159, + 0.5612384080886841 + ], + "mae_sum": 1.075439453125 + } + ] +}
\ No newline at end of file diff --git a/runs/ttc_rec_rrog_full_sig0.0_K1_bestq_T1_ns3_s0_test.json b/runs/ttc_rec_rrog_full_sig0.0_K1_bestq_T1_ns3_s0_test.json new file mode 100644 index 0000000..fd6aa76 --- /dev/null +++ b/runs/ttc_rec_rrog_full_sig0.0_K1_bestq_T1_ns3_s0_test.json @@ -0,0 +1,18 @@ +{ + "ckpt": "runs/ckpt_rec_rrog_full_sig0.0_K1_bestq_T1_ns3_s0.pt", + "split": "test", + "train_T": 1, + "train_n_sup": 3, + "eval_n_sup": 8, + "rows": [ + { + "T_eval": 1, + "n_sup_eval": 8, + "mae": [ + 0.660330057144165, + 0.6151341795921326 + ], + "mae_sum": 1.2754642367362976 + } + ] +}
\ No newline at end of file diff --git a/runs/ttc_rec_rrog_full_sig0.0_K1_bestq_T3_ns3_s0_test.json b/runs/ttc_rec_rrog_full_sig0.0_K1_bestq_T3_ns3_s0_test.json new file mode 100644 index 0000000..ae00620 --- /dev/null +++ b/runs/ttc_rec_rrog_full_sig0.0_K1_bestq_T3_ns3_s0_test.json @@ -0,0 +1,18 @@ +{ + "ckpt": "runs/ckpt_rec_rrog_full_sig0.0_K1_bestq_T3_ns3_s0.pt", + "split": "test", + "train_T": 3, + "train_n_sup": 3, + "eval_n_sup": 8, + "rows": [ + { + "T_eval": 3, + "n_sup_eval": 8, + "mae": [ + 0.41426005959510803, + 0.6339796185493469 + ], + "mae_sum": 1.048239678144455 + } + ] +}
\ No newline at end of file diff --git a/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s123_ns2_test.json b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s123_ns2_test.json new file mode 100644 index 0000000..4e954e1 --- /dev/null +++ b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s123_ns2_test.json @@ -0,0 +1,43 @@ +{ + "ckpt": "runs/ckpt_rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s123.pt", + "split": "test", + "train_T": 1, + "train_n_sup": 2, + "eval_n_sup": 2, + "adaptive": false, + "rows": [ + { + "T_eval": 0, + "n_sup_eval": 2, + "adaptive": false, + "avg_steps": 2.0, + "mae": [ + 0.6409543752670288, + 0.6232001185417175 + ], + "mae_sum": 1.2641544938087463 + }, + { + "T_eval": 1, + "n_sup_eval": 2, + "adaptive": false, + "avg_steps": 2.0, + "mae": [ + 0.5365709662437439, + 0.6183863282203674 + ], + "mae_sum": 1.1549572944641113 + }, + { + "T_eval": 2, + "n_sup_eval": 2, + "adaptive": false, + "avg_steps": 2.0, + "mae": [ + 0.5599585771560669, + 0.6114262342453003 + ], + "mae_sum": 1.1713848114013672 + } + ] +}
\ No newline at end of file diff --git a/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s123_ns2_test_adaptive.json b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s123_ns2_test_adaptive.json new file mode 100644 index 0000000..0a7e649 --- /dev/null +++ b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s123_ns2_test_adaptive.json @@ -0,0 +1,43 @@ +{ + "ckpt": "runs/ckpt_rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s123.pt", + "split": "test", + "train_T": 1, + "train_n_sup": 2, + "eval_n_sup": 2, + "adaptive": true, + "rows": [ + { + "T_eval": 0, + "n_sup_eval": 2, + "adaptive": true, + "avg_steps": 1.998, + "mae": [ + 0.6409543752670288, + 0.6232001185417175 + ], + "mae_sum": 1.2641544938087463 + }, + { + "T_eval": 1, + "n_sup_eval": 2, + "adaptive": true, + "avg_steps": 1.998, + "mae": [ + 0.5365839004516602, + 0.6184093952178955 + ], + "mae_sum": 1.1549932956695557 + }, + { + "T_eval": 2, + "n_sup_eval": 2, + "adaptive": true, + "avg_steps": 1.998, + "mae": [ + 0.5598364472389221, + 0.6113667488098145 + ], + "mae_sum": 1.1712031960487366 + } + ] +}
\ No newline at end of file diff --git a/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s124_ns2_test.json b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s124_ns2_test.json new file mode 100644 index 0000000..89e7ac8 --- /dev/null +++ b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s124_ns2_test.json @@ -0,0 +1,43 @@ +{ + "ckpt": "runs/ckpt_rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s124.pt", + "split": "test", + "train_T": 1, + "train_n_sup": 2, + "eval_n_sup": 2, + "adaptive": false, + "rows": [ + { + "T_eval": 0, + "n_sup_eval": 2, + "adaptive": false, + "avg_steps": 2.0, + "mae": [ + 0.5493720173835754, + 0.6576622724533081 + ], + "mae_sum": 1.2070342898368835 + }, + { + "T_eval": 1, + "n_sup_eval": 2, + "adaptive": false, + "avg_steps": 2.0, + "mae": [ + 0.5429545640945435, + 0.689839243888855 + ], + "mae_sum": 1.2327938079833984 + }, + { + "T_eval": 2, + "n_sup_eval": 2, + "adaptive": false, + "avg_steps": 2.0, + "mae": [ + 0.5237374305725098, + 0.6338798999786377 + ], + "mae_sum": 1.1576173305511475 + } + ] +}
\ No newline at end of file diff --git a/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s124_ns2_test_adaptive.json b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s124_ns2_test_adaptive.json new file mode 100644 index 0000000..34c226f --- /dev/null +++ b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s124_ns2_test_adaptive.json @@ -0,0 +1,43 @@ +{ + "ckpt": "runs/ckpt_rec_rrog_full_sig0.0_K1_none_T1_ns2_act2_s124.pt", + "split": "test", + "train_T": 1, + "train_n_sup": 2, + "eval_n_sup": 2, + "adaptive": true, + "rows": [ + { + "T_eval": 0, + "n_sup_eval": 2, + "adaptive": true, + "avg_steps": 2.0, + "mae": [ + 0.5493719577789307, + 0.6576622724533081 + ], + "mae_sum": 1.2070342302322388 + }, + { + "T_eval": 1, + "n_sup_eval": 2, + "adaptive": true, + "avg_steps": 2.0, + "mae": [ + 0.5429545640945435, + 0.689839243888855 + ], + "mae_sum": 1.2327938079833984 + }, + { + "T_eval": 2, + "n_sup_eval": 2, + "adaptive": true, + "avg_steps": 2.0, + "mae": [ + 0.5237374901771545, + 0.6338798999786377 + ], + "mae_sum": 1.1576173901557922 + } + ] +}
\ No newline at end of file diff --git a/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_e200_s0_ns8_test.json b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_e200_s0_ns8_test.json new file mode 100644 index 0000000..41de52c --- /dev/null +++ b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_e200_s0_ns8_test.json @@ -0,0 +1,76 @@ +{ + "ckpt": "runs/ckpt_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_e200_s0.pt", + "split": "test", + "train_T": 1, + "train_n_sup": 3, + "eval_n_sup": 8, + "adaptive": false, + "rows": [ + { + "T_eval": 0, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.5232908725738525, + 0.7065197229385376 + ], + "mae_sum": 1.2298105955123901 + }, + { + "T_eval": 1, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.35694339871406555, + 0.32599589228630066 + ], + "mae_sum": 0.6829392910003662 + }, + { + "T_eval": 2, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.34778130054473877, + 0.7186371684074402 + ], + "mae_sum": 1.066418468952179 + }, + { + "T_eval": 3, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.31050366163253784, + 0.7275600433349609 + ], + "mae_sum": 1.0380637049674988 + }, + { + "T_eval": 5, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.4022192358970642, + 0.7831410765647888 + ], + "mae_sum": 1.185360312461853 + }, + { + "T_eval": 8, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.4811066687107086, + 0.7915135025978088 + ], + "mae_sum": 1.2726201713085175 + } + ] +}
\ No newline at end of file diff --git a/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_e200_s0_ns8_test_adaptive.json b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_e200_s0_ns8_test_adaptive.json new file mode 100644 index 0000000..4f7e847 --- /dev/null +++ b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_e200_s0_ns8_test_adaptive.json @@ -0,0 +1,76 @@ +{ + "ckpt": "runs/ckpt_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_e200_s0.pt", + "split": "test", + "train_T": 1, + "train_n_sup": 3, + "eval_n_sup": 8, + "adaptive": true, + "rows": [ + { + "T_eval": 0, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 7.958, + "mae": [ + 0.5232908725738525, + 0.7065197229385376 + ], + "mae_sum": 1.2298105955123901 + }, + { + "T_eval": 1, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 1.717, + "mae": [ + 0.15837429463863373, + 0.22618268430233002 + ], + "mae_sum": 0.38455697894096375 + }, + { + "T_eval": 2, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 5.774, + "mae": [ + 0.36895444989204407, + 0.7003458738327026 + ], + "mae_sum": 1.0693003237247467 + }, + { + "T_eval": 3, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 5.905, + "mae": [ + 0.32024097442626953, + 0.706447958946228 + ], + "mae_sum": 1.0266889333724976 + }, + { + "T_eval": 5, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 6.277, + "mae": [ + 0.41388994455337524, + 0.7770671248435974 + ], + "mae_sum": 1.1909570693969727 + }, + { + "T_eval": 8, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 6.194, + "mae": [ + 0.4935642182826996, + 0.7972421050071716 + ], + "mae_sum": 1.2908063232898712 + } + ] +}
\ No newline at end of file diff --git a/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_s0_ns8_test.json b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_s0_ns8_test.json new file mode 100644 index 0000000..2e96f6d --- /dev/null +++ b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_s0_ns8_test.json @@ -0,0 +1,76 @@ +{ + "ckpt": "runs/ckpt_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_s0.pt", + "split": "test", + "train_T": 1, + "train_n_sup": 3, + "eval_n_sup": 8, + "adaptive": false, + "rows": [ + { + "T_eval": 0, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.4224133789539337, + 0.40480512380599976 + ], + "mae_sum": 0.8272185027599335 + }, + { + "T_eval": 1, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.3479718267917633, + 0.46119195222854614 + ], + "mae_sum": 0.8091637790203094 + }, + { + "T_eval": 2, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.33665651082992554, + 0.4896860420703888 + ], + "mae_sum": 0.8263425529003143 + }, + { + "T_eval": 3, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.3050404489040375, + 0.4860474765300751 + ], + "mae_sum": 0.7910879254341125 + }, + { + "T_eval": 5, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.3325568437576294, + 0.48589229583740234 + ], + "mae_sum": 0.8184491395950317 + }, + { + "T_eval": 8, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.35957154631614685, + 0.4916436970233917 + ], + "mae_sum": 0.8512152433395386 + } + ] +}
\ No newline at end of file diff --git a/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_s0_ns8_test_adaptive.json b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_s0_ns8_test_adaptive.json new file mode 100644 index 0000000..fa0a80b --- /dev/null +++ b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_s0_ns8_test_adaptive.json @@ -0,0 +1,76 @@ +{ + "ckpt": "runs/ckpt_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_binary0.3_s0.pt", + "split": "test", + "train_T": 1, + "train_n_sup": 3, + "eval_n_sup": 8, + "adaptive": true, + "rows": [ + { + "T_eval": 0, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 4.759, + "mae": [ + 0.4224133789539337, + 0.40480512380599976 + ], + "mae_sum": 0.8272185027599335 + }, + { + "T_eval": 1, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 3.227, + "mae": [ + 0.2506031394004822, + 0.36558958888053894 + ], + "mae_sum": 0.6161927282810211 + }, + { + "T_eval": 2, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 3.454, + "mae": [ + 0.3113872706890106, + 0.3894437253475189 + ], + "mae_sum": 0.7008309960365295 + }, + { + "T_eval": 3, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 3.355, + "mae": [ + 0.276737242937088, + 0.3839529752731323 + ], + "mae_sum": 0.6606902182102203 + }, + { + "T_eval": 5, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 3.602, + "mae": [ + 0.3202260434627533, + 0.4118613302707672 + ], + "mae_sum": 0.7320873737335205 + }, + { + "T_eval": 8, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 3.908, + "mae": [ + 0.3538242280483246, + 0.4284476041793823 + ], + "mae_sum": 0.7822718322277069 + } + ] +}
\ No newline at end of file diff --git a/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_s0_ns3_test.json b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_s0_ns3_test.json new file mode 100644 index 0000000..36eed47 --- /dev/null +++ b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_s0_ns3_test.json @@ -0,0 +1,76 @@ +{ + "ckpt": "runs/ckpt_rec_rrog_full_sig0.0_K1_none_T1_ns3_act8_s0.pt", + "split": "test", + "train_T": 1, + "train_n_sup": 3, + "eval_n_sup": 3, + "adaptive": false, + "rows": [ + { + "T_eval": 0, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.21611903607845306, + 0.2910664677619934 + ], + "mae_sum": 0.5071855038404465 + }, + { + "T_eval": 1, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.17683295905590057, + 0.2740752398967743 + ], + "mae_sum": 0.45090819895267487 + }, + { + "T_eval": 2, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.20486876368522644, + 0.2954113185405731 + ], + "mae_sum": 0.5002800822257996 + }, + { + "T_eval": 3, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.23122535645961761, + 0.30837035179138184 + ], + "mae_sum": 0.5395957082509995 + }, + { + "T_eval": 5, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.2507438659667969, + 0.3014044165611267 + ], + "mae_sum": 0.5521482825279236 + }, + { + "T_eval": 8, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.2450169026851654, + 0.294334352016449 + ], + "mae_sum": 0.5393512547016144 + } + ] +}
\ No newline at end of file diff --git a/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_s0_ns3_test_adaptive.json b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_s0_ns3_test_adaptive.json new file mode 100644 index 0000000..4484b54 --- /dev/null +++ b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_s0_ns3_test_adaptive.json @@ -0,0 +1,76 @@ +{ + "ckpt": "runs/ckpt_rec_rrog_full_sig0.0_K1_none_T1_ns3_act8_s0.pt", + "split": "test", + "train_T": 1, + "train_n_sup": 3, + "eval_n_sup": 3, + "adaptive": true, + "rows": [ + { + "T_eval": 0, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 3.037, + "mae": [ + 0.21611905097961426, + 0.2910664677619934 + ], + "mae_sum": 0.5071855187416077 + }, + { + "T_eval": 1, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 2.362, + "mae": [ + 0.18731115758419037, + 0.26750966906547546 + ], + "mae_sum": 0.45482082664966583 + }, + { + "T_eval": 2, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 2.687, + "mae": [ + 0.18941596150398254, + 0.2780311107635498 + ], + "mae_sum": 0.46744707226753235 + }, + { + "T_eval": 3, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 2.877, + "mae": [ + 0.19598323106765747, + 0.2850847840309143 + ], + "mae_sum": 0.4810680150985718 + }, + { + "T_eval": 5, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 3.083, + "mae": [ + 0.20526784658432007, + 0.28344079852104187 + ], + "mae_sum": 0.48870864510536194 + }, + { + "T_eval": 8, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 3.214, + "mae": [ + 0.21041440963745117, + 0.27915048599243164 + ], + "mae_sum": 0.4895648956298828 + } + ] +}
\ No newline at end of file diff --git a/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_s0_ns8_test.json b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_s0_ns8_test.json new file mode 100644 index 0000000..a790bc9 --- /dev/null +++ b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_s0_ns8_test.json @@ -0,0 +1,76 @@ +{ + "ckpt": "runs/ckpt_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_s0.pt", + "split": "test", + "train_T": 1, + "train_n_sup": 3, + "eval_n_sup": 8, + "adaptive": false, + "rows": [ + { + "T_eval": 0, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.38682764768600464, + 0.45607417821884155 + ], + "mae_sum": 0.8429018259048462 + }, + { + "T_eval": 1, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.38368427753448486, + 0.4671553671360016 + ], + "mae_sum": 0.8508396446704865 + }, + { + "T_eval": 2, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.40771323442459106, + 0.5411470532417297 + ], + "mae_sum": 0.9488602876663208 + }, + { + "T_eval": 3, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.4195733070373535, + 0.5811861753463745 + ], + "mae_sum": 1.000759482383728 + }, + { + "T_eval": 5, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.42317721247673035, + 0.5997551083564758 + ], + "mae_sum": 1.0229323208332062 + }, + { + "T_eval": 8, + "n_sup_eval": 8, + "adaptive": false, + "avg_steps": 8.0, + "mae": [ + 0.4142177104949951, + 0.5873055458068848 + ], + "mae_sum": 1.0015232563018799 + } + ] +}
\ No newline at end of file diff --git a/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_s0_ns8_test_adaptive.json b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_s0_ns8_test_adaptive.json new file mode 100644 index 0000000..c3880ac --- /dev/null +++ b/runs/ttc_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_s0_ns8_test_adaptive.json @@ -0,0 +1,76 @@ +{ + "ckpt": "runs/ckpt_rec_rrog_full_sig0.0_K1_none_T1_ns3_actfull8_s0.pt", + "split": "test", + "train_T": 1, + "train_n_sup": 3, + "eval_n_sup": 8, + "adaptive": true, + "rows": [ + { + "T_eval": 0, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 6.95, + "mae": [ + 0.38682764768600464, + 0.45607417821884155 + ], + "mae_sum": 0.8429018259048462 + }, + { + "T_eval": 1, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 5.9, + "mae": [ + 0.33561548590660095, + 0.4454902410507202 + ], + "mae_sum": 0.7811057269573212 + }, + { + "T_eval": 2, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 5.285, + "mae": [ + 0.34025096893310547, + 0.45459678769111633 + ], + "mae_sum": 0.7948477566242218 + }, + { + "T_eval": 3, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 5.079, + "mae": [ + 0.3467695415019989, + 0.4739716351032257 + ], + "mae_sum": 0.8207411766052246 + }, + { + "T_eval": 5, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 5.037, + "mae": [ + 0.35314130783081055, + 0.49610018730163574 + ], + "mae_sum": 0.8492414951324463 + }, + { + "T_eval": 8, + "n_sup_eval": 8, + "adaptive": true, + "avg_steps": 5.249, + "mae": [ + 0.358676016330719, + 0.5090946555137634 + ], + "mae_sum": 0.8677706718444824 + } + ] +}
\ No newline at end of file diff --git a/runs/zinc_gine_after_ogb.log b/runs/zinc_gine_after_ogb.log new file mode 100644 index 0000000..b39e901 --- /dev/null +++ b/runs/zinc_gine_after_ogb.log @@ -0,0 +1 @@ +[wait] OGB queue pid=2654451 diff --git a/scripts/analyze_ogb_hiv_log.py b/scripts/analyze_ogb_hiv_log.py new file mode 100644 index 0000000..21253fe --- /dev/null +++ b/scripts/analyze_ogb_hiv_log.py @@ -0,0 +1,312 @@ +#!/usr/bin/env python3 +import argparse +import csv +import json +import math +import re +from collections import defaultdict +from pathlib import Path + + +RUN_RE = re.compile( + r"^\[run\]\s+" + r"(?P<dataset>\S+)\s+view=(?P<view>\S+)\s+compute=(?P<compute>\S+)\s+" + r"T=(?P<T>\d+)\s+ns=(?P<ns>\d+)" +) +EP_RE = re.compile( + r"^ep(?P<ep>\d+)\s+val_(?P<metric>\w+)=(?P<val>[-+0-9.eE]+).*" + r"train_steps=(?P<steps>[-+0-9.eE]+)" +) + + +def _load_json(path: Path) -> dict | None: + try: + with path.open() as f: + return json.load(f) + except (OSError, json.JSONDecodeError): + return None + + +def _score(rep: dict, split: str) -> float | None: + metric = rep.get("metric") + if not metric: + return None + value = rep.get(split, {}).get(metric) + return None if value is None else float(value) + + +def parse_curves(path: Path): + curves = defaultdict(list) + current = None + with path.open(errors="replace") as f: + for line in f: + line = line.strip() + m = RUN_RE.match(line) + if m: + current = ( + m.group("dataset"), + m.group("view"), + m.group("compute"), + int(m.group("T")), + int(m.group("ns")), + ) + continue + m = EP_RE.match(line) + if current is not None and m: + curves[current].append({ + "ep": int(m.group("ep")), + "metric": m.group("metric"), + "val": float(m.group("val")), + "train_steps": float(m.group("steps")), + }) + return curves + + +def load_runs(runs_dir: Path, dataset: str): + runs = {} + for path in sorted(runs_dir.glob(f"{dataset}_*.json")): + rep = _load_json(path) + if rep is None: + continue + if rep.get("dataset") != dataset: + continue + key = ( + rep.get("view"), + rep.get("compute"), + int(rep.get("T", -1)), + int(rep.get("n_sup", -1)), + int(rep.get("seed", -1)), + ) + runs[key] = rep + return runs + + +def curve_stats(curve: list[dict]) -> dict: + if not curve: + return { + "curve_best_ep": None, + "curve_best_val": None, + "curve_final_ep": None, + "curve_final_val": None, + "final_gap": None, + "late_slope": None, + "range": None, + } + best = max(curve, key=lambda x: x["val"]) + final = curve[-1] + late_slope = None + if len(curve) >= 2: + late_slope = final["val"] - curve[-2]["val"] + vals = [x["val"] for x in curve] + return { + "curve_best_ep": best["ep"], + "curve_best_val": best["val"], + "curve_final_ep": final["ep"], + "curve_final_val": final["val"], + "final_gap": best["val"] - final["val"], + "late_slope": late_slope, + "range": max(vals) - min(vals), + } + + +def labels_for(row: dict, *, val_tol: float, test_tol: float, collapse_gap: float) -> str: + labels = [] + if row["val_delta"] >= -val_tol and row["test_delta"] >= -test_tol: + labels.append("positive_or_tie") + elif row["val_delta"] >= -val_tol and row["test_delta"] < -test_tol: + labels.append("val_up_test_down") + elif row["val_delta"] < -val_tol and row["test_delta"] >= -test_tol: + labels.append("test_up_val_down") + else: + labels.append("val_and_test_down") + + if row["val_delta"] < -0.02: + labels.append("fixed_val_lags_classic") + if row["cand_final_gap"] is not None and row["cand_final_gap"] > collapse_gap: + labels.append("late_collapse") + if ( + row["cand_curve_best_ep"] is not None + and row["cand_curve_final_ep"] is not None + and row["cand_curve_best_ep"] >= row["cand_curve_final_ep"] - 10 + and (row["cand_final_gap"] is None or row["cand_final_gap"] <= 0.01) + ): + labels.append("maybe_undertrained") + return ",".join(labels) + + +def fmt(x, digits=4): + if x is None: + return "" + if isinstance(x, int): + return str(x) + return f"{x:.{digits}f}" + + +def markdown_table(headers, rows): + out = [ + "| " + " | ".join(headers) + " |", + "| " + " | ".join(["---"] * len(headers)) + " |", + ] + out.extend("| " + " | ".join(row) + " |" for row in rows) + return "\n".join(out) + + +def mean(xs): + return sum(xs) / len(xs) if xs else 0.0 + + +def corr(xs, ys): + if len(xs) != len(ys) or len(xs) < 2: + return 0.0 + mx = mean(xs) + my = mean(ys) + den = math.sqrt(sum((x - mx) ** 2 for x in xs) * sum((y - my) ** 2 for y in ys)) + if den == 0: + return 0.0 + return sum((x - mx) * (y - my) for x, y in zip(xs, ys)) / den + + +def main(): + ap = argparse.ArgumentParser() + ap.add_argument("--dataset", default="ogbg-molhiv") + ap.add_argument("--runs-dir", default="runs") + ap.add_argument("--log", default="logs/ogbg-molhiv_0.log") + ap.add_argument("--out-dir", default="analysis") + ap.add_argument("--candidate-compute", default="fixed-rrog") + ap.add_argument("--candidate-T", type=int, default=3) + ap.add_argument("--candidate-n-sup", type=int, default=3) + ap.add_argument("--baseline-compute", default="classic") + ap.add_argument("--baseline-T", type=int, default=0) + ap.add_argument("--baseline-n-sup", type=int, default=1) + ap.add_argument("--seed", type=int, default=0) + ap.add_argument("--val-tol", type=float, default=0.0) + ap.add_argument("--test-tol", type=float, default=0.0) + ap.add_argument("--collapse-gap", type=float, default=0.03) + args = ap.parse_args() + + runs_dir = Path(args.runs_dir) + curves = parse_curves(Path(args.log)) + runs = load_runs(runs_dir, args.dataset) + out_dir = Path(args.out_dir) + out_dir.mkdir(parents=True, exist_ok=True) + + rows = [] + views = sorted({ + view for (view, compute, _t, _ns, seed) in runs + if seed == args.seed and compute == args.baseline_compute + }) + for view in views: + base_key = (view, args.baseline_compute, args.baseline_T, args.baseline_n_sup, args.seed) + cand_key = (view, args.candidate_compute, args.candidate_T, args.candidate_n_sup, args.seed) + base = runs.get(base_key) + cand = runs.get(cand_key) + if base is None or cand is None: + continue + metric = cand["metric"] + base_val = _score(base, "val") + base_test = _score(base, "test") + cand_val = _score(cand, "val") + cand_test = _score(cand, "test") + if None in {base_val, base_test, cand_val, cand_test}: + continue + base_curve = curve_stats(curves.get((args.dataset, view, args.baseline_compute, args.baseline_T, args.baseline_n_sup), [])) + cand_curve = curve_stats(curves.get((args.dataset, view, args.candidate_compute, args.candidate_T, args.candidate_n_sup), [])) + row = { + "view": view, + "metric": metric, + "base_ep": int(base.get("ep") or 0), + "base_val": base_val, + "base_test": base_test, + "cand_ep": int(cand.get("ep") or 0), + "cand_val": cand_val, + "cand_test": cand_test, + "val_delta": cand_val - base_val, + "test_delta": cand_test - base_test, + "base_curve_best_ep": base_curve["curve_best_ep"], + "base_final_gap": base_curve["final_gap"], + "cand_curve_best_ep": cand_curve["curve_best_ep"], + "cand_curve_final_ep": cand_curve["curve_final_ep"], + "cand_final_gap": cand_curve["final_gap"], + "cand_late_slope": cand_curve["late_slope"], + "cand_range": cand_curve["range"], + } + row["labels"] = labels_for( + row, + val_tol=args.val_tol, + test_tol=args.test_tol, + collapse_gap=args.collapse_gap, + ) + rows.append(row) + + csv_path = out_dir / f"{args.dataset}_{args.candidate_compute}_T{args.candidate_T}_ns{args.candidate_n_sup}_diagnostics.csv" + fieldnames = [ + "view", "metric", "base_ep", "base_val", "base_test", "cand_ep", "cand_val", "cand_test", + "val_delta", "test_delta", "base_curve_best_ep", "base_final_gap", + "cand_curve_best_ep", "cand_curve_final_ep", "cand_final_gap", "cand_late_slope", + "cand_range", "labels", + ] + with csv_path.open("w", newline="") as f: + writer = csv.DictWriter(f, fieldnames=fieldnames) + writer.writeheader() + writer.writerows(rows) + + counts = defaultdict(int) + for row in rows: + for label in row["labels"].split(","): + counts[label] += 1 + + pos = [r for r in rows if r["val_delta"] >= 0 and r["test_delta"] >= 0] + val_up_test_down = [r for r in rows if r["val_delta"] >= 0 and r["test_delta"] < 0] + val_down_test_up = [r for r in rows if r["val_delta"] < 0 and r["test_delta"] >= 0] + both_down = [r for r in rows if r["val_delta"] < 0 and r["test_delta"] < 0] + late = [r for r in rows if "maybe_undertrained" in r["labels"]] + collapse = [r for r in rows if "late_collapse" in r["labels"]] + val_deltas = [r["val_delta"] for r in rows] + test_deltas = [r["test_delta"] for r in rows] + + def row_line(r): + return [ + r["view"], + fmt(r["base_val"]), + fmt(r["cand_val"]), + fmt(r["val_delta"]), + fmt(r["base_test"]), + fmt(r["cand_test"]), + fmt(r["test_delta"]), + str(r["cand_ep"]), + fmt(r["cand_final_gap"]), + r["labels"], + ] + + md_path = csv_path.with_suffix(".md") + with md_path.open("w") as f: + f.write(f"# {args.dataset} {args.candidate_compute} T={args.candidate_T} ns={args.candidate_n_sup} diagnostics\n\n") + f.write(f"- rows: {len(rows)}\n") + f.write(f"- val+test positive: {len(pos)}\n") + f.write(f"- val up, test down: {len(val_up_test_down)}\n") + f.write(f"- val down, test up: {len(val_down_test_up)}\n") + f.write(f"- val+test down: {len(both_down)}\n") + f.write(f"- maybe undertrained: {len(late)}\n") + f.write(f"- late collapse: {len(collapse)}\n\n") + f.write(f"- mean val delta: {fmt(mean(val_deltas))}\n") + f.write(f"- mean test delta: {fmt(mean(test_deltas))}\n") + f.write(f"- val/test delta corr: {fmt(corr(val_deltas, test_deltas))}\n\n") + f.write("## Label Counts\n\n") + f.write(markdown_table(["label", "n"], [[k, str(v)] for k, v in sorted(counts.items())])) + f.write("\n\n## Per-Backbone Rows\n\n") + headers = [ + "view", "base_val", "cand_val", "d_val", "base_test", "cand_test", + "d_test", "cand_ep", "cand_final_gap", "labels", + ] + f.write(markdown_table(headers, [row_line(r) for r in rows])) + f.write("\n") + + print(f"wrote {csv_path}") + print(f"wrote {md_path}") + print(f"rows={len(rows)} val+test={len(pos)} val_up_test_down={len(val_up_test_down)} " + f"val_down_test_up={len(val_down_test_up)} both_down={len(both_down)} " + f"maybe_undertrained={len(late)} late_collapse={len(collapse)}") + + +if __name__ == "__main__": + main() diff --git a/scripts/collect_results.sh b/scripts/collect_results.sh new file mode 100755 index 0000000..360f05b --- /dev/null +++ b/scripts/collect_results.sh @@ -0,0 +1,10 @@ +#!/usr/bin/env bash +set -euo pipefail + +ROOT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd)" +cd "${ROOT_DIR}" +export PYTHONPATH="${ROOT_DIR}:${PYTHONPATH:-}" + +mkdir -p summaries +python3 -m rrog.cli zinc-results --epochs "${ZINC_EPOCHS:-200}" | tee summaries/zinc_cycle56.md +python3 -m rrog.cli results --epochs "${OGB_EPOCHS:-100}" | tee summaries/ogb_graphprop.md diff --git a/scripts/run_ogb_act_task.sh b/scripts/run_ogb_act_task.sh new file mode 100755 index 0000000..37eb1a6 --- /dev/null +++ b/scripts/run_ogb_act_task.sh @@ -0,0 +1,119 @@ +#!/usr/bin/env bash +set -euo pipefail + +ROOT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd)" +cd "${ROOT_DIR}" +export PYTHONPATH="${ROOT_DIR}:${PYTHONPATH:-}" + +TASK="${TASK:-ogbg-molhiv}" +DEVICE="${DEVICE:-cuda:0}" +EPOCHS="${EPOCHS:-100}" +SEEDS="${SEEDS:-${SEED:-0}}" +HIDDEN="${HIDDEN:-128}" +BS="${BS:-128}" +LR="${LR:-}" +EVAL_EVERY="${EVAL_EVERY:-10}" +NUM_WORKERS="${NUM_WORKERS:-0}" +T="${T:-1}" +N_SUP="${N_SUP:-3}" +HALT_MAX="${HALT_MAX:-8}" +HALT_MIN="${HALT_MIN:-2}" +HALT_TARGET="${HALT_TARGET:-loss}" +HALT_LOSS_THRESHOLD="${HALT_LOSS_THRESHOLD:-0.2}" +HALT_EXPLORATION_PROB="${HALT_EXPLORATION_PROB:-0.1}" +LAM_Q="${LAM_Q:-0.1}" +Q_WARMUP="${Q_WARMUP:-0}" +ACT_TRAIN_MODE="${ACT_TRAIN_MODE:-stream}" +EMA="${EMA:-0}" +MAX_TRAIN_BATCHES="${MAX_TRAIN_BATCHES:-}" +MAX_EVAL_BATCHES="${MAX_EVAL_BATCHES:-}" +COLLECT="${COLLECT:-1}" +VIEWS="${VIEWS:-gin gine gcn graphsage gatv2 graphconv transformer pna gen film resgated tag sgc cheb arma mf appnp}" + +mkdir -p runs logs summaries + +fmt_float() { + python3 - "$1" <<'PY' +import sys +print(f"{float(sys.argv[1]):g}") +PY +} + +result_path() { + local view="$1" + local seed="$2" + local target_tag="${HALT_TARGET}" + local loss_tag + local lam_tag + local hex_tag + local ema_tag="" + loss_tag="$(fmt_float "${HALT_LOSS_THRESHOLD}")" + lam_tag="$(fmt_float "${LAM_Q}")" + hex_tag="$(fmt_float "${HALT_EXPLORATION_PROB}")" + if [[ "${HALT_TARGET}" == "loss" ]]; then + target_tag="loss${loss_tag}" + fi + if [[ "$(fmt_float "${EMA}")" != "0" ]]; then + ema_tag="_ema$(fmt_float "${EMA}")" + fi + echo "runs/${TASK}_${view}_rrog-act_T${T}_ns${N_SUP}_${ACT_TRAIN_MODE}_hm${HALT_MAX}_hmin${HALT_MIN}_${target_tag}_lq${lam_tag}_hex${hex_tag}_qw${Q_WARMUP}_h${HIDDEN}_e${EPOCHS}${ema_tag}_s${seed}.json" +} + +run_cell() { + local view="$1" + local seed="$2" + local out + out="$(result_path "${view}" "${seed}")" + if [[ -f "${out}" ]]; then + echo "[skip] ${out}" + return + fi + + echo "[run] ${TASK} view=${view} compute=rrog-act mode=${ACT_TRAIN_MODE} T=${T} ns=${N_SUP} seed=${seed} device=${DEVICE}" + cmd=( + python3 -m rrog.cli run + --task "${TASK}" + --view "${view}" + --compute rrog-act + --epochs "${EPOCHS}" + --hidden "${HIDDEN}" + --bs "${BS}" + --T "${T}" + --n_sup "${N_SUP}" + --halt_max_steps "${HALT_MAX}" + --halt_min_steps "${HALT_MIN}" + --halt_target "${HALT_TARGET}" + --halt_loss_threshold "${HALT_LOSS_THRESHOLD}" + --halt_exploration_prob "${HALT_EXPLORATION_PROB}" + --lam_q "${LAM_Q}" + --q_warmup_epochs "${Q_WARMUP}" + --act_train_mode "${ACT_TRAIN_MODE}" + --eval_every "${EVAL_EVERY}" + --num_workers "${NUM_WORKERS}" + --seed "${seed}" + --device "${DEVICE}" + ) + if [[ -n "${LR}" ]]; then + cmd+=(--lr "${LR}") + fi + if [[ "$(fmt_float "${EMA}")" != "0" ]]; then + cmd+=(--ema "${EMA}") + fi + if [[ -n "${MAX_TRAIN_BATCHES}" ]]; then + cmd+=(--max_train_batches "${MAX_TRAIN_BATCHES}") + fi + if [[ -n "${MAX_EVAL_BATCHES}" ]]; then + cmd+=(--max_eval_batches "${MAX_EVAL_BATCHES}") + fi + "${cmd[@]}" +} + +for seed in ${SEEDS}; do + for view in ${VIEWS}; do + run_cell "${view}" "${seed}" + done +done + +if [[ "${COLLECT}" == "1" ]]; then + python3 -m rrog.cli results --epochs "${EPOCHS}" | tee "summaries/ogb_graphprop_act_${TASK}_e${EPOCHS}.md" +fi diff --git a/scripts/run_ogb_act_two_gpu.sh b/scripts/run_ogb_act_two_gpu.sh new file mode 100755 index 0000000..f51262b --- /dev/null +++ b/scripts/run_ogb_act_two_gpu.sh @@ -0,0 +1,91 @@ +#!/usr/bin/env bash +set -euo pipefail + +ROOT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd)" +cd "${ROOT_DIR}" +export PYTHONPATH="${ROOT_DIR}:${PYTHONPATH:-}" + +GPU0="${GPU0:-cuda:0}" +GPU1="${GPU1:-cuda:1}" +if [[ -z "${TASKS_GPU0+x}" ]]; then + TASKS_GPU0="ogbg-molhiv ogbg-molbbbp ogbg-molsider ogbg-molbace" +fi +if [[ -z "${TASKS_GPU1+x}" ]]; then + TASKS_GPU1="ogbg-molesol ogbg-mollipo ogbg-moltox21 ogbg-molclintox" +fi +EPOCHS="${EPOCHS:-100}" +SEEDS="${SEEDS:-${SEED:-0}}" +HALT_MAX="${HALT_MAX:-8}" +HALT_MIN="${HALT_MIN:-2}" +HALT_TARGET="${HALT_TARGET:-loss}" +HALT_LOSS_THRESHOLD="${HALT_LOSS_THRESHOLD:-0.2}" +HALT_EXPLORATION_PROB="${HALT_EXPLORATION_PROB:-0.1}" +LAM_Q="${LAM_Q:-0.1}" +Q_WARMUP="${Q_WARMUP:-0}" +ACT_TRAIN_MODE="${ACT_TRAIN_MODE:-stream}" + +mkdir -p logs summaries + +fmt_float() { + python3 - "$1" <<'PY' +import sys +print(f"{float(sys.argv[1]):g}") +PY +} + +target_log_tag() { + local target_tag="${HALT_TARGET}" + if [[ "${HALT_TARGET}" == "loss" ]]; then + target_tag="loss$(fmt_float "${HALT_LOSS_THRESHOLD}")" + fi + echo "${ACT_TRAIN_MODE}_hm${HALT_MAX}_hmin${HALT_MIN}_${target_tag}_lq$(fmt_float "${LAM_Q}")_hex$(fmt_float "${HALT_EXPLORATION_PROB}")_qw${Q_WARMUP}_e${EPOCHS}_s${SEEDS// /-}" +} + +run_queue() { + local device="$1" + shift + local tasks=("$@") + local task + local tag + tag="$(target_log_tag)" + for task in "${tasks[@]}"; do + if [[ -z "${task}" ]]; then + continue + fi + echo "[task] ${task} on ${device}" + TASK="${task}" DEVICE="${device}" EPOCHS="${EPOCHS}" SEEDS="${SEEDS}" \ + HALT_MAX="${HALT_MAX}" HALT_MIN="${HALT_MIN}" HALT_TARGET="${HALT_TARGET}" \ + HALT_LOSS_THRESHOLD="${HALT_LOSS_THRESHOLD}" HALT_EXPLORATION_PROB="${HALT_EXPLORATION_PROB}" \ + LAM_Q="${LAM_Q}" Q_WARMUP="${Q_WARMUP}" \ + ACT_TRAIN_MODE="${ACT_TRAIN_MODE}" COLLECT=0 \ + ./scripts/run_ogb_act_task.sh 2>&1 | tee "logs/${task}_act_${tag}.log" + done +} + +tasks0=() +tasks1=() +if [[ -n "${TASKS_GPU0}" ]]; then + read -r -a tasks0 <<< "${TASKS_GPU0}" +fi +if [[ -n "${TASKS_GPU1}" ]]; then + read -r -a tasks1 <<< "${TASKS_GPU1}" +fi + +pids=() +if (( ${#tasks0[@]} > 0 )); then + echo "[launch] ${GPU0}: ${tasks0[*]}" + run_queue "${GPU0}" "${tasks0[@]}" & + pids+=("$!") +fi +if (( ${#tasks1[@]} > 0 )); then + echo "[launch] ${GPU1}: ${tasks1[*]}" + run_queue "${GPU1}" "${tasks1[@]}" & + pids+=("$!") +fi + +for pid in "${pids[@]}"; do + wait "${pid}" +done + +echo "[done] collecting summaries" +OGB_EPOCHS="${EPOCHS}" ./scripts/collect_results.sh diff --git a/scripts/run_ogb_mol_all_tasks.sh b/scripts/run_ogb_mol_all_tasks.sh new file mode 100755 index 0000000..b191d79 --- /dev/null +++ b/scripts/run_ogb_mol_all_tasks.sh @@ -0,0 +1,17 @@ +#!/usr/bin/env bash +set -euo pipefail + +ROOT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd)" +cd "${ROOT_DIR}" + +DEVICE="${DEVICE:-cuda:1}" +EPOCHS="${EPOCHS:-100}" +SEED="${SEED:-0}" +TASKS="${TASKS:-ogbg-molhiv ogbg-molbbbp ogbg-molbace ogbg-moltox21 ogbg-molclintox ogbg-molsider ogbg-molesol ogbg-molfreesolv ogbg-mollipo}" + +mkdir -p logs +for task in ${TASKS}; do + echo "[task] ${task}" + TASK="${task}" DEVICE="${DEVICE}" EPOCHS="${EPOCHS}" SEED="${SEED}" \ + ./scripts/run_ogb_mol_task_full.sh 2>&1 | tee "logs/${task}_${SEED}.log" +done diff --git a/scripts/run_ogb_mol_task_full.sh b/scripts/run_ogb_mol_task_full.sh new file mode 100755 index 0000000..71ddba1 --- /dev/null +++ b/scripts/run_ogb_mol_task_full.sh @@ -0,0 +1,56 @@ +#!/usr/bin/env bash +set -euo pipefail + +ROOT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd)" +cd "${ROOT_DIR}" +export PYTHONPATH="${ROOT_DIR}:${PYTHONPATH:-}" + +TASK="${TASK:-ogbg-molhiv}" +DEVICE="${DEVICE:-cuda:1}" +EPOCHS="${EPOCHS:-100}" +SEED="${SEED:-0}" +HIDDEN="${HIDDEN:-128}" +FIXED_T="${FIXED_T:-3}" +FIXED_NS="${FIXED_NS:-3}" +VIEWS="${VIEWS:-gin gine gcn graphsage gatv2 graphconv transformer pna gen film resgated tag sgc cheb arma mf appnp}" + +mkdir -p runs logs + +result_path() { + local view="$1" + local compute="$2" + local t="$3" + local ns="$4" + echo "runs/${TASK}_${view}_${compute}_T${t}_ns${ns}_h${HIDDEN}_e${EPOCHS}_s${SEED}.json" +} + +run_cell() { + local view="$1" + local compute="$2" + local t="$3" + local ns="$4" + local out + out="$(result_path "${view}" "${compute}" "${t}" "${ns}")" + if [[ -f "${out}" ]]; then + echo "[skip] ${out}" + return + fi + echo "[run] ${TASK} view=${view} compute=${compute} T=${t} ns=${ns} device=${DEVICE}" + python3 -m rrog.cli run \ + --task "${TASK}" \ + --view "${view}" \ + --compute "${compute}" \ + --epochs "${EPOCHS}" \ + --hidden "${HIDDEN}" \ + --T "${t}" \ + --n_sup "${ns}" \ + --seed "${SEED}" \ + --device "${DEVICE}" +} + +for view in ${VIEWS}; do + run_cell "${view}" classic 0 1 + run_cell "${view}" fixed-rrog "${FIXED_T}" "${FIXED_NS}" +done + +python3 -m rrog.cli results --epochs "${EPOCHS}" diff --git a/scripts/run_smoke.sh b/scripts/run_smoke.sh new file mode 100755 index 0000000..6365cec --- /dev/null +++ b/scripts/run_smoke.sh @@ -0,0 +1,19 @@ +#!/usr/bin/env bash +set -euo pipefail + +ROOT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd)" +cd "${ROOT_DIR}" +export PYTHONPATH="${ROOT_DIR}:${PYTHONPATH:-}" + +DEVICE="${DEVICE:-cuda:0}" +mkdir -p runs logs + +python3 -m rrog.cli run \ + --task ogbg-molhiv --view gin --compute classic \ + --epochs 1 --hidden 32 --bs 64 --seed 991 --device "${DEVICE}" \ + --max_train_batches 2 --max_eval_batches 2 + +python3 -m rrog.cli run \ + --task ogbg-molhiv --view gin --compute fixed-rrog \ + --epochs 1 --hidden 32 --bs 64 --T 1 --n_sup 2 --seed 992 --device "${DEVICE}" \ + --max_train_batches 2 --max_eval_batches 2 diff --git a/scripts/run_two_a6000.sh b/scripts/run_two_a6000.sh new file mode 100755 index 0000000..8d9851f --- /dev/null +++ b/scripts/run_two_a6000.sh @@ -0,0 +1,32 @@ +#!/usr/bin/env bash +set -euo pipefail + +ROOT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd)" +cd "${ROOT_DIR}" +export PYTHONPATH="${ROOT_DIR}:${PYTHONPATH:-}" + +ZINC_DEVICE="${ZINC_DEVICE:-cuda:0}" +OGB_DEVICE="${OGB_DEVICE:-cuda:1}" +OGB_TASK="${OGB_TASK:-ogbg-molhiv}" +ZINC_EPOCHS="${ZINC_EPOCHS:-200}" +OGB_EPOCHS="${OGB_EPOCHS:-100}" +SEED="${SEED:-0}" + +mkdir -p runs logs + +echo "[launch] ZINC-cycle56 on ${ZINC_DEVICE}" +DEVICE="${ZINC_DEVICE}" EPOCHS="${ZINC_EPOCHS}" SEED="${SEED}" \ + ./scripts/run_zinc_cycle56_full.sh > "logs/zinc_cycle56_${SEED}.log" 2>&1 & +zinc_pid=$! + +echo "[launch] ${OGB_TASK} on ${OGB_DEVICE}" +TASK="${OGB_TASK}" DEVICE="${OGB_DEVICE}" EPOCHS="${OGB_EPOCHS}" SEED="${SEED}" \ + ./scripts/run_ogb_mol_task_full.sh > "logs/${OGB_TASK}_${SEED}.log" 2>&1 & +ogb_pid=$! + +echo "[pids] zinc=${zinc_pid} ogb=${ogb_pid}" +wait "${zinc_pid}" +wait "${ogb_pid}" + +echo "[done] collecting summaries" +./scripts/collect_results.sh diff --git a/scripts/run_zinc_cycle56_full.sh b/scripts/run_zinc_cycle56_full.sh new file mode 100755 index 0000000..151a51e --- /dev/null +++ b/scripts/run_zinc_cycle56_full.sh @@ -0,0 +1,54 @@ +#!/usr/bin/env bash +set -euo pipefail + +ROOT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd)" +cd "${ROOT_DIR}" +export PYTHONPATH="${ROOT_DIR}:${PYTHONPATH:-}" + +DEVICE="${DEVICE:-cuda:0}" +EPOCHS="${EPOCHS:-200}" +SEED="${SEED:-0}" +VIEWS="${VIEWS:-gin gine gcn graphsage gatv2 graphconv transformer pna gen film resgated tag sgc cheb arma mf appnp}" + +mkdir -p runs logs + +result_path() { + local view="$1" + local t="$2" + local ns="$3" + local view_tag="" + if [[ "${view}" != "gin" ]]; then + view_tag="_${view}" + fi + echo "runs/rec_rrog${view_tag}_full_sig0.0_K1_none_T${t}_ns${ns}_trace_s${SEED}.json" +} + +run_cell() { + local view="$1" + local compute="$2" + local t="$3" + local ns="$4" + local out + out="$(result_path "${view}" "${t}" "${ns}")" + if [[ -f "${out}" ]]; then + echo "[skip] ${out}" + return + fi + echo "[run] zinc-cycle56 view=${view} compute=${compute} T=${t} ns=${ns} device=${DEVICE}" + python3 -m rrog.cli run \ + --task zinc-cycle56 \ + --view "${view}" \ + --compute "${compute}" \ + --epochs "${EPOCHS}" \ + --T "${t}" \ + --n_sup "${ns}" \ + --seed "${SEED}" \ + --device "${DEVICE}" +} + +for view in ${VIEWS}; do + run_cell "${view}" classic 0 1 + run_cell "${view}" fixed-rrog 1 3 +done + +python3 -m rrog.cli zinc-results --epochs "${EPOCHS}" diff --git a/scripts/setup_and_run_two_a6000.sh b/scripts/setup_and_run_two_a6000.sh new file mode 100755 index 0000000..ec4e3da --- /dev/null +++ b/scripts/setup_and_run_two_a6000.sh @@ -0,0 +1,15 @@ +#!/usr/bin/env bash +set -euo pipefail + +ROOT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd)" +cd "${ROOT_DIR}" + +if [[ "${SKIP_SETUP:-0}" != "1" ]]; then + ./scripts/setup_env.sh +fi + +if [[ -d "${VENV_DIR:-.venv}" ]]; then + source "${VENV_DIR:-.venv}/bin/activate" +fi + +./scripts/run_two_a6000.sh diff --git a/scripts/setup_env.sh b/scripts/setup_env.sh new file mode 100755 index 0000000..66a94c8 --- /dev/null +++ b/scripts/setup_env.sh @@ -0,0 +1,35 @@ +#!/usr/bin/env bash +set -euo pipefail + +ROOT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd)" +cd "${ROOT_DIR}" + +PYTHON_BIN="${PYTHON_BIN:-python3}" +VENV_DIR="${VENV_DIR:-.venv}" +TORCH_INDEX_URL="${TORCH_INDEX_URL:-https://download.pytorch.org/whl/cu124}" + +if [[ ! -d "${VENV_DIR}" ]]; then + "${PYTHON_BIN}" -m venv "${VENV_DIR}" +fi + +source "${VENV_DIR}/bin/activate" +python -m pip install --upgrade pip wheel setuptools + +if ! python - <<'PY' >/dev/null 2>&1 +import torch +assert torch.cuda.is_available() or True +PY +then + python -m pip install torch --index-url "${TORCH_INDEX_URL}" +fi + +python -m pip install -r requirements.txt + +python - <<'PY' +import torch +import torch_geometric +import ogb +print("torch", torch.__version__, "cuda_available", torch.cuda.is_available()) +print("torch_geometric", torch_geometric.__version__) +print("ogb", ogb.__version__) +PY diff --git a/summaries/ogb_graphprop.md b/summaries/ogb_graphprop.md new file mode 100644 index 0000000..ff3e0ee --- /dev/null +++ b/summaries/ogb_graphprop.md @@ -0,0 +1,467 @@ + +Classic baseline: task x backbone +| task | backbone | metric | n | val | test | +| --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | rocauc | 1 | 0.6564 +/- 0.0000 | 0.7423 +/- 0.0000 | +| ogbg-molbace | arma | rocauc | 1 | 0.6923 +/- 0.0000 | 0.7839 +/- 0.0000 | +| ogbg-molbace | cheb | rocauc | 1 | 0.7267 +/- 0.0000 | 0.7969 +/- 0.0000 | +| ogbg-molbace | film | rocauc | 1 | 0.6703 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-molbace | gatv2 | rocauc | 1 | 0.7029 +/- 0.0000 | 0.7400 +/- 0.0000 | +| ogbg-molbace | gcn | rocauc | 1 | 0.6381 +/- 0.0000 | 0.7393 +/- 0.0000 | +| ogbg-molbace | gen | rocauc | 1 | 0.7128 +/- 0.0000 | 0.7326 +/- 0.0000 | +| ogbg-molbace | gin | rocauc | 1 | 0.6520 +/- 0.0000 | 0.7336 +/- 0.0000 | +| ogbg-molbace | gine | rocauc | 1 | 0.6641 +/- 0.0000 | 0.7454 +/- 0.0000 | +| ogbg-molbace | graphconv | rocauc | 1 | 0.7311 +/- 0.0000 | 0.8035 +/- 0.0000 | +| ogbg-molbace | graphsage | rocauc | 1 | 0.6758 +/- 0.0000 | 0.7759 +/- 0.0000 | +| ogbg-molbace | mf | rocauc | 1 | 0.7421 +/- 0.0000 | 0.7760 +/- 0.0000 | +| ogbg-molbace | pna | rocauc | 1 | 0.7516 +/- 0.0000 | 0.6912 +/- 0.0000 | +| ogbg-molbace | resgated | rocauc | 1 | 0.7172 +/- 0.0000 | 0.7877 +/- 0.0000 | +| ogbg-molbace | sgc | rocauc | 1 | 0.6575 +/- 0.0000 | 0.6966 +/- 0.0000 | +| ogbg-molbace | tag | rocauc | 1 | 0.7084 +/- 0.0000 | 0.7345 +/- 0.0000 | +| ogbg-molbace | transformer | rocauc | 1 | 0.6663 +/- 0.0000 | 0.7364 +/- 0.0000 | +| ogbg-molbbbp | appnp | rocauc | 1 | 0.9147 +/- 0.0000 | 0.6388 +/- 0.0000 | +| ogbg-molbbbp | arma | rocauc | 1 | 0.9367 +/- 0.0000 | 0.6651 +/- 0.0000 | +| ogbg-molbbbp | cheb | rocauc | 1 | 0.9452 +/- 0.0000 | 0.6514 +/- 0.0000 | +| ogbg-molbbbp | film | rocauc | 1 | 0.9285 +/- 0.0000 | 0.6300 +/- 0.0000 | +| ogbg-molbbbp | gatv2 | rocauc | 1 | 0.9347 +/- 0.0000 | 0.6324 +/- 0.0000 | +| ogbg-molbbbp | gcn | rocauc | 1 | 0.9386 +/- 0.0000 | 0.6679 +/- 0.0000 | +| ogbg-molbbbp | gen | rocauc | 1 | 0.9549 +/- 0.0000 | 0.6775 +/- 0.0000 | +| ogbg-molbbbp | gin | rocauc | 1 | 0.9251 +/- 0.0000 | 0.5670 +/- 0.0000 | +| ogbg-molbbbp | gine | rocauc | 1 | 0.9324 +/- 0.0000 | 0.6160 +/- 0.0000 | +| ogbg-molbbbp | graphconv | rocauc | 1 | 0.9268 +/- 0.0000 | 0.5900 +/- 0.0000 | +| ogbg-molbbbp | graphsage | rocauc | 1 | 0.9483 +/- 0.0000 | 0.6288 +/- 0.0000 | +| ogbg-molbbbp | mf | rocauc | 1 | 0.9395 +/- 0.0000 | 0.6365 +/- 0.0000 | +| ogbg-molbbbp | pna | rocauc | 1 | 0.9554 +/- 0.0000 | 0.6418 +/- 0.0000 | +| ogbg-molbbbp | resgated | rocauc | 1 | 0.9183 +/- 0.0000 | 0.6626 +/- 0.0000 | +| ogbg-molbbbp | sgc | rocauc | 1 | 0.9300 +/- 0.0000 | 0.6239 +/- 0.0000 | +| ogbg-molbbbp | tag | rocauc | 1 | 0.9476 +/- 0.0000 | 0.6100 +/- 0.0000 | +| ogbg-molbbbp | transformer | rocauc | 1 | 0.9495 +/- 0.0000 | 0.6156 +/- 0.0000 | +| ogbg-molclintox | appnp | rocauc | 1 | 0.8516 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | arma | rocauc | 1 | 0.9463 +/- 0.0000 | 0.8678 +/- 0.0000 | +| ogbg-molclintox | cheb | rocauc | 1 | 0.8928 +/- 0.0000 | 0.9152 +/- 0.0000 | +| ogbg-molclintox | film | rocauc | 1 | 0.9048 +/- 0.0000 | 0.7731 +/- 0.0000 | +| ogbg-molclintox | gatv2 | rocauc | 1 | 0.9515 +/- 0.0000 | 0.8493 +/- 0.0000 | +| ogbg-molclintox | gcn | rocauc | 1 | 0.9318 +/- 0.0000 | 0.8932 +/- 0.0000 | +| ogbg-molclintox | gen | rocauc | 1 | 0.9820 +/- 0.0000 | 0.8128 +/- 0.0000 | +| ogbg-molclintox | gin | rocauc | 1 | 0.9547 +/- 0.0000 | 0.8586 +/- 0.0000 | +| ogbg-molclintox | gine | rocauc | 1 | 0.9353 +/- 0.0000 | 0.8869 +/- 0.0000 | +| ogbg-molclintox | graphconv | rocauc | 1 | 0.8917 +/- 0.0000 | 0.8501 +/- 0.0000 | +| ogbg-molclintox | graphsage | rocauc | 1 | 0.9143 +/- 0.0000 | 0.8882 +/- 0.0000 | +| ogbg-molclintox | mf | rocauc | 1 | 0.9252 +/- 0.0000 | 0.8370 +/- 0.0000 | +| ogbg-molclintox | pna | rocauc | 1 | 0.9286 +/- 0.0000 | 0.8603 +/- 0.0000 | +| ogbg-molclintox | resgated | rocauc | 1 | 0.9244 +/- 0.0000 | 0.9184 +/- 0.0000 | +| ogbg-molclintox | sgc | rocauc | 1 | 0.9195 +/- 0.0000 | 0.8986 +/- 0.0000 | +| ogbg-molclintox | tag | rocauc | 1 | 0.9237 +/- 0.0000 | 0.7998 +/- 0.0000 | +| ogbg-molclintox | transformer | rocauc | 1 | 0.9271 +/- 0.0000 | 0.8764 +/- 0.0000 | +| ogbg-molesol | appnp | rmse | 1 | 1.6083 +/- 0.0000 | 1.5212 +/- 0.0000 | +| ogbg-molesol | arma | rmse | 1 | 1.0195 +/- 0.0000 | 1.0666 +/- 0.0000 | +| ogbg-molesol | cheb | rmse | 1 | 0.9650 +/- 0.0000 | 0.8722 +/- 0.0000 | +| ogbg-molesol | film | rmse | 1 | 1.0718 +/- 0.0000 | 1.2896 +/- 0.0000 | +| ogbg-molesol | gatv2 | rmse | 1 | 1.0368 +/- 0.0000 | 0.9878 +/- 0.0000 | +| ogbg-molesol | gcn | rmse | 1 | 1.0409 +/- 0.0000 | 1.1161 +/- 0.0000 | +| ogbg-molesol | gen | rmse | 1 | 1.0089 +/- 0.0000 | 0.8762 +/- 0.0000 | +| ogbg-molesol | gin | rmse | 1 | 1.0187 +/- 0.0000 | 0.9900 +/- 0.0000 | +| ogbg-molesol | gine | rmse | 1 | 1.0286 +/- 0.0000 | 1.0807 +/- 0.0000 | +| ogbg-molesol | graphconv | rmse | 1 | 0.9741 +/- 0.0000 | 0.9732 +/- 0.0000 | +| ogbg-molesol | graphsage | rmse | 1 | 0.9680 +/- 0.0000 | 1.0038 +/- 0.0000 | +| ogbg-molesol | mf | rmse | 1 | 1.1494 +/- 0.0000 | 1.0639 +/- 0.0000 | +| ogbg-molesol | pna | rmse | 1 | 0.9116 +/- 0.0000 | 0.9153 +/- 0.0000 | +| ogbg-molesol | resgated | rmse | 1 | 0.9492 +/- 0.0000 | 0.8908 +/- 0.0000 | +| ogbg-molesol | sgc | rmse | 1 | 1.0617 +/- 0.0000 | 0.9780 +/- 0.0000 | +| ogbg-molesol | tag | rmse | 1 | 0.9323 +/- 0.0000 | 0.9678 +/- 0.0000 | +| ogbg-molesol | transformer | rmse | 1 | 0.9398 +/- 0.0000 | 0.9492 +/- 0.0000 | +| ogbg-molfreesolv | appnp | rmse | 1 | 6.0462 +/- 0.0000 | 4.6478 +/- 0.0000 | +| ogbg-molfreesolv | arma | rmse | 1 | 4.2662 +/- 0.0000 | 2.9769 +/- 0.0000 | +| ogbg-molfreesolv | cheb | rmse | 1 | 2.9481 +/- 0.0000 | 2.2431 +/- 0.0000 | +| ogbg-molfreesolv | film | rmse | 1 | 3.1546 +/- 0.0000 | 2.9581 +/- 0.0000 | +| ogbg-molfreesolv | gatv2 | rmse | 1 | 4.2086 +/- 0.0000 | 2.7368 +/- 0.0000 | +| ogbg-molfreesolv | gcn | rmse | 1 | 3.7172 +/- 0.0000 | 2.4851 +/- 0.0000 | +| ogbg-molfreesolv | gen | rmse | 1 | 3.9998 +/- 0.0000 | 2.5588 +/- 0.0000 | +| ogbg-molfreesolv | gin | rmse | 1 | 4.0190 +/- 0.0000 | 3.4898 +/- 0.0000 | +| ogbg-molfreesolv | gine | rmse | 1 | 3.2961 +/- 0.0000 | 3.1442 +/- 0.0000 | +| ogbg-molfreesolv | graphconv | rmse | 1 | 2.5314 +/- 0.0000 | 2.7953 +/- 0.0000 | +| ogbg-molfreesolv | graphsage | rmse | 1 | 3.5022 +/- 0.0000 | 2.2977 +/- 0.0000 | +| ogbg-molfreesolv | mf | rmse | 1 | 2.7374 +/- 0.0000 | 2.8885 +/- 0.0000 | +| ogbg-molfreesolv | pna | rmse | 1 | 2.3625 +/- 0.0000 | 2.2610 +/- 0.0000 | +| ogbg-molfreesolv | resgated | rmse | 1 | 2.4772 +/- 0.0000 | 2.0041 +/- 0.0000 | +| ogbg-molfreesolv | sgc | rmse | 1 | 3.9147 +/- 0.0000 | 2.4146 +/- 0.0000 | +| ogbg-molfreesolv | tag | rmse | 1 | 2.6874 +/- 0.0000 | 2.3826 +/- 0.0000 | +| ogbg-molfreesolv | transformer | rmse | 1 | 4.0942 +/- 0.0000 | 2.3205 +/- 0.0000 | +| ogbg-molhiv | appnp | rocauc | 3 | 0.7274 +/- 0.0374 | 0.6982 +/- 0.0073 | +| ogbg-molhiv | arma | rocauc | 3 | 0.7799 +/- 0.0063 | 0.7396 +/- 0.0263 | +| ogbg-molhiv | cheb | rocauc | 3 | 0.7799 +/- 0.0207 | 0.7264 +/- 0.0039 | +| ogbg-molhiv | film | rocauc | 3 | 0.7840 +/- 0.0421 | 0.7505 +/- 0.0298 | +| ogbg-molhiv | gatv2 | rocauc | 3 | 0.7841 +/- 0.0088 | 0.7292 +/- 0.0262 | +| ogbg-molhiv | gcn | rocauc | 3 | 0.7751 +/- 0.0003 | 0.7360 +/- 0.0190 | +| ogbg-molhiv | gen | rocauc | 3 | 0.7626 +/- 0.0141 | 0.7438 +/- 0.0126 | +| ogbg-molhiv | gin | rocauc | 3 | 0.8052 +/- 0.0145 | 0.7600 +/- 0.0179 | +| ogbg-molhiv | gine | rocauc | 3 | 0.7787 +/- 0.0156 | 0.7505 +/- 0.0200 | +| ogbg-molhiv | graphconv | rocauc | 3 | 0.7656 +/- 0.0284 | 0.7330 +/- 0.0222 | +| ogbg-molhiv | graphsage | rocauc | 3 | 0.7865 +/- 0.0102 | 0.7506 +/- 0.0195 | +| ogbg-molhiv | mf | rocauc | 3 | 0.7718 +/- 0.0137 | 0.7352 +/- 0.0319 | +| ogbg-molhiv | pna | rocauc | 3 | 0.7943 +/- 0.0148 | 0.7520 +/- 0.0114 | +| ogbg-molhiv | resgated | rocauc | 3 | 0.7963 +/- 0.0157 | 0.7316 +/- 0.0205 | +| ogbg-molhiv | sgc | rocauc | 3 | 0.7699 +/- 0.0225 | 0.7038 +/- 0.0055 | +| ogbg-molhiv | tag | rocauc | 3 | 0.7488 +/- 0.0133 | 0.7432 +/- 0.0156 | +| ogbg-molhiv | transformer | rocauc | 3 | 0.7668 +/- 0.0086 | 0.7714 +/- 0.0168 | +| ogbg-mollipo | appnp | rmse | 1 | 0.9015 +/- 0.0000 | 0.9070 +/- 0.0000 | +| ogbg-mollipo | arma | rmse | 1 | 0.7325 +/- 0.0000 | 0.7295 +/- 0.0000 | +| ogbg-mollipo | cheb | rmse | 1 | 0.7188 +/- 0.0000 | 0.7180 +/- 0.0000 | +| ogbg-mollipo | film | rmse | 1 | 0.7620 +/- 0.0000 | 0.7371 +/- 0.0000 | +| ogbg-mollipo | gatv2 | rmse | 1 | 0.6865 +/- 0.0000 | 0.7308 +/- 0.0000 | +| ogbg-mollipo | gcn | rmse | 1 | 0.7379 +/- 0.0000 | 0.7828 +/- 0.0000 | +| ogbg-mollipo | gen | rmse | 1 | 0.7046 +/- 0.0000 | 0.7379 +/- 0.0000 | +| ogbg-mollipo | gin | rmse | 1 | 0.6854 +/- 0.0000 | 0.7390 +/- 0.0000 | +| ogbg-mollipo | gine | rmse | 1 | 0.6615 +/- 0.0000 | 0.7341 +/- 0.0000 | +| ogbg-mollipo | graphconv | rmse | 1 | 0.7178 +/- 0.0000 | 0.7297 +/- 0.0000 | +| ogbg-mollipo | graphsage | rmse | 1 | 0.7239 +/- 0.0000 | 0.7783 +/- 0.0000 | +| ogbg-mollipo | mf | rmse | 1 | 0.7129 +/- 0.0000 | 0.7405 +/- 0.0000 | +| ogbg-mollipo | pna | rmse | 1 | 0.7179 +/- 0.0000 | 0.7749 +/- 0.0000 | +| ogbg-mollipo | resgated | rmse | 1 | 0.6721 +/- 0.0000 | 0.7270 +/- 0.0000 | +| ogbg-mollipo | sgc | rmse | 1 | 0.7505 +/- 0.0000 | 0.8176 +/- 0.0000 | +| ogbg-mollipo | tag | rmse | 1 | 0.6692 +/- 0.0000 | 0.7227 +/- 0.0000 | +| ogbg-mollipo | transformer | rmse | 1 | 0.6810 +/- 0.0000 | 0.7346 +/- 0.0000 | +| ogbg-molsider | appnp | rocauc | 1 | 0.5886 +/- 0.0000 | 0.6004 +/- 0.0000 | +| ogbg-molsider | arma | rocauc | 1 | 0.6273 +/- 0.0000 | 0.6159 +/- 0.0000 | +| ogbg-molsider | cheb | rocauc | 1 | 0.6237 +/- 0.0000 | 0.6033 +/- 0.0000 | +| ogbg-molsider | film | rocauc | 1 | 0.6024 +/- 0.0000 | 0.5898 +/- 0.0000 | +| ogbg-molsider | gatv2 | rocauc | 1 | 0.6071 +/- 0.0000 | 0.6013 +/- 0.0000 | +| ogbg-molsider | gcn | rocauc | 1 | 0.6293 +/- 0.0000 | 0.6086 +/- 0.0000 | +| ogbg-molsider | gen | rocauc | 1 | 0.6519 +/- 0.0000 | 0.5854 +/- 0.0000 | +| ogbg-molsider | gin | rocauc | 1 | 0.6225 +/- 0.0000 | 0.5748 +/- 0.0000 | +| ogbg-molsider | gine | rocauc | 1 | 0.6327 +/- 0.0000 | 0.5495 +/- 0.0000 | +| ogbg-molsider | graphconv | rocauc | 1 | 0.5921 +/- 0.0000 | 0.6151 +/- 0.0000 | +| ogbg-molsider | graphsage | rocauc | 1 | 0.6217 +/- 0.0000 | 0.5807 +/- 0.0000 | +| ogbg-molsider | mf | rocauc | 1 | 0.6202 +/- 0.0000 | 0.5861 +/- 0.0000 | +| ogbg-molsider | pna | rocauc | 1 | 0.6219 +/- 0.0000 | 0.5965 +/- 0.0000 | +| ogbg-molsider | resgated | rocauc | 1 | 0.6209 +/- 0.0000 | 0.5910 +/- 0.0000 | +| ogbg-molsider | sgc | rocauc | 1 | 0.6174 +/- 0.0000 | 0.6043 +/- 0.0000 | +| ogbg-molsider | tag | rocauc | 1 | 0.6439 +/- 0.0000 | 0.6143 +/- 0.0000 | +| ogbg-molsider | transformer | rocauc | 1 | 0.6160 +/- 0.0000 | 0.5980 +/- 0.0000 | +| ogbg-moltox21 | appnp | rocauc | 1 | 0.7255 +/- 0.0000 | 0.7158 +/- 0.0000 | +| ogbg-moltox21 | arma | rocauc | 1 | 0.7799 +/- 0.0000 | 0.7223 +/- 0.0000 | +| ogbg-moltox21 | cheb | rocauc | 1 | 0.7834 +/- 0.0000 | 0.7301 +/- 0.0000 | +| ogbg-moltox21 | film | rocauc | 1 | 0.7702 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gatv2 | rocauc | 1 | 0.7627 +/- 0.0000 | 0.7160 +/- 0.0000 | +| ogbg-moltox21 | gcn | rocauc | 1 | 0.7580 +/- 0.0000 | 0.7171 +/- 0.0000 | +| ogbg-moltox21 | gen | rocauc | 1 | 0.7835 +/- 0.0000 | 0.7444 +/- 0.0000 | +| ogbg-moltox21 | gin | rocauc | 1 | 0.7690 +/- 0.0000 | 0.7242 +/- 0.0000 | +| ogbg-moltox21 | gine | rocauc | 1 | 0.7744 +/- 0.0000 | 0.7328 +/- 0.0000 | +| ogbg-moltox21 | graphconv | rocauc | 1 | 0.7831 +/- 0.0000 | 0.7147 +/- 0.0000 | +| ogbg-moltox21 | graphsage | rocauc | 1 | 0.7709 +/- 0.0000 | 0.7196 +/- 0.0000 | +| ogbg-moltox21 | mf | rocauc | 1 | 0.7773 +/- 0.0000 | 0.7281 +/- 0.0000 | +| ogbg-moltox21 | pna | rocauc | 1 | 0.7660 +/- 0.0000 | 0.6946 +/- 0.0000 | +| ogbg-moltox21 | resgated | rocauc | 1 | 0.7950 +/- 0.0000 | 0.7275 +/- 0.0000 | +| ogbg-moltox21 | sgc | rocauc | 1 | 0.7611 +/- 0.0000 | 0.7240 +/- 0.0000 | +| ogbg-moltox21 | tag | rocauc | 1 | 0.7866 +/- 0.0000 | 0.7416 +/- 0.0000 | +| ogbg-moltox21 | transformer | rocauc | 1 | 0.7656 +/- 0.0000 | 0.7309 +/- 0.0000 | + +Delta vs matching classic +| task | backbone | compute | metric | n | val score (delta) | test score (delta) | adaptive test (delta) | steps | +| --- | --- | --- | --- | --- | --- | --- | --- | --- | +| ogbg-molbace | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7168 (0.0604) | 0.7209 (-0.0214) | | | +| ogbg-molbace | appnp | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6835 (0.0271) | 0.7119 (-0.0304) | 0.7328 (-0.0095) | 2.13 | +| ogbg-molbace | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7179 (0.0256) | 0.7672 (-0.0167) | | | +| ogbg-molbace | arma | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7355 (0.0432) | 0.7451 (-0.0388) | 0.7646 (-0.0193) | 4.38 | +| ogbg-molbace | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7114 (-0.0154) | 0.7533 (-0.0436) | | | +| ogbg-molbace | cheb | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7165 (-0.0103) | 0.8007 (0.0038) | 0.8120 (0.0151) | 2.60 | +| ogbg-molbace | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6652 (-0.0051) | 0.7242 (0.0000) | | | +| ogbg-molbace | film | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6467 (-0.0236) | 0.6802 (-0.0440) | 0.6733 (-0.0509) | 5.26 | +| ogbg-molbace | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7026 (-0.0004) | 0.7519 (0.0118) | | | +| ogbg-molbace | gatv2 | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7132 (0.0103) | 0.8261 (0.0861) | 0.8263 (0.0862) | 4.01 | +| ogbg-molbace | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6374 (-0.0007) | 0.7733 (0.0339) | | | +| ogbg-molbace | gcn | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7201 (0.0821) | 0.7484 (0.0090) | 0.7451 (0.0057) | 3.96 | +| ogbg-molbace | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6894 (-0.0234) | 0.7449 (0.0123) | | | +| ogbg-molbace | gen | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6535 (-0.0593) | 0.6915 (-0.0410) | 0.6788 (-0.0537) | 3.98 | +| ogbg-molbace | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6538 (0.0018) | 0.7169 (-0.0167) | | | +| ogbg-molbace | gin | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6802 (0.0282) | 0.7235 (-0.0101) | 0.7220 (-0.0117) | 3.47 | +| ogbg-molbace | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6685 (0.0044) | 0.6994 (-0.0461) | | | +| ogbg-molbace | gine | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6824 (0.0183) | 0.7719 (0.0264) | 0.7698 (0.0243) | 3.17 | +| ogbg-molbace | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7462 (0.0150) | 0.7983 (-0.0052) | | | +| ogbg-molbace | graphconv | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6908 (-0.0403) | 0.7475 (-0.0560) | 0.7639 (-0.0396) | 4.28 | +| ogbg-molbace | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6703 (-0.0055) | 0.7119 (-0.0640) | | | +| ogbg-molbace | graphsage | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7092 (0.0333) | 0.7821 (0.0063) | 0.7910 (0.0151) | 3.75 | +| ogbg-molbace | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7234 (-0.0187) | 0.7684 (-0.0077) | | | +| ogbg-molbace | mf | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7747 (0.0326) | 0.8019 (0.0259) | 0.7950 (0.0190) | 4.98 | +| ogbg-molbace | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7037 (-0.0480) | 0.7967 (0.1055) | | | +| ogbg-molbace | pna | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7095 (-0.0421) | 0.7809 (0.0897) | 0.7338 (0.0426) | 3.91 | +| ogbg-molbace | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6912 (-0.0260) | 0.7465 (-0.0412) | | | +| ogbg-molbace | resgated | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7396 (0.0223) | 0.7314 (-0.0563) | 0.7618 (-0.0259) | 3.39 | +| ogbg-molbace | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6454 (-0.0121) | 0.7727 (0.0762) | | | +| ogbg-molbace | sgc | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6615 (0.0040) | 0.7971 (0.1005) | 0.7988 (0.1022) | 3.64 | +| ogbg-molbace | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7355 (0.0271) | 0.6806 (-0.0539) | | | +| ogbg-molbace | tag | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7084 (0.0000) | 0.7960 (0.0616) | 0.7776 (0.0431) | 2.55 | +| ogbg-molbace | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6982 (0.0319) | 0.7487 (0.0123) | | | +| ogbg-molbace | transformer | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6535 (-0.0128) | 0.7192 (-0.0172) | 0.7293 (-0.0071) | 2.71 | +| ogbg-molbbbp | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9360 (0.0213) | 0.6073 (-0.0314) | | | +| ogbg-molbbbp | appnp | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9066 (-0.0081) | 0.5574 (-0.0814) | 0.6226 (-0.0162) | 2.01 | +| ogbg-molbbbp | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9415 (0.0048) | 0.6635 (-0.0016) | | | +| ogbg-molbbbp | arma | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9405 (0.0038) | 0.6411 (-0.0240) | 0.6368 (-0.0284) | 2.15 | +| ogbg-molbbbp | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9278 (-0.0174) | 0.6659 (0.0145) | | | +| ogbg-molbbbp | cheb | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9496 (0.0044) | 0.6182 (-0.0332) | 0.6110 (-0.0404) | 2.17 | +| ogbg-molbbbp | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9400 (0.0115) | 0.6323 (0.0023) | | | +| ogbg-molbbbp | film | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9393 (0.0108) | 0.5584 (-0.0716) | 0.5746 (-0.0555) | 3.21 | +| ogbg-molbbbp | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9356 (0.0009) | 0.6560 (0.0235) | | | +| ogbg-molbbbp | gatv2 | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9303 (-0.0044) | 0.6648 (0.0324) | 0.6627 (0.0303) | 2.14 | +| ogbg-molbbbp | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9417 (0.0031) | 0.6017 (-0.0663) | | | +| ogbg-molbbbp | gcn | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9528 (0.0142) | 0.6795 (0.0116) | 0.6629 (-0.0050) | 2.27 | +| ogbg-molbbbp | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9429 (-0.0119) | 0.6037 (-0.0738) | | | +| ogbg-molbbbp | gen | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9251 (-0.0298) | 0.6314 (-0.0461) | 0.6291 (-0.0483) | 3.79 | +| ogbg-molbbbp | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9526 (0.0275) | 0.5932 (0.0261) | | | +| ogbg-molbbbp | gin | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9204 (-0.0047) | 0.6528 (0.0857) | 0.6526 (0.0856) | 4.87 | +| ogbg-molbbbp | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9421 (0.0098) | 0.6976 (0.0816) | | | +| ogbg-molbbbp | gine | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9205 (-0.0118) | 0.5918 (-0.0242) | 0.5948 (-0.0212) | 2.92 | +| ogbg-molbbbp | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9337 (0.0069) | 0.6518 (0.0618) | | | +| ogbg-molbbbp | graphconv | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9234 (-0.0034) | 0.6602 (0.0702) | 0.6875 (0.0975) | 2.79 | +| ogbg-molbbbp | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9502 (0.0019) | 0.5934 (-0.0354) | | | +| ogbg-molbbbp | graphsage | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9407 (-0.0077) | 0.6040 (-0.0248) | 0.6148 (-0.0140) | 2.57 | +| ogbg-molbbbp | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9488 (0.0094) | 0.6481 (0.0116) | | | +| ogbg-molbbbp | mf | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9368 (-0.0027) | 0.6621 (0.0257) | 0.6678 (0.0313) | 3.54 | +| ogbg-molbbbp | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9585 (0.0031) | 0.6682 (0.0264) | | | +| ogbg-molbbbp | pna | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9500 (-0.0054) | 0.6173 (-0.0245) | 0.6180 (-0.0238) | 4.69 | +| ogbg-molbbbp | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9535 (0.0352) | 0.5839 (-0.0787) | | | +| ogbg-molbbbp | resgated | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9133 (-0.0050) | 0.5753 (-0.0873) | 0.5887 (-0.0739) | 3.59 | +| ogbg-molbbbp | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9285 (-0.0015) | 0.6454 (0.0215) | | | +| ogbg-molbbbp | sgc | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9475 (0.0175) | 0.6593 (0.0354) | 0.6675 (0.0436) | 2.25 | +| ogbg-molbbbp | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9459 (-0.0017) | 0.6420 (0.0320) | | | +| ogbg-molbbbp | tag | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9496 (0.0020) | 0.6580 (0.0480) | 0.6551 (0.0451) | 2.62 | +| ogbg-molbbbp | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9355 (-0.0140) | 0.6221 (0.0065) | | | +| ogbg-molbbbp | transformer | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9398 (-0.0098) | 0.6426 (0.0269) | 0.6310 (0.0153) | 2.23 | +| ogbg-molclintox | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9029 (0.0513) | 0.8898 (-0.0286) | | | +| ogbg-molclintox | appnp | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9156 (0.0640) | 0.7780 (-0.1404) | 0.8861 (-0.0323) | 2.16 | +| ogbg-molclintox | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9135 (-0.0328) | 0.8863 (0.0185) | | | +| ogbg-molclintox | arma | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9423 (-0.0040) | 0.8458 (-0.0220) | 0.8651 (-0.0027) | 2.72 | +| ogbg-molclintox | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8816 (-0.0112) | 0.8982 (-0.0170) | | | +| ogbg-molclintox | cheb | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9172 (0.0244) | 0.9066 (-0.0086) | 0.9058 (-0.0094) | 2.98 | +| ogbg-molclintox | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9454 (0.0406) | 0.8430 (0.0699) | | | +| ogbg-molclintox | film | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.8532 (-0.0516) | 0.8230 (0.0499) | 0.8409 (0.0679) | 3.57 | +| ogbg-molclintox | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9351 (-0.0164) | 0.8328 (-0.0164) | | | +| ogbg-molclintox | gatv2 | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9507 (-0.0008) | 0.8618 (0.0125) | 0.8344 (-0.0149) | 2.34 | +| ogbg-molclintox | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9097 (-0.0221) | 0.8792 (-0.0140) | | | +| ogbg-molclintox | gcn | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9460 (0.0142) | 0.8712 (-0.0220) | 0.8802 (-0.0130) | 2.20 | +| ogbg-molclintox | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9399 (-0.0421) | 0.8194 (0.0066) | | | +| ogbg-molclintox | gen | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9627 (-0.0194) | 0.7994 (-0.0134) | 0.8025 (-0.0103) | 2.52 | +| ogbg-molclintox | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9164 (-0.0383) | 0.8788 (0.0202) | | | +| ogbg-molclintox | gin | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9600 (0.0053) | 0.8034 (-0.0553) | 0.8111 (-0.0475) | 2.71 | +| ogbg-molclintox | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9225 (-0.0127) | 0.8840 (-0.0030) | | | +| ogbg-molclintox | gine | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9456 (0.0104) | 0.9048 (0.0179) | 0.9069 (0.0200) | 2.30 | +| ogbg-molclintox | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.8494 (-0.0424) | 0.8186 (-0.0316) | | | +| ogbg-molclintox | graphconv | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9575 (0.0657) | 0.8813 (0.0311) | 0.8485 (-0.0016) | 2.41 | +| ogbg-molclintox | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9579 (0.0436) | 0.8664 (-0.0217) | | | +| ogbg-molclintox | graphsage | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9516 (0.0373) | 0.8822 (-0.0060) | 0.8780 (-0.0101) | 2.43 | +| ogbg-molclintox | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9147 (-0.0104) | 0.8047 (-0.0323) | | | +| ogbg-molclintox | mf | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9416 (0.0165) | 0.8527 (0.0157) | 0.8698 (0.0328) | 2.57 | +| ogbg-molclintox | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9064 (-0.0222) | 0.8735 (0.0132) | | | +| ogbg-molclintox | pna | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.8741 (-0.0544) | 0.8539 (-0.0064) | 0.8614 (0.0011) | 3.68 | +| ogbg-molclintox | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9055 (-0.0188) | 0.8979 (-0.0205) | | | +| ogbg-molclintox | resgated | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9577 (0.0333) | 0.8777 (-0.0407) | 0.8951 (-0.0233) | 2.26 | +| ogbg-molclintox | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9220 (0.0025) | 0.9054 (0.0068) | | | +| ogbg-molclintox | sgc | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9153 (-0.0042) | 0.8883 (-0.0103) | 0.8905 (-0.0081) | 2.25 | +| ogbg-molclintox | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9183 (-0.0054) | 0.8433 (0.0435) | | | +| ogbg-molclintox | tag | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.9001 (-0.0236) | 0.8009 (0.0011) | 0.8084 (0.0085) | 2.59 | +| ogbg-molclintox | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.9322 (0.0051) | 0.8522 (-0.0242) | | | +| ogbg-molclintox | transformer | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.8521 (-0.0749) | 0.7333 (-0.1431) | 0.7908 (-0.0855) | 3.26 | +| ogbg-molesol | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 1.4196 (0.1887) | 1.4929 (0.0284) | | | +| ogbg-molesol | appnp | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 1.6270 (-0.0187) | 1.2973 (0.2239) | 1.0733 (0.4479) | 2.81 | +| ogbg-molesol | arma | fixed-rrog-T1-ns3 | rmse | 1 | 1.0034 (0.0160) | 1.1272 (-0.0606) | | | +| ogbg-molesol | arma | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 1.3100 (-0.2905) | 1.5310 (-0.4644) | 1.0386 (0.0280) | 2.58 | +| ogbg-molesol | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 0.9199 (0.0451) | 0.8841 (-0.0118) | | | +| ogbg-molesol | cheb | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 1.0643 (-0.0993) | 1.0342 (-0.1620) | 0.8498 (0.0225) | 2.60 | +| ogbg-molesol | film | fixed-rrog-T1-ns3 | rmse | 1 | 1.0196 (0.0521) | 1.0849 (0.2047) | | | +| ogbg-molesol | film | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 1.3674 (-0.2956) | 1.3648 (-0.0752) | 1.1286 (0.1610) | 3.61 | +| ogbg-molesol | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 1.0018 (0.0350) | 0.9780 (0.0098) | | | +| ogbg-molesol | gatv2 | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 0.9842 (0.0525) | 0.9534 (0.0344) | 0.8806 (0.1072) | 2.49 | +| ogbg-molesol | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 0.9591 (0.0818) | 0.9305 (0.1856) | | | +| ogbg-molesol | gcn | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 1.0294 (0.0115) | 1.2573 (-0.1411) | 0.9222 (0.1940) | 2.72 | +| ogbg-molesol | gen | fixed-rrog-T1-ns3 | rmse | 1 | 1.0027 (0.0062) | 0.9206 (-0.0444) | | | +| ogbg-molesol | gen | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 1.1622 (-0.1534) | 1.4459 (-0.5697) | 1.0919 (-0.2157) | 2.61 | +| ogbg-molesol | gin | fixed-rrog-T1-ns3 | rmse | 1 | 0.9647 (0.0540) | 1.0798 (-0.0899) | | | +| ogbg-molesol | gin | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 1.4047 (-0.3860) | 2.0651 (-1.0751) | 0.9663 (0.0236) | 2.98 | +| ogbg-molesol | gine | fixed-rrog-T1-ns3 | rmse | 1 | 1.0581 (-0.0295) | 1.0951 (-0.0144) | | | +| ogbg-molesol | gine | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 1.3110 (-0.2824) | 2.0394 (-0.9588) | 1.0993 (-0.0186) | 2.88 | +| ogbg-molesol | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 1.0048 (-0.0307) | 0.9968 (-0.0236) | | | +| ogbg-molesol | graphconv | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 1.1480 (-0.1739) | 1.2081 (-0.2348) | 1.0046 (-0.0314) | 2.74 | +| ogbg-molesol | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 0.9934 (-0.0254) | 1.0794 (-0.0757) | | | +| ogbg-molesol | graphsage | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 1.1587 (-0.1907) | 1.3229 (-0.3191) | 0.9324 (0.0714) | 2.40 | +| ogbg-molesol | mf | fixed-rrog-T1-ns3 | rmse | 1 | 1.0553 (0.0942) | 1.0368 (0.0271) | | | +| ogbg-molesol | mf | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 1.0765 (0.0729) | 1.0844 (-0.0205) | 0.9589 (0.1050) | 3.41 | +| ogbg-molesol | pna | fixed-rrog-T1-ns3 | rmse | 1 | 0.9841 (-0.0725) | 0.9092 (0.0060) | | | +| ogbg-molesol | pna | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 1.2810 (-0.3694) | 1.4176 (-0.5023) | 0.9829 (-0.0677) | 2.60 | +| ogbg-molesol | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 0.9873 (-0.0382) | 0.8825 (0.0083) | | | +| ogbg-molesol | resgated | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 1.0939 (-0.1447) | 1.0833 (-0.1925) | 0.9181 (-0.0273) | 3.23 | +| ogbg-molesol | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 1.0129 (0.0488) | 0.9373 (0.0407) | | | +| ogbg-molesol | sgc | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 1.0345 (0.0272) | 1.0466 (-0.0686) | 0.9781 (-0.0001) | 3.28 | +| ogbg-molesol | tag | fixed-rrog-T1-ns3 | rmse | 1 | 0.9036 (0.0288) | 0.9462 (0.0215) | | | +| ogbg-molesol | tag | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 1.0871 (-0.1548) | 1.2508 (-0.2831) | 1.0190 (-0.0512) | 2.35 | +| ogbg-molesol | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 0.9841 (-0.0443) | 1.0004 (-0.0512) | | | +| ogbg-molesol | transformer | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 1.0664 (-0.1267) | 0.9534 (-0.0042) | 0.8505 (0.0987) | 2.28 | +| ogbg-molfreesolv | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 5.5593 (0.4869) | 3.6549 (0.9928) | | | +| ogbg-molfreesolv | arma | fixed-rrog-T1-ns3 | rmse | 1 | 5.0683 (-0.8021) | 3.6823 (-0.7053) | | | +| ogbg-molfreesolv | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 3.0142 (-0.0662) | 2.2399 (0.0032) | | | +| ogbg-molfreesolv | film | fixed-rrog-T1-ns3 | rmse | 1 | 3.2952 (-0.1406) | 3.3042 (-0.3460) | | | +| ogbg-molfreesolv | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 3.9984 (0.2103) | 2.5966 (0.1403) | | | +| ogbg-molfreesolv | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 3.5888 (0.1285) | 2.4444 (0.0407) | | | +| ogbg-molfreesolv | gen | fixed-rrog-T1-ns3 | rmse | 1 | 4.3009 (-0.3011) | 2.9063 (-0.3476) | | | +| ogbg-molfreesolv | gin | fixed-rrog-T1-ns3 | rmse | 1 | 3.9743 (0.0447) | 3.4292 (0.0607) | | | +| ogbg-molfreesolv | gine | fixed-rrog-T1-ns3 | rmse | 1 | 4.4468 (-1.1508) | 3.7405 (-0.5963) | | | +| ogbg-molfreesolv | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 2.9106 (-0.3792) | 3.1429 (-0.3476) | | | +| ogbg-molfreesolv | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 3.7380 (-0.2358) | 2.1931 (0.1046) | | | +| ogbg-molfreesolv | mf | fixed-rrog-T1-ns3 | rmse | 1 | 2.5060 (0.2313) | 3.1892 (-0.3007) | | | +| ogbg-molfreesolv | pna | fixed-rrog-T1-ns3 | rmse | 1 | 3.3334 (-0.9708) | 2.4279 (-0.1669) | | | +| ogbg-molfreesolv | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 3.0920 (-0.6148) | 2.0244 (-0.0203) | | | +| ogbg-molfreesolv | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 3.9261 (-0.0114) | 2.4887 (-0.0741) | | | +| ogbg-molfreesolv | tag | fixed-rrog-T1-ns3 | rmse | 1 | 2.7359 (-0.0486) | 2.0588 (0.3237) | | | +| ogbg-molfreesolv | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 4.4180 (-0.3237) | 2.4325 (-0.1120) | | | +| ogbg-molhiv | appnp | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7568 (0.0294) | 0.7303 (0.0321) | | | +| ogbg-molhiv | appnp | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7203 (-0.0471) | 0.6825 (-0.0175) | | | +| ogbg-molhiv | appnp | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7379 (-0.0296) | 0.6883 (-0.0117) | 0.7291 (0.0291) | 2.10 | +| ogbg-molhiv | arma | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7823 (0.0023) | 0.7120 (-0.0276) | | | +| ogbg-molhiv | arma | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7926 (0.0054) | 0.7318 (0.0021) | | | +| ogbg-molhiv | arma | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7861 (-0.0011) | 0.7307 (0.0011) | 0.7379 (0.0082) | 2.09 | +| ogbg-molhiv | cheb | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7898 (0.0099) | 0.7347 (0.0083) | | | +| ogbg-molhiv | cheb | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7735 (-0.0096) | 0.7426 (0.0144) | | | +| ogbg-molhiv | cheb | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7825 (-0.0006) | 0.7206 (-0.0076) | 0.7219 (-0.0063) | 2.29 | +| ogbg-molhiv | film | fixed-rrog-T1-ns3 | rocauc | 3 | 0.8070 (0.0230) | 0.7523 (0.0018) | | | +| ogbg-molhiv | film | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7633 (-0.0288) | 0.7728 (-0.0114) | | | +| ogbg-molhiv | film | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.8150 (0.0229) | 0.7415 (-0.0427) | 0.7292 (-0.0551) | 2.21 | +| ogbg-molhiv | gatv2 | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7734 (-0.0106) | 0.7269 (-0.0023) | | | +| ogbg-molhiv | gatv2 | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7835 (0.0001) | 0.7466 (-0.0096) | | | +| ogbg-molhiv | gatv2 | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7722 (-0.0112) | 0.7005 (-0.0557) | 0.7210 (-0.0353) | 2.16 | +| ogbg-molhiv | gcn | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7829 (0.0078) | 0.7386 (0.0026) | | | +| ogbg-molhiv | gcn | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7455 (-0.0300) | 0.7483 (0.0285) | | | +| ogbg-molhiv | gcn | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7652 (-0.0102) | 0.7280 (0.0082) | 0.7195 (-0.0003) | 2.14 | +| ogbg-molhiv | gen | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7664 (0.0038) | 0.7487 (0.0049) | | | +| ogbg-molhiv | gen | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8128 (0.0598) | 0.7631 (0.0318) | | | +| ogbg-molhiv | gen | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7690 (0.0160) | 0.7434 (0.0121) | 0.7427 (0.0113) | 2.18 | +| ogbg-molhiv | gin | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7710 (-0.0342) | 0.7548 (-0.0052) | | | +| ogbg-molhiv | gin | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7524 (-0.0644) | 0.7324 (-0.0400) | | | +| ogbg-molhiv | gin | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7623 (-0.0545) | 0.7285 (-0.0439) | 0.7415 (-0.0309) | 2.18 | +| ogbg-molhiv | gine | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7646 (-0.0140) | 0.7352 (-0.0153) | | | +| ogbg-molhiv | gine | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7575 (-0.0368) | 0.7401 (-0.0044) | | | +| ogbg-molhiv | gine | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7427 (-0.0515) | 0.7217 (-0.0228) | 0.7220 (-0.0226) | 2.19 | +| ogbg-molhiv | graphconv | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7755 (0.0099) | 0.7305 (-0.0025) | | | +| ogbg-molhiv | graphconv | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7713 (0.0006) | 0.6979 (-0.0129) | | | +| ogbg-molhiv | graphconv | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7791 (0.0084) | 0.7511 (0.0403) | 0.7493 (0.0385) | 2.23 | +| ogbg-molhiv | graphsage | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7860 (-0.0005) | 0.7290 (-0.0216) | | | +| ogbg-molhiv | graphsage | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7587 (-0.0382) | 0.7641 (0.0016) | | | +| ogbg-molhiv | graphsage | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7724 (-0.0244) | 0.7541 (-0.0084) | 0.7493 (-0.0132) | 2.23 | +| ogbg-molhiv | mf | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7826 (0.0109) | 0.7127 (-0.0225) | | | +| ogbg-molhiv | mf | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7931 (0.0085) | 0.7217 (0.0143) | | | +| ogbg-molhiv | mf | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.8047 (0.0201) | 0.7416 (0.0343) | 0.7333 (0.0260) | 2.20 | +| ogbg-molhiv | pna | fixed-rrog-T1-ns3 | rocauc | 3 | 0.8141 (0.0198) | 0.7503 (-0.0018) | | | +| ogbg-molhiv | pna | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7890 (0.0111) | 0.7630 (-0.0018) | | | +| ogbg-molhiv | pna | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7488 (-0.0292) | 0.6730 (-0.0918) | 0.6877 (-0.0771) | 2.06 | +| ogbg-molhiv | resgated | fixed-rrog-T1-ns3 | rocauc | 3 | 0.8020 (0.0057) | 0.7383 (0.0066) | | | +| ogbg-molhiv | resgated | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8174 (0.0030) | 0.7055 (-0.0187) | | | +| ogbg-molhiv | resgated | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.8031 (-0.0113) | 0.7503 (0.0261) | 0.7567 (0.0325) | 2.22 | +| ogbg-molhiv | sgc | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7643 (-0.0056) | 0.7105 (0.0067) | | | +| ogbg-molhiv | sgc | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7482 (0.0003) | 0.7177 (0.0158) | | | +| ogbg-molhiv | sgc | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7353 (-0.0126) | 0.6962 (-0.0057) | 0.7017 (-0.0002) | 2.08 | +| ogbg-molhiv | tag | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7554 (0.0066) | 0.7339 (-0.0093) | | | +| ogbg-molhiv | tag | fixed-rrog-T3-ns3 | rocauc | 1 | 0.7804 (0.0276) | 0.7352 (0.0096) | | | +| ogbg-molhiv | tag | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7568 (0.0040) | 0.7481 (0.0225) | 0.7477 (0.0222) | 2.23 | +| ogbg-molhiv | transformer | fixed-rrog-T1-ns3 | rocauc | 3 | 0.7844 (0.0177) | 0.7637 (-0.0077) | | | +| ogbg-molhiv | transformer | fixed-rrog-T3-ns3 | rocauc | 1 | 0.8088 (0.0471) | 0.7413 (-0.0134) | | | +| ogbg-molhiv | transformer | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7813 (0.0196) | 0.7294 (-0.0253) | 0.7396 (-0.0151) | 2.22 | +| ogbg-mollipo | appnp | fixed-rrog-T1-ns3 | rmse | 1 | 0.8393 (0.0622) | 0.9174 (-0.0104) | | | +| ogbg-mollipo | appnp | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 1.1389 (-0.2374) | 1.0733 (-0.1663) | 0.8332 (0.0738) | 2.24 | +| ogbg-mollipo | arma | fixed-rrog-T1-ns3 | rmse | 1 | 0.7173 (0.0152) | 0.7548 (-0.0253) | | | +| ogbg-mollipo | arma | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 108.3475 (-107.6151) | 1.5815 (-0.8520) | 1.2715 (-0.5420) | 6.02 | +| ogbg-mollipo | cheb | fixed-rrog-T1-ns3 | rmse | 1 | 0.6990 (0.0198) | 0.7132 (0.0048) | | | +| ogbg-mollipo | cheb | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 0.7459 (-0.0271) | 0.8055 (-0.0875) | 0.7405 (-0.0225) | 2.03 | +| ogbg-mollipo | film | fixed-rrog-T1-ns3 | rmse | 1 | 0.8122 (-0.0502) | 0.7353 (0.0018) | | | +| ogbg-mollipo | film | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 0.9864 (-0.2243) | 0.9712 (-0.2341) | 0.8345 (-0.0974) | 3.21 | +| ogbg-mollipo | gatv2 | fixed-rrog-T1-ns3 | rmse | 1 | 0.7080 (-0.0215) | 0.7334 (-0.0026) | | | +| ogbg-mollipo | gatv2 | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 0.8837 (-0.1973) | 0.9251 (-0.1943) | 0.7936 (-0.0628) | 2.29 | +| ogbg-mollipo | gcn | fixed-rrog-T1-ns3 | rmse | 1 | 0.7730 (-0.0351) | 0.7759 (0.0069) | | | +| ogbg-mollipo | gcn | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 0.9104 (-0.1725) | 0.9299 (-0.1471) | 0.8010 (-0.0181) | 2.48 | +| ogbg-mollipo | gen | fixed-rrog-T1-ns3 | rmse | 1 | 0.6594 (0.0452) | 0.7456 (-0.0077) | | | +| ogbg-mollipo | gen | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 0.9300 (-0.2254) | 0.9386 (-0.2007) | 0.9375 (-0.1996) | 4.25 | +| ogbg-mollipo | gin | fixed-rrog-T1-ns3 | rmse | 1 | 0.6749 (0.0105) | 0.7073 (0.0317) | | | +| ogbg-mollipo | gin | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 0.8873 (-0.2019) | 1.0246 (-0.2856) | 0.8619 (-0.1229) | 2.54 | +| ogbg-mollipo | gine | fixed-rrog-T1-ns3 | rmse | 1 | 0.7168 (-0.0553) | 0.7316 (0.0025) | | | +| ogbg-mollipo | gine | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 0.8773 (-0.2159) | 0.9710 (-0.2369) | 0.8221 (-0.0880) | 2.40 | +| ogbg-mollipo | graphconv | fixed-rrog-T1-ns3 | rmse | 1 | 0.7372 (-0.0195) | 0.7396 (-0.0099) | | | +| ogbg-mollipo | graphconv | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 0.9624 (-0.2446) | 0.9986 (-0.2689) | 0.7662 (-0.0366) | 2.12 | +| ogbg-mollipo | graphsage | fixed-rrog-T1-ns3 | rmse | 1 | 0.7184 (0.0055) | 0.7720 (0.0063) | | | +| ogbg-mollipo | graphsage | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 1.0742 (-0.3503) | 1.1165 (-0.3382) | 0.9748 (-0.1965) | 5.46 | +| ogbg-mollipo | mf | fixed-rrog-T1-ns3 | rmse | 1 | 0.7050 (0.0080) | 0.7101 (0.0304) | | | +| ogbg-mollipo | mf | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 1.0056 (-0.2927) | 0.9820 (-0.2415) | 0.9414 (-0.2009) | 4.32 | +| ogbg-mollipo | pna | fixed-rrog-T1-ns3 | rmse | 1 | 0.7466 (-0.0287) | 0.7908 (-0.0159) | | | +| ogbg-mollipo | pna | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 0.9147 (-0.1968) | 0.9267 (-0.1517) | 0.8750 (-0.1001) | 4.61 | +| ogbg-mollipo | resgated | fixed-rrog-T1-ns3 | rmse | 1 | 0.6766 (-0.0046) | 0.7144 (0.0126) | | | +| ogbg-mollipo | resgated | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 0.8307 (-0.1587) | 0.8825 (-0.1554) | 0.7250 (0.0020) | 2.12 | +| ogbg-mollipo | sgc | fixed-rrog-T1-ns3 | rmse | 1 | 0.7537 (-0.0032) | 0.7490 (0.0685) | | | +| ogbg-mollipo | sgc | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 0.9196 (-0.1692) | 1.0145 (-0.1969) | 0.8478 (-0.0303) | 2.35 | +| ogbg-mollipo | tag | fixed-rrog-T1-ns3 | rmse | 1 | 0.6743 (-0.0052) | 0.7201 (0.0026) | | | +| ogbg-mollipo | tag | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 0.8615 (-0.1924) | 0.9196 (-0.1969) | 0.8038 (-0.0812) | 2.35 | +| ogbg-mollipo | transformer | fixed-rrog-T1-ns3 | rmse | 1 | 0.6688 (0.0121) | 0.7396 (-0.0050) | | | +| ogbg-mollipo | transformer | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rmse | 1 | 0.8666 (-0.1856) | 0.8930 (-0.1583) | 0.7886 (-0.0540) | 2.32 | +| ogbg-molsider | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.5938 (0.0051) | 0.5905 (-0.0099) | | | +| ogbg-molsider | appnp | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.5801 (-0.0085) | 0.6009 (0.0005) | 0.5959 (-0.0045) | 7.28 | +| ogbg-molsider | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6344 (0.0071) | 0.6141 (-0.0018) | | | +| ogbg-molsider | arma | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6605 (0.0332) | 0.5590 (-0.0569) | 0.5581 (-0.0578) | 7.90 | +| ogbg-molsider | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6263 (0.0026) | 0.6096 (0.0062) | | | +| ogbg-molsider | cheb | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6409 (0.0172) | 0.6150 (0.0116) | 0.6145 (0.0111) | 7.87 | +| ogbg-molsider | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.5862 (-0.0162) | 0.5974 (0.0076) | | | +| ogbg-molsider | film | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.5408 (-0.0616) | 0.5825 (-0.0073) | 0.5825 (-0.0073) | 8.00 | +| ogbg-molsider | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6462 (0.0391) | 0.6000 (-0.0013) | | | +| ogbg-molsider | gatv2 | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.5778 (-0.0294) | 0.6337 (0.0324) | 0.6340 (0.0326) | 7.96 | +| ogbg-molsider | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6256 (-0.0037) | 0.6117 (0.0031) | | | +| ogbg-molsider | gcn | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6346 (0.0053) | 0.6445 (0.0359) | 0.6445 (0.0359) | 7.93 | +| ogbg-molsider | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6345 (-0.0175) | 0.6053 (0.0199) | | | +| ogbg-molsider | gen | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6114 (-0.0405) | 0.6071 (0.0218) | 0.6071 (0.0218) | 8.00 | +| ogbg-molsider | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6046 (-0.0179) | 0.6022 (0.0274) | | | +| ogbg-molsider | gin | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.5942 (-0.0283) | 0.5949 (0.0201) | 0.5949 (0.0201) | 8.00 | +| ogbg-molsider | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6151 (-0.0176) | 0.6150 (0.0655) | | | +| ogbg-molsider | gine | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6117 (-0.0209) | 0.6143 (0.0648) | 0.6148 (0.0653) | 7.96 | +| ogbg-molsider | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6010 (0.0089) | 0.5963 (-0.0188) | | | +| ogbg-molsider | graphconv | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6140 (0.0219) | 0.6069 (-0.0082) | 0.6064 (-0.0087) | 7.92 | +| ogbg-molsider | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6232 (0.0015) | 0.5861 (0.0053) | | | +| ogbg-molsider | graphsage | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6150 (-0.0068) | 0.6082 (0.0275) | 0.6073 (0.0265) | 7.92 | +| ogbg-molsider | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6190 (-0.0012) | 0.5983 (0.0122) | | | +| ogbg-molsider | mf | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6300 (0.0098) | 0.5843 (-0.0017) | 0.5856 (-0.0005) | 7.87 | +| ogbg-molsider | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6058 (-0.0161) | 0.5721 (-0.0243) | | | +| ogbg-molsider | pna | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.5810 (-0.0408) | 0.5398 (-0.0567) | 0.5398 (-0.0567) | 8.00 | +| ogbg-molsider | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6205 (-0.0005) | 0.5960 (0.0050) | | | +| ogbg-molsider | resgated | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6097 (-0.0112) | 0.6246 (0.0335) | 0.6247 (0.0336) | 7.95 | +| ogbg-molsider | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6151 (-0.0022) | 0.6417 (0.0375) | | | +| ogbg-molsider | sgc | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.5866 (-0.0308) | 0.6246 (0.0203) | 0.6242 (0.0199) | 7.88 | +| ogbg-molsider | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6410 (-0.0028) | 0.6102 (-0.0041) | | | +| ogbg-molsider | tag | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6329 (-0.0109) | 0.6061 (-0.0082) | 0.6067 (-0.0076) | 7.91 | +| ogbg-molsider | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.6315 (0.0156) | 0.6190 (0.0210) | | | +| ogbg-molsider | transformer | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.6288 (0.0128) | 0.6215 (0.0235) | 0.6212 (0.0232) | 7.95 | +| ogbg-moltox21 | appnp | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7280 (0.0025) | 0.7154 (-0.0005) | | | +| ogbg-moltox21 | appnp | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7171 (-0.0083) | 0.7197 (0.0039) | 0.7332 (0.0173) | 2.59 | +| ogbg-moltox21 | arma | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7771 (-0.0028) | 0.7209 (-0.0014) | | | +| ogbg-moltox21 | arma | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7575 (-0.0224) | 0.7162 (-0.0061) | 0.7237 (0.0014) | 2.87 | +| ogbg-moltox21 | cheb | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7710 (-0.0125) | 0.7286 (-0.0015) | | | +| ogbg-moltox21 | cheb | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7824 (-0.0010) | 0.7195 (-0.0105) | 0.7203 (-0.0098) | 3.01 | +| ogbg-moltox21 | film | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7727 (0.0025) | 0.7369 (0.0209) | | | +| ogbg-moltox21 | film | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7513 (-0.0189) | 0.6885 (-0.0275) | 0.6897 (-0.0263) | 3.55 | +| ogbg-moltox21 | gatv2 | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7762 (0.0135) | 0.7303 (0.0143) | | | +| ogbg-moltox21 | gatv2 | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7674 (0.0046) | 0.7155 (-0.0004) | 0.7172 (0.0012) | 4.04 | +| ogbg-moltox21 | gcn | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7588 (0.0007) | 0.7230 (0.0059) | | | +| ogbg-moltox21 | gcn | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7677 (0.0097) | 0.7136 (-0.0035) | 0.7247 (0.0076) | 3.26 | +| ogbg-moltox21 | gen | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7757 (-0.0077) | 0.7312 (-0.0132) | | | +| ogbg-moltox21 | gen | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7548 (-0.0286) | 0.7300 (-0.0144) | 0.7366 (-0.0078) | 3.43 | +| ogbg-moltox21 | gin | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7718 (0.0028) | 0.7237 (-0.0005) | | | +| ogbg-moltox21 | gin | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7634 (-0.0056) | 0.7044 (-0.0198) | 0.7112 (-0.0130) | 4.17 | +| ogbg-moltox21 | gine | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7622 (-0.0122) | 0.7193 (-0.0135) | | | +| ogbg-moltox21 | gine | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7616 (-0.0127) | 0.7120 (-0.0208) | 0.7177 (-0.0151) | 3.93 | +| ogbg-moltox21 | graphconv | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7820 (-0.0011) | 0.7313 (0.0166) | | | +| ogbg-moltox21 | graphconv | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7641 (-0.0191) | 0.7210 (0.0063) | 0.7323 (0.0175) | 4.09 | +| ogbg-moltox21 | graphsage | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7697 (-0.0012) | 0.7205 (0.0009) | | | +| ogbg-moltox21 | graphsage | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7792 (0.0083) | 0.7217 (0.0021) | 0.7282 (0.0087) | 3.39 | +| ogbg-moltox21 | mf | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7695 (-0.0078) | 0.7279 (-0.0002) | | | +| ogbg-moltox21 | mf | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7656 (-0.0117) | 0.7236 (-0.0045) | 0.7314 (0.0034) | 2.96 | +| ogbg-moltox21 | pna | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7745 (0.0085) | 0.7349 (0.0403) | | | +| ogbg-moltox21 | pna | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7625 (-0.0035) | 0.7138 (0.0192) | 0.7200 (0.0254) | 4.06 | +| ogbg-moltox21 | resgated | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7887 (-0.0064) | 0.7380 (0.0104) | | | +| ogbg-moltox21 | resgated | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7737 (-0.0213) | 0.7454 (0.0179) | 0.7449 (0.0173) | 2.78 | +| ogbg-moltox21 | sgc | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7506 (-0.0105) | 0.7355 (0.0115) | | | +| ogbg-moltox21 | sgc | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7669 (0.0058) | 0.7262 (0.0022) | 0.7331 (0.0091) | 3.26 | +| ogbg-moltox21 | tag | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7839 (-0.0027) | 0.7342 (-0.0074) | | | +| ogbg-moltox21 | tag | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7792 (-0.0074) | 0.7195 (-0.0221) | 0.7225 (-0.0190) | 3.32 | +| ogbg-moltox21 | transformer | fixed-rrog-T1-ns3 | rocauc | 1 | 0.7761 (0.0105) | 0.7292 (-0.0018) | | | +| ogbg-moltox21 | transformer | rrog-act-stream-T1-ns3-hm8-min2-loss0.2-lq0.1-hex0.1-qw0 | rocauc | 1 | 0.7840 (0.0184) | 0.7237 (-0.0072) | 0.7242 (-0.0068) | 4.33 | diff --git a/summaries/zinc_cycle56.md b/summaries/zinc_cycle56.md new file mode 100644 index 0000000..961f0b4 --- /dev/null +++ b/summaries/zinc_cycle56.md @@ -0,0 +1,42 @@ + +ZINC-cycle56 classic baseline +| task | backbone | n | val MAE-sum | test MAE-sum | +| --- | --- | --- | --- | --- | +| zinc-cycle56 | appnp | 1 | 1.0040 +/- 0.0000 | 1.0183 +/- 0.0000 | +| zinc-cycle56 | arma | 1 | 0.3456 +/- 0.0000 | 0.3406 +/- 0.0000 | +| zinc-cycle56 | cheb | 1 | 0.4038 +/- 0.0000 | 0.3887 +/- 0.0000 | +| zinc-cycle56 | film | 1 | 0.4906 +/- 0.0000 | 0.4998 +/- 0.0000 | +| zinc-cycle56 | gatv2 | 1 | 0.4084 +/- 0.0000 | 0.4012 +/- 0.0000 | +| zinc-cycle56 | gcn | 1 | 0.5821 +/- 0.0000 | 0.5854 +/- 0.0000 | +| zinc-cycle56 | gen | 1 | 0.3961 +/- 0.0000 | 0.3854 +/- 0.0000 | +| zinc-cycle56 | gin | 1 | 0.2981 +/- 0.0000 | 0.2725 +/- 0.0000 | +| zinc-cycle56 | gine | 1 | 0.2387 +/- 0.0000 | 0.2317 +/- 0.0000 | +| zinc-cycle56 | graphconv | 1 | 0.3507 +/- 0.0000 | 0.3462 +/- 0.0000 | +| zinc-cycle56 | graphsage | 1 | 0.4134 +/- 0.0000 | 0.4179 +/- 0.0000 | +| zinc-cycle56 | mf | 1 | 0.3051 +/- 0.0000 | 0.3031 +/- 0.0000 | +| zinc-cycle56 | pna | 1 | 0.1565 +/- 0.0000 | 0.1539 +/- 0.0000 | +| zinc-cycle56 | resgated | 1 | 0.3183 +/- 0.0000 | 0.3168 +/- 0.0000 | +| zinc-cycle56 | sgc | 1 | 0.6287 +/- 0.0000 | 0.6432 +/- 0.0000 | +| zinc-cycle56 | tag | 1 | 0.2889 +/- 0.0000 | 0.2831 +/- 0.0000 | +| zinc-cycle56 | transformer | 1 | 0.3837 +/- 0.0000 | 0.3760 +/- 0.0000 | + +ZINC-cycle56 delta vs matching classic +| task | backbone | compute | n | val score (improvement) | test score (improvement) | +| --- | --- | --- | --- | --- | --- | +| zinc-cycle56 | appnp | fixed-rrog-T1-ns3+trace | 1 | 0.9730 (0.0310) | 0.9845 (0.0338) | +| zinc-cycle56 | arma | fixed-rrog-T1-ns3+trace | 1 | 0.2414 (0.1042) | 0.2378 (0.1028) | +| zinc-cycle56 | cheb | fixed-rrog-T1-ns3+trace | 1 | 0.2896 (0.1143) | 0.2830 (0.1057) | +| zinc-cycle56 | film | fixed-rrog-T1-ns3+trace | 1 | 0.6898 (-0.1993) | 0.6643 (-0.1646) | +| zinc-cycle56 | gatv2 | fixed-rrog-T1-ns3+trace | 1 | 0.3155 (0.0929) | 0.3121 (0.0891) | +| zinc-cycle56 | gcn | fixed-rrog-T1-ns3+trace | 1 | 0.4380 (0.1441) | 0.4603 (0.1251) | +| zinc-cycle56 | gen | fixed-rrog-T1-ns3+trace | 1 | 0.3554 (0.0407) | 0.3405 (0.0450) | +| zinc-cycle56 | gin | fixed-rrog-T1-ns3+trace | 1 | 0.2269 (0.0711) | 0.2222 (0.0502) | +| zinc-cycle56 | gine | fixed-rrog-T1-ns3+trace | 1 | 0.1641 (0.0745) | 0.1509 (0.0808) | +| zinc-cycle56 | graphconv | fixed-rrog-T1-ns3+trace | 1 | 0.2091 (0.1416) | 0.2060 (0.1402) | +| zinc-cycle56 | graphsage | fixed-rrog-T1-ns3+trace | 1 | 0.3381 (0.0753) | 0.3407 (0.0772) | +| zinc-cycle56 | mf | fixed-rrog-T1-ns3+trace | 1 | 0.1987 (0.1065) | 0.1911 (0.1120) | +| zinc-cycle56 | pna | fixed-rrog-T1-ns3+trace | 1 | 0.1216 (0.0349) | 0.1056 (0.0483) | +| zinc-cycle56 | resgated | fixed-rrog-T1-ns3+trace | 1 | 0.1834 (0.1350) | 0.1765 (0.1403) | +| zinc-cycle56 | sgc | fixed-rrog-T1-ns3+trace | 1 | 0.5008 (0.1278) | 0.5066 (0.1366) | +| zinc-cycle56 | tag | fixed-rrog-T1-ns3+trace | 1 | 0.1410 (0.1479) | 0.1386 (0.1445) | +| zinc-cycle56 | transformer | fixed-rrog-T1-ns3+trace | 1 | 0.3092 (0.0744) | 0.3268 (0.0491) | |