[gpu3-ablation] start Wed Jun 24 10:20:44 CDT 2026
[gpu3-ablation] phase1 exact target, classification tasks, views=gin gcn sgc tag graphconv appnp pna resgated
[launch] cuda:3: ogbg-molhiv ogbg-molbbbp ogbg-molsider ogbg-molbace ogbg-moltox21 ogbg-molclintox
[launch] cuda:3: ogbg-molesol ogbg-mollipo ogbg-moltox21 ogbg-molclintox
[task] ogbg-molhiv on cuda:3
[task] ogbg-molesol on cuda:3
[run] ogbg-molesol view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3
[run] ogbg-molhiv view=gin compute=rrog-act mode=stream T=1 ns=3 seed=0 device=cuda:3
python3 rrog/train_ogb_graphprop.py --dataset ogbg-molesol --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0
python3 rrog/train_ogb_graphprop.py --dataset ogbg-molhiv --view gin --compute rrog-act --T 1 --n_sup 3 --hidden 128 --bs 128 --epochs 100 --eval_every 10 --agg_layers 5 --compute_layers 2 --seed 0 --lam_q 0.1 --halt_max_steps 8 --halt_min_steps 2 --halt_target exact --halt_loss_threshold 0.2 --halt_exploration_prob 0.1 --act_train_mode stream --q_warmup_epochs 0 --device cuda:3 --num_workers 0
Downloading http://snap.stanford.edu/ogb/data/graphproppred/csv_mol_download/esol.zip

  0%|          | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB:   0%|          | 0/2 [00:00<?, ?it/s]
Downloaded 0.00 GB:  50%|█████     | 1/2 [00:00<00:00,  9.67it/s]
Downloaded 0.00 GB:  50%|█████     | 1/2 [00:00<00:00,  9.67it/s]
Downloaded 0.00 GB: 100%|██████████| 2/2 [00:00<00:00, 19.32it/s]
Processing...
Extracting /home/yurenh2/rrog-gnn-runner/data/ogb/esol.zip
Loading necessary files...
This might take a while.
Processing graphs...

  0%|          | 0/1128 [00:00<?, ?it/s]
100%|██████████| 1128/1128 [00:00<00:00, 184042.28it/s]
Converting graphs into PyG objects...

  0%|          | 0/1128 [00:00<?, ?it/s]
100%|██████████| 1128/1128 [00:00<00:00, 77870.45it/s]
/home/yurenh2/miniconda3/lib/python3.13/site-packages/ogb/graphproppred/dataset_pyg.py:158: UserWarning: The given NumPy array is not writable, and PyTorch does not support non-writable tensors. This means writing to this tensor will result in undefined behavior. You may want to copy the array to protect its data or make it writable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at /pytorch/torch/csrc/utils/tensor_numpy.cpp:213.)
  g.y = torch.from_numpy(graph_label[i]).view(1,-1).to(torch.float32)
Done!
Saving...
Traceback (most recent call last):
  File "/home/yurenh2/rrog-gnn-runner/rrog/train_ogb_graphprop.py", line 704, in <module>
    main()
    ~~~~^^
  File "/home/yurenh2/rrog-gnn-runner/rrog/train_ogb_graphprop.py", line 601, in main
    act_state, train_metrics = train_epoch(
                               ~~~~~~~~~~~^
        model, train_loader, opt, dev, args, act_state, ema_state, ep + 1, metric)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/yurenh2/rrog-gnn-runner/rrog/train_ogb_graphprop.py", line 507, in train_epoch
    act_state, m = act_train_step(model, act_state, batch, opt, dev, args, epoch, metric)
                   ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/yurenh2/rrog-gnn-runner/rrog/train_ogb_graphprop.py", line 412, in act_train_step
    raise ValueError(args.halt_target)
ValueError: exact