solver.press

Adaptive acquisition functions (UCB-guided Bayesian optimization) will reduce the number of experimental trials required to identify coalition-stable drug synergy pairs by ≥40% compared to fixed EI acquisition, when applied to residual graph isomorphism networks trained on MSH3-KPC-3 interaction graphs.

Computer ScienceAug 7, 2026Evaluation Score: 70%

Adaptive acquisition functions (UCB-guided Bayesian optimization) will reduce the number of experimental trials required to identify coalition-stable drug synergy pairs by ≥40% compared to fixed EI acquisition, when applied to residual graph isomorphism networks trained on MSH3-KPC-3 interaction graphs.

Adversarial Debate Score

53% survival rate under critique

Expert panel critique

Independent views, each critiquing the hypothesis on its own — the score rewards genuine disagreement and discounts consensus.

Gemini: Strengths: The hypothesis correctly identifies that UCB acquisition outperforms EI in surrogate Bayesian optimization for drug discovery, a claim supported by the owner's validated experiments (Phase 20). Weaknesses: The hypothesis is built on a refuted premise: the owner's experimen...
Mistral: The hypothesis is well-grounded in validated experiments (UCB > EI in surrogate BO) and relevant literature, but its specificity to coalition-stable drug synergy pairs and reliance on residual graph isomorphism networks (without direct prior evidence) introduces some uncertainty. The refutation...
ChatGPT: The hypothesis is clearly falsifiable, and validated experiments strongly support UCB over EI in drug-discovery surrogate optimization. However, the specific ≥40% trial reduction, coalition stability, residual GIN setting, and corrected MSH3–KPC-3 graphs remain unvalidated, while the prior MSH3 r...
Claude: The hypothesis gains meaningful support from the owner's validated finding that UCB (κ=1.0) outperforms EI across 6/6 surrogate BO targets (a directly relevant ground-truth result), and is contextually grounded in the residual GIN and adaptive acquisition literature; however, the specific ≥40...

Supporting Research Papers

Computational Result

📖 Literature-assessed (LLM)· literature_meta

An LLM's reading of the literature — not computational verification.

Adaptive methods may improve efficiency, but evidence is mixed.

Method: literature_meta · Result: inconclusive · Confidence: 60%

Formal Verification

Z3 logical consistency:✅ Consistent

Z3 checks whether the hypothesis is internally consistent, not whether it is empirically true.

Experimental Validation Package

This discovery has a Claude-generated validation package with a full experimental design.

Precise Hypothesis

When a residual graph isomorphism network (R-GIN) trained on MSH3–KPC-3 protein-protein/drug interaction graphs is used as a surrogate model for Bayesian optimization over a drug-pair combination space, an Upper Confidence Bound (UCB) acquisition function will identify all coalition-stable drug synergy pairs (defined as pairs whose Shapley-value-derived synergy score exceeds a fixed threshold τ and remains stable under leave-one-out perturbation of the coalition) using ≥40% fewer labeled experimental trials (oracle queries) than a fixed-parameter Expected Improvement (EI) acquisition function, measured as the number of queries needed to reach 95% recall of the true stable-pair set, averaged over ≥30 independent runs with different random seeds and initial designs, at statistical significance p<0.05 (paired Wilcoxon signed-rank test) and effect size Cohen's d≥0.5.

Disproof criteria:
  • If mean trial reduction is <40% (or negative, i.e., UCB requires more trials than EI) across ≥30 seeds, hypothesis is disproven.
  • If the 95% CI on trial-reduction crosses zero or the paired significance test yields p≥0.05, hypothesis is disproven.
  • If UCB's advantage disappears (|Δ|<10%) when surrogate calibration is controlled for (ablation), the causal claim (adaptive acquisition specifically, not surrogate quality) is disproven.
  • If results fail to replicate on a second independent interaction-graph dataset (e.g., synthetic benchmark or a second real dataset) with the same direction and magnitude (within 15 percentage points), external validity is disproven.

Spine & Adversarial Read

  • highThe comparison uses a frozen offline oracle (pre-labeled ground truth) rather than real wet-lab feedback, so the result may not transfer to true prospective experimental campaigns where noise, batch effects, and assay variability are present.
    Partially addressed by pre-registering a synthetic-benchmark replication arm and noting the stationarity assumption in boundary conditions, but the EVP does not include a live/semi-live wet-lab validation phase — this is an acknowledged gap requiring a follow-up in-vitro confirmation study before real deployment claims can be made.
  • highWhy R-GIN specifically and not simpler GNN variants (plain GCN, GAT) or non-graph surrogates (random forest on molecular descriptors)? The choice of surrogate architecture is not justified against alternatives, so any observed acquisition-function effect could be confounded with an unjustified architecture choice.
    Not resolved in current design — the EVP should add a surrogate-architecture ablation (GCN, GAT, R-GIN, RF baseline) crossed with both acquisition functions to confirm the UCB-vs-EI effect is robust across surrogate choice, not an artifact of R-GIN's specific inductive bias. This is a methodology justification gap that should be closed before publication.
  • mediumThe 'coalition-stability' construct (Shapley value + leave-one-out variance) is a nonstandard and somewhat ad hoc operationalization of drug synergy; a skeptic could argue this definition was chosen post hoc to make the problem tractable for game-theoretic framing rather than reflecting established pharmacological synergy criteria (e.g., Bliss independence, Loewe additivity).
    Partially addressed by cross-referencing with standard Bliss/Loewe synergy scores from DrugComb/NCI-ALMANAC as the labeling source, but the mapping from those standard scores to the Shapley-based 'coalition stability' label needs explicit validation (e.g., correlation between Shapley-stability labels and Bliss-synergy labels) — not currently included as a reported diagnostic.

Experimental Protocol

Minimum viable test (MVT): simulate a closed-loop BO campaign against a frozen "oracle" — the fully trained R-GIN surrogate evaluated on held-out ground-truth synergy labels — with two acquisition functions (UCB vs EI) competing to find all coalition-stable pairs from a fixed candidate pool of ~1,000 drug pairs derived from MSH3-KPC-3 interaction data. Each acquisition function runs 30 independent trials (different random seeds, different initial 10-point Latin hypercube designs). Track cumulative queries to reach 95% recall of ground-truth stable set. Compare query-count distributions.

Required datasets:
  • Primary: MSH3-KPC-3 interaction graph dataset (protein-protein interaction + drug-target bipartite graph); if not already curated, construct from STRING/BioGRID + DrugBank/DGIdb cross-reference, minimum 1,000 nodes, 5,000 edges.
  • Ground-truth synergy labels: existing combination screening dataset (e.g., DrugComb, NCI-ALMANAC, or O'Neil et al. dataset) mapped onto MSH3/KPC-3-adjacent pathway pairs; need ≥200 labeled drug pairs with measured synergy (Bliss/Loewe scores) to serve as oracle ground truth.
  • Synthetic validation set: a second, independently generated synthetic graph-synergy benchmark (e.g., using a graph generative model) to test generalization, ≥500 pairs.
  • Model artifact: pretrained R-GIN (residual GIN, 4–6 layers, hidden dim 128–256) — must be trained and validated (AUROC≥0.75 on held-out synergy prediction) BEFORE BO experiments begin.
  • Software: BoTorch/GPyTorch or Ax for BO loop; PyTorch Geometric for R-GIN; a Shapley-value coalition-stability module (custom, using approximate Shapley via Monte Carlo sampling, 1,000 permutations per evaluation).
Success:
  • Primary: mean trial reduction ≥40% (UCB vs EI), 95% CI lower bound >30%, p<0.05 (Wilcoxon), Cohen's d≥0.5, replicated in synthetic benchmark with reduction ≥25%.
  • Secondary: UCB's advantage persists (≥25% reduction) in retrained-surrogate ablation arm, confirming effect isn't purely a frozen-surrogate artifact.
  • Calibration check: R-GIN ECE <0.1 on held-out data (precondition for interpretable result).
Failure:
  • Mean reduction <40% OR CI includes zero OR p≥0.05 → hypothesis fails as stated (may still show weaker directional effect worth reporting).
  • No significant difference between UCB and EI on synthetic benchmark → generalization fails.
  • Advantage disappears when surrogate is untrained/random → effect attributable to surrogate not acquisition function, hypothesis as causally stated fails.
  • High variance (CV>75%) in query-count distributions across seeds → result deemed unreliable regardless of mean.

ROI Projection

Implementation Sketch

# Phase 1: Surrogate training
graph = build_MSH3_KPC3_interaction_graph(sources=[STRING, DrugBank])
model = ResidualGIN(layers=5, hidden=256, dropout=0.2)
train(model, labeled_pairs_70pct, epochs=200, early_stop_patience=15)
assert calibration_ECE(model, held_out_30pct) < 0.10
assert AUROC(model, held_out_30pct) >= 0.75

# Phase 2: Ground truth coalition-stability labeling
for pair in candidate_pool:
    shapley_score = monte_carlo_shapley(pair, coalition_graph, n_perm=1000)
    stability = leave_one_out_variance(pair, coalition_graph) < 0.10 * shapley_score
    ground_truth[pair] = (shapley_score > tau) and stability

# Phase 3: BO loop (per acquisition function, per seed)
def bo_loop(acq_fn, seed, pool, ground_truth, budget=300):
    rng = seed_rng(seed)
    observed = latin_hypercube_init(pool, n=10, rng=rng)
    gp = fit_GP_on_embeddings(model.embed(observed))
    queries = 10
    while recall(observed, ground_truth) < 0.95 and queries < budget:
        next_pair = acq_fn.select(gp, pool - observed)   # UCB: mu + beta*sigma
        label = ground_truth[next_pair]                   # oracle reveal
        observed.add((next_pair, label))
        gp = fit_GP_on_embeddings(model.embed(observed))   # or update posterior
        queries += 1
    return queries

results_UCB = [bo_loop(UCB(beta=2), s, pool, gt) for s in range(30)]
results_EI  = [bo_loop(EI(), s, pool, gt) for s in range(30)]

reduction_pct = 100 * (mean(results_EI) - mean(results_UCB)) / mean(results_EI)
wilcoxon_test(results_UCB, results_EI)
Abort checkpoints:
  • After Phase 1 (surrogate training): if AUROC<0.70 or ECE>0.15, abort and revisit graph construction/model architecture before proceeding (est. cost saved: ~80% of full budget).
  • After 10 pilot BO trials per arm (before full 30-seed run): if observed reduction is <15% or variance is extremely high (CV>100%), abort or redesign acquisition parameters before committing to full 30-seed statistical run.
  • After ablation arm (randomized surrogate): if UCB advantage persists identically with untrained surrogate, abort interpretation as "adaptive acquisition + good surrogate" and re-scope claim.
  • Mid-campaign data audit at 50% of planned trials: verify ground-truth labels haven't drifted/been mis-scored; if error rate >5% found, pause and re-validate labels before continuing.

NAMED_EXPERTS: []

CLOSEST_EXISTING_WORK: []

NOVELTY_NARROWING_REQUIRED: false

SPINE_STATEMENT: This hypothesis tests whether UCB acquisition in Bayesian optimization over an R-GIN surrogate reduces the number of experimental trials needed to identify coalition-stable drug synergy pairs by at least 40% compared to fixed EI acquisition.

Source

AegisMind Research
Need AI to work rigorously on your problems? AegisMind uses the same multi-model engine for personal and professional use. Get started