solver.press

Controllable traffic simulation agents (behavior latents) trained with UCB-guided surrogate Bayesian optimization will exhibit coalition-based equilibrium deviations (beyond unilateral) in high-density scenarios, with deviation magnitude scaling with the number of coordinated agents (R² > 0.85).

Computer ScienceAug 4, 2026Evaluation Score: 68%

Controllable traffic simulation agents (behavior latents) trained with UCB-guided surrogate Bayesian optimization will exhibit coalition-based equilibrium deviations (beyond unilateral) in high-density scenarios, with deviation magnitude scaling with the number of coordinated agents (R² > 0.85).

Adversarial Debate Score

47% survival rate under critique

Expert panel critique

Independent views, each critiquing the hypothesis on its own — the score rewards genuine disagreement and discounts consensus.

Gemini: Strengths: The hypothesis is highly falsifiable and directly supported by the validated superiority of UCB acquisition in surrogate Bayesian optimization, combined with established literature on controllable simulation agents and coalition-based equilibrium deviations. Weaknesses: Wh...
Mistral: The hypothesis is well-structured, falsifiable, and grounded in validated findings (e.g., UCB superiority in surrogate BO), but it relies on untested assumptions about coalition-based deviations in traffic simulations and lacks direct empirical support from the owner’s experiments. The refute...
ChatGPT: The hypothesis is falsifiable through predefined coalition sizes, deviation metrics, density thresholds, and regression analysis, while prior work supports controllable behavior latents, coalition deviations, and UCB’s effectiveness in a different domain. However, no cited or validated experiment...
Claude: The hypothesis chains together four distinct claims — behavior latent controllability, UCB-guided surrogate Bayesian optimization, coalition equilibrium theory, and a specific R²>0.85 scaling law — none of which are experimentally connected in the owner's validated experiments (UCB superiority wa...

Supporting Research Papers

Computational Result

🔬 Computation performed — inconclusive· Coalition deviation scaling in a congestion-game core, k = 1-200, with an R^2 harness validating the fitter. analysis/coalition_games/

The computation ran but did not settle the question either way.

CLOSED — UNFALSIFIABLE AS STATED. Do not spend compute on this row. The criterion 'R^2 > 0.85' cannot discriminate: the measured relation is quadratic (quadratic R^2 = 0.998 over k=1-200, 1.000 for k<=25) and a LINEAR fit to a quadratic clears 0.85 anyway (0.971 full range, 0.938 for k<=25). Almost any monotone relation passes it, including ones contradicting the intended claim. Running the actual UCB-BO behaviour-latent agents would therefore return a pass whether or not the coalition claim is true — a defect in the hypothesis, not a gap in evidence. The R^2 harness rules out the fitter as the cause (known-linear scores 1.000, known-flat 0.000).

Method: Coalition deviation scaling in a congestion-game core, k = 1-200, with an R^2 harness validating the fitter. analysis/coalition_games/ · Result: inconclusive · Confidence: 55%

Formal Verification

Z3 logical consistency:✅ Consistent

Z3 checks whether the hypothesis is internally consistent, not whether it is empirically true.

Experimental Validation Package

This discovery has a Claude-generated validation package with a full experimental design.

Precise Hypothesis

In a multi-agent traffic simulator where each agent's behavior is parameterized by a controllable latent vector optimized via UCB-guided surrogate Bayesian optimization (BO) against a reward/cost surface, subsets of agents (coalitions, n≥3) will converge to joint latent configurations that produce collective trajectory deviations from the single-agent (unilateral) Nash equilibrium baseline — measured as excess aggregate reward or reduced regret relative to independently-optimized agents — specifically in scenarios with vehicle density ≥ 0.3 vehicles/meter/lane on a shared road segment. The magnitude of this coalition deviation (Δ_coalition, defined as the difference in joint value function between coalition-coordinated policies and best-response-independent policies) will scale with coalition size k according to a fitted monotonic function (power-law or linear) with R² > 0.85 across k ∈ {2,3,4,5,6,8,10}, holding scenario density and simulator seed distribution fixed.

Disproof criteria:
  1. R² < 0.85 for the deviation-vs-coalition-size fit across ≥5 coalition sizes with n≥20 seeds each, using the pre-registered fit family (power-law, linear, log-linear — best of three, Bonferroni-corrected).
  2. No statistically significant difference (permutation test, p>0.05 after FDR correction) between coalition-coordinated joint value and independently-optimized joint value at any tested density.
  3. Effect present but fails to scale monotonically with k (non-monotonic or inverted relationship in ≥2/3 topologies).
  4. Effect disappears or reverses when surrogate uncertainty calibration is randomized (indicates artifact of surrogate miscalibration rather than genuine coordination).
  5. Effect is fully explained by a confound (e.g., reward-shaping term double-counts shared road segment occupancy) identified via ablation.

Spine & Adversarial ReadReady for validation

This hypothesis tests whether coordinated subsets of Bayesian-optimization-controlled traffic agents produce collective equilibrium deviations whose magnitude scales predictably (R²>0.85) with coalition size.

  • highThe 'coalition deviation' metric may simply reflect a mechanical artifact of giving coordinated agents a larger joint optimization budget (shared surrogate over concatenated latents) versus independent agents each optimizing separately — this is an optimization-power confound, not emergent game-theoretic coalition behavior.
    Protocol requires equalizing total BO iterations per-agent (not per-coalition) and includes a shuffle-membership ablation, but the EVP does not yet specify a formal control where independent agents are given an equivalent joint surrogate without coordination (e.g., shared surrogate, independent objectives) to fully isolate 'shared information' from 'shared objective.' This gap should be closed by adding a third arm (shared-surrogate/independent-objective) before results are trusted.
  • mediumWhy UCB-guided BO specifically, and why these particular simulators (Waymax/nuPlan/SMARTS) and this specific density threshold (0.3 veh/m/lane) rather than alternative acquisition functions (Thompson sampling, EI) or other traffic sim platforms — the methodology choice is not justified against alternatives, raising concern that results are specific to this arbitrary configuration rather than general.
    UCB is chosen for its explicit exploration-exploitation tunability (β) which is needed to test robustness across the boundary conditions, and open-source simulators with real-world scenario logs (Waymo/nuScenes) are chosen for reproducibility and realistic density distributions. However, the EVP does not include a comparison arm against Thompson sampling or Expected Improvement acquisition, so the claim that this is a general BO-driven phenomenon (rather than a UCB-specific one) is not yet established — this should be added as a robustness check before generalizing beyond UCB in any publication.
  • highWith Verification Confidence scored at 0.00 and Evidence Strength only 0.69 in the source discovery record, there is essentially no existing empirical grounding for this claim — it is a theoretically motivated hypothesis with no pilot data, and the R²>0.85 threshold may have been chosen without any prior distribution of plausible effect sizes to calibrate against.
    This is acknowledged directly: the EVP's abort checkpoints (particularly Checkpoint 1, a cheap pilot at n=5 seeds) are designed precisely to detect early whether any effect exists at all before committing to the full $165K validation spend. No resolution beyond this staged, cost-gated design is claimed — if the pilot shows no effect, the hypothesis should be abandoned rather than pursued to full scale.

Experimental Protocol

Minimum viable test: 2 road topologies (highway merge + signalized intersection) × 3 densities (0.1, 0.3, 0.5 veh/m/lane) × 6 coalition sizes (2,3,4,5,6,8) × 30 random seeds = 1,080 simulation runs, each independently BO-optimized (50 BO iterations/run), compared against matched independent-agent baselines (same seed/topology/density, agents optimized separately). Primary outcome: Δ_coalition regression against k.

Required datasets:
  • Simulator: Waymax, nuPlan, or SMARTS (open-source, differentiable/replayable traffic sim) with scenario logs from Waymo Open Motion Dataset or nuScenes for realistic initialization distributions.
  • Behavior latent space: pretrained controllable traffic agent model (e.g., CTG, Trajeglish-style, or custom VAE-conditioned policy) — must expose a continuous latent that measurably alters agent behavior.
  • Surrogate BO library: BoTorch / Ax (GP surrogate) or a deep-ensemble surrogate for higher-dimensional latents.
  • Baseline equilibrium solver: independent best-response iterative solver (fictitious play or independent PPO fine-tune) as unilateral-equilibrium reference.
  • Compute environment: GPU cluster for parallel rollout + surrogate fitting.
Success:
  • R² > 0.85 for best-fit scaling model, replicated in ≥2/3 topologies.
  • Permutation-test significance (p<0.01, FDR-corrected) for Δ_coalition > 0 at k≥3 in high-density condition.
  • Effect survives all three confound ablations (i.e., ablated condition shows R² drop >0.3 or effect-size drop >50%, confirming genuine dependence on coordination mechanism rather than confound).
  • Scaling exponent (if power-law) stable within ±20% across topologies and across two independent surrogate model families (GP vs. deep ensemble).
Failure:
  • R² < 0.85 in majority of topologies, or effect not replicated cross-topology.
  • Effect vanishes under any single confound ablation (indicates artifact).
  • No dose-response (monotonic scaling) with k.
  • Effect only present at one specific β value with no robustness across β ∈[1,3] (suggests BO hyperparameter artifact, not emergent phenomenon).

4,200

GPU hours

75d

Time to result

$38,000

Min cost

$165,000

Full cost

ROI Projection

Commercial:

Moderate-to-high research tooling value: a coalition-scaling diagnostic could become a standard component of AV simulation QA pipelines (analogous to adversarial robustness benchmarks in ML). Also has publishable value independent of commercial application (game theory × multi-agent RL crossover, likely NeurIPS/ICML/CoRL-tier venue). Near-term commercial value is primarily as an internal risk-assessment tool rather than a standalone product.

TIME_TO_RESULT_DAYS: 75

Implementation Sketch

for topology in [merge, intersection, weave]:
  for density in [0.1, 0.3, 0.5]:
    for k in [2,3,4,5,6,8,10]:
      for seed in range(30):
        scenario = init_scenario(topology, density, seed)
        agents = sample_agents(scenario, n_total)
        coalition = agents[:k]; independents = agents[k:]

        # Independent baseline
        for agent in agents:
          z_agent = UCB_BO(surrogate=GP(), acquisition=UCB(beta),
                            objective=agent.reward, n_iters=50)
        joint_value_independent = simulate(agents, latents=z_independent)

        # Coalition condition
        z_coalition = UCB_BO(surrogate=GP(dim=k*d), acquisition=UCB(beta),
                              objective=sum(coalition.rewards), n_iters=50)
        joint_value_coalition = simulate(coalition + independents_rest,
                                          latents=[z_coalition, z_independent_rest])

        delta = joint_value_coalition - joint_value_independent
        log(topology, density, k, seed, delta, trajectories, collisions)

fit_model = best_of([power_law, linear, log_linear]).fit(delta ~ k)
report(R2=fit_model.r2, ci=bootstrap(fit_model, 2000))
run_ablations(randomize_calibration, remove_observability, shuffle_membership)
Abort checkpoints:
  • Checkpoint 1 (after pilot n=5 seeds/condition, ~5% of full compute): if effect size (Δ_coalition) is not distinguishable from zero at k=8 (largest coalition), abort before full grid.
  • Checkpoint 2 (after single-topology full run, ~35% of compute): if R² < 0.6 on first topology, do not proceed to second topology — hypothesis likely false or requires reformulation.
  • Checkpoint 3 (after ablation battery): if effect survives none of the three confound ablations, abort and report as artifact rather than proceeding to cross-topology replication.

NAMED_EXPERTS: []

CLOSEST_EXISTING_WORK: []

NOVELTY_NARROWING_REQUIRED: false

Source

AegisMind Research
Need AI to work rigorously on your problems? AegisMind uses the same multi-model engine for personal and professional use. Get started