Controllable traffic simulation agents (behavior latents) trained with UCB-guided surrogate Bayesian optimization will exhibit coalition-based equilibrium deviations (beyond unilateral) in high-density scenarios, with deviation magnitude scaling with the number of coordinated agents (R² > 0.85).
Controllable traffic simulation agents (behavior latents) trained with UCB-guided surrogate Bayesian optimization will exhibit coalition-based equilibrium deviations (beyond unilateral) in high-density scenarios, with deviation magnitude scaling with the number of coordinated agents (R² > 0.85).
Adversarial Debate Score
47% survival rate under critique
Expert panel critique
Independent views, each critiquing the hypothesis on its own — the score rewards genuine disagreement and discounts consensus.
Supporting Research Papers
- Controllable Sim Agents with Behavior Latents
Realistic traffic simulation requires agents that imitate logged behavior and can also be steered along interpretable axes. Such controllability enables engineers to isolate variables, reproduce speci...
- Quantifying Trade-Offs Between Stability and Goal-Obfuscation
Safety-critical autonomy in adversarial settings demands more than Lyapunov stability of tracking error signals. An agent executing a goal-directed trajectory is intrinsically legible to a passive obs...
- Computing Equilibrium beyond Unilateral Deviation
Most familiar equilibrium concepts, such as Nash and correlated equilibrium, guarantee only that no single player can improve their utility by deviating unilaterally. They offer no guarantees against ...
Computational Result
The computation ran but did not settle the question either way.
CLOSED — UNFALSIFIABLE AS STATED. Do not spend compute on this row. The criterion 'R^2 > 0.85' cannot discriminate: the measured relation is quadratic (quadratic R^2 = 0.998 over k=1-200, 1.000 for k<=25) and a LINEAR fit to a quadratic clears 0.85 anyway (0.971 full range, 0.938 for k<=25). Almost any monotone relation passes it, including ones contradicting the intended claim. Running the actual UCB-BO behaviour-latent agents would therefore return a pass whether or not the coalition claim is true — a defect in the hypothesis, not a gap in evidence. The R^2 harness rules out the fitter as the cause (known-linear scores 1.000, known-flat 0.000).
Method: Coalition deviation scaling in a congestion-game core, k = 1-200, with an R^2 harness validating the fitter. analysis/coalition_games/ · Result: inconclusive · Confidence: 55%
Formal Verification
Z3 checks whether the hypothesis is internally consistent, not whether it is empirically true.
This discovery has a Claude-generated validation package with a full experimental design.
Precise Hypothesis
In a multi-agent traffic simulator where each agent's behavior is parameterized by a controllable latent vector optimized via UCB-guided surrogate Bayesian optimization (BO) against a reward/cost surface, subsets of agents (coalitions, n≥3) will converge to joint latent configurations that produce collective trajectory deviations from the single-agent (unilateral) Nash equilibrium baseline — measured as excess aggregate reward or reduced regret relative to independently-optimized agents — specifically in scenarios with vehicle density ≥ 0.3 vehicles/meter/lane on a shared road segment. The magnitude of this coalition deviation (Δ_coalition, defined as the difference in joint value function between coalition-coordinated policies and best-response-independent policies) will scale with coalition size k according to a fitted monotonic function (power-law or linear) with R² > 0.85 across k ∈ {2,3,4,5,6,8,10}, holding scenario density and simulator seed distribution fixed.
- R² < 0.85 for the deviation-vs-coalition-size fit across ≥5 coalition sizes with n≥20 seeds each, using the pre-registered fit family (power-law, linear, log-linear — best of three, Bonferroni-corrected).
- No statistically significant difference (permutation test, p>0.05 after FDR correction) between coalition-coordinated joint value and independently-optimized joint value at any tested density.
- Effect present but fails to scale monotonically with k (non-monotonic or inverted relationship in ≥2/3 topologies).
- Effect disappears or reverses when surrogate uncertainty calibration is randomized (indicates artifact of surrogate miscalibration rather than genuine coordination).
- Effect is fully explained by a confound (e.g., reward-shaping term double-counts shared road segment occupancy) identified via ablation.
Spine & Adversarial ReadReady for validation
“This hypothesis tests whether coordinated subsets of Bayesian-optimization-controlled traffic agents produce collective equilibrium deviations whose magnitude scales predictably (R²>0.85) with coalition size.”
- highThe 'coalition deviation' metric may simply reflect a mechanical artifact of giving coordinated agents a larger joint optimization budget (shared surrogate over concatenated latents) versus independent agents each optimizing separately — this is an optimization-power confound, not emergent game-theoretic coalition behavior.Protocol requires equalizing total BO iterations per-agent (not per-coalition) and includes a shuffle-membership ablation, but the EVP does not yet specify a formal control where independent agents are given an equivalent joint surrogate without coordination (e.g., shared surrogate, independent objectives) to fully isolate 'shared information' from 'shared objective.' This gap should be closed by adding a third arm (shared-surrogate/independent-objective) before results are trusted.
- mediumWhy UCB-guided BO specifically, and why these particular simulators (Waymax/nuPlan/SMARTS) and this specific density threshold (0.3 veh/m/lane) rather than alternative acquisition functions (Thompson sampling, EI) or other traffic sim platforms — the methodology choice is not justified against alternatives, raising concern that results are specific to this arbitrary configuration rather than general.UCB is chosen for its explicit exploration-exploitation tunability (β) which is needed to test robustness across the boundary conditions, and open-source simulators with real-world scenario logs (Waymo/nuScenes) are chosen for reproducibility and realistic density distributions. However, the EVP does not include a comparison arm against Thompson sampling or Expected Improvement acquisition, so the claim that this is a general BO-driven phenomenon (rather than a UCB-specific one) is not yet established — this should be added as a robustness check before generalizing beyond UCB in any publication.
- highWith Verification Confidence scored at 0.00 and Evidence Strength only 0.69 in the source discovery record, there is essentially no existing empirical grounding for this claim — it is a theoretically motivated hypothesis with no pilot data, and the R²>0.85 threshold may have been chosen without any prior distribution of plausible effect sizes to calibrate against.This is acknowledged directly: the EVP's abort checkpoints (particularly Checkpoint 1, a cheap pilot at n=5 seeds) are designed precisely to detect early whether any effect exists at all before committing to the full $165K validation spend. No resolution beyond this staged, cost-gated design is claimed — if the pilot shows no effect, the hypothesis should be abandoned rather than pursued to full scale.
Experimental Protocol
Minimum viable test: 2 road topologies (highway merge + signalized intersection) × 3 densities (0.1, 0.3, 0.5 veh/m/lane) × 6 coalition sizes (2,3,4,5,6,8) × 30 random seeds = 1,080 simulation runs, each independently BO-optimized (50 BO iterations/run), compared against matched independent-agent baselines (same seed/topology/density, agents optimized separately). Primary outcome: Δ_coalition regression against k.
- Simulator: Waymax, nuPlan, or SMARTS (open-source, differentiable/replayable traffic sim) with scenario logs from Waymo Open Motion Dataset or nuScenes for realistic initialization distributions.
- Behavior latent space: pretrained controllable traffic agent model (e.g., CTG, Trajeglish-style, or custom VAE-conditioned policy) — must expose a continuous latent that measurably alters agent behavior.
- Surrogate BO library: BoTorch / Ax (GP surrogate) or a deep-ensemble surrogate for higher-dimensional latents.
- Baseline equilibrium solver: independent best-response iterative solver (fictitious play or independent PPO fine-tune) as unilateral-equilibrium reference.
- Compute environment: GPU cluster for parallel rollout + surrogate fitting.
- R² > 0.85 for best-fit scaling model, replicated in ≥2/3 topologies.
- Permutation-test significance (p<0.01, FDR-corrected) for Δ_coalition > 0 at k≥3 in high-density condition.
- Effect survives all three confound ablations (i.e., ablated condition shows R² drop >0.3 or effect-size drop >50%, confirming genuine dependence on coordination mechanism rather than confound).
- Scaling exponent (if power-law) stable within ±20% across topologies and across two independent surrogate model families (GP vs. deep ensemble).
- R² < 0.85 in majority of topologies, or effect not replicated cross-topology.
- Effect vanishes under any single confound ablation (indicates artifact).
- No dose-response (monotonic scaling) with k.
- Effect only present at one specific β value with no robustness across β ∈[1,3] (suggests BO hyperparameter artifact, not emergent phenomenon).
4,200
GPU hours
75d
Time to result
$38,000
Min cost
$165,000
Full cost
ROI Projection
Moderate-to-high research tooling value: a coalition-scaling diagnostic could become a standard component of AV simulation QA pipelines (analogous to adversarial robustness benchmarks in ML). Also has publishable value independent of commercial application (game theory × multi-agent RL crossover, likely NeurIPS/ICML/CoRL-tier venue). Near-term commercial value is primarily as an internal risk-assessment tool rather than a standalone product.
TIME_TO_RESULT_DAYS: 75
Implementation Sketch
for topology in [merge, intersection, weave]: for density in [0.1, 0.3, 0.5]: for k in [2,3,4,5,6,8,10]: for seed in range(30): scenario = init_scenario(topology, density, seed) agents = sample_agents(scenario, n_total) coalition = agents[:k]; independents = agents[k:] # Independent baseline for agent in agents: z_agent = UCB_BO(surrogate=GP(), acquisition=UCB(beta), objective=agent.reward, n_iters=50) joint_value_independent = simulate(agents, latents=z_independent) # Coalition condition z_coalition = UCB_BO(surrogate=GP(dim=k*d), acquisition=UCB(beta), objective=sum(coalition.rewards), n_iters=50) joint_value_coalition = simulate(coalition + independents_rest, latents=[z_coalition, z_independent_rest]) delta = joint_value_coalition - joint_value_independent log(topology, density, k, seed, delta, trajectories, collisions) fit_model = best_of([power_law, linear, log_linear]).fit(delta ~ k) report(R2=fit_model.r2, ci=bootstrap(fit_model, 2000)) run_ablations(randomize_calibration, remove_observability, shuffle_membership)
- Checkpoint 1 (after pilot n=5 seeds/condition, ~5% of full compute): if effect size (Δ_coalition) is not distinguishable from zero at k=8 (largest coalition), abort before full grid.
- Checkpoint 2 (after single-topology full run, ~35% of compute): if R² < 0.6 on first topology, do not proceed to second topology — hypothesis likely false or requires reformulation.
- Checkpoint 3 (after ablation battery): if effect survives none of the three confound ablations, abort and report as artifact rather than proceeding to cross-topology replication.
NAMED_EXPERTS: []
CLOSEST_EXISTING_WORK: []
NOVELTY_NARROWING_REQUIRED: false