Performative scenario optimization solutions converge to classical stochastic programming solutions as the strength of the decision-feedback effect decreases, with convergence rate bounded by the Lipschitz modulus of the distribution map.
Adversarial Debate Score
70% survival rate under critique
Expert panel critique
Independent views, each critiquing the hypothesis on its own — the score rewards genuine disagreement and discounts consensus.
Supporting Research Papers
- Performative Scenario Optimization
This paper introduces a performative scenario optimization framework for decision-dependent chance-constrained problems. Unlike classical stochastic optimization, we account for the feedback loop wher...
- ParetoEnsembles.jl: A Julia Package for Multiobjective Parameter Estimation Using Pareto Optimal Ensemble Techniques
Mathematical models of natural and man-made systems often have many adjustable parameters that must be estimated from multiple, potentially conflicting datasets. Rather than reporting a single best-fi...
- On Lipschitzian properties of multifunctions defined implicitly by"split"feasibility problems
In the present paper, a systematic study is made of quantitative semicontinuity (a.k.a. Lipschitzian) properties of certain multifunctions, which are defined as a solution map associated to a family o...
- Sampling at intermediate temperatures is optimal for training large language models in protein structure prediction
We investigate the parameter space of transformer models trained on protein sequence data using a statistical mechanics framework, sampling the loss landscape at varying temperatures by Langevin dynam...
Computational Result
Computation is the experiment in this domain.
SUPPORTED ON 2 OF 3 PRE-REGISTERED PRIMARY CRITERIA. Slope alpha in [1.000, 1.028] (mean 1.006) for 5/5 families and R^2 >= 0.9995 for 5/5 -- both criteria required >=4/5 and both passed, confirming exact O(eps) convergence. THE THIRD CRITERION FAILED: C <= 1.5*L_hat was required for >=3 of 5 families and was met by 2 of 5. The experiment's own summary records "confirmed": false. A tighter bound C <= 0.75*(L_hat*||x*(0)||) does hold for 5/5, but it was selected after inspecting these data and is an observation, not satisfaction of the registered criterion.
Method: Log-log regression of ||x*(eps) - x*(0)|| against eps over eps in [0.001, 0.5], five synthetic problem families (linear-quadratic, portfolio, newsvendor, logistic, QP), seed 42, criteria fixed in the script docstring before the run. docs/run_performative_experiment.py, docs/performative_results.json · Result: supported · Confidence: 0%
Formal Verification
Z3 checks whether the hypothesis is internally consistent, not whether it is empirically true.
This discovery has a Claude-generated validation package with a full experimental design.
Precise Hypothesis
Let P_θ(x) denote a decision-dependent (performative) distribution map where θ ∈ [0,1] parameterizes the strength of decision-feedback (θ=0 recovers the classical, decision-independent distribution P_0), and let ε(θ) = sup_x W(P_θ(x), P_0) be the Lipschitz modulus of the distribution map with respect to the decision variable x, measured in Wasserstein distance W(·,·). Define x*(θ) as the performatively stable (or optimal) solution of the scenario optimization problem under P_θ, and x_0 the classical stochastic programming solution under P_0. The falsifiable claim is: (1) ‖x(θ) − x_0‖ → 0 as θ → 0, and (2) there exist constants C > 0 and a monotone function L(θ) (the empirical Lipschitz modulus of the map θ ↦ P_θ) such that ‖x(θ) − x*_0‖ ≤ C·L(θ) for all θ in a neighborhood of 0, with L(θ) → 0 as θ → 0 at a rate no slower than O(θ) under strong convexity of the objective and joint strong monotonicity assumptions standard in performative prediction (Perdomo et al. 2020 framework).
- Empirical finding that ‖x*(θ) − x*_0‖ does not shrink monotonically as θ → 0 across at least 3 independent problem families (portfolio optimization, supply chain newsvendor, resource allocation).
- Finding a problem instance where the convergence rate empirically exceeds C·L(θ) by a factor >2 with statistical significance (p<0.01, bootstrap CI) for multiple values of θ, falsifying the bound.
- Existence of a counterexample where θ→0 but ‖x*(θ)−x*_0‖ remains bounded away from 0 (non-vanishing gap), even under the stated boundary conditions.
- Rate constant C estimated from regression of log‖x*(θ)−x*_0‖ vs. log L(θ) has slope significantly different from 1 (i.e., not linear in L(θ)), contradicting the claimed bound structure.
Spine & Adversarial Read
- highChecked 2 Oct 2026 (web search, not exhaustive): the general convergence behaviour this row's hypothesis states -- rate bounded by the Lipschitz modulus of the distribution map, recovering the classical rate as performativity weakens -- is the headline theorem of Perdomo/Zrnic/Mendler-Dunner/Hardt (ICML 2020 + NeurIPS 2020), six years old and foundational to the field. This row's own record only confirms the convergence EXPONENT (alpha near 1, 5/5 families) empirically on synthetic problems; it does not establish new theory.unresolved
- highThe row's own pre-registered criterion for the SPECIFIC constant bound (C <= 1.5*L_hat) FAILED (met by 2/5 families, below the >=3/5 threshold), and docs/performative_results.json records "confirmed": false. The EVP's roi_if_proven claims this provides 'theoretical justification for practitioners' -- but the general theoretical justification already existed before this row ran, and the one thing this row tried to add beyond the known theory (a usable constant) did not clear its own bar.unresolved
Closest Existing Work
Experimental Protocol
Minimum viable test: synthetic performative scenario optimization problems (portfolio selection with strategic price response, newsvendor with demand-shift feedback) where P_θ is constructed analytically (e.g., mean/covariance shift linear in θ·x), permitting closed-form or near-closed-form x_0 and controllable ground-truth L(θ). Sweep θ ∈ {0, 0.01, 0.05, 0.1, 0.2, 0.4, 0.6, 0.8, 1.0}, solve performative scenario optimization via repeated retraining (RRM) or performative gradient descent, compare to classical SAA (sample average approximation) solution at θ=0, measure ‖x(θ)−x*_0‖_2 and regress against measured L(θ).
- Synthetic portfolio optimization dataset: 500 assets, 10 years simulated returns (or bootstrapped from CRSP/Yahoo Finance historical daily returns, 2010–2023).
- Synthetic newsvendor/inventory dataset with parameterized decision-dependent demand shift (fully synthetic, no external dependency).
- Strategic classification benchmark (Perdomo et al. 2020 credit-scoring dataset, e.g., Kaggle "Give Me Some Credit") adapted to scenario-optimization formulation for cross-domain validation.
- Solver stack: Gurobi 10.x or CVXPY+ECOS/SCS for convex scenario programs; custom Python implementation of performative RRM/PerfGD loop.
- Monotone decrease of ‖x*(θ)−x*_0‖ as θ→0 observed in ≥90% of the 3×3=9 (problem×perturbation) configurations.
- Log-log regression slope β ∈ [0.8, 1.2] (consistent with linear-in-L(θ) bound) with R² ≥ 0.85 in ≥7/9 configurations.
- Empirical constant C within 3x of theoretically predicted constant (from μ, L_f, K) in ≥6/9 configurations.
- 95% bootstrap CI for ‖x*(θ)−x*_0‖ at θ=0.01 excludes zero-gap-nonconvergence scenarios (i.e., gap statistically distinguishable from a non-vanishing floor).
- Non-monotone or oscillatory ‖x*(θ)−x*_0‖ behavior in ≥3/9 configurations without explainable numerical artifact.
- Log-log slope β outside [0.5, 2.0] (bound structurally wrong) in majority of configurations.
- Gap fails to shrink below 10% of its θ=1 value even at θ=0.01 (evidence of non-vanishing residual bias, e.g., from RRM non-convergence rather than true performative gap).
- Theoretical vs. empirical constant C mismatch >10x systematically, suggesting the Lipschitz-modulus bound is vacuous/non-predictive.
100
GPU hours
30d
Time to result
$1,000
Min cost
$10,000
Full cost
ROI Projection
SUPERSEDED 2 Oct 2026 -- quantitative finance, dynamic pricing and credit-scoring practitioners already have the 2020 Perdomo-et-al result available if they want this theoretical grounding; this row adds an empirical confirmation on synthetic problem families plus a constant bound that did not clear its own pre-registered bar. No case for commercial value beyond informing our own internal modelling choices. Original pitch retained for the record below.
Implementation Sketch
# Pseudocode: Performative Scenario Optimization Convergence Test def classical_SAA(P0, N=10000): scenarios = sample(P0, N) x0_star = solve_convex_program(scenarios) return x0_star def performative_RRM(theta, P0, g, max_iter=50, tol=1e-6): x_t = initialize_x() for t in range(max_iter): P_theta_xt = P0 + theta * g(x_t) # decision-dependent shift scenarios = sample(P_theta_xt, N=10000) x_next = solve_convex_program(scenarios) if norm(x_next - x_t) < tol: break x_t = x_next L_theta = wasserstein_distance(P_theta_xt, P0) # Sinkhorn approx return x_t, L_theta def run_experiment(): x0_star = classical_SAA(P0) results = [] for theta in [0, 0.01, 0.05, 0.1, 0.2, 0.4, 0.6, 0.8, 1.0]: for seed in range(30): x_theta, L_theta = performative_RRM(theta, P0, g, seed=seed) gap = norm(x_theta - x0_star) results.append((theta, L_theta, gap, seed)) # regression: log(gap) ~ beta * log(L_theta) + log(C) beta, logC, R2 = fit_loglog(results) return results, beta, logC, R2
- Checkpoint 1 (Day 7): If classical SAA baseline solutions are not numerically stable/reproducible across seeds (CV > 5%), abort and fix solver/sample-size issues before proceeding.
- Checkpoint 2 (Day 15): If RRM fails to converge (within 50 iterations) for θ ≤ 0.2 in >20% of runs, abort and revisit contraction condition assumptions (ε(θ)L_f/μ<1 may be violated by construction).
- Checkpoint 3 (Day 25): If preliminary log-log regression (on first problem family only) shows R² < 0.5, abort full 3×3 sweep and re-examine whether Wasserstein estimation noise is swamping signal; consider increasing N or using exact OT solvers.
- Checkpoint 4 (Day 35): If results from problem family 1 and 2 show contradictory β estimates (differing by >1.0), abort generalization claims and restrict scope to single-domain finding.
NAMED_EXPERTS: []
CLOSEST_EXISTING_WORK: []
NOVELTY_NARROWING_REQUIRED: true
SPINE_STATEMENT: This hypothesis tests whether the solution gap between performative and classical scenario optimization shrinks to zero at a rate linearly bounded by the Lipschitz modulus of the decision-dependent distribution map as feedback strength vanishes.
Our preprint on this result
Self-deposited and not peer-reviewed. The record below is the authoritative statement of what was and was not shown.
- Convergence of Performative Scenario Optimization to Classical Stochastic Programming in the Vanishing-Feedback Limit ↗Zenodo · doi:10.5281/zenodo.21187859 · corrected
Corrected 7 September 2026: the earlier version reported both hypotheses as confirmed; the convergence rate holds, the constant criterion failed.