Performative scenario optimization solutions converge to classical stochastic programming solutions as the strength of the decision-feedback effect decreases, with convergence rate bounded by the Lipschitz modulus of the distribution map.
Adversarial Debate Score
70% survival rate under critique
Expert panel critique
Independent views, each critiquing the hypothesis on its own — the score rewards genuine disagreement and discounts consensus.
Supporting Research Papers
- Performative Scenario Optimization
This paper introduces a performative scenario optimization framework for decision-dependent chance-constrained problems. Unlike classical stochastic optimization, we account for the feedback loop wher...
- ParetoEnsembles.jl: A Julia Package for Multiobjective Parameter Estimation Using Pareto Optimal Ensemble Techniques
Mathematical models of natural and man-made systems often have many adjustable parameters that must be estimated from multiple, potentially conflicting datasets. Rather than reporting a single best-fi...
- On Lipschitzian properties of multifunctions defined implicitly by"split"feasibility problems
In the present paper, a systematic study is made of quantitative semicontinuity (a.k.a. Lipschitzian) properties of certain multifunctions, which are defined as a solution map associated to a family o...
- Sampling at intermediate temperatures is optimal for training large language models in protein structure prediction
We investigate the parameter space of transformer models trained on protein sequence data using a statistical mechanics framework, sampling the loss landscape at varying temperatures by Langevin dynam...
Computational Result
Computation is the experiment in this domain.
SUPPORTED ON 2 OF 3 PRE-REGISTERED PRIMARY CRITERIA. Slope alpha in [1.000, 1.028] (mean 1.006) for 5/5 families and R^2 >= 0.9995 for 5/5 -- both criteria required >=4/5 and both passed, confirming exact O(eps) convergence. THE THIRD CRITERION FAILED: C <= 1.5*L_hat was required for >=3 of 5 families and was met by 2 of 5. The experiment's own summary records "confirmed": false. A tighter bound C <= 0.75*(L_hat*||x*(0)||) does hold for 5/5, but it was selected after inspecting these data and is an observation, not satisfaction of the registered criterion.
Method: Log-log regression of ||x*(eps) - x*(0)|| against eps over eps in [0.001, 0.5], five synthetic problem families (linear-quadratic, portfolio, newsvendor, logistic, QP), seed 42, criteria fixed in the script docstring before the run. docs/run_performative_experiment.py, docs/performative_results.json · Result: supported · Confidence: 0%
Formal Verification
Z3 checks whether the hypothesis is internally consistent, not whether it is empirically true.
This discovery has a Claude-generated validation package with a full experimental design.
Precise Hypothesis
Let P_θ(x) denote a decision-dependent (performative) distribution map where θ ∈ [0,1] parameterizes the strength of decision-feedback (θ=0 recovers the classical, decision-independent distribution P_0), and let ε(θ) = sup_x W(P_θ(x), P_0) be the Lipschitz modulus of the distribution map with respect to the decision variable x, measured in Wasserstein distance W(·,·). Define x*(θ) as the performatively stable (or optimal) solution of the scenario optimization problem under P_θ, and x_0 the classical stochastic programming solution under P_0. The falsifiable claim is: (1) ‖x(θ) − x_0‖ → 0 as θ → 0, and (2) there exist constants C > 0 and a monotone function L(θ) (the empirical Lipschitz modulus of the map θ ↦ P_θ) such that ‖x(θ) − x*_0‖ ≤ C·L(θ) for all θ in a neighborhood of 0, with L(θ) → 0 as θ → 0 at a rate no slower than O(θ) under strong convexity of the objective and joint strong monotonicity assumptions standard in performative prediction (Perdomo et al. 2020 framework).
- Empirical finding that ‖x*(θ) − x*_0‖ does not shrink monotonically as θ → 0 across at least 3 independent problem families (portfolio optimization, supply chain newsvendor, resource allocation).
- Finding a problem instance where the convergence rate empirically exceeds C·L(θ) by a factor >2 with statistical significance (p<0.01, bootstrap CI) for multiple values of θ, falsifying the bound.
- Existence of a counterexample where θ→0 but ‖x*(θ)−x*_0‖ remains bounded away from 0 (non-vanishing gap), even under the stated boundary conditions.
- Rate constant C estimated from regression of log‖x*(θ)−x*_0‖ vs. log L(θ) has slope significantly different from 1 (i.e., not linear in L(θ)), contradicting the claimed bound structure.
Spine & Adversarial Read
- highThe claimed linear-in-L(θ) bound is asserted without citation to a specific theorem; performative prediction theory (Perdomo et al. 2020) establishes contraction/convergence of iterates under repeated risk minimization, but scenario optimization (sample-based, distributionally robust) has different finite-sample error interactions that may produce a different (e.g., sqrt or higher-order) rate — the EVP has not established this bound exists in prior literature, only that it is plausible by analogy.The methodology explicitly tests β (regression exponent) as an open empirical question rather than assuming β=1; success criteria allow β∈[0.8,1.2] as a falsifiable range. This is honest, but the EVP does not yet resolve whether the *scenario-optimization-specific* theoretical derivation exists — this must be attempted analytically (e.g., via McDiarmid/Wasserstein-based perturbation analysis of SAA solutions) before or alongside the empirical study, otherwise the empirical fit is descriptive, not confirmatory of a proven bound.
- mediumWhy these specific problem families (portfolio, newsvendor, strategic classification) and not others (e.g., queueing, energy dispatch)? The choice appears driven by convenience/availability of standard benchmarks rather than a principled argument that these span the relevant space of Lipschitz-modulus behaviors (linear vs. nonlinear feedback, convex vs. non-convex constraint sets).Partial justification given: these three families are the standard benchmarks in both performative prediction (strategic classification) and stochastic programming (portfolio, newsvendor) literatures, enabling direct comparison to prior published baselines. However, the EVP does not justify why 3 families and 3 perturbation classes constitute sufficient coverage of the hypothesis space — a more rigorous approach would include a fourth adversarially-designed 'stress-test' family specifically constructed to try to break the linear bound (e.g., highly non-smooth or discontinuous distribution maps), which is currently absent.
- mediumWasserstein distance approximation via Sinkhorn regularization introduces a bias that could systematically distort the measured L(θ), especially at small θ where the true signal is small — this could produce a spurious linear fit (regularization bias masquerading as true convergence rate) rather than reflecting genuine problem structure.Acknowledged in KNOWN_FAILURE_MODES and partially addressed by Checkpoint 3, but the EVP does not specify a concrete mitigation (e.g., exact OT solver cross-check via linear programming for small-to-moderate problem sizes, or entropic regularization parameter sweep to test sensitivity of β to Sinkhorn epsilon). This should be added as an explicit robustness check before final success/failure determination.
Experimental Protocol
Minimum viable test: synthetic performative scenario optimization problems (portfolio selection with strategic price response, newsvendor with demand-shift feedback) where P_θ is constructed analytically (e.g., mean/covariance shift linear in θ·x), permitting closed-form or near-closed-form x_0 and controllable ground-truth L(θ). Sweep θ ∈ {0, 0.01, 0.05, 0.1, 0.2, 0.4, 0.6, 0.8, 1.0}, solve performative scenario optimization via repeated retraining (RRM) or performative gradient descent, compare to classical SAA (sample average approximation) solution at θ=0, measure ‖x(θ)−x*_0‖_2 and regress against measured L(θ).
- Synthetic portfolio optimization dataset: 500 assets, 10 years simulated returns (or bootstrapped from CRSP/Yahoo Finance historical daily returns, 2010–2023).
- Synthetic newsvendor/inventory dataset with parameterized decision-dependent demand shift (fully synthetic, no external dependency).
- Strategic classification benchmark (Perdomo et al. 2020 credit-scoring dataset, e.g., Kaggle "Give Me Some Credit") adapted to scenario-optimization formulation for cross-domain validation.
- Solver stack: Gurobi 10.x or CVXPY+ECOS/SCS for convex scenario programs; custom Python implementation of performative RRM/PerfGD loop.
- Monotone decrease of ‖x*(θ)−x*_0‖ as θ→0 observed in ≥90% of the 3×3=9 (problem×perturbation) configurations.
- Log-log regression slope β ∈ [0.8, 1.2] (consistent with linear-in-L(θ) bound) with R² ≥ 0.85 in ≥7/9 configurations.
- Empirical constant C within 3x of theoretically predicted constant (from μ, L_f, K) in ≥6/9 configurations.
- 95% bootstrap CI for ‖x*(θ)−x*_0‖ at θ=0.01 excludes zero-gap-nonconvergence scenarios (i.e., gap statistically distinguishable from a non-vanishing floor).
- Non-monotone or oscillatory ‖x*(θ)−x*_0‖ behavior in ≥3/9 configurations without explainable numerical artifact.
- Log-log slope β outside [0.5, 2.0] (bound structurally wrong) in majority of configurations.
- Gap fails to shrink below 10% of its θ=1 value even at θ=0.01 (evidence of non-vanishing residual bias, e.g., from RRM non-convergence rather than true performative gap).
- Theoretical vs. empirical constant C mismatch >10x systematically, suggesting the Lipschitz-modulus bound is vacuous/non-predictive.
100
GPU hours
30d
Time to result
$1,000
Min cost
$10,000
Full cost
ROI Projection
Medium-high value for quantitative finance (algorithmic trading strategies affecting market prices), ride-sharing/dynamic pricing (demand response to pricing decisions), credit scoring (strategic applicant behavior), and supply chain (demand shifts from inventory decisions). A validated bound could be productized as a diagnostic library (e.g., "PerformativeGap" Python package) estimated to be relevant to a $500M+ adjacent market in decision-optimization software (Gurobi/AIMMS/IBM CPLEX ecosystem plus MLOps feedback-loop monitoring tools).
TIME_TO_RESULT_DAYS: 45
Implementation Sketch
# Pseudocode: Performative Scenario Optimization Convergence Test def classical_SAA(P0, N=10000): scenarios = sample(P0, N) x0_star = solve_convex_program(scenarios) return x0_star def performative_RRM(theta, P0, g, max_iter=50, tol=1e-6): x_t = initialize_x() for t in range(max_iter): P_theta_xt = P0 + theta * g(x_t) # decision-dependent shift scenarios = sample(P_theta_xt, N=10000) x_next = solve_convex_program(scenarios) if norm(x_next - x_t) < tol: break x_t = x_next L_theta = wasserstein_distance(P_theta_xt, P0) # Sinkhorn approx return x_t, L_theta def run_experiment(): x0_star = classical_SAA(P0) results = [] for theta in [0, 0.01, 0.05, 0.1, 0.2, 0.4, 0.6, 0.8, 1.0]: for seed in range(30): x_theta, L_theta = performative_RRM(theta, P0, g, seed=seed) gap = norm(x_theta - x0_star) results.append((theta, L_theta, gap, seed)) # regression: log(gap) ~ beta * log(L_theta) + log(C) beta, logC, R2 = fit_loglog(results) return results, beta, logC, R2
- Checkpoint 1 (Day 7): If classical SAA baseline solutions are not numerically stable/reproducible across seeds (CV > 5%), abort and fix solver/sample-size issues before proceeding.
- Checkpoint 2 (Day 15): If RRM fails to converge (within 50 iterations) for θ ≤ 0.2 in >20% of runs, abort and revisit contraction condition assumptions (ε(θ)L_f/μ<1 may be violated by construction).
- Checkpoint 3 (Day 25): If preliminary log-log regression (on first problem family only) shows R² < 0.5, abort full 3×3 sweep and re-examine whether Wasserstein estimation noise is swamping signal; consider increasing N or using exact OT solvers.
- Checkpoint 4 (Day 35): If results from problem family 1 and 2 show contradictory β estimates (differing by >1.0), abort generalization claims and restrict scope to single-domain finding.
NAMED_EXPERTS: []
CLOSEST_EXISTING_WORK: []
NOVELTY_NARROWING_REQUIRED: true
SPINE_STATEMENT: This hypothesis tests whether the solution gap between performative and classical scenario optimization shrinks to zero at a rate linearly bounded by the Lipschitz modulus of the decision-dependent distribution map as feedback strength vanishes.