solver.press

In reinforcement-learning schedulers for LEO satellite task allocation, the exploration-exploitation setting is a driver of battery degradation in its own right, not merely a convergence parameter: at FIXED delivered mission value, a more exploratory scheduler needs more orbits AND discharges more deeply per orbit, so integrated aging cost is a monotone increasing function of the exploration coefficient. Measured 17 Sep 2026: 2.33x the damage at eps=1 versus eps=0 for the same delivered value, split 55% cycle count and 45% discharge depth. Note what is NOT claimed: cycles per DAY are pinned by orbital mechanics (15.58 at 400 km) and no scheduler changes them; it is cycles per MISSION that rise. FALSIFIED IF replaying one fixed task stream at several exploration coefficients, each run to the same cumulative reward, shows no monotone relationship between the coefficient and integrated aging.

Computer ScienceJul 28, 2026Evaluation Score: 62%

Adversarial Debate Score

47% survival rate under critique

Expert panel critique

Independent views, each critiquing the hypothesis on its own — the score rewards genuine disagreement and discounts consensus.

Gemini: Strengths: The hypothesis is highly falsifiable and strongly supported by the literature on LEO battery aging costs and the owner's validated experiments, which empirically confirm that UCB acquisition outperforms EI in surrogate Bayesian optimization. Weaknesses: While the core opti...
Mistral: The hypothesis is falsifiable, conceptually grounded in validated experiments (e.g., UCB acquisition superiority), and aligns with recent literature on LEO battery aging and non-stationary RL. However, it assumes a direct link between exploration-exploitation tradeoffs and battery aging wit...
Claude: The hypothesis assembles plausible components (UCB-guided BO, agentic RL, LEO battery aging, coalition equilibria) but the connections between them are speculative and unsupported by the provided literature, which covers UAV navigation, drug discovery BO, and auction theory rather than satellite ...
ChatGPT: The hypothesis is falsifiable in principle and is partially motivated by validated UCB exploration benefits and physics-based battery-aging costs, but neither establishes transfer to decentralized LEO scheduling. The key causal chain—agentic RL plus UCB reducing coalition deviations while directl...

Supporting Research Papers

Computational Result

🧪 Numerically verified· simulated 400 km LEO, epsilon-greedy scheduler over 6 tasks, Wohler/Palmgren-Miner damage (DoD^1.87), each arm run to the SAME cumulative reward

Computation is the experiment in this domain.

At fixed delivered mission value (96/96 runs on target, reward CV 0.0016), Spearman(eps, mean DoD) = +0.755 (p=6e-19) and Spearman(eps, integrated aging) = +0.957 (p=2e-52). eps=1 costs 2.33x the damage of eps=0 for the same value delivered.

Method: simulated 400 km LEO, epsilon-greedy scheduler over 6 tasks, Wohler/Palmgren-Miner damage (DoD^1.87), each arm run to the SAME cumulative reward · Result: supported · Confidence: 75%

Formal Verification

Z3 logical consistency:✅ Consistent

Z3 checks whether the hypothesis is internally consistent, not whether it is empirically true.

Experimental Validation Package

This discovery has a Claude-generated validation package with a full experimental design.

Precise Hypothesis

In decentralized LEO satellite constellations performing distributed task scheduling via a coalition-formation game, an agentic reinforcement learning (RL) controller whose exploration policy is guided by Upper-Confidence-Bound (UCB) acquisition over a surrogate Bayesian-optimization (BO) model of task-assignment value will (a) reduce the mean deviation from coalition-structure-stable equilibria (measured as normalized Shapley-value regret) by ≥20% relative to a baseline decentralized RL controller (e.g., independent PPO or greedy auction) under identical constellation, traffic, and battery models, AND (b) exhibit a statistically significant (p<0.05, paired test across ≥30 simulated episodes/seeds) positive correlation between the controller's exploration rate (UCB confidence width / entropy of action distribution) and an unmodeled/hidden battery-aging cost metric (cumulative depth-of-discharge-weighted cycle stress from onboard compute-induced power draw), such that higher exploration produces measurably higher aging cost per unit of scheduling-quality gain.

Disproof criteria:
  • No statistically significant reduction (or a reduction <10%) in equilibrium-deviation regret versus baseline across ≥30 seeds (two-sided paired t-test or Wilcoxon, α=0.05).
  • Exploration rate shows no significant correlation (|r|<0.15, p>0.05) with battery-aging cost, or the correlation is negative/inconsistent across ≥3 independent constellation configurations.
  • UCB-guided surrogate BO controller's equilibrium-deviation improvement disappears (Δ<5%) when controlling for wall-clock compute budget parity with baseline (i.e., gains are attributable to extra compute, not the method).
  • Battery aging cost predicted by the model does not correlate (r<0.2) with independently simulated electrochemical degradation from a higher-fidelity physics-based cell model, invalidating the "hidden cost" claim as an artifact of a weak proxy metric.
  • Results fail to replicate when swapping the RL backbone (e.g., PPO→SAC) or surrogate kernel, suggesting the effect is an implementation artifact rather than a general phenomenon.

Spine & Adversarial ReadReady for validation

This hypothesis tests whether an RL controller's exploration-exploitation setting, tuned via UCB-guided Bayesian optimization to reduce decentralized satellite-coalition scheduling regret, causally trades off against a previously unmodeled battery-aging cost from onboard computation.

  • highThe 'hidden battery aging cost' may simply be a restatement of total compute/energy expenditure — of course more exploration (more candidate evaluations, more GP updates) consumes more energy and thus causes more aging; this is not a novel coupling but a trivial accounting fact dressed up as a discovery.
    The protocol's compute-budget-parity control (Step 9) is designed to address exactly this by matching wall-clock/FLOP budgets between controllers. However, the EVP does not yet specify how to disentangle 'exploration causes aging via extra actions taken' from 'exploration causes aging via a qualitatively different power draw pattern (e.g., more frequent SoC swings)' — this decomposition needs an explicit sub-analysis (e.g., regress aging cost on both action-count and exploration-entropy jointly) that is not currently in the methodology and should be added before claiming a non-trivial coupling.
  • mediumWhy coalition-game equilibrium regret and Shapley-value stability specifically, rather than simpler scheduling-quality metrics (e.g., task completion rate, latency)? The choice of a cooperative-game-theoretic framing adds analytical complexity (sampled coalition valuations are themselves approximate and noisy) without clear justification for why equilibrium deviation is the right lens for a battery-cost tradeoff question.
    Unresolved in the current EVP. The methodology should justify this choice explicitly — e.g., if the real operational concern is fairness/stability of task allocation across a coalition of operators or subsystems, that should be stated; otherwise a simpler, less noisy scheduling-quality metric (throughput, SLA violation rate) may be more defensible as the primary endpoint, with equilibrium regret as a secondary/exploratory metric.
  • highThe entire validation is simulation-only with synthetic traffic and a semi-empirical (not physics-based) battery model; without any real telemetry or hardware-in-the-loop validation, claims about 'hidden' real-world battery costs are unfalsifiable in the sense that matters operationally (i.e., they may not transfer to actual spacecraft power systems).
    Acknowledged gap. The EVP explicitly notes full validation would benefit from public CubeSat telemetry but treats this as optional rather than required. Given evidence_strength (0.69) and verification_confidence (0.00) in the input metadata, this gap is significant and should be elevated: a minimum bar for any claim of practical (not just simulated) relevance should require at least one cross-validation against real SmallSat power telemetry logs before ROI or commercial-value claims are asserted publicly.

Experimental Protocol

Minimum viable test (MVT): a discrete-event LEO constellation simulator (walker-delta, 66–100 sats) with a coalition-formation task-scheduling layer, comparing 3 controllers (baseline greedy/auction, independent PPO, UCB-BO-guided agentic RL) across 30 randomized seeds, 3 traffic regimes (steady, bursty, emergency-surge), and a calibrated battery-aging cost model, run for 500 simulated orbits (~750–1000 hrs simulated time) per condition. Primary endpoints: (1) normalized equilibrium-deviation regret, (2) exploration-rate vs. aging-cost correlation, (3) Pareto frontier of scheduling-quality vs. battery-aging cost across exploration hyperparameter sweep (UCB β ∈ {0.1,...,5}).

Required datasets:
  • Synthetic constellation traffic generator (task arrival, priority, data-volume distributions) — build or adapt from existing LEO scheduling literature (e.g., NASA/ESA open scheduling benchmarks if available; otherwise synthetic Poisson/bursty generator).
  • Orbital dynamics: TLE-based propagation via Skyfield/SGP4 or STK-equivalent open tool (Orekit) for constellation geometry and contact windows.
  • Battery aging model: semi-empirical Li-ion degradation model (e.g., NREL's BLAST-Lite or an open Rainflow-cycle-counting degradation model calibrated to published 18650/pouch cell cycle-life data — e.g., NASA PCoE battery dataset or Sandia's cycling datasets).
  • RL environment: custom Gymnasium-compatible multi-agent env wrapping the above; baseline implementations of PPO/SAC (Stable-Baselines3 or RLlib) and a BoTorch/GPyTorch-based surrogate BO module with UCB acquisition.
  • No real satellite telemetry required for MVT (synthetic-only); full validation would benefit from public SmallSat power telemetry (e.g., open CubeSat mission logs, if available) for battery model cross-validation.
Success:
  • ≥20% reduction in mean normalized equilibrium-deviation regret vs. best baseline (p<0.05, paired test, 30 seeds).
  • Significant positive correlation (Spearman r≥0.4, p<0.01) between exploration-rate metric and battery-aging cost, replicated in ≥2 of 3 traffic regimes.
  • Aging-cost proxy correlates with higher-fidelity electrochemical model at r≥0.6.
  • Effect survives compute-budget-parity control (regret improvement remains ≥10% when compute-matched).
  • Pareto frontier shows a non-trivial (non-corner) knee point, i.e., some exploration is beneficial but excess exploration measurably worsens aging cost disproportionately to scheduling gains.
Failure:
  • Regret improvement <10% or not statistically significant.
  • Exploration-aging correlation |r|<0.15 or non-replicable across regimes/seeds.
  • Effect vanishes under compute-parity control (indicates confound, not mechanism).
  • Aging-cost proxy uncorrelated with physics-based degradation model (r<0.2) — invalidates the "hidden cost" framing.
  • Results are seed/hyperparameter-fragile (high variance, CV>50% across seeds) indicating lack of robustness.

1,800

GPU hours

75d

Time to result

$18,000

Min cost

$95,000

Full cost

ROI Projection

Commercial:

Directly relevant to LEO constellation operators (telecom, EO, defense) seeking onboard autonomy that reduces ground-control burden while protecting hardware longevity; applicable to 6G non-terrestrial network standardization efforts and disaster-response satellite tasking (e.g., rapid-tasking coalitions for emergency communications). Licensable as a scheduling middleware/control-policy module; also valuable as a benchmark environment (open-sourced sim) for the broader multi-agent RL + space-systems research community. Estimated addressable value: satellite constellation operations software/analytics market segment, low-tens-of-millions-USD niche within the broader $10B+ smallsat market.

TIME_TO_RESULT_DAYS: 75

Implementation Sketch

# Pseudocode: Agentic RL + UCB-guided surrogate BO for coalition scheduling

for episode in range(N_EPISODES):
    env.reset(constellation_config, traffic_regime, battery_state)
    surrogate_gp = GaussianProcess(kernel=Matern52)  # BoTorch/GPyTorch
    for orbit_step in range(N_ORBITS):
        for sat in env.satellites:
            state = sat.get_state()  # SoC, queue, position, ISL links
            # Surrogate BO proposes candidate task-assignment values
            candidate_actions = sample_candidates(state)
            mu, sigma = surrogate_gp.predict(candidate_actions)
            ucb_score = mu + beta * sigma
            action = argmax(ucb_score)  # exploration-guided choice

            reward, next_state, aging_cost = env.step(sat, action)
            surrogate_gp.update(candidate_actions[action], reward)

            # Outer RL policy (PPO) updates using reward - lambda*aging_cost
            rl_agent.store_transition(state, action, reward, aging_cost, next_state)

        rl_agent.update()  # PPO gradient step across coalition
        coalition_regret = compute_shapley_regret(env.coalition_state)
        log(coalition_regret, aging_cost, ucb_beta, exploration_entropy)

# Post-hoc analysis
correlation = spearman(exploration_entropy_series, aging_cost_series)
pareto_frontier = compute_pareto(regret_series, aging_cost_series, over=ucb_beta_sweep)
Abort checkpoints:
  • Day 10: baseline simulator + battery model calibration sanity check — if aging-cost proxy doesn't correlate (r>0.5) with published cycle-life curves on simple test cases, halt and re-derive model before proceeding.
  • Day 25: pilot run (5 seeds, 1 traffic regime) — if equilibrium-regret improvement <5%, reassess controller design before committing to full factorial sweep.
  • Day 45: mid-sweep checkpoint — if exploration-aging correlation is <0.1 across first 50% of runs, halt full sweep and run targeted ablations to diagnose (metric issue vs. true null).
  • Day 60: compute-parity control — if effect vanishes, stop and report as compute-confound failure rather than completing full statistical writeup.

NAMED_EXPERTS: []

CLOSEST_EXISTING_WORK: []

NOVELTY_NARROWING_REQUIRED: false

Source

AegisMind Research
Need AI to work rigorously on your problems? AegisMind uses the same multi-model engine for personal and professional use. Get started