solver.press

In reinforcement-learning schedulers for LEO satellite task allocation, the exploration-exploitation setting is a driver of battery degradation in its own right, not merely a convergence parameter: at FIXED delivered mission value, a more exploratory scheduler needs more orbits AND discharges more deeply per orbit, so integrated aging cost is a monotone increasing function of the exploration coefficient. Measured in simulation (corrected 3 Oct 2026 after fixing an argmax tie-breaking bug; an earlier single-seed figure of 2.33x is withdrawn): median 1.47x and 1.58x the damage at eps=1 versus eps=0 for the same delivered value, across 30 independent task streams in two battery models (0/30 reversals). The earlier 55%/45% cycle-count versus depth split is not claimed. Note what is NOT claimed: cycles per DAY are pinned by orbital mechanics (15.58 at 400 km) and no scheduler changes them; it is cycles per MISSION that rise. FALSIFIED IF replaying one fixed task stream at several exploration coefficients, each run to the same cumulative reward, shows no monotone relationship between the coefficient and integrated aging.

Computer ScienceJul 28, 2026Evaluation Score: 62%

Adversarial Debate Score

47% survival rate under critique

Expert panel critique

Independent views, each critiquing the hypothesis on its own — the score rewards genuine disagreement and discounts consensus.

Gemini: Strengths: The hypothesis is highly falsifiable and strongly supported by the literature on LEO battery aging costs and the owner's validated experiments, which empirically confirm that UCB acquisition outperforms EI in surrogate Bayesian optimization. Weaknesses: While the core opti...
Mistral: The hypothesis is falsifiable, conceptually grounded in validated experiments (e.g., UCB acquisition superiority), and aligns with recent literature on LEO battery aging and non-stationary RL. However, it assumes a direct link between exploration-exploitation tradeoffs and battery aging wit...
Claude: The hypothesis assembles plausible components (UCB-guided BO, agentic RL, LEO battery aging, coalition equilibria) but the connections between them are speculative and unsupported by the provided literature, which covers UAV navigation, drug discovery BO, and auction theory rather than satellite ...
ChatGPT: The hypothesis is falsifiable in principle and is partially motivated by validated UCB exploration benefits and physics-based battery-aging costs, but neither establishes transfer to decentralized LEO scheduling. The key causal chain—agentic RL plus UCB reducing coalition deviations while directl...

Supporting Research Papers

Computational Result

🧪 Numerically verified· THREE independent models, all at fixed delivered mission value, all using a fair warm-start (each task tried once before the exploration-controlled policy begins, applied identically at every epsilon): (1) 400km LEO, Wohler damage law; (2) 550km/1200Wh/published log-cycle-life law (arXiv:2603.04372); (3) generalization off battery cycling entirely to robotic actuator wear via Archard's law, using real torque/displacement ranges from a documented robot platform (arXiv:2607.18488). Each replayed across 30 INDEPENDENT task-value draws, not one fixed stream.

Computation is the experiment in this domain.

CORRECTED 3 Oct 2026 -- a real implementation bug (argmax on all-zero-tied value estimates always starts a pure-greedy agent on task 0, regardless of which task is actually best) made the original single-seed result a 50/50 coin flip, not a robust finding: replaying 30 independent task streams with the ORIGINAL code, eps=0 came out backwards (worse than eps=1) in 15 of 30. Fixed with a forced warm start (try every task once before the exploration-controlled policy takes over, applied equally at every epsilon). WITH THE FIX: exploration independently drives aging/wear at fixed delivered mission value, robust across 30 independent environments in both battery models (0/30 backwards, median ratio 1.47x and 1.58x, Wilcoxon p=9.3e-10 both) and largely in the actuator-wear generalization (2/30 backwards, median 1.71x where it holds, range [0.83x, 3.30x]).

Method: THREE independent models, all at fixed delivered mission value, all using a fair warm-start (each task tried once before the exploration-controlled policy begins, applied identically at every epsilon): (1) 400km LEO, Wohler damage law; (2) 550km/1200Wh/published log-cycle-life law (arXiv:2603.04372); (3) generalization off battery cycling entirely to robotic actuator wear via Archard's law, using real torque/displacement ranges from a documented robot platform (arXiv:2607.18488). Each replayed across 30 INDEPENDENT task-value draws, not one fixed stream. · Result: supported · Confidence: 82%

Formal Verification

Z3 logical consistency:✅ Consistent

Z3 checks whether the hypothesis is internally consistent, not whether it is empirically true.

Experimental Validation Package

This discovery has a Claude-generated validation package with a full experimental design.

Precise Hypothesis

In decentralized LEO satellite constellations performing distributed task scheduling via a coalition-formation game, an agentic reinforcement learning (RL) controller whose exploration policy is guided by Upper-Confidence-Bound (UCB) acquisition over a surrogate Bayesian-optimization (BO) model of task-assignment value will (a) reduce the mean deviation from coalition-structure-stable equilibria (measured as normalized Shapley-value regret) by ≥20% relative to a baseline decentralized RL controller (e.g., independent PPO or greedy auction) under identical constellation, traffic, and battery models, AND (b) exhibit a statistically significant (p<0.05, paired test across ≥30 simulated episodes/seeds) positive correlation between the controller's exploration rate (UCB confidence width / entropy of action distribution) and an unmodeled/hidden battery-aging cost metric (cumulative depth-of-discharge-weighted cycle stress from onboard compute-induced power draw), such that higher exploration produces measurably higher aging cost per unit of scheduling-quality gain.

Disproof criteria:
  • No statistically significant reduction (or a reduction <10%) in equilibrium-deviation regret versus baseline across ≥30 seeds (two-sided paired t-test or Wilcoxon, α=0.05).
  • Exploration rate shows no significant correlation (|r|<0.15, p>0.05) with battery-aging cost, or the correlation is negative/inconsistent across ≥3 independent constellation configurations.
  • UCB-guided surrogate BO controller's equilibrium-deviation improvement disappears (Δ<5%) when controlling for wall-clock compute budget parity with baseline (i.e., gains are attributable to extra compute, not the method).
  • Battery aging cost predicted by the model does not correlate (r<0.2) with independently simulated electrochemical degradation from a higher-fidelity physics-based cell model, invalidating the "hidden cost" claim as an artifact of a weak proxy metric.
  • Results fail to replicate when swapping the RL backbone (e.g., PPO→SAC) or surrogate kernel, suggesting the effect is an implementation artifact rather than a general phenomenon.

Spine & Adversarial ReadReady for validation

“This hypothesis tests whether an RL controller's exploration-exploitation setting, tuned via UCB-guided Bayesian optimization to reduce decentralized satellite-coalition scheduling regret, causally trades off against a previously unmodeled battery-aging cost from onboard computation.”

  • highA GRANTED US PATENT (11,480,617) covers real-time scheduling for suppressing satellite battery aging. Checked 2 Oct 2026 by web search only (title/abstract) -- a freedom-to-operate read of the actual claims is required before this row is pitched commercially or any filing is considered.
    RESOLVED 2 Oct 2026 -- claim 1 read in full. The patent is deterministic EDF-based scheduling that maximizes current-draw variance to suppress lithium plating at low temperature; no RL, no exploration-exploitation parameter, no DoD/cycle-count aging mechanism. Does not conflict with or pre-empt this row's claim. No FTO concern from this specific patent.

Closest Existing Work

  • Novelty after this: Confirmed distinct: this patent's mechanism and target failure mode (lithium plating from current-draw timing at low temperature) do not overlap with the row's claim (RL exploration coefficient as an independent cycle/DoD aging driver at fixed delivered mission value).

Experimental Protocol

Minimum viable test (MVT): a discrete-event LEO constellation simulator (walker-delta, 66–100 sats) with a coalition-formation task-scheduling layer, comparing 3 controllers (baseline greedy/auction, independent PPO, UCB-BO-guided agentic RL) across 30 randomized seeds, 3 traffic regimes (steady, bursty, emergency-surge), and a calibrated battery-aging cost model, run for 500 simulated orbits (~750–1000 hrs simulated time) per condition. Primary endpoints: (1) normalized equilibrium-deviation regret, (2) exploration-rate vs. aging-cost correlation, (3) Pareto frontier of scheduling-quality vs. battery-aging cost across exploration hyperparameter sweep (UCB β ∈ {0.1,...,5}).

Required datasets:
  • Synthetic constellation traffic generator (task arrival, priority, data-volume distributions) — build or adapt from existing LEO scheduling literature (e.g., NASA/ESA open scheduling benchmarks if available; otherwise synthetic Poisson/bursty generator).
  • Orbital dynamics: TLE-based propagation via Skyfield/SGP4 or STK-equivalent open tool (Orekit) for constellation geometry and contact windows.
  • Battery aging model: semi-empirical Li-ion degradation model (e.g., NREL's BLAST-Lite or an open Rainflow-cycle-counting degradation model calibrated to published 18650/pouch cell cycle-life data — e.g., NASA PCoE battery dataset or Sandia's cycling datasets).
  • RL environment: custom Gymnasium-compatible multi-agent env wrapping the above; baseline implementations of PPO/SAC (Stable-Baselines3 or RLlib) and a BoTorch/GPyTorch-based surrogate BO module with UCB acquisition.
  • No real satellite telemetry required for MVT (synthetic-only); full validation would benefit from public SmallSat power telemetry (e.g., open CubeSat mission logs, if available) for battery model cross-validation.
Success:
  • ≥20% reduction in mean normalized equilibrium-deviation regret vs. best baseline (p<0.05, paired test, 30 seeds).
  • Significant positive correlation (Spearman r≥0.4, p<0.01) between exploration-rate metric and battery-aging cost, replicated in ≥2 of 3 traffic regimes.
  • Aging-cost proxy correlates with higher-fidelity electrochemical model at r≥0.6.
  • Effect survives compute-budget-parity control (regret improvement remains ≥10% when compute-matched).
  • Pareto frontier shows a non-trivial (non-corner) knee point, i.e., some exploration is beneficial but excess exploration measurably worsens aging cost disproportionately to scheduling gains.
Failure:
  • Regret improvement <10% or not statistically significant.
  • Exploration-aging correlation |r|<0.15 or non-replicable across regimes/seeds.
  • Effect vanishes under compute-parity control (indicates confound, not mechanism).
  • Aging-cost proxy uncorrelated with physics-based degradation model (r<0.2) — invalidates the "hidden cost" framing.
  • Results are seed/hyperparameter-fragile (high variance, CV>50% across seeds) indicating lack of robustness.

1,800

GPU hours

75d

Time to result

$18,000

Min cost

$95,000

Full cost

ROI Projection

Commercial:

Directly relevant to LEO constellation operators (telecom, EO, defense) seeking onboard autonomy that reduces ground-control burden while protecting hardware longevity; applicable to 6G non-terrestrial network standardization efforts and disaster-response satellite tasking (e.g., rapid-tasking coalitions for emergency communications). Licensable as a scheduling middleware/control-policy module; also valuable as a benchmark environment (open-sourced sim) for the broader multi-agent RL + space-systems research community. Estimated addressable value: satellite constellation operations software/analytics market segment, low-tens-of-millions-USD niche within the broader $10B+ smallsat market.

TIME_TO_RESULT_DAYS: 75

Implementation Sketch

# Pseudocode: Agentic RL + UCB-guided surrogate BO for coalition scheduling

for episode in range(N_EPISODES):
    env.reset(constellation_config, traffic_regime, battery_state)
    surrogate_gp = GaussianProcess(kernel=Matern52)  # BoTorch/GPyTorch
    for orbit_step in range(N_ORBITS):
        for sat in env.satellites:
            state = sat.get_state()  # SoC, queue, position, ISL links
            # Surrogate BO proposes candidate task-assignment values
            candidate_actions = sample_candidates(state)
            mu, sigma = surrogate_gp.predict(candidate_actions)
            ucb_score = mu + beta * sigma
            action = argmax(ucb_score)  # exploration-guided choice

            reward, next_state, aging_cost = env.step(sat, action)
            surrogate_gp.update(candidate_actions[action], reward)

            # Outer RL policy (PPO) updates using reward - lambda*aging_cost
            rl_agent.store_transition(state, action, reward, aging_cost, next_state)

        rl_agent.update()  # PPO gradient step across coalition
        coalition_regret = compute_shapley_regret(env.coalition_state)
        log(coalition_regret, aging_cost, ucb_beta, exploration_entropy)

# Post-hoc analysis
correlation = spearman(exploration_entropy_series, aging_cost_series)
pareto_frontier = compute_pareto(regret_series, aging_cost_series, over=ucb_beta_sweep)
Abort checkpoints:
  • Day 10: baseline simulator + battery model calibration sanity check — if aging-cost proxy doesn't correlate (r>0.5) with published cycle-life curves on simple test cases, halt and re-derive model before proceeding.
  • Day 25: pilot run (5 seeds, 1 traffic regime) — if equilibrium-regret improvement <5%, reassess controller design before committing to full factorial sweep.
  • Day 45: mid-sweep checkpoint — if exploration-aging correlation is <0.1 across first 50% of runs, halt full sweep and run targeted ablations to diagnose (metric issue vs. true null).
  • Day 60: compute-parity control — if effect vanishes, stop and report as compute-confound failure rather than completing full statistical writeup.

NAMED_EXPERTS: []

CLOSEST_EXISTING_WORK: []

NOVELTY_NARROWING_REQUIRED: false

Our preprint on this result

Self-deposited and not peer-reviewed. The record below is the authoritative statement of what was and was not shown.

Source

AegisMind Research
Need AI to work rigorously on your problems? AegisMind uses the same multi-model engine for personal and professional use. Get started