In reinforcement-learning schedulers for LEO satellite task allocation, the exploration-exploitation setting is a driver of battery degradation in its own right, not merely a convergence parameter: at FIXED delivered mission value, a more exploratory scheduler needs more orbits AND discharges more deeply per orbit, so integrated aging cost is a monotone increasing function of the exploration coefficient. Measured in simulation (corrected 3 Oct 2026 after fixing an argmax tie-breaking bug; an earlier single-seed figure of 2.33x is withdrawn): median 1.47x and 1.58x the damage at eps=1 versus eps=0 for the same delivered value, across 30 independent task streams in two battery models (0/30 reversals). The earlier 55%/45% cycle-count versus depth split is not claimed. Note what is NOT claimed: cycles per DAY are pinned by orbital mechanics (15.58 at 400 km) and no scheduler changes them; it is cycles per MISSION that rise. FALSIFIED IF replaying one fixed task stream at several exploration coefficients, each run to the same cumulative reward, shows no monotone relationship between the coefficient and integrated aging.
Adversarial Debate Score
47% survival rate under critique
Expert panel critique
Independent views, each critiquing the hypothesis on its own — the score rewards genuine disagreement and discounts consensus.
Supporting Research Papers
- Unseen Cost of Space Computing: Quantifying LEO Battery Aging via Physics-Driven Modeling
Low Earth Orbit (LEO) satellite constellations in the 6G era are evolving into intelligent in-orbit computational platforms, forming Space Computing Power Networks (SCPNs) to deliver global-scale comp...
- PRIME: Plasticity Recovery in Multi-Agent Environments for UAV-Assisted Emergency Communication Networks
Most reinforcement learning controllers for these networks assume stationary conditions, and the few that handle change react to the external environment while leaving the network's internal state une...
- Self-Refining Agentic Reinforcement Learning for Vision-Conditioned UAV Navigation
Deep reinforcement learning has shown strong potential for enabling autonomous robots to learn complex navigational tasks. However, its practical use still depends heavily on human designed reward fun...
- Learning vs. Optimizing Bidders in Budgeted Auctions
The study of repeated interactions between a learner and a utility-maximizing optimizer has yielded deep insights into the manipulability of learning algorithms. However, existing literature primarily...
Computational Result
Computation is the experiment in this domain.
CORRECTED 3 Oct 2026 -- a real implementation bug (argmax on all-zero-tied value estimates always starts a pure-greedy agent on task 0, regardless of which task is actually best) made the original single-seed result a 50/50 coin flip, not a robust finding: replaying 30 independent task streams with the ORIGINAL code, eps=0 came out backwards (worse than eps=1) in 15 of 30. Fixed with a forced warm start (try every task once before the exploration-controlled policy takes over, applied equally at every epsilon). WITH THE FIX: exploration independently drives aging/wear at fixed delivered mission value, robust across 30 independent environments in both battery models (0/30 backwards, median ratio 1.47x and 1.58x, Wilcoxon p=9.3e-10 both) and largely in the actuator-wear generalization (2/30 backwards, median 1.71x where it holds, range [0.83x, 3.30x]).
Method: THREE independent models, all at fixed delivered mission value, all using a fair warm-start (each task tried once before the exploration-controlled policy begins, applied identically at every epsilon): (1) 400km LEO, Wohler damage law; (2) 550km/1200Wh/published log-cycle-life law (arXiv:2603.04372); (3) generalization off battery cycling entirely to robotic actuator wear via Archard's law, using real torque/displacement ranges from a documented robot platform (arXiv:2607.18488). Each replayed across 30 INDEPENDENT task-value draws, not one fixed stream. · Result: supported · Confidence: 82%
Formal Verification
Z3 checks whether the hypothesis is internally consistent, not whether it is empirically true.
This discovery has a Claude-generated validation package with a full experimental design.
Precise Hypothesis
In decentralized LEO satellite constellations performing distributed task scheduling via a coalition-formation game, an agentic reinforcement learning (RL) controller whose exploration policy is guided by Upper-Confidence-Bound (UCB) acquisition over a surrogate Bayesian-optimization (BO) model of task-assignment value will (a) reduce the mean deviation from coalition-structure-stable equilibria (measured as normalized Shapley-value regret) by ≥20% relative to a baseline decentralized RL controller (e.g., independent PPO or greedy auction) under identical constellation, traffic, and battery models, AND (b) exhibit a statistically significant (p<0.05, paired test across ≥30 simulated episodes/seeds) positive correlation between the controller's exploration rate (UCB confidence width / entropy of action distribution) and an unmodeled/hidden battery-aging cost metric (cumulative depth-of-discharge-weighted cycle stress from onboard compute-induced power draw), such that higher exploration produces measurably higher aging cost per unit of scheduling-quality gain.
- No statistically significant reduction (or a reduction <10%) in equilibrium-deviation regret versus baseline across ≥30 seeds (two-sided paired t-test or Wilcoxon, α=0.05).
- Exploration rate shows no significant correlation (|r|<0.15, p>0.05) with battery-aging cost, or the correlation is negative/inconsistent across ≥3 independent constellation configurations.
- UCB-guided surrogate BO controller's equilibrium-deviation improvement disappears (Δ<5%) when controlling for wall-clock compute budget parity with baseline (i.e., gains are attributable to extra compute, not the method).
- Battery aging cost predicted by the model does not correlate (r<0.2) with independently simulated electrochemical degradation from a higher-fidelity physics-based cell model, invalidating the "hidden cost" claim as an artifact of a weak proxy metric.
- Results fail to replicate when swapping the RL backbone (e.g., PPO→SAC) or surrogate kernel, suggesting the effect is an implementation artifact rather than a general phenomenon.
Spine & Adversarial ReadReady for validation
“This hypothesis tests whether an RL controller's exploration-exploitation setting, tuned via UCB-guided Bayesian optimization to reduce decentralized satellite-coalition scheduling regret, causally trades off against a previously unmodeled battery-aging cost from onboard computation.”
- highA GRANTED US PATENT (11,480,617) covers real-time scheduling for suppressing satellite battery aging. Checked 2 Oct 2026 by web search only (title/abstract) -- a freedom-to-operate read of the actual claims is required before this row is pitched commercially or any filing is considered.RESOLVED 2 Oct 2026 -- claim 1 read in full. The patent is deterministic EDF-based scheduling that maximizes current-draw variance to suppress lithium plating at low temperature; no RL, no exploration-exploitation parameter, no DoD/cycle-count aging mechanism. Does not conflict with or pre-empt this row's claim. No FTO concern from this specific patent.
Closest Existing Work
Novelty after this: Confirmed distinct: this patent's mechanism and target failure mode (lithium plating from current-draw timing at low temperature) do not overlap with the row's claim (RL exploration coefficient as an independent cycle/DoD aging driver at fixed delivered mission value).
Experimental Protocol
Minimum viable test (MVT): a discrete-event LEO constellation simulator (walker-delta, 66–100 sats) with a coalition-formation task-scheduling layer, comparing 3 controllers (baseline greedy/auction, independent PPO, UCB-BO-guided agentic RL) across 30 randomized seeds, 3 traffic regimes (steady, bursty, emergency-surge), and a calibrated battery-aging cost model, run for 500 simulated orbits (~750–1000 hrs simulated time) per condition. Primary endpoints: (1) normalized equilibrium-deviation regret, (2) exploration-rate vs. aging-cost correlation, (3) Pareto frontier of scheduling-quality vs. battery-aging cost across exploration hyperparameter sweep (UCB β ∈ {0.1,...,5}).
- Synthetic constellation traffic generator (task arrival, priority, data-volume distributions) — build or adapt from existing LEO scheduling literature (e.g., NASA/ESA open scheduling benchmarks if available; otherwise synthetic Poisson/bursty generator).
- Orbital dynamics: TLE-based propagation via Skyfield/SGP4 or STK-equivalent open tool (Orekit) for constellation geometry and contact windows.
- Battery aging model: semi-empirical Li-ion degradation model (e.g., NREL's BLAST-Lite or an open Rainflow-cycle-counting degradation model calibrated to published 18650/pouch cell cycle-life data — e.g., NASA PCoE battery dataset or Sandia's cycling datasets).
- RL environment: custom Gymnasium-compatible multi-agent env wrapping the above; baseline implementations of PPO/SAC (Stable-Baselines3 or RLlib) and a BoTorch/GPyTorch-based surrogate BO module with UCB acquisition.
- No real satellite telemetry required for MVT (synthetic-only); full validation would benefit from public SmallSat power telemetry (e.g., open CubeSat mission logs, if available) for battery model cross-validation.
- ≥20% reduction in mean normalized equilibrium-deviation regret vs. best baseline (p<0.05, paired test, 30 seeds).
- Significant positive correlation (Spearman r≥0.4, p<0.01) between exploration-rate metric and battery-aging cost, replicated in ≥2 of 3 traffic regimes.
- Aging-cost proxy correlates with higher-fidelity electrochemical model at r≥0.6.
- Effect survives compute-budget-parity control (regret improvement remains ≥10% when compute-matched).
- Pareto frontier shows a non-trivial (non-corner) knee point, i.e., some exploration is beneficial but excess exploration measurably worsens aging cost disproportionately to scheduling gains.
- Regret improvement <10% or not statistically significant.
- Exploration-aging correlation |r|<0.15 or non-replicable across regimes/seeds.
- Effect vanishes under compute-parity control (indicates confound, not mechanism).
- Aging-cost proxy uncorrelated with physics-based degradation model (r<0.2) — invalidates the "hidden cost" framing.
- Results are seed/hyperparameter-fragile (high variance, CV>50% across seeds) indicating lack of robustness.
1,800
GPU hours
75d
Time to result
$18,000
Min cost
$95,000
Full cost
ROI Projection
Directly relevant to LEO constellation operators (telecom, EO, defense) seeking onboard autonomy that reduces ground-control burden while protecting hardware longevity; applicable to 6G non-terrestrial network standardization efforts and disaster-response satellite tasking (e.g., rapid-tasking coalitions for emergency communications). Licensable as a scheduling middleware/control-policy module; also valuable as a benchmark environment (open-sourced sim) for the broader multi-agent RL + space-systems research community. Estimated addressable value: satellite constellation operations software/analytics market segment, low-tens-of-millions-USD niche within the broader $10B+ smallsat market.
TIME_TO_RESULT_DAYS: 75
Implementation Sketch
# Pseudocode: Agentic RL + UCB-guided surrogate BO for coalition scheduling for episode in range(N_EPISODES): env.reset(constellation_config, traffic_regime, battery_state) surrogate_gp = GaussianProcess(kernel=Matern52) # BoTorch/GPyTorch for orbit_step in range(N_ORBITS): for sat in env.satellites: state = sat.get_state() # SoC, queue, position, ISL links # Surrogate BO proposes candidate task-assignment values candidate_actions = sample_candidates(state) mu, sigma = surrogate_gp.predict(candidate_actions) ucb_score = mu + beta * sigma action = argmax(ucb_score) # exploration-guided choice reward, next_state, aging_cost = env.step(sat, action) surrogate_gp.update(candidate_actions[action], reward) # Outer RL policy (PPO) updates using reward - lambda*aging_cost rl_agent.store_transition(state, action, reward, aging_cost, next_state) rl_agent.update() # PPO gradient step across coalition coalition_regret = compute_shapley_regret(env.coalition_state) log(coalition_regret, aging_cost, ucb_beta, exploration_entropy) # Post-hoc analysis correlation = spearman(exploration_entropy_series, aging_cost_series) pareto_frontier = compute_pareto(regret_series, aging_cost_series, over=ucb_beta_sweep)
- Day 10: baseline simulator + battery model calibration sanity check — if aging-cost proxy doesn't correlate (r>0.5) with published cycle-life curves on simple test cases, halt and re-derive model before proceeding.
- Day 25: pilot run (5 seeds, 1 traffic regime) — if equilibrium-regret improvement <5%, reassess controller design before committing to full factorial sweep.
- Day 45: mid-sweep checkpoint — if exploration-aging correlation is <0.1 across first 50% of runs, halt full sweep and run targeted ablations to diagnose (metric issue vs. true null).
- Day 60: compute-parity control — if effect vanishes, stop and report as compute-confound failure rather than completing full statistical writeup.
NAMED_EXPERTS: []
CLOSEST_EXISTING_WORK: []
NOVELTY_NARROWING_REQUIRED: false
Our preprint on this result
Self-deposited and not peer-reviewed. The record below is the authoritative statement of what was and was not shown.
- Exploration Cost: The Exploration Coefficient in Onboard Reinforcement-Learning Schedulers Is an Independent Driver of Battery Aging ↗engrXiv · doi:10.31224/8438 · current version
Simulation study, not hardware or flight data. Reports the corrected result after an implementation bug was fixed; the earlier 2.33x figure is withdrawn.