In reinforcement-learning schedulers for LEO satellite task allocation, the exploration-exploitation setting is a driver of battery degradation in its own right, not merely a convergence parameter: at FIXED delivered mission value, a more exploratory scheduler needs more orbits AND discharges more deeply per orbit, so integrated aging cost is a monotone increasing function of the exploration coefficient. Measured 17 Sep 2026: 2.33x the damage at eps=1 versus eps=0 for the same delivered value, split 55% cycle count and 45% discharge depth. Note what is NOT claimed: cycles per DAY are pinned by orbital mechanics (15.58 at 400 km) and no scheduler changes them; it is cycles per MISSION that rise. FALSIFIED IF replaying one fixed task stream at several exploration coefficients, each run to the same cumulative reward, shows no monotone relationship between the coefficient and integrated aging.
Adversarial Debate Score
47% survival rate under critique
Expert panel critique
Independent views, each critiquing the hypothesis on its own — the score rewards genuine disagreement and discounts consensus.
Supporting Research Papers
- Unseen Cost of Space Computing: Quantifying LEO Battery Aging via Physics-Driven Modeling
Low Earth Orbit (LEO) satellite constellations in the 6G era are evolving into intelligent in-orbit computational platforms, forming Space Computing Power Networks (SCPNs) to deliver global-scale comp...
- PRIME: Plasticity Recovery in Multi-Agent Environments for UAV-Assisted Emergency Communication Networks
Most reinforcement learning controllers for these networks assume stationary conditions, and the few that handle change react to the external environment while leaving the network's internal state une...
- Self-Refining Agentic Reinforcement Learning for Vision-Conditioned UAV Navigation
Deep reinforcement learning has shown strong potential for enabling autonomous robots to learn complex navigational tasks. However, its practical use still depends heavily on human designed reward fun...
- Learning vs. Optimizing Bidders in Budgeted Auctions
The study of repeated interactions between a learner and a utility-maximizing optimizer has yielded deep insights into the manipulability of learning algorithms. However, existing literature primarily...
Computational Result
Computation is the experiment in this domain.
At fixed delivered mission value (96/96 runs on target, reward CV 0.0016), Spearman(eps, mean DoD) = +0.755 (p=6e-19) and Spearman(eps, integrated aging) = +0.957 (p=2e-52). eps=1 costs 2.33x the damage of eps=0 for the same value delivered.
Method: simulated 400 km LEO, epsilon-greedy scheduler over 6 tasks, Wohler/Palmgren-Miner damage (DoD^1.87), each arm run to the SAME cumulative reward · Result: supported · Confidence: 75%
Formal Verification
Z3 checks whether the hypothesis is internally consistent, not whether it is empirically true.
This discovery has a Claude-generated validation package with a full experimental design.
Precise Hypothesis
In decentralized LEO satellite constellations performing distributed task scheduling via a coalition-formation game, an agentic reinforcement learning (RL) controller whose exploration policy is guided by Upper-Confidence-Bound (UCB) acquisition over a surrogate Bayesian-optimization (BO) model of task-assignment value will (a) reduce the mean deviation from coalition-structure-stable equilibria (measured as normalized Shapley-value regret) by ≥20% relative to a baseline decentralized RL controller (e.g., independent PPO or greedy auction) under identical constellation, traffic, and battery models, AND (b) exhibit a statistically significant (p<0.05, paired test across ≥30 simulated episodes/seeds) positive correlation between the controller's exploration rate (UCB confidence width / entropy of action distribution) and an unmodeled/hidden battery-aging cost metric (cumulative depth-of-discharge-weighted cycle stress from onboard compute-induced power draw), such that higher exploration produces measurably higher aging cost per unit of scheduling-quality gain.
- No statistically significant reduction (or a reduction <10%) in equilibrium-deviation regret versus baseline across ≥30 seeds (two-sided paired t-test or Wilcoxon, α=0.05).
- Exploration rate shows no significant correlation (|r|<0.15, p>0.05) with battery-aging cost, or the correlation is negative/inconsistent across ≥3 independent constellation configurations.
- UCB-guided surrogate BO controller's equilibrium-deviation improvement disappears (Δ<5%) when controlling for wall-clock compute budget parity with baseline (i.e., gains are attributable to extra compute, not the method).
- Battery aging cost predicted by the model does not correlate (r<0.2) with independently simulated electrochemical degradation from a higher-fidelity physics-based cell model, invalidating the "hidden cost" claim as an artifact of a weak proxy metric.
- Results fail to replicate when swapping the RL backbone (e.g., PPO→SAC) or surrogate kernel, suggesting the effect is an implementation artifact rather than a general phenomenon.
Spine & Adversarial ReadReady for validation
“This hypothesis tests whether an RL controller's exploration-exploitation setting, tuned via UCB-guided Bayesian optimization to reduce decentralized satellite-coalition scheduling regret, causally trades off against a previously unmodeled battery-aging cost from onboard computation.”
- highThe 'hidden battery aging cost' may simply be a restatement of total compute/energy expenditure — of course more exploration (more candidate evaluations, more GP updates) consumes more energy and thus causes more aging; this is not a novel coupling but a trivial accounting fact dressed up as a discovery.The protocol's compute-budget-parity control (Step 9) is designed to address exactly this by matching wall-clock/FLOP budgets between controllers. However, the EVP does not yet specify how to disentangle 'exploration causes aging via extra actions taken' from 'exploration causes aging via a qualitatively different power draw pattern (e.g., more frequent SoC swings)' — this decomposition needs an explicit sub-analysis (e.g., regress aging cost on both action-count and exploration-entropy jointly) that is not currently in the methodology and should be added before claiming a non-trivial coupling.
- mediumWhy coalition-game equilibrium regret and Shapley-value stability specifically, rather than simpler scheduling-quality metrics (e.g., task completion rate, latency)? The choice of a cooperative-game-theoretic framing adds analytical complexity (sampled coalition valuations are themselves approximate and noisy) without clear justification for why equilibrium deviation is the right lens for a battery-cost tradeoff question.Unresolved in the current EVP. The methodology should justify this choice explicitly — e.g., if the real operational concern is fairness/stability of task allocation across a coalition of operators or subsystems, that should be stated; otherwise a simpler, less noisy scheduling-quality metric (throughput, SLA violation rate) may be more defensible as the primary endpoint, with equilibrium regret as a secondary/exploratory metric.
- highThe entire validation is simulation-only with synthetic traffic and a semi-empirical (not physics-based) battery model; without any real telemetry or hardware-in-the-loop validation, claims about 'hidden' real-world battery costs are unfalsifiable in the sense that matters operationally (i.e., they may not transfer to actual spacecraft power systems).Acknowledged gap. The EVP explicitly notes full validation would benefit from public CubeSat telemetry but treats this as optional rather than required. Given evidence_strength (0.69) and verification_confidence (0.00) in the input metadata, this gap is significant and should be elevated: a minimum bar for any claim of practical (not just simulated) relevance should require at least one cross-validation against real SmallSat power telemetry logs before ROI or commercial-value claims are asserted publicly.
Experimental Protocol
Minimum viable test (MVT): a discrete-event LEO constellation simulator (walker-delta, 66–100 sats) with a coalition-formation task-scheduling layer, comparing 3 controllers (baseline greedy/auction, independent PPO, UCB-BO-guided agentic RL) across 30 randomized seeds, 3 traffic regimes (steady, bursty, emergency-surge), and a calibrated battery-aging cost model, run for 500 simulated orbits (~750–1000 hrs simulated time) per condition. Primary endpoints: (1) normalized equilibrium-deviation regret, (2) exploration-rate vs. aging-cost correlation, (3) Pareto frontier of scheduling-quality vs. battery-aging cost across exploration hyperparameter sweep (UCB β ∈ {0.1,...,5}).
- Synthetic constellation traffic generator (task arrival, priority, data-volume distributions) — build or adapt from existing LEO scheduling literature (e.g., NASA/ESA open scheduling benchmarks if available; otherwise synthetic Poisson/bursty generator).
- Orbital dynamics: TLE-based propagation via Skyfield/SGP4 or STK-equivalent open tool (Orekit) for constellation geometry and contact windows.
- Battery aging model: semi-empirical Li-ion degradation model (e.g., NREL's BLAST-Lite or an open Rainflow-cycle-counting degradation model calibrated to published 18650/pouch cell cycle-life data — e.g., NASA PCoE battery dataset or Sandia's cycling datasets).
- RL environment: custom Gymnasium-compatible multi-agent env wrapping the above; baseline implementations of PPO/SAC (Stable-Baselines3 or RLlib) and a BoTorch/GPyTorch-based surrogate BO module with UCB acquisition.
- No real satellite telemetry required for MVT (synthetic-only); full validation would benefit from public SmallSat power telemetry (e.g., open CubeSat mission logs, if available) for battery model cross-validation.
- ≥20% reduction in mean normalized equilibrium-deviation regret vs. best baseline (p<0.05, paired test, 30 seeds).
- Significant positive correlation (Spearman r≥0.4, p<0.01) between exploration-rate metric and battery-aging cost, replicated in ≥2 of 3 traffic regimes.
- Aging-cost proxy correlates with higher-fidelity electrochemical model at r≥0.6.
- Effect survives compute-budget-parity control (regret improvement remains ≥10% when compute-matched).
- Pareto frontier shows a non-trivial (non-corner) knee point, i.e., some exploration is beneficial but excess exploration measurably worsens aging cost disproportionately to scheduling gains.
- Regret improvement <10% or not statistically significant.
- Exploration-aging correlation |r|<0.15 or non-replicable across regimes/seeds.
- Effect vanishes under compute-parity control (indicates confound, not mechanism).
- Aging-cost proxy uncorrelated with physics-based degradation model (r<0.2) — invalidates the "hidden cost" framing.
- Results are seed/hyperparameter-fragile (high variance, CV>50% across seeds) indicating lack of robustness.
1,800
GPU hours
75d
Time to result
$18,000
Min cost
$95,000
Full cost
ROI Projection
Directly relevant to LEO constellation operators (telecom, EO, defense) seeking onboard autonomy that reduces ground-control burden while protecting hardware longevity; applicable to 6G non-terrestrial network standardization efforts and disaster-response satellite tasking (e.g., rapid-tasking coalitions for emergency communications). Licensable as a scheduling middleware/control-policy module; also valuable as a benchmark environment (open-sourced sim) for the broader multi-agent RL + space-systems research community. Estimated addressable value: satellite constellation operations software/analytics market segment, low-tens-of-millions-USD niche within the broader $10B+ smallsat market.
TIME_TO_RESULT_DAYS: 75
Implementation Sketch
# Pseudocode: Agentic RL + UCB-guided surrogate BO for coalition scheduling for episode in range(N_EPISODES): env.reset(constellation_config, traffic_regime, battery_state) surrogate_gp = GaussianProcess(kernel=Matern52) # BoTorch/GPyTorch for orbit_step in range(N_ORBITS): for sat in env.satellites: state = sat.get_state() # SoC, queue, position, ISL links # Surrogate BO proposes candidate task-assignment values candidate_actions = sample_candidates(state) mu, sigma = surrogate_gp.predict(candidate_actions) ucb_score = mu + beta * sigma action = argmax(ucb_score) # exploration-guided choice reward, next_state, aging_cost = env.step(sat, action) surrogate_gp.update(candidate_actions[action], reward) # Outer RL policy (PPO) updates using reward - lambda*aging_cost rl_agent.store_transition(state, action, reward, aging_cost, next_state) rl_agent.update() # PPO gradient step across coalition coalition_regret = compute_shapley_regret(env.coalition_state) log(coalition_regret, aging_cost, ucb_beta, exploration_entropy) # Post-hoc analysis correlation = spearman(exploration_entropy_series, aging_cost_series) pareto_frontier = compute_pareto(regret_series, aging_cost_series, over=ucb_beta_sweep)
- Day 10: baseline simulator + battery model calibration sanity check — if aging-cost proxy doesn't correlate (r>0.5) with published cycle-life curves on simple test cases, halt and re-derive model before proceeding.
- Day 25: pilot run (5 seeds, 1 traffic regime) — if equilibrium-regret improvement <5%, reassess controller design before committing to full factorial sweep.
- Day 45: mid-sweep checkpoint — if exploration-aging correlation is <0.1 across first 50% of runs, halt full sweep and run targeted ablations to diagnose (metric issue vs. true null).
- Day 60: compute-parity control — if effect vanishes, stop and report as compute-confound failure rather than completing full statistical writeup.
NAMED_EXPERTS: []
CLOSEST_EXISTING_WORK: []
NOVELTY_NARROWING_REQUIRED: false