Adaptive LLM-driven zeroth-order optimization schedules can dynamically adjust mutation rates in mRNA sequence design evolutionary algorithms.
Adversarial Debate Score
67% survival rate under critique
Expert panel critique
Independent views, each critiquing the hypothesis on its own — the score rewards genuine disagreement and discounts consensus.
Supporting Research Papers
- Cheap Thrills: Effective Amortized Optimization Using Inexpensive Labels
To scale the solution of optimization and simulation problems, prior work has explored machine-learning surrogates that inexpensively map problem parameters to corresponding solutions. Commonly used a...
- FlashOptim: Optimizers for Memory Efficient Training
Standard mixed-precision training of neural networks requires many bytes of accelerator memory for each model parameter. These bytes reflect not just the parameter itself, but also its gradient and on...
- Universal Persistent Brownian Motions in Confluent Tissues
Biological tissues are active materials whose non-equilibrium dynamics emerge from distinct cellular force-generating mechanisms. Using a two-dimensional active foam model, we compare the effects of t...
- Toward Expert Investment Teams:A Multi-Agent LLM System with Fine-Grained Trading Tasks
The advancement of large language models (LLMs) has accelerated the development of autonomous financial trading systems. While mainstream approaches deploy multi-agent systems mimicking analyst and ma...
Literature Assessment
An LLM's reading of the literature — not computational verification.
Adaptive LLMs may enhance mutation rate adjustments in mRNA design.
Method: literature_meta · Result: inconclusive
Formal Verification
Z3 checks whether the hypothesis is internally consistent, not whether it is empirically true.
This discovery has a Claude-generated validation package with a full experimental design.
Precise Hypothesis
An LLM acting as a meta-controller, which observes the state of an evolutionary/genetic algorithm (population fitness distribution, diversity metrics, generation index, plateau length) and outputs a mutation-rate schedule (and optionally crossover/selection-pressure parameters) at each generation, will produce mRNA sequence design outcomes — measured by predicted stability (e.g., ΔG of secondary structure), codon adaptation index (CAI), predicted translation efficiency, and/or in-silico expression proxy score — that are statistically superior (≥10% improvement in final best-fitness at fixed compute budget, or ≥30% reduction in generations-to-target-fitness) compared to (a) fixed mutation-rate GA, (b) standard adaptive heuristics (1/5-success rule, simulated-annealing-style decay), and (c) CMA-ES self-adaptation, across a defined benchmark suite of mRNA design tasks.
- No statistically significant improvement (p≥0.05, paired Wilcoxon signed-rank across ≥30 independent runs) in final fitness or generations-to-convergence versus best classical adaptive baseline (1/5-rule or CMA-ES) on ≥3 of 5 benchmark tasks.
- Improvement is present but disappears when LLM is replaced by a simple learned bandit/linear controller with equivalent state input (i.e., "LLM" component adds no value beyond a much cheaper adaptive controller) — this would falsify the "LLM-specific" claim while leaving "adaptive control" claim intact.
- Wall-clock or dollar-cost-normalized performance is worse than fixed-schedule GA once LLM inference cost is included.
- Gains do not generalize beyond the exact benchmark/prompt template used (fail on held-out mRNA targets or held-out organism codon tables).
Spine & Adversarial Read
- highDecades of evolution-strategy literature (1/5-success rule, CMA-ES step-size adaptation) already solves adaptive mutation-rate control efficiently and cheaply; an LLM call (50-500ms, nonzero $ cost) is a strictly worse mechanism unless it captures information the classical controllers cannot (e.g., semantic understanding of sequence/biological constraints) — this EVP does not yet establish what specific information channel the LLM exploits that a bandit cannot.Ablation A (linear/logistic bandit with identical state features) is designed exactly to isolate this; if bandit matches LLM, the EVP's own failure criteria call this correctly as a negative result. This is acknowledged as the central risk, not resolved in advance.
- mediumWhy these specific benchmarks and fitness oracles (ViennaRNA/CAI) rather than wet-lab-validated expression data or a broader established mRNA design benchmark suite? Method choice appears convenience-driven (fast, free, in-silico) rather than justified against the therapeutic-relevance target of the claim.Partial justification given: in-silico oracles are necessary for statistical power (n=30 seeds × 600 runs is infeasible with wet-lab feedback) and are standard proxies in the mRNA design literature (MFE/CAI correlate with expression in prior published work, though this EVP does not cite specific validating papers due to unavailable search results). Gap: no wet-lab validation arm is included; ROI estimates assume in-silico gains transfer to real expression, which is unverified here.
- mediumThe claim of 'dynamic tuning' could trivially collapse to the LLM learning/reproducing a fixed good schedule from its training data (e.g., recommending standard simulated-annealing-style decay), which is not meaningfully different from a hand-tuned fixed schedule — undermining the 'dynamic, context-aware' novelty claim.Not fully resolved by current design; recommend adding a diagnostic analysis correlating LLM-output mutation rates against population state variables (regression/mutual information) to confirm genuine state-dependence versus a constant/decay-only pattern — this analysis is not yet in the protocol and should be added before claiming 'dynamic tuning' is demonstrated.
Experimental Protocol
Minimum viable test (MVT): 5 benchmark mRNA design tasks (2 synthetic ViennaRNA-based structure-minimization tasks, 2 real therapeutic targets — e.g., SARS-CoV-2 spike RBD-coding mRNA and EPO mRNA — with CAI+MFE joint objective, 1 adversarial multimodal landscape task), each run with n=30 random seeds, comparing 4 arms: (1) fixed mutation rate GA, (2) 1/5-success-rule adaptive GA, (3) CMA-ES self-adaptive, (4) LLM-scheduled GA (GPT-4o-mini or Llama-3.1-8B-Instruct as controller, called every 5 generations with summarized population state). Fixed compute budget = 2,000 fitness evaluations per run. Primary endpoints: best fitness at budget exhaustion, generations-to-90%-of-best-known-fitness, wall-clock time, total dollar cost including LLM API calls.
- Benchmark sequence set: 10–20 real therapeutic mRNA CDS/UTR sequences from NCBI RefSeq / literature (e.g., EPO, spike RBD, luciferase reporter — used as design targets, not training data).
- Fitness oracles: ViennaRNA 2.6 (MFE/structure), LinearFold (fast MFE approximation for long sequences), CAI calculator (codon usage tables from Kazusa/HIVE-CUT for human), and optionally a pretrained mRNA stability/translation-efficiency surrogate model (e.g., Optimus 5-Prime, CodonBERT, or an in-house regression model if available) as a secondary fitness signal.
- LLM controllers: GPT-4o-mini (API), Llama-3.1-8B-Instruct and Llama-3.1-70B-Instruct (self-hosted, for cost/ablation control), plus one open-weight reasoning-tuned model (e.g., Qwen2.5-32B-Instruct) for robustness check.
- Classical baselines: DEAP or custom GA implementation with 1/5-rule, CMA-ES (pycma library).
- Compute environment: single-node 4×A100-80GB (for local LLM inference + parallelized GA runs), plus API budget for closed-model comparisons.
- No dependency on the MS transcriptomics datasets (GSE193770, GSE138614, GTEx, STRING) — these are unrelated to this discovery and are noted only because they appear in the shared context.
- Primary: LLM-scheduled GA beats best classical adaptive baseline (CMA-ES or 1/5-rule) by ≥10% in final normalized fitness OR ≥30% fewer generations-to-90%-best-known-fitness, significant at p<0.05 (Holm-corrected) on ≥4 of 5 tasks.
- Secondary: Ablation A shows LLM controller outperforms linear-bandit controller by ≥5% (establishes LLM-specific value, not just "any adaptive controller").
- Cost-normalized efficiency of LLM arm is within 2× of best classical baseline (i.e., gains aren't erased by API cost) using GPT-4o-mini pricing.
- Held-out generalization: performance advantage retained (≥5% improvement) on ≥3 of 5 held-out targets.
- No significant difference vs. best classical baseline on ≥3 of 5 tasks (p≥0.05 after correction).
- LLM arm matched or beaten by linear-bandit ablation on ≥3 of 5 tasks → conclude effect is "adaptive control," not "LLM-specific."
- Cost-normalized efficiency of LLM arm >5× worse than classical baseline (API cost dominates any fitness gain) → conclude impractical at current LLM pricing/latency.
- Held-out generalization fails (gains vanish or reverse on new targets) → conclude prompt/schedule overfit to benchmark tasks.
- LLM outputs invalid/unstable schedules (>10% of calls fail JSON validation or produce degenerate rates causing GA divergence) without robust fallback.
ROI Projection
Implementation Sketch
for generation in range(max_generations): state = summarize_population(population) # mean/var/best/worst fitness, # diversity, stagnation_count if generation % k == 0: prompt = build_prompt(state, task_description, history[-5:]) response = llm.query(prompt, schema=MutationScheduleSchema) mutation_rate = clip(response.mutation_rate, 1e-4, 0.5) crossover_rate = clip(response.crossover_rate, 0.0, 1.0) log(generation, state, mutation_rate, crossover_rate) offspring = crossover(population, crossover_rate) offspring = mutate(offspring, mutation_rate) fitness = evaluate(offspring, oracle=[ViennaRNA_MFE, CAI, surrogate]) population = select(population + offspring, fitness) if converged(population, tol) or eval_budget_exhausted(): break record_metrics(best_fitness, generations_used, wallclock, api_cost)
Ablation swap point: replace llm.query(...) with bandit_controller.predict(state) (linear/logistic model trained online via Thompson sampling) for Ablation A.
- Day 7 (after baseline + LLM arm on 1 task, n=10 seeds): if LLM arm shows no directional trend (mean improvement <2%) vs. CMA-ES, halt and reassess prompt design before scaling to full n=30×5 tasks.
- Day 15 (after Ablation A, linear-bandit control): if bandit matches LLM performance within 3%, deprioritize full LLM-cost scale-up; pivot framing to "adaptive control" rather than "LLM-specific" claim.
- Day 25 (after full 600-run sweep): if Holm-corrected significance not reached on ≥4/5 tasks, do not proceed to held-out generalization phase — report negative/mixed result.
NAMED_EXPERTS: []
CLOSEST_EXISTING_WORK: []
NOVELTY_NARROWING_REQUIRED: true
SPINE_STATEMENT: This hypothesis tests whether an LLM-driven meta-controller that dynamically sets mutation rates during evolutionary mRNA sequence design produces significantly better fitness outcomes per unit compute than classical adaptive (non-LLM) mutation-rate schedules.