solver.press

Applying homology-based morphometry to longitudinal spinal cord MRI will show that topological invariants (persistent homology Betti numbers) predict MS lesion merging and splitting events over time with a higher area under the ROC curve than conventional semantic segmentation volume-change models.

NeuroscienceOct 3, 2026Evaluation Score: 67%

Adversarial Debate Score

57% survival rate under critique

Expert panel critique

Independent views, each critiquing the hypothesis on its own — the score rewards genuine disagreement and discounts consensus.

Gemini: 5/10 Strengths: The hypothesis is highly falsifiable, clinically relevant, and directly addresses the critical limitation identified in the literature regarding the inability of semantic segmentation to track instance-level lesion correspondences over time. Weaknesses: While conceptu...
Mistral: The hypothesis is well-grounded in topological data analysis and addresses a clear gap in longitudinal MS lesion tracking, but its predictive superiority over conventional models lacks direct empirical validation in the provided experiments, and potential counterarguments (e.g., computational com...
ChatGPT: The hypothesis is falsifiable, but the cited work supports only the general feasibility of longitudinal lesion tracking and homology-based morphometry—not superior prediction of spinal-cord lesion merging/splitting. The owner’s validated experiments are unrelated, and the claim needs a prespecifi...
Claude: The hypothesis is falsifiable in principle and draws on a coherent conceptual bridge between persistent homology and lesion topology, but it is almost entirely unsupported by the owner's validated experiments (which concern numerical precision and drug-discovery BO, with zero relevance to spi...

Supporting Research Papers

Formal Verification

Z3 logical consistency:✅ Consistent

Z3 checks whether the hypothesis is internally consistent, not whether it is empirically true.

Experimental Validation Package

This discovery has a Claude-generated validation package with a full experimental design.

Precise Hypothesis

In patients with multiple sclerosis undergoing serial spinal cord MRI (≥3 timepoints, ≥6-month total follow-up), a persistent-homology feature vector computed from binarized/probabilistic lesion segmentation masks — specifically Betti-0 (connected components), Betti-1 (loops/handles), and their persistence-diagram summary statistics (birth-death lifetimes, total persistence, Wasserstein/bottleneck distances between consecutive timepoints) — will predict the occurrence of a lesion merge or split event at the subsequent timepoint (binary label, defined via voxelwise component-correspondence tracking) with a higher cross-validated AUROC than a baseline model using only volumetric/semantic-segmentation change features (total lesion volume, per-lesion volume delta, count of new/resolved lesions). The claim is falsifiable: it specifies the comparator model, the outcome definition, the feature class, and requires a pre-registered statistical test (DeLong test or bootstrap CI comparison) on held-out patients.

Disproof criteria:
  • Cross-validated AUROC(topology model) is not statistically greater than AUROC(volume model) at α=0.05 (one-sided DeLong test), or the point estimate is lower.
  • Effect size (ΔAUROC) <0.03 even if nominally significant — pre-specified as a minimum clinically meaningful margin, below which the claim is considered practically disproven despite statistical significance.
  • Topology features add no incremental predictive value in a combined model (likelihood ratio test p>0.05 for nested model comparison, topology features added to volume baseline).
  • Results fail to replicate in an independent external cohort (second dataset) with ΔAUROC crossing zero or sign-flipping.
  • Betti number instability: persistence diagrams show >30% feature-value variance under segmentation-noise perturbation (bootstrap resampling of mask boundary), indicating the signal is a segmentation artifact rather than genuine topological signal.

Spine & Adversarial ReadReady for validation

“This hypothesis tests whether persistent-homology-derived Betti number features of spinal cord MRI lesion masks predict future lesion merge/split events with higher cross-validated AUROC than conventional lesion-volume-change features.”

  • highWhy persistent homology specifically, and why Betti numbers/persistence diagrams rather than simpler shape descriptors (e.g., surface curvature, fractal dimension, lesion eccentricity) that could capture similar morphological complexity at far lower computational and interpretive cost? The methodology choice is asserted, not justified against simpler alternatives.
    This EVP does not yet include a head-to-head ablation against simpler shape-descriptor baselines (curvature, eccentricity, surface-area-to-volume ratio). This is a genuine gap: Step 12 (combined-model ablation) should be extended to include a 'simple shape features' arm, not only volume vs. topology, before the novelty claim that topology specifically (not just 'more shape information') drives the improvement can be defended.
  • highMerge/split events as detected by component tracking are themselves highly sensitive to the IoU correspondence threshold and segmentation mask quality — the outcome label and the predictor (persistence diagrams, also computed from the same masks) are not independent, risking circularity where topology features trivially predict merge/split because both are mechanically derived from the same noisy mask boundaries.
    Partially addressed by the mask-perturbation stability analysis (Step 11, success criterion of <15% CV), but this only tests robustness, not circularity. A stronger test would use independent raters/segmentation pipelines for label generation (ground-truth merge/split adjudicated by a different method/rater than the one generating topology features) — this is not currently specified and should be added as a required protocol amendment.
  • mediumSample size and event rarity: with only 60-80 patients and likely <20-30 true merge/split events, the study is statistically underpowered to detect a ΔAUROC of 0.03-0.05 with adequate confidence, and the pre-specified success threshold may be met by chance in a small, high-variance sample.
    Acknowledged via the abort checkpoint (Day ~30, <15 events triggers abort) and the mandatory Phase B external replication requirement before any claim is treated as validated. However, no formal power calculation is included in this package; one should be computed (given assumed baseline AUROC ~0.65, target AUROC ~0.70, expected event count) before Phase A is funded, to confirm n=60-80 is adequate rather than assumed.

Experimental Protocol

Minimum viable test (Phase A, n≈60–80 patients, retrospective):

  1. Acquire longitudinal spinal cord MRI + existing lesion segmentations from one public/consortium dataset.
  2. Compute ground-truth merge/split labels via component-tracking across timepoints (connected-component relabeling + IoU-based correspondence, threshold IoU<0.3 triggers manual adjudication).
  3. Extract (a) volumetric features (11-dim: total volume, lesion count, per-lesion volume vector stats, volume-change rate) and (b) persistent homology features (cubical complex filtration on signed-distance-transformed masks; Betti-0/1 curves sampled at 50 filtration steps; persistence image vectorization, 20×20 grid → 400-dim, PCA-reduced to 20 components).
  4. Train/evaluate both feature sets with identical classifier family (logistic regression + gradient-boosted trees) under nested 5-fold patient-level cross-validation (no patient leakage across folds).
  5. Compare AUROC via DeLong test; report 95% CI via 1000-iteration bootstrap.
  6. Pre-register hypothesis, feature definitions, and primary endpoint before unblinding test folds.

Full validation (Phase B): repeat on independent external cohort (different scanner/site), n≥150, with prospective-style held-out lock-box evaluation.

Required datasets:
  • Primary: A longitudinal spinal cord MRI MS cohort with ≥3 timepoints per patient — candidates: NIH/NINDS MS natural history cohorts, University of Basel/NYU longitudinal spinal MS datasets, or OFSEP (French MS registry) spinal cord sub-studies. None of these are confirmed accessible in this package — acquisition/DUA negotiation is a required first step and is costed separately below.
  • Segmentation ground truth: expert manual annotations or validated automated pipeline (SCT — Spinal Cord Toolbox; nnU-Net spinal lesion model).
  • Compute environment: Python 3.10+, GUDHI or Ripser++ (persistent homology), Spinal Cord Toolbox (SCT v6+), scikit-learn, PyTorch (if CNN segmentation needed), MONAI.
  • External replication dataset: second independent site/scanner cohort — required for Phase B, not yet identified/confirmed.
  • No GPU-heavy foundation model training is intrinsically required unless segmentation masks must be generated from raw DICOM (adds nnU-Net training/inference cost).
Success:
  • Phase A: AUROC(topology) − AUROC(volume) ≥ +0.05, DeLong p<0.05, bootstrap 95% CI for ΔAUROC excludes 0.
  • Combined model LR test shows topology features contribute significant incremental value (p<0.05) beyond volume alone.
  • Topology feature stability: <15% coefficient-of-variation under segmentation perturbation bootstrap.
  • Phase B (external replication): ΔAUROC ≥ +0.03 with same-direction effect, p<0.05, in independent cohort.
  • Calibration: Brier score of combined/topology model not worse than volume-only model by >0.02.
Failure:
  • ΔAUROC ≤0 or not significant in Phase A → hypothesis disproven at MVP stage, no Phase B.
  • ΔAUROC significant in Phase A but fails to replicate (crosses zero, CI overlaps substantially) in Phase B → hypothesis unsupported/overfit, publish as negative result.
  • Topology features show >30% instability under mask perturbation → signal attributed to segmentation noise, not genuine biology; disproof of mechanistic interpretation even if raw AUROC looks favorable.
  • Insufficient merge/split events in available cohort (<15 positive events total) → study underpowered, inconclusive (not disproof, but abort/redesign trigger).

180

GPU hours

150d

Time to result

$45,000

Min cost

$240,000

Full cost

ROI Projection

Commercial:

Moderate-to-high if proven: licensable as a software module (post-processing add-on to existing MS lesion segmentation pipelines, e.g., integrated into SCT or commercial neuro-radiology AI platforms). Addressable market includes neuroimaging CRO/biotech sponsors running MS trials (dozens of active MS Phase 2/3 trials industry-wide) and radiology AI vendors seeking differentiated biomarker features. Realistic commercial value range: $3–15M in licensing/platform-integration value over 5 years if validated and regulatory-pathway (SaMD) feasibility is established; this is a research-tool/biomarker opportunity, not a therapeutic, so valuation ceiling is substantially lower than the drug-target discoveries in the accompanying transcriptomics portfolio.

🔓 If proven, this unlocks

Proving this hypothesis is a prerequisite for the following downstream discoveries and applications:

  • 1topo-ms-brain-lesion-generalization-001
  • 2topo-trial-enrichment-biomarker-002
  • 3topo-ms-treatment-response-monitoring-003

Prerequisites

These must be validated before this hypothesis can be confirmed:

  • none — this hypothesis is self-contained and does not require prior validation of other discoveries in this portfolio

Implementation Sketch

# Phase A pipeline (pseudocode)

for patient in cohort:
    scans = load_longitudinal_MRI(patient)  # T2/PSIR, ≥3 timepoints
    scans = harmonize(scans, N4_bias_correct, resample_iso_0.8mm, SCT_crop_cord)

    masks = []
    for t in scans:
        mask_t = existing_expert_mask(t) or nnUNet_infer(t)
        qc_check(mask_t, dice_threshold=0.7)
        masks.append(mask_t)

    components = track_components(masks)   # IoU-based correspondence across t
    events = label_merge_split(components) # binary per lesion-pair per transition

    vol_features = []
    topo_features = []
    for t, mask_t in zip(scans, masks):
        vol_features.append(extract_volumetric(mask_t))
        sdt = signed_distance_transform(mask_t)
        pd = cubical_persistence(sdt, lib="GUDHI")   # persistence diagram
        pi = persistence_image(pd, grid=20x20)
        betti_curve = betti_numbers_over_filtration(pd, steps=50)
        topo_features.append(concat(pi.flatten(), betti_curve, pd_summary_stats(pd)))

    store(patient, vol_features, topo_features, events)

# Modeling
X_vol, X_topo, y = assemble_dataset(all_patients, horizon="next_timepoint")
split = PatientLevelStratifiedKFold(n_splits=5, stratify_on=y)

for model_class in [LogisticRegression, GradientBoostedTrees]:
    auc_vol  = nested_cv_eval(model_class, X_vol, y, split)
    auc_topo = nested_cv_eval(model_class, X_topo, y, split)
    auc_comb = nested_cv_eval(model_class, concat(X_vol, X_topo), y, split)

delong_test(auc_topo_preds, auc_vol_preds, y)
bootstrap_CI(auc_topo - auc_vol, n_iter=1000)
likelihood_ratio_test(auc_comb_model, auc_vol_model)  # incremental value of topology

# Stability/sensitivity
for perturbation in [dilate(1vx), erode(1vx), remove_small_components(thresh)]:
    masks_perturbed = apply(perturbation, masks)
    topo_features_perturbed = recompute_topology(masks_perturbed)
    cv_stability = coefficient_of_variation(topo_features, topo_features_perturbed)
Abort checkpoints:
  1. After cohort identification (Day ~30): if <15 total merge/split events exist in accessible data, abort or redesign (underpowered).
  2. After segmentation QC (Day ~60): if mean Dice <0.7 vs. expert raters and cannot be improved, abort — unreliable topology computation downstream.
  3. After stability analysis (Day ~100): if topology feature CV >30% under mask perturbation, treat as high risk of artifact; do not proceed to claim disproof-resistant result without resolving this first.
  4. After Phase A primary analysis (Day ~150): if ΔAUROC <0.03 or not significant, abort Phase B — do not spend external-replication budget on an unsupported MVP result.

Source

AegisMind Research
Need AI to work rigorously on your problems? AegisMind uses the same multi-model engine for personal and professional use. Get started