Persistent homology of the whole lesion set: H0 persistence of the multiple sclerosis lesion cloud across a distance filtration, so the death times are inter-lesion distances, predicts which lesions merge or split between baseline and follow-up MRI. The hypothesis is falsified if this H0 feature set does not beat a nearest-neighbour inter-lesion-distance baseline (AUROC difference of at least 0.05) on a held-out longitudinal cohort of at least 100 patients, because H0 death times of a point cloud are the edge lengths of its minimum spanning tree and may add nothing beyond local distances.
Adversarial Debate Score
65% survival rate under critique
Expert panel critique
Independent views, each critiquing the hypothesis on its own — the score rewards genuine disagreement and discounts consensus.
Supporting Research Papers
- Longitudinal tracking of multiple sclerosis lesions in the spinal cord: A validation study
Longitudinal characterization of multiple sclerosis (MS) lesions remains constrained by the lack of frameworks capable of establishing consistent instance-level correspondences across time. Convention...
- Homology-based Morphometry of Brain Atrophy: Methods and Applications
Understanding the structure of the brain, and how it changes with time and disease, is a core goal of structural neuroimaging. Contemporary approaches to structural brain analysis are dominated by vox...
- Seeing Beyond the Lesion: Disease Recognition from Reactive CNS Tissue
Sampling error yields exclusively reactive, non-lesional brain parenchyma in a significant proportion of intracranial biopsies, leaving the underlying disease undiagnosed. We benchmark four pathology ...
- Topology of Multi-species Localization
Spatial relationships in multi-species data can indicate and affect system outcomes and behaviors, ranging from disease progression in cancer to coral reef resilience in ecology; therefore, quantifyin...
- Attention-Based Segmentation of WMHs and Differentiation of Vascular vs. Demyelinating Lesions
White Matter Hyperintensities (WMHs) are commonly observed in brain Magnetic Resonance Imaging (MRI) scans. They are associated with various neurological conditions, including vascular and inflammator...
Formal Verification
Z3 checks whether the hypothesis is internally consistent, not whether it is empirically true.
This discovery has a Claude-generated validation package with a full experimental design.
Precise Hypothesis
In longitudinal brain MRI of multiple sclerosis patients, treating each segmented lesion (or lesion-voxel centroid) at baseline as a point in 3D space, the H0 (connected-component) persistence barcode of a distance-based Vietoris-Rips/Čech filtration over the full lesion point cloud — whose death times equal the pairwise inter-lesion distances realized in the minimum spanning tree (MST) of that cloud — contains features (e.g., persistence entropy, number of bars below threshold d, bar-length distribution statistics) that, when added to a predictive model, improve AUROC by ≥0.05 over a baseline using only raw nearest-neighbor inter-lesion distances, for the binary classification task "will lesion i merge with or split from its baseline identity by follow-up timepoint t" — evaluated on a held-out cohort of ≥100 patients not used in training.
- ΔAUROC (H0-augmented model vs. NN-distance baseline) < 0.05 on held-out cohort (n≥100), with 95% CI excluding 0.05 in a bootstrap test (n=2000 resamples).
- ΔAUROC ≥0.05 only in training/cross-validation but not replicating on an independent external cohort (generalization failure).
- Feature importance analysis (SHAP/permutation) shows H0-derived features contribute ≤5% of total predictive signal relative to baseline distance features — i.e., statistically significant but practically negligible.
- Effect sizes attributable entirely to confounds (lesion count, lesion volume, disease duration) that, when adjusted for via stratification or as baseline covariates, eliminate the ΔAUROC.
Spine & Adversarial ReadReady for validation
“This hypothesis tests whether H0 persistent-homology features of the inter-lesion distance filtration on longitudinal MS MRI improve merge/split prediction AUROC by at least 0.05 over a nearest-neighbor-distance-only baseline on a held-out cohort of 100+ patients.”
- highH0 death times are mathematically just the edge weights of the minimum spanning tree of the point cloud — any summary statistic of the MST (e.g., max edge, mean edge, edge-length variance) is already captured by 'smarter' distance baselines than plain nearest-neighbor distance. Comparing only to NN-distance (not MST-statistics) sets up a weak baseline and risks a false positive attributed to topology when it's really just 'better distance features.'The protocol as specified only partially addresses this: Step 8 baseline includes mean/std of pairwise distances, which overlaps with MST summary stats but is not identical to MST-edge-length statistics. A stronger version of this EVP should add an explicit MST-feature baseline as a second comparison arm; as written, a pass against NN-distance-only does not yet rule out that MST summary statistics alone (without full persistence formalism) achieve the same AUROC gain. This gap is acknowledged, not resolved.
- highThe correspondence/ground-truth labeling of 'merge' vs 'split' between timepoints is itself typically defined using spatial overlap or distance thresholds — if the label generation process uses distance-based heuristics, then NN-distance features are mechanically correlated with the label by construction, while H0 features are a nonlinear transform of the same underlying distances. Any AUROC gain could reflect the model exploiting labeling artifacts rather than a genuine topological signal.Partially addressed via radiologist adjudication on a 20-30 patient subsample (kappa check), but this subsample is small relative to the full cohort (n=100-300) and does not eliminate label-construction circularity for the remaining ~90% of automatically-labeled data. A full resolution would require either (a) 100% radiologist-adjudicated labels (costly, likely +$30-50K), or (b) a label-generation method provably independent of both candidate feature sets (e.g., using volumetric overlap only, explicitly excluding centroid distance). This should be added as a protocol amendment before execution.
- mediumWhy Vietoris-Rips H0 specifically, and why not graph neural networks on lesion adjacency graphs, or simpler engineered features (lesion count, total volume, spatial spread/convex hull volume) as competing baselines? The methodology does not justify why persistent homology is the right tool versus a simpler geometric summary (e.g., convex hull volume, Ripley's K-function for spatial clustering) that could achieve similar discriminative power with far less computational and conceptual overhead.Not resolved in current design. The EVP should add a geometric-baseline arm (convex hull statistics, Ripley's K, k-means cluster count) alongside the NN-distance and MST baselines, both to strengthen the falsification test and to pre-empt reviewer rejection on 'why this method' grounds. Until added, a positive result is vulnerable to the critique that a far cheaper spatial statistic could have achieved the same gain.
Experimental Protocol
Minimum viable test (MVT):
- Cohort: n=100 patients minimum (held-out test), n≥300 total recommended (train/val/test 60/20/20) with paired baseline + ≥1 follow-up 3D FLAIR/T1-Gd scans.
- Pipeline: (1) lesion segmentation → centroid extraction; (2) build point cloud per timepoint; (3) compute H0 persistence diagram via Vietoris-Rips filtration (GUDHI/Ripser); (4) derive feature vector (persistence entropy, total persistence, bar-count histogram at k thresholds, Betti curve summary stats); (5) compute NN-distance baseline features (min, mean, std of nearest-neighbor distances per lesion); (6) label each baseline lesion as "merged," "split," "stable," or "resolved" by matching to follow-up lesion mask via deformable registration + overlap/centroid-tracking heuristic (ground truth defined by radiologist-adjudicated correspondence on a 20-patient subsample, kappa≥0.75 required); (7) train logistic regression + gradient-boosted tree (XGBoost) classifiers on (a) baseline-only features, (b) H0+baseline features; (8) compare AUROC with DeLong test and bootstrap CI.
- Pre-registration of exact feature set and classifier hyperparameters before touching test set (lock file in repo, hash-committed).
- Longitudinal MS MRI cohort with ≥100 patients, ≥2 timepoints, lesion masks (manual or validated automated, e.g., nnU-Net segmentations). Candidates: OFSEP (France, >10,000 patients longitudinal), MSSEG-2 challenge data, ADNI-adjacent public MS datasets, or a private trial imaging archive (e.g., from a completed phase 3 DMT trial with serial MRI — common in industry data-sharing requests, e.g., Novartis/Biogen MRI repositories via Vivli/YODA).
- Expert-adjudicated lesion correspondence subsample (n=20–30 patients) for ground-truth merge/split labeling validation.
- Registration pipeline: ANTs or FSL FLIRT/FNIRT for baseline→follow-up alignment.
- Software: GUDHI, Ripser++, scikit-TDA, XGBoost, scikit-learn, statsmodels (DeLong test implementation).
- Compute environment: single-node GPU for segmentation inference (if using deep learning segmentation, e.g., nnU-Net); CPU cluster for persistent homology computation (CPU-bound, not GPU-bound).
- Primary: ΔAUROC ≥0.05 (H0-augmented vs. NN-distance baseline) on held-out cohort (n≥100), bootstrap 95% CI lower bound >0.03, DeLong p<0.05.
- Secondary: H0 features retain ≥10% relative SHAP importance share in combined model.
- Tertiary: Effect replicates (ΔAUROC ≥0.03) on an independent external cohort.
- Ground-truth labeling reliability: kappa ≥0.75 between automated correspondence and radiologist adjudication.
- ΔAUROC <0.05 or CI includes 0 → hypothesis falsified as stated.
- ΔAUROC ≥0.05 in-sample but <0.03 on external validation → non-generalizable, treat as failure for clinical deployment purposes.
- Ground-truth correspondence labeling kappa <0.6 → entire label set unreliable, experiment inconclusive (not a valid test either way), must fix before re-running.
- H0 feature contribution attributable to lesion count/volume confound after covariate adjustment (ΔAUROC drops below 0.05 when stratified) → mechanistic claim fails even if raw ΔAUROC passes.
180
GPU hours
150d
Time to result
$45,000
Min cost
$165,000
Full cost
ROI Projection
Moderate-to-high if proven: addressable market is MS imaging CRO services (~$150-300M/year global MS trial imaging analytics spend) plus potential FDA-qualified biomarker status (Drug Development Tool pathway) which would be a durable competitive moat. Negative or marginal result still has publishable value (rigorous negative benchmarking of TDA vs. simple baselines is citable methods literature). Platform-level reusability: the H0-on-point-cloud approach generalizes to any multifocal lesion disease (liver mets, lung nodules) — a positive result opens a broader TDA-in-radiology product line.
🔓 If proven, this unlocks
Proving this hypothesis is a prerequisite for the following downstream discoveries and applications:
- 1topology-informed-lesion-tracking-clinical-trial-endpoint
- 2persistent-homology-biomarker-for-DMT-response
- 3generalized-TDA-framework-for-other-lesion-based-diseases
Implementation Sketch
# Phase A: data prep for patient in cohort: seg_base, seg_fup = segment_lesions(mri_base), segment_lesions(mri_fup) seg_fup_reg = register(seg_fup, target=mri_base) # ANTs SyN centroids_base = extract_centroids(seg_base) centroids_fup = extract_centroids(seg_fup_reg) labels = match_correspondence(centroids_base, centroids_fup) # merge/split/stable/new # Phase B: feature extraction def h0_features(points): rips = gudhi.RipsComplex(points=points, max_edge_length=T_max) st = rips.create_simplex_tree(max_dimension=0) diag = st.persistence() return { 'entropy': persistence_entropy(diag), 'total_persistence': sum(death-birth for (b,death) in diag), 'bar_hist': histogram_bars(diag, bins=[5,10,20,40]), # mm 'betti0_auc': betti_curve_auc(diag) } def nn_baseline_features(points): D = pairwise_distances(points) return {'nn_dist': D.min(axis=1), 'mean_dist': D.mean(), 'std_dist': D.std()} X_baseline = [nn_baseline_features(p) for p in all_patients] X_full = [concat(nn_baseline_features(p), h0_features(p)) for p in all_patients] y = labels # binary: merge_or_split vs stable # Phase C: model + eval model_base = XGBClassifier().fit(X_baseline_train, y_train) model_full = XGBClassifier().fit(X_full_train, y_train) auc_base = roc_auc_score(y_test, model_base.predict_proba(X_baseline_test)) auc_full = roc_auc_score(y_test, model_full.predict_proba(X_full_test)) delong_test(auc_base, auc_full) # significance bootstrap_ci(auc_full - auc_base, n=2000)
- After Step 5 (ground-truth labeling): if kappa <0.6 between automated and radiologist correspondence, halt and fix labeling before any model training (estimated checkpoint: day 30).
- After Step 10 (initial CV on training set): if ΔAUROC in cross-validation is <0.02 (far below target), halt before incurring external validation cost (day 75).
- After Step 11 (held-out test): primary endpoint evaluation — go/no-go for external validation cohort acquisition (day 110).