SpongeScope v1
a fast AI model for predicting lncRNA–miRNA interactions
2 min readupdated
This compact model from sawcheet predicts whether a long non-coding RNA (lncRNA) interacts with a microRNA (miRNA). Under the hood, a lightweight 697,857-parameter architecture uses cross-attention (a mechanism that aligns context across two inputs) between candidate binding-site context and the miRNA sequence. Unlike traditional methods that often inflate accuracy by relying on simple sequence matches, the model was rigorously evaluated on hard negatives and unseen RNA clusters. It runs on a CPU in roughly 5 ms per pair once the lncRNA embedding is cached, making it practical for bioinformaticians shortlisting candidates ahead of wet-lab experiments.
Key features
- Compact footprint: just 697,857 parameters and ~5 ms CPU inference per pair with a cached lncRNA representation.
- Strict cold-start validation: test lncRNAs do not overlap with training clusters under MMseqs2 (80% sequence identity threshold), and 10% of miRNA families are completely held out from training.
- Honest dataset: trained on 15,962 pairs from ENCORI CLIP alongside hard negatives (an ~8:1 ratio, half of which share a 7mer-site match without actual CLIP support).
- Transparent limitations: the author explicitly documented negative experiments—adding tissue expression data and individual site labels did not improve pair-level predictions.
What you can do
- Rank lncRNA–miRNA pairs to prioritize wet-lab validation (testing the top 10 candidates yields roughly 2.7 true interactions compared to 1 with random selection).
- Use the built-in deterministic splits and bootstrap-interval evaluation module as a standardized benchmark for your own RNA-interaction models.
- Run large-scale candidate interaction screening on a standard CPU without renting GPU compute.
Example
The model card does not include an inference snippet, but outlines the evaluation workflow: the model takes a long non-coding RNA (from GENCODE 50 transcripts) paired with a mature microRNA sequence (from miRBase), computes an interaction score via cross-attention over candidate binding sites, and outputs a ranked list of pairs. On the cold lncRNA split, it reaches an AUROC of 0.841 and precision@10 = 0.274.
Read more
DetailsTest metrics: cold lncRNA — AUROC 0.841 (AUPR 0.303, ECE 0.009); seed-controlled — AUROC 0.753 (AUPR 0.312); cold lncRNA + miRNA — AUROC 0.853 (AUPR 0.297).
Baseline comparison: gradient boosting on the same features scores 0.824 AUROC; cross-attention adds roughly 0.025 AUPR (though no statistically significant AUPR gain was observed across the 149 test lncRNAs).
Hardware: runs comfortably on a standard CPU (~5 ms per pair after caching the lncRNA embedding).
Limitations: intended solely for ranking candidates prior to experiments; it does not replace wet-lab validation and is not calibrated for clinical diagnostics.










Comments