Alcyone-W
an AI model at the intersection of particle physics, topology, and Lean 4
3 min read
Researcher Teerth Sharma has introduced an experimental AI model called Alcyone-W — the first architecture in the JEPA family (Joint-Embedding Predictive Architecture — AI models that predict the hidden part of input data) that restores not abstract embeddings, but the exact topology of a hidden region. The model works with CMS detector particle collision data (CERN Open Data): it turns particle momenta into a 32×64 grid landscape, masks a fragment of it, and predicts the number of energy "lakes", their persistence, and volume. The system combines a trainable 5.9-million-parameter W-JEPA convolutional encoder and a frozen scientific language model facebook/galactica-6.7b (6.66 billion parameters), which converts textual particle descriptions into additional terrain channels. Unlike classical JEPAs, target metrics here are calculated strictly mathematically using algorithms formally proven within the Lean 4 verification system. This development will interest researchers in physical ML, topological data analysis, and neuro-symbolic AI.
Key features
- Topological targets without training collapse: the model predicts the number of basins (
basins), their persistence (persistence), and energy volume (water), which are computed via an exact hydraulic algorithm without relying on an unstable teacher network. - A hybrid of vision, language, and formal logic: the frozen Galactica-6.7B encodes textual descriptions of particles (such as muons and jets) via PCA into 8 terrain channels, while 1,818 lemmas in Lean 4 and Haskell guarantee calculation correctness.
- Built-in agent with numerical verification: the repository includes a runtime for Galactica with 4 tools (
watershed,charge,describe,calc) that forces the model to call tools and flags any numbers not backed by code. - Honest limitations reporting: the author published all pre-specified verification criteria — for example, noting that a standard MLP using kinematics is still more accurate on jet multiplicity tasks, and that the charge channel is absent in the current version.
What you can do
- Reproduce LHC data experiments: run the ready-made script on the provided sample of 512 test CMS NanoAOD events and compare topology predictions with exact calculations.
- Explore formally verified ML: use the
WatershedLemmaslibrary in Lean 4 and Haskell mirrors with QuickCheck tests as an example of integrating theorem proving into a machine learning pipeline. - Test the neuro-symbolic agent: ask questions about collision event properties via
agent.py, where computations rely on Gauss's law and hydraulic lemmas instead of LLM hallucinations.
Example
import sys; sys.path.insert(0, "code")
from alcyone import WatershedJEPA, exact_summary, window_mask
m = WatershedJEPA(".", galactica="facebook/galactica-6.7b")
z = m.encode(x) # x: (N, 15, 8) [pT, eta, phi, mass, charge, type, btag, valid]
win = window_mask(12, 24, len(x))
pred = m.predict_summary(x, win)
true = exact_summary(x, win)
Read more
DetailsBasin count accuracy on 512 CMS events: 0.945 (vs 0.572 when picking the most frequent class) and 0.936 on 4,096 validation windows.
Trained on 2.24 million CMS Open Data events (38,155 steps); Galactica-6.7B weights (CC BY-NC 4.0) are not included in the repository and must be downloaded separately.
Limitations: the model is strictly tailored to the CMS NanoAOD format, partially "peeks" through the edges of the hidden window, and does not account for particle electric charge in the terrain.










Comments