Blinded comparison: holdout vs OpenScientist (NF042963 / DUF1156)

Blinded comparison: holdout vs OpenScientist (NF042963 / DUF1156)

Compares HOLDOUT-prediction.md (recorded before the run, from InterPro/UniProt)
against openscientist.md (structure-based, blinded to the mechanism), plus a
family-wide check run afterward to adjudicate the one disagreement.

Agreement (both, high confidence)

Disagreement: target base (m4C vs m6A) — the interesting part

Holdout (annotation) OpenScientist (structure)
Target base N6-adenine (m6A) N4-cytosine (m4C)
Basis InterPro IPR014455 "DNA methylase, N-6 adenine-specific"; UniProt names "Adenine-specific DNA methylase" Foldseek top hits M.MjaII/M.MvaI/M.AvaI all m4C (EC 2.1.1.113), prob 1.0

Adjudication (family-wide, 151 members, 2026-07-18): 19 named "adenine", 0
named "cytosine"; 2 carry IPR014455 (N6-adenine). Every base-specificity signal in
the family points to adenine (m6A), none to cytosine. Foldseek cannot
distinguish m6A from m4C — the two amino-MTase classes share the same β-class fold
and the DPPY motif (OpenScientist's own Limitation #5). So the confident m4C call is
an over-reach from single-representative fold-matching; the family evidence favors
m6A, matching the holdout. Net: base genuinely UNDECIDED, leaning m6A.

What the run genuinely ADDED beyond the holdout

GO consequences