Bgee expression as evidence: explaining, corroborating and contesting function

IN_PROGRESS PIPELINEEVALUATION

Species: human, mouse

Genes: PAX6 G6pc2 Pax4 ATOH1 OLIG2 MITF GCG CRYAA G6PC1 G6PC3 ACTL8 AGFG1 AGFG2 GBX2 FGF8 PTF1A RORA RELN SHH SMO FBXO41 DNER PTPN11 EN1 EN2

Bgee expression as evidence

Bottom line: Bgee expression is a useful consistency check on GO
annotations but a poor discriminator between good and bad ones. It becomes
real evidence only where something controls for what the data cannot see:

We joined Bgee 15.2 calls to 12,080 reviewed human annotations whose GO term names an anatomy (via go-plus logical
definitions such as eye development results_in_development_of eye). The
term's anatomy is among the gene's top-10% tissues for 46% of ACCEPT rows,
against 26% for the same terms paired with a random gene. So annotations and
expression agree well beyond chance. But MARK_AS_OVER_ANNOTATED rows are just
as concordant (43%): expression in a tissue does not make a gene act there,
which is the old lesson of IEP in numbers. Absence carries the signal people
hope for, but only after four predictable artifacts are screened out:

Once those are screened, true absence is rare (0.5% of ACCEPT rows that have data,
1.3% by chance). The project's positive results are the three controlled
designs. G6PC1, G6PC2 and G6PC3 all inherit gluconeogenesis from one PAINT
node, but only G6PC1's top tissues fall where the satisfiability engine says
gluconeogenesis can run. AGFG2 and ACTL8 are absent from the anatomy of an
inherited IBA term in which their sister paralog is detected. And the
cerebellum-development module switches on in a staggered wave that broadly
follows module order. The wave also exposes two module-modelling issues and two
gaps in the Cell Ontology. Full reviews of mouse G6pc2 and Pax4, the two
strongest paralog leads, removed the inherited gluconeogenesis, brain and
forebrain terms and marked the retina terms as over-annotations. In both,
expression was one supporting line among phylogeny, phenotype and literature,
never the deciding one. The Pax4 review also traced an expression-only (IEP)
rat annotation into both an orthology projection and a PAINT seed.

Contents

Why expression, and why carefully

PAX6 is expressed in the eye, and that should be explainable by what PAX6
does. Expression has also been abused in GO: IEP annotations turn "transcript
changes in condition X" into "involved in X". The question here is narrower.
Can expression add weight to other evidence in clear cases? And can it lend
evidence against a function, for example against a paralog inheriting a
function by phylogenetic propagation? The project tests three uses:

  1. Explain a gene's expression by its reviewed functions, and find top
    tissues that no function explains.
  2. Corroborate or contest an annotation, calibrated against the
    decisions reviewers have already made in this repository, and sharpened by
    comparing paralogs below the PAINT node (PTN) that propagated the term.
  3. Time a developmental module, extending
    pathway satisfiability from "can this pathway
    run in this tissue?" to "is each step's gene on, where the step acts, when
    it acts?". This uses the cerebellum development module.

How it works

Whole-body samples never count as containers.
- Tiers.
- ENRICHED: present, and the anatomy is in the gene's own top 10%.
- CONSISTENT: present, but not enriched.
- ABSENT: Bgee has calls in or around the anatomy, all absent.
- NO_DATA: Bgee has nothing there.
- Labelled absences that are uninformative: developmental term with
stage-merged data; regulator; extracellular or ligand product; quiescent
target cell.
- Data. Bgee 15.2 per-species "simple" call files, which hold present
and absent calls merged over stages, for the corpus. The Bgee REST API
supplies stage-resolved present calls and OMA orthologs. PANTHER 19 trees give
PTN clades. Details are in Methods & reproduction.

Results

1. Explaining a gene's expression by its functions

For 1,618 human genes with at least one retained anatomy-bearing annotation,
an average of 18.0% of their top-10 Bgee tissues are explained by a retained
annotation, against 10.7% when scored with another gene's annotations. For the
single top tissue the rates are 19.6% and 11.1%. Most explanations are broad.
Brain development explains a cerebellum sample, for example, and only 4.2%
(2.0% shuffled) are explained by a target no larger than about 500
anatomical classes. Per-gene tables are in
tissue_explanation_cases.md.

The G6PC1 case is instructive. Its top tissues are exactly where the
satisfiability engine finds gluconeogenesis
satisfiable, yet no GO anatomy can say so. Explaining expression by a
metabolic function needs the module's context, not the GO term.
- Only 187 of 16,034 top tissues (1.2%) would be explained by a row the
reviewers rejected. Reviewers are not discarding annotations that expression
supports.

2. Calibration against reviewers' decisions

Share of anatomy-bearing annotations whose anatomy is among the gene's top-10% Bgee tissues, by reviewer action, with the shuffled rate as a reference tick

Figure 1. Real gene–term pairs (bars) are concordant with expression well
above chance (dashed tick: same terms, random gene). But
MARK_AS_OVER_ANNOTATED rows are as concordant as ACCEPT rows, and REMOVE rows
nearly so. Generated by scripts/figures.py from results/corpus_calibration.yaml.

rejected rows retained rows ratio (95% CI)
ENRICHED, all evidence 349/827 3157/7647 1.02 (0.94–1.11)
ABSENT before screening, all evidence 36/827 293/7647 1.14 (0.81–1.59)
ABSENT before screening, IBA 4/34 30/670 2.63 (0.98–7.03)
ABSENT before screening, ISS/ISO/ISA 9/157 47/1723 2.10 (1.05–4.21)
ABSENT after screening, all evidence 6/827 26/7647 2.13 (0.88–5.17)
ABSENT after screening, IBA 2/34 3/670 13.1 (2.3–76)

Rejected = REMOVE or MARK_AS_OVER_ANNOTATED; retained = ACCEPT or
KEEP_AS_NON_CORE; rows with no Bgee data excluded. Source:
results/corpus_calibration.yaml.

Presence is not evidence that a function is real: the ENRICHED ratio sits on 1.0.
Absence leans toward rejection for inferred annotations (IBA, ISS), but most
raw absences are artifacts. The table below lists the four failure modes. The
classifier screens each one, and 111 of the 119 absent rows on retained
experimental annotations fell into one of them. The screened IBA ratio is
large, but it rests on five rows (2 rejected, 3 retained), so read it as a
direction, not an effect size.

failure mode example from the corpus screen
regulator acts on another cell positive regulation of endothelial cell proliferation (13 retained experimental rows) anatomy reached only via regulates
secreted / ligand product CCL11 eosinophil chemotaxis, GDF2 ossification gene annotated extracellular (not exosome/vesicle) or receptor ligand
quiescent target cell sperm flagellum and acrosome terms (sperm carry spermatid-made protein) sperm, erythrocyte, platelet
developmental term, adult data ATOH1, NEUROG1/2 sensory organ development term under developmental process

A fifth failure mode is not screened: rare cells diluted in bulk tissue, or
low-sensitivity single-cell samples. Examples are hair-cell genes (CABP2,
GRXCR2) where the cochlea is not sampled, and ubiquitous MYH9 and PGAM2 read as
absent in oocyte samples. Such cases make up most of the 17 remaining
leads, so treat those leads as
prompts to check, not as findings.

3. Paralogs at the PTN level: the sister as a positive control

An absent call says little on its own. A sister paralog below the same PAINT
node that is detected in that anatomy shows that the anatomy was sampled and
that the assay could see a family member there. That makes the absence a
comparison rather than a missing value.

G6PC (PTHR12591, node PTN000971890). The node propagates gluconeogenesis.
GO gives gluconeogenesis no anatomy, so the context is where the
gluconeogenesis module is satisfiable: liver, kidney cortex and small intestine.

gene top tissue top-10 tissues in context (chance) breadth (share of sampled entities present)
human G6PC1 liver (98) 5/10 (1.8) 0.27
human G6PC2 islet of Langerhans (99) 2/10 (0.9) 0.67
human G6PC3 adenohypophysis (98) 1/10 (0.4) 0.97
mouse G6pc1 kidney (98) 6/10 (2.0) 0.18
mouse G6pc2 islet of Langerhans (100) 1/10 (0.4) 0.29
mouse G6pc3 choroid plexus (96) 0/10 (0.4) 0.86

The satisfiability engine already gates gluconeogenesis on G6PC1. Expression
adds that G6PC2 is islet-dominant in both species. Its GOA record carries
gluconeogenesis by IBA and Reactome TAS alongside IMP rows for glucose
homeostasis
and regulation of insulin secretion (PMID:20668700), so the
inherited process term is the one expression argues against. G6PC3 is present
almost everywhere, including kidney cortex (score 96), so expression cannot
argue against its inherited term. The existing G6PC3 review keeps that row as
KEEP_AS_NON_CORE on phylogenetic grounds, and expression neither supports nor
contradicts that.

PAX4 / PAX6 (PTHR45636, node PTN002900580). In PANTHER 19 the PAX4/PAX6
split is a Mammalia-level duplication (PTN000676674), below the Euteleostomi
node that carries the IBDs for retina development in camera-type eye,
forebrain development and type B pancreatic cell differentiation. So PAX4
inherits all three.

Expression shows quantitative divergence, with PAX6 top-ranked and PAX4
marginal. It does not show absence, so it supports questioning the node
placement but cannot settle it alone.

Corpus scan. 1,865 IBA groups (one PTN, one GO term) cover two or more
reviewed human genes. 86 of them name an anatomy, and 7 are discordant
(table):

4. Cerebellum development: is the module switched on in order?

Cerebellum module genes by mouse developmental stage, coloured by whether each is expressed in its step's declared context, only in the wider cerebellar territory, or only elsewhere

Figure 2. Mouse Bgee stage-resolved present calls for the OMA ortholog of each
module participant. Rows follow module steps. Dark = expressed in the step's
declared context at that stage; light = only in the wider cerebellar territory
(midbrain-hindbrain boundary, rhombomere 1, rhombic lip, metencephalon). The
step-by-stage verdicts come from the module_logic engine; full tables are in
cerebellum_timing.md.

A metabolic module is satisfiable all at once. A developmental module is a sequence, so
satisfiability is asked per stage, and the expectation is a staggered wave.
With the territory oracle, steps first become satisfiable in this order:

step first stage satisfiable
anlage allocation (GBX2, FGF8) E8–E10.5
germinal zones (ATOH1, PTF1A) E10.5–E14
Purkinje cells (RORA, RELN, SHH) E10.5–E14
GCP proliferation (SMO) E14–birth
migration and Bergmann glia (FBXO41, DNER, PTPN11) P0–P7
foliation (EN1/EN2) E8–E10.5

That gives 9 concordant, 4 discordant and 2 tied step pairs. Every discordance
comes from the foliation step.

What the wave says about the module:

5. Follow-up reviews: mouse G6pc2 and Pax4

The two strongest paralog leads were reviewed in full, in mouse, which has the
richest Bgee data for both genes. G6pc2 has 95 anatomical entities and 35
stages across in situ, Affymetrix, RNA-seq and single-cell data. Pax4 has 47
entities and 22 stages, including 34 in situ calls. Each review cites a
per-gene expression report (scripts/gene_report.py) that scores every
anatomy-bearing GO term for the gene and its sister paralogs:

mouse/G6pc2 (17 GOA rows plus 1 NEW: 12 ACCEPT, 3 MODIFY, 2 REMOVE,
1 NEW).

mouse/Pax4 (50 rows: 21 ACCEPT,
18 MODIFY, 6 MARK_AS_OVER_ANNOTATED, 5 REMOVE). The core functions are
transcriptional repression, β-cell fate allocation by cross-repression with
Arx, and enteroendocrine fate in the gut.

The circadian, cAMP and xenobiotic rows are removed: a transcript that
oscillates or responds to a signal is an output of the pathway, not a
participant in it. Here mouse Bgee supplies a controlled absence for a
non-developmental term. Pax4 is absent from the pineal body (gold) where
Pax6 is present.

Double check on G6pc2. Two further checks tested the gluconeogenesis
removal.

Both reviews record source defects for the upstream resources and pose the
PAINT node questions as suggested questions.

Human reviews. Human G6PC2 and PAX4 were then reviewed, with the mouse
reviews as the consistency reference and per-gene human Bgee reports.

Rules of use: when expression can count

These rules come from the calibration and are offered as working guidance for
reviewers. They are not repository policy.

  1. Never as sole evidence, never for a NEW process term. Presence does not
    separate accepted from over-annotated rows (ratio 1.02).
  2. Presence corroborates; it does not establish. An ENRICHED tier on an
    annotation that already has independent support is fair to mention in
    reason. A CONSISTENT tier adds nothing.
  3. Absence counts only with a control and after the screens. Read it as
    evidence against an annotation only when all of these hold:
  4. the term is not developmental, or the data are stage-matched;
  5. the anatomy is not reached through regulates;
  6. the product is not secreted or a ligand;
  7. the target cell is not transcriptionally quiescent;
  8. ideally, a sister paralog is detected in the same anatomy.
  9. Metabolic and physiological terms need a context source. GO gives them no
    anatomy; use the module's context or the satisfiability engine's satisfiable
    tissues.
  10. Developmental modules need stage-resolved, cell-resolved data. Organ-level
    in situ calls can show order but not which cell expresses the gene.
  11. Cite Bgee calls, not tiers. Quote the entity, score and data type from
    data/*.tsv or the Bgee gene page, and keep the tier as reasoning in
    reason.

Leads for curators

kind item what expression shows suggested action
IBA ACTL8 axon (GO:0030424) ACTB detected in neurons; ACTL8 germline-only and absent reconsider the UNDECIDED row; candidate MARK_AS_OVER_ANNOTATED
IBA AGFG2 acrosome assembly (GO:0001675) AGFG1 at 98–100 in sperm and male germ cells; AGFG2 absent re-check the ACCEPT against AGFG2-specific literature
IBA G6PC2 gluconeogenesis (GO:0006094) islet-dominant; 2/10 top tissues in the gluconeogenic context done (mouse and human): IBA, IEA and the human Reactome TAS REMOVEd; IRD suggested at the mammalian G6PC2 node PTN000287500
IBA / PAINT PAX4 retina and forebrain terms from PTN002900580 PAX6 enriched; PAX4 absent (human) or marginal (mouse) done (mouse and human): brain and forebrain REMOVEd, retina and sensory organ MARK_AS_OVER_ANNOTATED; IRDs suggested on PTN000676639 and PTN009180007
source (Reactome) G6PC2 islet reaction R-HSA-3266566 inside Gluconeogenesis R-HSA-70263 the pathway summary confines gluconeogenesis to liver and kidney recorded as a Reactome source defect on human G6PC2
module modules/gluconeogenesis_human.yaml paralog-trap note calls G6PC2 a "largely catalytically inactive autoantigen", contradicted by the G6PC2 enzymology and mutagenesis papers (PMID:14722102, PMID:38095063) done: the note now describes G6PC2 as a low-turnover islet glucose-6-phosphatase that sets hormone-secretion thresholds; the paralog-trap decision itself stands
review gap MITF RPE, heart, skeletal muscle top tissues unexplained by any retained anatomy term check whether the review is missing functions
module cerebellum step 1 context GBX2/FGF8 expressed at the midbrain-hindbrain boundary and rhombomere 1, not in the declared cerebellum change the step context
module EN1/EN2 placement expressed from E8, with the isthmic genes suggested question for module curators
ontology (CL) CL:0002362, CL:0001031 GCP lacks an external-granule-layer location; granule cell has none request axioms from CL
source (MGI) mouse G6pc2 ER IDA citing PMID:10787428 not expression: the cited paper is about NPC1 recorded as a suspected wrong reference for MGI to check
source (RGD, Ensembl) rat Pax4 IEP rows (PMID:19012751, PMID:18818287) rhythmic or regulated transcript levels, not function recorded as source defects; four rows reach mouse Pax4 by orthology, and one seeds the PAINT retina IBD

The full machine-generated lists are
corpus_leads.tsv and
paralog_discordant_groups.tsv.

Limitations and next steps

Methods & reproduction

Scripts, data provenance and the commands that regenerate every number and
figure on this page: Methods & reproduction.