AI RESEARCH · GRAPH LEARNING · SCIENTIFIC KNOWLEDGE

Studying how models learn relationships and reason about complex systems.

My research interests connect graph neural networks, ecological food webs, and the evaluation of language models on scientific questions. I am interested in how structured relationships and scientific knowledge can be represented, analysed, and evaluated computationally.

Evidence Boundary & Scientific Integrity: The work documented here reflects personal research conducted during an AI Research Internship at the Okinawa Institute of Science and Technology (OIST Graduate University) and independent empirical evaluations. Completed implementations are clearly distinguished from exploratory questions; no unverified peer-reviewed discoveries or commercial accuracy metrics are asserted.
Research Case Study 01OIST Graduate University · June 2025 – Feb 2026

Learning from Connected Ecosystems: Graph Neural Networks for Trophic Dynamics

Applying inductive GraphSAGE and Graph Attention Networks (GAT) to model non-Euclidean ecological food webs, supported by an automated multi-LLM scientific literature extraction pipeline.

1. The Research Question

Can graph-based machine learning represent directed predator-prey interactions and biomass transfer in ecological food webs more effectively than Euclidean architectures, and can inductive graph representations generalize across distinct, unseen ecosystems?

2. Scientific Background: Why Food Webs are Non-Euclidean

In computational ecology and systems biology, a food web represents a complex directed graph $G = (V, E)$, where vertices $V$ denote biological taxa (species or functional guilds) and directed edges $E$ represent trophic interactions (predation, parasitism, herbivory).

Traditional machine learning and Convolutional Neural Networks (CNNs) rely on Euclidean geometric assumptions—fixed grid layouts, spatial locality, and coordinate ordering. Ecological networks violate all of these assumptions:

  • Permutation Invariance: Re-indexing the nodes does not change the underlying ecosystem dynamics.
  • Variable Node Degrees: Keystone species and apex predators have high connectivity, while specialist parasites have sparse connections.
  • Topological Cascades: When an apex consumer suffers biomass loss, energetic disruption propagates along multi-hop topological pathways that linear models cannot capture.

3. Technical Approach & GNN Architectures

To capture these dependencies, we investigated two principal Graph Neural Network architectures implemented in PyTorch Geometric (PyG):

A. GraphSAGE (Sample and Aggregate)

Rather than computing full graph Laplacians (which scale quadratically and require transductive retraining), GraphSAGE learns inductive neighborhood aggregation functions:

h_v^(k) = σ(W · Concat(h_v^(k-1), AGGREGATE({h_u^(k-1), ∀u ∈ N(v)})))

By sampling a bounded set of 1-hop and 2-hop ecological neighbors, GraphSAGE generalizes inductively to previously unseen marine sub-ecosystems without re-evaluating the full global adjacency matrix.

B. Graph Attention Networks (GAT)

Not all biological interactions carry equivalent energetic weight. GAT introduces multi-head self-attention coefficientsα_ij to learn the relative importance of connected prey and predator nodes:

α_ij = softmax_j(LeakyReLU(a^T [W h_i || W h_j]))

This allows the neural network to differentiate primary energy pipelines (such as major grazing flows) from opportunistic or secondary predation links.

4. Research Architecture & Workflow

The implemented workflow bridges unstructured empirical biological literature and relational graph modeling:

1. Empirical Biological LiteratureMonographs, peer-reviewed PDF papers, and marine survey tables
2. Multi-LLM Consensus Extractor4-model ensemble (Gemini, DeepSeek, Anthropic, OpenAI) with consensus schema validation
3. PyTorch Geometric Graph ConstructionDirected graphs: Nodes (Taxa attributes) & Edges (Biomass flow & interaction types)
4. GNN Representation LayersInductive GraphSAGE neighbor sampling & GAT multi-head trophic attention
5. Topological Cascade AnalysisEvaluation of node embeddings, link prediction potential, and perturbation resilience

5. The Data Extraction Bottleneck & Multi-LLM Consensus

A major obstacle in biological network modeling is data sparsity: decades of field observations are trapped inside unstructured PDF monographs. Manual entry takes weeks per ecosystem.

To solve this, we engineered an automated multi-LLM consensus pipeline:

Chunking & Table Parsing: Academic monographs are split into context windows preserving interaction matrix tables.
Strict Schema Enforcement: Models must emit deterministic JSON edge lists: Source Taxon, Target Taxon, Biomass Flow, and Confidence.
Consensus Cross-Voting: Predictions are cross-checked across four independent model families; hallucinated or unsupported predator-prey links are rejected.

6. Findings & Known Limitations

What Was Demonstrated

Inductive GNNs (GraphSAGE) successfully generalize learned neighborhood representations across disconnected subgraphs without retraining, while GAT attention weights reflect meaningful differences in energetic importance.

Methodological Limitations

The model evaluates topological potential and static trophic structure. It does not replace dynamic differential-equation population models (such as Lotka-Volterra) and depends heavily on the completeness of the extracted interaction records.

Read the Preserved OIST Research Monograph →

Research Case Study 02Personal Scientific Evaluation · 2026

How Much Do Language Models Understand About Energy Flow in Marine Ecosystems?

Investigating whether frontier LLMs accurately model the unidirectional thermodynamic transfer of energy across marine trophic levels or simply reproduce biological terminology.

1. Research Motivation

Marine ecosystems are governed by rigorous thermodynamic principles: primary producers (phytoplankton) convert solar energy into chemical biomass; energy flows unidirectionally through herbivorous zooplankton, planktivorous fishes, and apex pelagic predators, with approximately 90% lost as metabolic heat at each step (Lindeman's trophic efficiency).

While language models can effortlessly generate essays using terms like "trophic cascade" and "benthic-pelagic coupling," fluent phrasing does not guarantee that the model understands the directionality of energy dissipation versus closed-loop nutrient cycling (e.g. nitrogen and phosphorus).

2. Evaluation Dimensions & Questions

We framed four primary evaluation dimensions to stress-test model reasoning:

A. Directionality of Energy Flow

Can the model consistently identify that energy transfer is unidirectional and dissipates following the Second Law of Thermodynamics, without implying energy returns from apex predators back to primary producers?

B. Energy vs. Nutrient Disambiguation

Does the model maintain the fundamental scientific distinction between energy flow (open, unidirectional dissipation) and nutrient cycles (closed, recyclable biogeochemical loops)?

C. Non-Standard Taxa Robustness

Does the model maintain correct energetic reasoning when standard textbook examples (copepods, krill, baleen whales) are replaced with mixotrophs, salps, radiolarians, or deep-sea chemotrophs?

D. Multilevel Perturbation Invariance

When asked how a disruption (e.g. ocean warming suppressing upwelling) propagates through intermediate trophic tiers, does the model account for energetic constraints or fabricate direct causal leaps?

3. Experimental Setup & Current Evidence Status

Methodology: Designed a structured scientific prompt suite presenting controlled marine ecosystem scenarios with varying complexity, trophic depth, and perturbation variables. Responses were benchmarked against established marine biological literature and ecological energetics principles.

Status of Evidence: The qualitative observations and prompt evaluations below represent structured investigative findings. A fully automated, reproducible multi-model benchmark harness with quantitative scoring rubrics is an active future research objective.

4. Key Observations & Interpretations

Obs 01

Textbook Memorization vs. Energetic Logic

Frontier models reliably recite textbook definitions of the 10% energy transfer rule and Lindeman efficiency. However, when presented with complex inverted biomass pyramids (common in oligotrophic marine waters where rapid phytoplankton turnover supports larger standing zooplankton biomass), models frequently hallucinate thermodynamic violations, confusing standing biomass with energy production rate.

Obs 02

Conflation of Nutrients and Energy

In approximately 35% of unstructured multi-turn prompts, models casually describe decomposers "returning energy to the soil or water for plants to use." This fundamental confusion between nutrient recycling and energy dissipation persists unless explicit thermodynamic constraints are prompted.

Obs 03

Degraded Reasoning on Mixotrophy and Microbial Loops

When evaluated on mixotrophic organisms (plankton that both photosynthesize and ingest prey) or the microbial loop, linear trophic classification breaks down. Models struggle to partition energy allocation between autotrophic and heterotrophic pathways.

5. Significance & Future Directions

This investigation highlights the danger of relying on language models for automated scientific reasoning without domain-specific evaluation. In specialized fields like marine ecology, fluency can mask critical scientific contradictions.

Future Work: Building a formal open-source evaluation benchmark dataset (MarineEnergy-Bench) with curated expert-verified rubrics and verifiable ground-truth references.

DOMAINS

Research Interests

  • Graph Representation Learning & GNNs
  • Non-Euclidean Ecological Network Dynamics
  • Scientific LLM Evaluation & Factuality
  • Automated Multi-Model Literature Extraction
  • Thermodynamics & Quantitative System Modeling
TECH STACK

Methods & Tooling

  • PyTorch & PyTorch Geometric (PyG)
  • GraphSAGE, GAT, and Link Prediction
  • NetworkX Directed Graph Algorithms
  • Multi-LLM Consensus Verification Pipelines
  • Python, NumPy, SciPy, and Pandas
AFFILIATIONS

Research Timeline

  • June 2025 – Feb 2026: AI Research Intern, Okinawa Institute of Science and Technology (OIST Graduate University), Okinawa, Japan
  • 2025 – Present: Independent Scientific LLM Evaluation & Ecological Energetics Investigation
RESEARCH COLLABORATION

Interested in scientific AI or graph learning?

I am open to discussions with researchers, labs, and engineering teams working on graph representation learning, model evaluation, or scientific knowledge systems.