End-to-end pipeline
Not Meta-lab 64ch Brain2Qwerty weights — your 14-channel EPOC geometry, English-first labels, deployable on consumer GPU.
Brain test data (what we use today)
Synthetic (CI / smoke)
Generated 14ch epochs for pipeline tests. scripts/download_public_datasets.py synthetic
Gear test (mock Cortex)
Mock WSS CSV + injected key events — proves raw → processed → fine-tune on your PC. scripts/test_gear_finetune.py
Staging (ST) / HF dataset
Raw sessions staged for upload: neuroglyph-epoc-typing-en-v1. Catalog: data/catalog.json
Gold path (your headset)
~10 min English typing session → data/raw/ → fine-tune with frozen encoder. docs/FIRST_SESSION_PROTOCOL.md
| Source | Purpose | On HF? |
|---|---|---|
| Synthetic hand | Train smoke, adaptive engine | No (regen locally) |
| Gear / mock sessions | Pipeline regression | Yes (dataset repo) |
| Live EPOC (future) | Personal decoder weights | You choose (push script) |
Pre-download model & fine-tune on your machine
Published checkpoint (hand, English path):
python scripts/download_hf_artifacts.py # → checkpoints/hf/NeuroGlyph-EPOC-Typing-v1/ # → data/hf/neuroglyph-epoc-typing-en-v1/ python scripts/run_swarm_pipeline.py # full YOLO: data → train → fine-tune → smoke
Local GPU: RTX 4070 12GB + PyTorch cu124 (docs/LOCAL_GPU.md). Inference can stay CPU; training uses CUDA when available.
Hermes Agent (in-repo MCP)
NeuroGlyph MCP server
preprocess_session— raw → epochstrain_decoder— hand / zone / intentrun_live_decoder— gated predictionssend_to_unreal— bridge to UE
Adaptive situations
neuroglyph_agent/adaptive_engine.py reads signals (live vs synthetic, checkpoints, queue) and writes data/adaptive_brief.md so the swarm pivots without re-steering.
Comfy UI / Comfy Cloud MCP
Role in the stack: generative layer for promo art, brain-map visuals, stream overlays, and experiment thumbnails — not the EEG decoder itself. Hermes can call Comfy Cloud MCP (workflows, templates, image gen) while NeuroGlyph handles BCI.
- Brand assets under
assets/brand/(GPT-Image-2 pipeline) - Live stream: BCI intent → Hermes narrative → Comfy for visuals → OBS / reality live
- Keep API keys in Hermes auth — never commit to this repo
Unreal Engine MCP
Editor HTTP MCP with Mcp-Session-Id: list_toolsets, call_tool.
Predictions map through neuroglyph_unreal.ue_actions.prediction_to_unreal_action
(e.g. MoveLeft, SpawnDebugActor) when confidence ≥ 0.75.
Setup: docs/UNREAL_SETUP.md · skill: unreal-engine-mcp in Hermes.
MindBot / synergetic cognition
NeuroGlyph emits PredictionEvent JSON into the MindBot bus — Hermes plans, dreams/CoT can comment on intent, Unreal executes. Export trajectories (context + plan + outcome), not raw EEG dumps, for MindBot training.
Quick start
git clone https://github.com/TheMindExpansionNetwork/neuroglyph-forge.git cd neuroglyph-forge python -m venv .venv && .venv/Scripts/activate pip install -e ".[cloud,recorder]" pytest tests/ -q python scripts/download_hf_artifacts.py python scripts/run_swarm_pipeline.py