Recurrent models process tokens one after another — long-range dependencies fade, and nothing parallelizes. Key idea: attention alone, no recurrence — every token attends to every other in one step, and the whole sequence trains in parallel. The architecture nearly every large language model since has built on.
Content & typography
The pieces prose is built from. Each one consumes only the semantic tier of the tokens — re-skin the palette and all of them follow.
§1.1Callout
Five variants; title replaces the variant's default label (Note / Intuition / Warning / Important / Abstract — the same defaults the quote syntax uses, localizable through labels). The kitchen-sink shows the quote-syntax and raw-HTML spellings of the same markup.
§1.2Chip
Inline badges for status and categories, in the four variants PaperCard tags and HubCard chips share: stable beta research new — or a custom tone for topic palettes: custom tone
§1.3Grid
One grid, three skins (plain, card, cmp). Cards:
Tokens first. Import order is part of the contract: tokens, then the content layer, then site chrome.
Semantic layer only. Components never touch raw colors — re-skin the palette and they all follow.
And the compare skin, made for before/after panels:
Without a guard — an unclosed ** ships to production as two literal asterisks.
With the guard — the build fails at file:line:column with a caret under the marker.
§1.4Steps
A markdown list on a vertical rail:
- Add the two submodules and the
file:dependencies. - Import
tokens.css,base.cssand (for a wiki)browse.cssin your global stylesheet. - Wire
siteMarkdown()intoastro.config. - Override the tier-one palette with your identity pigments.
§1.5Stats
- token tiers
- 2
- components
- 24
- probe viewports
- 4
- build steps
- 0
§1.6PaperCard
The survey workhorse — alias, full title, venue tags, author meta, links, and two dedicated slots:
Under a deep-dive heading, a one-line plain-language gloss (.speak) tells the reader what a module does before the mechanism:
Attention is a soft lookup table: every token asks "who is relevant to me?" and gets a weighted mix of the answers.
§1.7References
- Vaswani et al., Attention Is All You Need, NeurIPS 2017.
- Knuth, The TeXbook — the reason the math grounds get their own paper tone.
- W3C, Web Content Accessibility Guidelines 2.2 — the AA contrast bar the tokens are audited against.