Reference

The open web is built from complementary specifications and conventions—not one universal content-publishing protocol. HTML describes documents. HTTP transfers resources. Feeds announce updates. Sitemaps advertise URLs. Structured data describes entities. Link relations explain relationships. Interaction protocols let independently operated websites communicate.

These mechanisms are maintained by different organizations and communities. Some are formal standards; others are community specifications, industry protocols, living vocabularies, or experimental proposals. This page is a technical index: find the authoritative source, understand what each mechanism requires, and see how Joshternet’s hub crawl relates—without confusing partial extraction with full conformance.

Using every specification is neither necessary nor expected.

  1. Identify Name the publishing task you need to solve.
  2. Authority Open the primary specification or community document.
  3. Requirements Separate format-required, optional, and consumer-specific rules.
  4. Validate Check syntax and delivery with the Validation chapter’s tools.
  5. Hub limits If relevant, read the Joshternet matrix for crawl behavior—not the web.

Find the specification you need

  1. Web foundations
  2. Discovery and search
  3. Structured content
  4. Feeds and syndication
  5. Identity and relationships
  6. Creative media
  7. Events and calendars
  8. Slash-page conventions
  9. Crawler access and AI preferences
  10. Testing and validation
  11. Joshternet specifications and hub support

What kind of specification are you reading?

Classification Meaning
IETF RFC Document in the RFC Series; status is stated by the RFC (not every RFC is an Internet Standard)
W3C Recommendation Specification through the W3C Recommendation process
W3C Note Informative W3C publication, not a Recommendation
Living Standard Continuously revised specification (for example WHATWG HTML)
Community specification Convention or spec developed by a community
Industry protocol Widely deployed technical specification from an industry group
Vocabulary Shared types and properties (for example Schema.org)
Internet-Draft IETF work in progress—not a published RFC
Vendor-specific guidance Rules for a particular product or search feature
Joshternet RFC Project specification for Joshternet behavior

A document’s acronym does not determine its authority. An Internet-Draft can be active without IETF consensus. A popular community path is not automatically IANA-registered.

Normative terminology

RFC 2119 and RFC 8174 define MUST, MUST NOT, REQUIRED, SHOULD, SHOULD NOT, RECOMMENDED, MAY, and OPTIONAL. Normative sections state requirements; informative sections explain. Handbook tutorials may recommend practices that are not format requirements—do not confuse the two.

Example: Atom MUST include certain entry identifiers for conformance. Adding Open Graph tags is often useful for previews but is not required for a valid Atom feed.

Authoritative specifications catalog

Web foundations

Specification Purpose Maintainer Status Source Chapter
HTML Documents and media WHATWG Living Standard html.spec.whatwg.org HTML
URL URL parsing WHATWG Living Standard url.spec.whatwg.org SEO
Fetch Fetching resources WHATWG Living Standard fetch.spec.whatwg.org Validation
RFC 9110 HTTP semantics IETF RFC rfc-editor.org Validation
RFC 9111 HTTP caching IETF RFC rfc-editor.org Validation
RFC 3986 URI syntax IETF RFC rfc-editor.org Links
RFC 3987 IRIs IETF RFC rfc-editor.org Explore
XML 1.0 Markup syntax W3C Recommendation w3.org Feeds
RFC 8259 JSON IETF RFC rfc-editor.org Schema.org
BCP 47 Language tags IETF BCP rfc-editor.org Explore
IANA media types MIME registry IANA Registry iana.org Validation

Structured content

Specification Purpose Maintainer Status Source Chapter
Microformats2 parsing Parse mf2 HTML Microformats Community microformats.org Microformats2
h-card People/orgs Microformats Community microformats.org Identity
h-entry Posts Microformats Community microformats.org Microformats2
h-feed Feeds in HTML Microformats Community microformats.org Microformats2
h-event Events Microformats Community microformats.org Events
Open Graph Link previews Meta / community Industry protocol ogp.me Open Graph
Schema.org Entity vocabulary Schema.org Living vocabulary schema.org Schema.org
JSON-LD 1.1 Linked data in JSON W3C Recommendation w3.org Schema.org
RDF 1.1 Concepts Graph data model W3C Recommendation w3.org Schema.org
Specification Purpose Maintainer Status Source Chapter
Sitemap Protocol Advertise URLs sitemaps.org Industry protocol sitemaps.org Sitemaps
RSS 2.0 Syndicated feeds RSS Advisory Board Industry protocol rssboard.org Feeds
Atom RFC 4287 Atom feeds IETF RFC rfc-editor.org Feeds
JSON Feed 1.1 JSON feeds jsonfeed.org Community jsonfeed.org Feeds
OPML 2.0 Outline lists OPML Community / industry opml.org OPML
RFC 8288 Web Linking IETF RFC rfc-editor.org Links
RFC 6596 Canonical Link Relation IETF RFC rfc-editor.org SEO
RFC 9309 Robots Exclusion IETF RFC rfc-editor.org Robots

Independent-web interactions

Specification Purpose Maintainer Status Source Chapter
Webmention Link notifications W3C Recommendation w3.org Connections
WebSub Topic update distribution W3C Recommendation (02 June 2026) w3.org Connections
Micropub Publishing API W3C Recommendation w3.org Connections
IndieAuth Auth using web identity IndieWeb Living Standard indieauth.spec.indieweb.org Identity
WebFinger RFC 7033 Account resource discovery IETF RFC rfc-editor.org Identity
ActivityPub Federated social activities W3C Recommendation w3.org Connections
ActivityStreams 2.0 Social activity vocabulary W3C Recommendation w3.org Connections

Creative publishing and events

Specification Purpose Maintainer Status Source Chapter
Schema.org creative types Works vocabulary Schema.org Vocabulary schema.org Creative media
HTML media elements img / audio / video WHATWG Living Standard html.spec.whatwg.org Creative media
WebVTT Captions/subtitles W3C Recommendation w3.org Creative media
WCAG 2.2 Accessibility W3C Recommendation w3.org Creative media
IPTC Photo Metadata Photo metadata IPTC Industry iptc.org Creative media
C2PA Content provenance C2PA Industry c2pa.org Creative media
RFC 5545 iCalendar IETF RFC rfc-editor.org Events
RFC 7986 iCalendar extensions IETF RFC rfc-editor.org Events
RFC 4791 CalDAV IETF RFC rfc-editor.org Events
RFC 5546 iTIP IETF RFC rfc-editor.org Events
RFC 6047 iMIP IETF RFC rfc-editor.org Events

Community conventions

Convention Purpose Reference Chapter
Slash pages Memorable personal paths slashpages.net Slash pages
/.well-known/slashpages OPML slash-page catalog proposal OPML
Blogroll Lists of sites you follow IndieWeb / community Links
Uses pages Tools and equipment uses.tech Uses
POSSE / PESOS Syndication patterns IndieWeb Connections
IndieWeb RSVP Attendance replies indieweb.org/rsvp Events

Standards and their primary responsibilities

Need Primary mechanism
Publish readable content HTML
Transfer a resource HTTP
Stable page address URL + canonicalization
Person or org profile h-card or Schema.org Person
Article or note h-entry or Schema.org Article / BlogPosting
Link preview Open Graph
Content updates RSS, Atom, or JSON Feed
Advertise URLs XML Sitemap
Organize slash pages HTML /slashes/ or optional OPML
Crawler access rules robots.txt (RFC 9309)
Indexing preferences robots meta / X-Robots-Tag
Relationships Link relations (RFC 8288)
Notify about a link Webmention
Distribute topic updates WebSub
Client publishing API Micropub
Auth with web identity IndieAuth
Federated social activities ActivityPub
Describe an event h-event or Schema.org Event
Exchange calendar entries iCalendar

What is actually required?

Format-required — the specification needs it for validity (for example certain Atom entry fields).

Format-optional — valid when present, not mandatory (many Schema.org properties).

Consumer-required — needed for a particular app or rich-result feature (Google Event rules ≠ Schema.org Event validity).

Open Graph defines four core properties (og:title, og:type, og:image, og:url). Schema.org does not impose one mandatory property list for every type. Do not merge unrelated specs into one fictional required-fields table.

Web resource paths and well-known locations

Path Kind Notes
/robots.txt Protocol location RFC 9309
/sitemap.xml Conventional Discovery may also use robots Sitemap:
/feed.xml, /rss.xml, /atom.xml, /feed.json Conventional Prefer autodiscovery links
/about/, /now/, /uses/, /slashes/ Community conventions Paths may vary
/.well-known/slashpages Community proposal Not IANA-registered as of Nov. 3, 2026
/.well-known/webfinger Protocol RFC 7033
/.well-known/josh Joshternet Project RFCs—not an IANA registration

RFC 8615 and the IANA Well-Known URI registry govern registered suffixes. Using .well-known does not create a registration.

Useful relations discussed in the handbook include registered and HTML-oriented types such as alternate, author, canonical, describedby, help, icon, license, me, next, prev, self, search, webmention, micropub, hub, plus link qualifications such as nofollow, noopener, noreferrer, sponsored, and ugc. See the IANA link relations registry.

rel="blogroll" is a community convention and was not listed in the IANA registry as of Nov. 3, 2026. A relation’s presence does not prove friendship, ownership, or endorsement—verification depends on the protocol.

Metadata and structured-data families

HTML: title, description, lang, canonical, robots meta. See HTML and SEO.

Microformats2 prefixes: h-* (root), p-* (plain text), u-* (URL), dt-* (datetime), e-* (element tree).

Open Graph: four core properties plus optional general and article namespaces (ogp.me).

Schema.org: types and properties for entities—not the same as JSON-LD syntax.

JSON-LD keywords: @context, @type, @id, @graph, @value, @language, @list, @set (JSON-LD 1.1).

Common Schema.org types

Type Definition
Person schema.org/Person
Organization schema.org/Organization
WebSite schema.org/WebSite
WebPage schema.org/WebPage
AboutPage schema.org/AboutPage
CollectionPage schema.org/CollectionPage
BlogPosting schema.org/BlogPosting
Article schema.org/Article
CreativeWork schema.org/CreativeWork
Photograph schema.org/Photograph
VisualArtwork schema.org/VisualArtwork
ImageObject schema.org/ImageObject
MusicRecording schema.org/MusicRecording
MusicComposition schema.org/MusicComposition
MusicAlbum schema.org/MusicAlbum
VideoObject schema.org/VideoObject
PodcastEpisode schema.org/PodcastEpisode
SoftwareApplication schema.org/SoftwareApplication
SoftwareSourceCode schema.org/SoftwareSourceCode
VideoGame schema.org/VideoGame
Book schema.org/Book
Event schema.org/Event
EventSeries schema.org/EventSeries
Place schema.org/Place
VirtualLocation schema.org/VirtualLocation
Product schema.org/Product
Review schema.org/Review
ItemList schema.org/ItemList

Prefer a specialized type when it fits; use a general type when it does not. Do not invent types to match hub UI categories.

Current Schema.org version

Verified Nov. 3, 2026 against schema.org/docs/releases.html:

Schema.org is a living vocabulary. Do not rewrite every handbook example solely because a new release appears—verify whether relevant types or properties actually changed.

Formats and media types

Resource Typical content type
HTML text/html
JSON application/json
JSON-LD document application/ld+json
RSS application/rss+xml
Atom application/atom+xml
JSON Feed application/feed+json
XML sitemap application/xml
OPML text/x-opml or XML
robots.txt text/plain
iCalendar text/calendar
JPEG / PNG / WebP image/jpeg, image/png, image/webp

A JSON-LD <script type="application/ld+json"> does not change the HTML document’s Content-Type. Prefer correct UTF-8 delivery.

Dates and identifiers

Publication, modification, feed update, site deployment, crawl observation, and external discovery times are different. HTML datetime, RSS pubDate, Atom published/updated, JSON Feed date_published/date_modified, Schema.org datePublished/dateModified, iCalendar DTSTART/DTEND/UID, sitemap lastmod, feed entry IDs, canonical URLs, and JSON-LD @id each name a different job. An event’s start is not a page’s publication time. See Feeds, Events, and Validation.

Feeds and syndication

  RSS 2.0 Atom JSON Feed 1.1
Spec rssboard.org RFC 4287 jsonfeed.org
Root rss / channel feed JSON object
Entries item entry items
Stable ID guid (practice) id (required) id (required)
Autodiscovery MIME application/rss+xml application/atom+xml application/feed+json

Pagination: RFC 5005. Media RSS and podcast namespaces are extensions—document separately. Full examples: Feeds.

Sitemaps and crawler directives

XML Sitemap Protocol (urlset, loc, lastmod, size limits), sitemap indexes, and vendor extensions (image/video/news/hreflang) are distinct from RFC 9309 robots rules and from robots meta / X-Robots-Tag indexing directives. Crawl access ≠ indexing ≠ AI usage preferences. See Sitemaps and Robots.

AI usage preferences and emerging proposals

As of Nov. 3, 2026, these remain works in progress or vendor mechanisms—not RFCs unless stated:

Name Maintainer Status Scope
draft-ietf-aipref-vocab IETF AIPREF WG Internet-Draft (vocab-08) AI use vocabulary
draft-ietf-aipref-attach IETF AIPREF WG Internet-Draft (attach-05) HTTP / robots Content-Usage
draft-kelley-aipref-training-preference-signal Individual I-D Internet-Draft (00, Oct. 30, 2026) Training preference via special UA groups
Content Signals Vendor/community Not an IETF RFC Content-Signal preferences

Do not describe planned RFC status as achieved. Full guidance: Robots.

Identity and relationships

Protocol Primary purpose Maturity
h-card Structured profiles Community vocabulary
rel=me Identity relationships between URLs HTML / IndieWeb practice
WebFinger Discover account-associated resources RFC 7033
IndieAuth Decentralized authentication IndieWeb Living Standard (distinct from older W3C Note)
Webmention Notify a target of a source link W3C Recommendation
WebSub Distribute topic updates via hubs W3C Recommendation (02 June 2026)
Micropub Create/update/delete posts via API W3C Recommendation
ActivityPub Federated social interactions W3C Recommendation

These protocols are not interchangeable. See Identity and Connections.

Creative media and accessibility

HTML images/audio/video, responsive images, WebVTT, WCAG 2.2, Schema.org creative-work types, IPTC, EXIF, XMP, C2PA, Media RSS, and Creative Commons licensing address presentation, description, accessibility, provenance, and rights—different jobs. No single format proves copyright ownership or factual authenticity. See Creative media.

Events and calendars

Schema.org Event, h-event, iCalendar (RFC 5545 / 7986), CalDAV, iTIP, iMIP, and IndieWeb RSVP cover description, exchange, subscription, sync, and scheduling separately. Stable UIDs and time zones matter. See Events.

Community conventions

/about, /now, /uses, /blogroll, /slashes, slash-page directories, /.well-known/slashpages, blogroll OPML, POSSE, PESOS, and IndieWeb RSVP are useful conventions—not mandated Internet Standards. Publishers may use different URLs. The slash-page catalog is not a set of required routes. See Slash pages, Uses, and OPML.

Joshternet specifications

Authoritative project specs: github.com/joshternet/spec.

Document Role
RFC-JOSH-0000 Foundational principles
RFC-JOSH-0001 Josh identity
RFC-JOSH-0002 /.well-known/josh participation

These govern Joshternet participation. They do not redefine HTML, Microformats2, Schema.org, Open Graph, RSS, Webmention, or other open-web standards. A valid declaration is separate from permitting crawls and from declaring Josh identity. Guides: Implement, Specs, declaration checker.

A standard can exist even when an application doesn’t implement it

Distinguish: (1) the specification, (2) a publisher implementing it, (3) a parser recognizing syntax, (4) an application extracting fields, (5) display or action, (6) relationship verification, (7) a complete conforming implementation.

Recognizing p-category is not full Microformats2 conformance. Extracting Schema.org Event is not every Schema.org type. Reading RSS categories is not every RSS extension. Discovering a Webmention endpoint is not sending or receiving Webmentions.

Joshternet hub crawl support matrix

Hand-maintained in _data/content_support_matrix.json and checked by tests. Statuses: implemented, partial, not_implemented, under_consideration. Partial means partial—not “we support Schema.org.” This matrix describes hub crawl behavior, not the open web.

Crawler: Joshternet-Joshbot (+https://joshternet.org/joshbot) · Matrix verified: 2026-11-03

Area Status Published inputs Limitations Chapter Verified
Semantic HTML partial title; lang; main/article structure via visible text; time[datetime]; canonical link No dedicated semantic-landmark parser; extraction uses HTML text, time elements, and related page heuristics. Open 2026-11-03
SEO fundamentals partial title; meta description (share text); canonical; robots meta where relevant to hub pages SEO is a discipline. JoshBot does not implement search-engine ranking; it consumes overlapping metadata fields. Open 2026-11-03
Slash pages implemented catalog paths; aliases; probe seeds; extraction roles /uses is site-info only (not Network about blurbs or Showcase works). Open 2026-11-03
OPML and /.well-known/slashpages implemented type; text/title; url/htmlUrl/xmlUrl; category/categories; include outlines 256 KiB; 4 includes; depth 2; 200 outlines; cross-origin outlines are evidence-only, never membership. Open 2026-11-03
Microformats2 partial p-category; h-entry (u-url, p-name, p-summary, e-content, time); h-event (p-name, u-url, p-location, dt-start, dt-end); u-in-reply-to / in-reply-to; u-repost-of / repost-of; u-syndication / syndication Not a full microformats2 parser. No complete h-card authorship graph as crawl input. Open 2026-11-03
Open Graph Protocol partial og:title; og:type; og:image; og:url; og:description; og:site_name; article:published_time Does not consume og:locale, og:video, og:audio, or og:image:alt as discovery drivers. Open 2026-11-03
Schema.org and JSON-LD partial CreativeWork family types in CREATIVE_SCHEMA_TYPES; Event family + startDate; Person/Organization knowsAbout; WebSite/Person name/description Many Schema.org types ignored. Taxonomy lists some JSON-LD sources without live extractors. Open 2026-11-03
RSS, Atom, and JSON Feed implemented rel=alternate feed links; titles, ids/guids, dates, summaries; categories/tags; enclosures/images Feed count caps apply (network vs NLP). Not every extension is read. Open 2026-11-03
XML sitemaps implemented Sitemap: robots lines; urlset loc; sitemapindex children Same-origin only; max 20 sitemap files; lastmod not a ranking signal. Open 2026-11-03
robots.txt and crawler directives implemented User-agent; Allow; Disallow; Sitemap No Crawl-delay. Product token Joshternet-Joshbot. Declaration does not override robots. Open 2026-11-03
Web Linking, canonical URLs, and relations partial canonical; alternate (feeds); me; blogroll; in-reply-to; repost-of; syndication Not every HTML link relation is interpreted. Open 2026-11-03
Identity and authorship partial rel=me; Person/WebSite JSON-LD; about/profile page blurbs Full h-card graphs are not crawl input. Josh identity remains /.well-known/josh only. Open 2026-11-03
Connections and IndieWeb interaction partial homepage-link; content-link; blogroll; reply-to; repost-of; syndication; credit Webmention, WebSub, Micropub, IndieAuth, and ActivityPub are not implemented by the hub crawl. Open 2026-11-03
Creative media metadata implemented CREATIVE_SCHEMA_TYPES JSON-LD; figures; creative indexes; Open Graph fallback on creative-index paths Chrome paths such as /uses/ and /about/ are excluded from Showcase works. Open 2026-11-03
Events implemented h-event dt-start; Schema Event startDate; name; url; location; endDate Requires a dependable start date. Mentions and cancelled events are filtered. Open 2026-11-03
Uses pages partial /uses catalog seed; outbound links from the page No Uses Intelligence analytics product. Not Network about text. Not Showcase. Open 2026-11-03
Seeking pages partial h-listing p-action wanted; e-description; optional p-category; optional p-name; optional nested p-item; page-level update date Optional. No /.well-known/josh field. Request bodies are not committed with network sync. Live excerpts await a non-commit publish path. Categories stay local to Seeking. Open 2026-11-04
Explore projections implemented Documents view-build rules. Raw inventories stay off visitor pages. Open 2026-11-03
Validation implemented Documents external validators and local checks. No proprietary JoshBot diagnostic UI. Open 2026-11-03
Reference and support matrix implemented Matrix is hand-maintained and verified by tests against extractor sources. Open 2026-11-03
Webmention not_implemented Documented for interoperability only. Hub crawl does not send or receive Webmentions. Open 2026-11-03
Uses Intelligence analytics under_consideration No analytics product in this repository. Do not invent reporting metadata. Open 2026-11-03

Known limitations and nonclaims

  • Discovering a page does not guarantee indexing.
  • Valid structured data does not guarantee rich results.
  • A topic tag does not prove expertise.
  • A product mention does not prove usage or ownership.
  • A link does not prove friendship.
  • An h-card does not verify legal identity.
  • A Webmention notification is unverified until its source is checked.
  • A feed does not guarantee instant delivery.
  • An OPML manifest does not establish Joshternet membership.
  • An AI usage preference does not technically prevent copying.
  • A Joshternet declaration does not require every optional publishing convention.

Example reference entries

RSS 2.0

  • Maintainer: RSS Advisory Board
  • Status: Industry protocol (not an IETF RFC)
  • Resource: Syndicated channel / items
  • Typical type: application/rss+xml
  • Spec: rssboard.org/rss-specification
  • Chapter: Feeds

Microformats2 h-entry

The parsing specification defines how class names become JSON. The h-entry vocabulary names properties such as p-name and dt-published. Supporting one property is not full parser conformance. Chapter: Microformats2.

Well-known slashpages

Specifications change

Check RFC status and errata, obsoletes/updates relationships, W3C document status, Living Standard revisions, Schema.org releases, Internet-Draft revisions and expiration, community revisions, and vendor doc changes. Prefer the current authoritative URL over copying old snapshots. A newer publication is not automatically incompatible with earlier implementations.

Maintainable references

Each handbook entry should keep a stable name, primary authoritative URL, concise purpose, verified maturity, related chapter, and review date where needed. Avoid duplicate contradictory lists. Link to chapter tutorials instead of copying them. No new code-generation architecture is required to maintain this index.

Validation resources

Area Tool
HTML Nu HTML Checker
Accessibility WAI tools
Microformats2 pin13, tests
Schema.org validator.schema.org
Google features Rich Results Test
RSS / Atom Feed validator
JSON Feed Spec + JSON parser checks
Webmention / WebSub / Micropub webmention.rocks, websub.rocks, micropub.rocks

Full procedures: Validation.

Security and trust

Specifications describe interoperable behavior—not automatic trust. Distinguish authentication from crawler access; treat remote structured data as untrusted; verify identity claims; bound cross-origin fetches (SSRF); parse XML/JSON carefully; watch embedded scripts and privacy-sensitive metadata; respect copyright/licensing and AI preference limits; avoid pasting secrets into third-party validators. See each protocol’s security considerations and Validation.

Which chapter should I read?

Task Chapter
Structure a page Semantic HTML
Search discoverability SEO
Personal slash pages Slash pages
Slash-page catalog OPML
Articles/people in HTML Microformats2
Link previews Open Graph
Structured entities Schema.org
Subscriptions Feeds
Advertise URLs Sitemaps
Crawler access Robots
Resource relationships Links
Identity and authorship Identity
Cross-site interactions Connections
Creative work Creative media
Events and calendars Events
Tools and equipment Uses
Content discovery strategy Explore
Diagnose problems Validation
Handbook hub Content Discovery Handbook

Glossary

Canonical URL — Preferred resource URL for duplicates. Content type — MIME type of a representation. Crawling — Fetching URLs by following links or seeds. Discoverability — Ease of finding published work. Entity — A thing described by structured data. Feed — Syndicated updates. Identifier — Stable ID for a resource or entry. Indexing — Recording content for retrieval. Link relation — Typed relationship (rel). Metadata — Data about a resource. Microformats2 — HTML class vocabularies. MIME type — Media type label. Namespace — Scoped name vocabulary. Origin — Scheme + host + port. OPML — Outline markup for lists. Parsing — Interpreting a format into structure. Permalink — Stable public URL. Provenance — Origin/history of content. RDF — Graph data model. Schema — Shared type system (often Schema.org). Semantic HTML — Meaningful document structure. Serialization — Encoding a model as bytes/text. Structured data — Explicit machine-readable description. Syndication — Distributing updates. Vocabulary — Shared terms. Webmention — Link notification protocol. Well-known URI — /.well-known/ path (RFC 8615).

Authoritative sources

Prefer direct links to the document that defines a requirement.

Continue through the handbook

This is the final handbook chapter. Navigation below follows content_nav (previous: Validation; no next chapter).