6496588bbc
X bills a post containing a URL at a much higher rate than a plain post, and its algorithm demotes link posts. The X version of a post now rewrites every URL non-clickable (https://example.com/post becomes example(.)com/post): scheme and www. dropped, every dot of the host replaced with (.). Leaving a single dot intact would still leave a resolvable domain for X to detect, so all of them are broken. A scheme or www. proves a token is a URL on its own; a bare host only counts when its last label is a delegated TLD, which is the one thing telling acme.com apart from Node.js. That check runs against App\Support\LinkTlds, generated from the whole IANA root zone in every form a TLD can appear in a post -- ASCII, punycode and the Unicode it decodes to -- because whatever X links is what X bills, so a hand-picked subset would leave us paying for its gaps. If the regex engine bails out on pathological input the original content is returned instead of crashing the publisher. The transform lives in the Platform::X arm of ContentSanitizer, so it reaches publishing and the app/API/MCP previews from one place and cannot touch any other network. Off by default; opt in with X_DEFUSE_LINKS. The editor counts characters and renders its preview client-side and cannot ask the server on every keystroke, so the rewrite is mirrored in TypeScript. PHP stays the source of truth: a parity test fails if the two TLD sets drift, and a browser test drives the real editor so the mirror is covered rather than assumed. Without it the composer promised text the network never receives. Character limits now measure the text a reader will see: sanitized, then with markup resolved away. Measuring the raw draft blocked saving posts that publish fine and let through posts the network rejects, and counted the editor's HTML toward the limit. Measuring the sanitized form alone would have counted Telegram's escaped entities, rejecting messages Telegram accepts. Empty content is handled once inside the sanitizer instead of by a guard repeated at every call site.
39 lines
1.8 KiB
TypeScript
39 lines
1.8 KiB
TypeScript
import { Platform } from '@/types/platform';
|
|
|
|
/**
|
|
* Mirror of the `Platform::X` branch of `App\Services\Social\ContentSanitizer`.
|
|
* The editor needs it to count characters and render the preview against the text
|
|
* that will actually be posted, and it cannot ask the server on every keystroke.
|
|
*
|
|
* Keep it in step with the PHP: a scheme (with optional userinfo) or `www.` proves
|
|
* a token is a URL on its own, while a bare host only counts when its last label is
|
|
* a delegated TLD — the single thing telling `acme.com` apart from `Node.js`.
|
|
*
|
|
* The character before a candidate is consumed and put back rather than checked with
|
|
* a lookbehind, which Safari only understands from 16.4 on.
|
|
*/
|
|
const LINK_PATTERN =
|
|
/(^|[^\p{L}\p{N}\p{M}_@/.])((?:https?:\/\/(?:[^\s/@]+@)?)?(?:www\.)?)((?:[\p{L}\p{N}](?:[\p{L}\p{N}\p{M}-]*[\p{L}\p{N}\p{M}])?\.)+([\p{L}\p{N}\p{M}-]{2,63}))(?![\p{L}\p{N}\p{M}-])((?:\/\S*)?)/giu;
|
|
|
|
/**
|
|
* The delegated TLDs are handed in rather than declared here: `App\Support\LinkTlds`
|
|
* is the only place the list lives, and the editor receives it as a page prop.
|
|
*/
|
|
export const defuseXLinks = (content: string, tlds: ReadonlySet<string>): string =>
|
|
content.replace(
|
|
LINK_PATTERN,
|
|
(whole: string, boundary: string, prefix: string, host: string, tld: string, path: string): string =>
|
|
prefix === '' && !tlds.has(tld.toLowerCase())
|
|
? whole
|
|
: boundary + host.replaceAll('.', '(.)') + path,
|
|
);
|
|
|
|
/**
|
|
* The content as the given platform will show it. Only X rewrites anything today,
|
|
* so every other network gets its text back untouched.
|
|
*/
|
|
export const contentForPlatform = (
|
|
content: string,
|
|
platform: string,
|
|
tlds: ReadonlySet<string>,
|
|
): string => (platform === Platform.X && tlds.size > 0 ? defuseXLinks(content, tlds) : content);
|