Books20 chapters6 h 3 min read
User-Generated Platforms
Forums, image hosts, live streaming, chat servers, federated networks and peer-to-peer marketplaces look like different industries, and underneath they run on the same machinery: accounts with several roles, communities with their own rules and volunteer moderators, an upload path that scans every file before it publishes, video that costs money for every hour watched, money held for creators and hosts until it's paid out, and a trust and safety stack answering to Section 230, the DSA, the Online Safety Act and the child-safety reporting laws. This book surveys how the industry does each piece, benchmarked across Reddit, Discord, Pinterest, Imgur, Twitch, YouTube, Kick, Tumblr, Bluesky, Mastodon, Airbnb, Outdoorsy, RVshare, Turo, Etsy, eBay and Vinted and the vendors behind them, with no single platform as the model, and how you'd build it, extending one core data model chapter by chapter.
It reads in eight parts, plus a reference. The Business: how the platforms make money, how big they are, the core data model, the platform and vendor landscape, and accounts, identity and standing. Communities and Conversation: communities, roles and permissions, posts and voting, feeds and recommendations, search, real-time chat, voice rooms, volunteer moderation, federation, and developer platforms and data access. Media: the upload path, images at scale, storage and delivery economics, video on demand, and live streaming from ingest to latency, VODs and the interactive layer. Creators and Money: monetization strategies, ads, brand safety and data licensing, creator monetization, and paying creators and sellers. Peer-to-Peer Marketplaces: supply onboarding, listings and ranking, availability and booking, pricing and all-in prices, deposits and protection, damage and claims, messaging and reviews, cancellations and disputes, and marketplace fraud. Trust and Safety: the law of hosting user content, moderation at scale, spam and bots, child safety, violent extremism and graphic content, intimate image abuse, copyright, and abuse desks for hosts and registrars. The Rules: regulators and enforcement, minors and age assurance, law enforcement requests, and transparency reporting. Running the Platform: architecture, AI, operating metrics, and migrations, purges and shutdowns. Reference: a glossary of every term, grouped by part.
The Business
- 01The User-Generated Platform BusinessHow platforms where users supply the content or the inventory work: the parties, every way they earn, how big they are, and the core data model.33 min
- 02The Platform LandscapeCommunities, media hosts, streaming, chat, federated networks and peer-to-peer marketplaces, the vendors behind them, the deals, and what to build.18 min
- 03Accounts, Identity & StandingHandles, DIDs and domain handles, verification badges, one login with host and guest roles, account standing, takeover defense, and deletion versus holds.20 min
Communities and Conversation
- 04Communities, Roles & PermissionsForum, server and instance models, channels and categories, role hierarchies and the permission algorithm, invites, and ownership transfer.17 min
- 05Posts, Comments & VotingPost types, reposts and quotes, threaded comments, removal versus deletion, votes and karma, hot and confidence ranking, vote manipulation and viral galleries.17 min
- 06Feeds & RecommendationsThe social graph, feed types, fan-out, candidate generation and ranking, graph and sequence models, logged-out economics, re-engagement, and feed rules.16 min
- 07Search & DiscoveryKeyword search over community content, keeping the index in step with removals, visual search, translation, AI answers with citations, and safety in search.13 min
- 08Real-Time ChatCommunity chat at scale: gateways and sharding, large-server fan-out and member lists, message storage, DMs and message requests, rate limits, and chat search.17 min
- 09Voice & Live RoomsVoice channels and stage rooms on community platforms: SFU design, regional assignment and failover, encryption, stage moderation, recording and consent.14 min
- 10Volunteer Moderation & Community GovernanceCommunity rules over sitewide rules, automod rules engines, mod queues, logs and mail, moderator caps and accountability, and the 2023 blackout.16 min
- 11Federation & Open ProtocolsActivityPub and the AT Protocol: delivery and signatures, portability, local and stackable moderation, labelers, defederation, bridges and big platforms.17 min
- 12Developer Platforms, APIs & Data AccessBots and apps, privileged data, rate limits, on-platform app runtimes, API pricing changes, data licensing, researcher access and scraping suits.18 min
The Rules
- 13Regulators & EnforcementThe DSA, the UK Online Safety Act and Australia's eSafety regime as platforms meet them: tiers, designations, clocks, fines, withdrawals and a ledger.27 min
- 14Minors, Age Assurance & US State LawAge checks on user-generated platforms: methods and vendor risk, teen-by-default, family tools, minimum ages, US state laws in court, KOSA, COPPA, design suits.21 min
- 15Law Enforcement Requests & User DataSubpoenas, court orders, warrants, emergency and preservation requests, user notice, the CLOUD Act and EU e-evidence, and requests versus privacy rights.19 min
- 16Transparency ReportingWhat Reddit, Discord, Pinterest, Snap, Bluesky and others count, the DSA templates, OSA notices and state filings, and how to make the report a query.16 min
Running the Platform
- 17Platform ArchitectureHow user-generated platforms are built at scale: the community as partition key, hot communities, service splits, media and moderation pipelines, events.16 min
- 18AI on User-Generated PlatformsAI moderation and its error budgets, labels for AI-generated uploads, C2PA and IPTC provenance, EU AI Act disclosure, AI answers and training opt-outs.17 min
- 19Operating MetricsThe numbers user-generated platforms run on: daily uniques and MAU, supply and creator health, GMV and take rate, prevalence and action rates, and unit costs.15 min
- 20Migrations, Purges & ShutdownsPolicy-driven purges, storage caps, link rot and tombstones, country withdrawals, data exports and portability, and how to end a feature or a whole service.16 min