Books57 chapters21 h 32 min read
User-Generated Platforms
Forums, image hosts, short-form video apps, live streaming, chat servers, federated networks and peer-to-peer marketplaces look like different industries, and underneath they run on the same machinery: accounts with several roles, communities with their own rules and volunteer moderators, an upload path that scans every file before it publishes, video that costs money for every hour watched, money held for creators and hosts until it's paid out, and a trust and safety stack answering to Section 230, the DSA, the Online Safety Act and the child-safety reporting laws. This book surveys how the industry does each piece, benchmarked across Reddit, Discord, TikTok, YouTube, Twitch, Bluesky, Mastodon, Airbnb, Turo, Etsy and the others, with no single platform as the model, and how you'd build it, extending one core data model chapter by chapter.
It reads in nine parts, plus a glossary, including media from upload to live streaming, how the For You feed works, peer-to-peer marketplaces, and trust and safety.
The Business
- 01The User-Generated Platform BusinessHow platforms where users supply the content or the inventory work: the parties, every way they earn, how big they are, and the core data model.29 min
- 02The Platform LandscapeCommunities, media hosts, streaming, chat, federated networks and peer-to-peer marketplaces, the vendors behind them, the deals, and what to build.15 min
- 03Accounts, Identity & StandingHandles, DIDs and domain handles, verification badges, one login with host and guest roles, account standing, takeover defense, and deletion versus holds.16 min
Communities and Conversation
- 04Communities, Roles & PermissionsForum, server and instance models, channels and categories, role hierarchies and the permission algorithm, invites, and ownership transfer.14 min
- 05Posts, Comments & VotingPost types, reposts and quotes, threaded comments, removal versus deletion, votes and karma, hot and confidence ranking, vote manipulation and viral galleries.14 min
- 06Feeds & RecommendationsThe social graph, feed types, fan-out, candidate generation and ranking, graph and sequence models, logged-out economics, re-engagement, and feed rules.14 min
- 07Search & DiscoveryKeyword search over community content, keeping the index in step with removals, visual search, translation, AI answers with citations, and safety in search.11 min
- 08Real-Time ChatCommunity chat at scale: gateways and sharding, large-server fan-out and member lists, message storage, DMs and message requests, rate limits, and chat search.15 min
- 09Voice & Live RoomsVoice channels and stage rooms on community platforms: SFU design, regional assignment and failover, encryption, stage moderation, recording and consent.12 min
- 10Volunteer Moderation & Community GovernanceCommunity rules over sitewide rules, automod rules engines, mod queues, logs and mail, moderator caps and accountability, and the 2023 blackout.13 min
- 11Federation & Open ProtocolsActivityPub and the AT Protocol: delivery and signatures, portability, local and stackable moderation, labelers, defederation, bridges and big platforms.14 min
- 12Developer Platforms, APIs & Data AccessBots and apps, privileged data, rate limits, on-platform app runtimes, API pricing changes, data licensing, researcher access and scraping suits.15 min
Media
- 13The Upload PathDirect-to-storage and resumable uploads, validation against hostile files and decompression bombs, mezzanine specs, and scanning before anything publishes.16 min
- 14Images at ScaleImage variants made on upload or on demand, AVIF, WebP and HEIC negotiation, GIF to video, EXIF and location stripping, and provenance that must survive.21 min
- 15Storage, Dedup & Delivery EconomicsExact and perceptual dedup, hot, warm and cold tiers, CDN and egress costs, hotlinking, takedown purges, orphans and link rot, storage caps and geo-withdrawal.21 min
- 16Video on DemandTranscode farms, encoding ladders and per-title encoding, codec portfolios, HLS, DASH and CMAF packaging, DRM, signed playback and cost per viewer-hour.23 min
- 17Live Streaming: Ingest & TranscodingGetting a creator's live video in: RTMP, Enhanced RTMP, SRT and WHIP, stream keys, ingest routing, transcode versus transmux, and rationing capacity.21 min
- 18Live Latency, Playback & VODsLive latency tiers and what each gives up, distribution at scale, real-time stages, timed metadata and ad breaks, live to VOD, retention caps and clips.20 min
- 19Live Chat & the Interactive LayerLive chat fanout, rate limits and bots, moderation before delivery, shared chat, raids, channel points, polls, predictions, extensions, drops and event feeds.27 min
Social and Short-Form
- 20Interest-Graph FeedsHow follow-free short-video feeds work: watch signals, multi-task value scores, real-time training, staged tryouts, boosts, dispersal, controls and the rules.35 min
- 21Sounds, Remix & DuetsSounds as first-class objects, duets, stitches, remixes and templates, lineage between posts, music licensing by account and region, and how trends spread.31 min
- 22Camera & EffectsIn-app capture and drafts, on-device face and body tracking, effect creator platforms and rewards, beauty filter rules, generative effects and biometric law.35 min
- 23Stories & Disappearing ContentStories, close friends and audience snapshots, view-once and disappearing messages, what deleted really means, holds that beat expiry, and ephemeral safety.30 min
- 24Social Commerce & Live ShoppingShoppable video and live selling: affiliate plans and attribution, live offers and auctions, seller standards, settlement, de minimis and commerce fraud.31 min
Creators and Money
- 25Monetization StrategiesEvery way a user-generated platform earns, who pays, how each model shapes the product, app-store cuts, regional prices, conflicts and unit economics.32 min
- 26Ads, Brand Safety & Data LicensingSelling ads beside content nobody reviewed: inventory, regional ARPU, suitability tiers, demonetization, ad law, and licensing the corpus to AI companies.23 min
- 27Creator MonetizationHow creators earn on user-generated platforms: subscriptions, gifts, tips and virtual currencies, paid chat, ad shares, sponsorships and splits compared.21 min
- 28Paying Creators & SellersGetting money out to creators, hosts and sellers: eligibility gates, payee KYC, payout triggers, holds, tax interviews, withholding, 1099-K and DAC7.18 min
Peer-to-Peer Marketplaces
- 29Supply Onboarding & VerificationBringing hosts and sellers on: identity, payout and tax gates, asset eligibility, the INFORM Act, DSA trader traceability and DAC7 data.19 min
- 30Listings, Search & RankingListing schemas and quality scores, lifecycle states, product compliance fields, availability-aware geo search, ranking signals, indexing and cold start.13 min
- 31Availability & BookingCalendars, blocks and buffers, external calendar sync, request to book versus instant book, decline reasons, supply sanctions and trip modifications.13 min
- 32Pricing, Fees & All-In PricesHost pricing and dynamic recommendations, marketplace fee models, usage charges, split payments, the FTC fees rule and drip pricing, and facilitator tax.15 min
- 33Deposits, Protection Plans & InsuranceDeposit holds and waivers, post-trip charges, embedded insurance versus contractual protection, host and guest plan tiers, car-sharing law and licensing.16 min
- 34Handoffs, Damage & ClaimsCheck-in and check-out evidence, readings and signed agreements, claim windows, appraisal and total loss, subrogation, and fraud-aware settlement.13 min
- 35Messaging, Reviews & ReputationMessaging as the transaction record, off-platform leakage and contact detection, simultaneous-reveal reviews, the FTC reviews rule and host status programs.13 min
- 36Cancellations, Guarantees & DisputesCancellation policy catalogs, host cancellation penalties, guarantee programs in front of chargebacks, case lifecycles, and arbitration on marketplaces.16 min
- 37Marketplace Fraud & RiskGuest and driver verification, reservation risk scoring, linked accounts, fake listings and payment diversion, seller fraud, and sanctions screening.14 min
- 38Services Marketplaces: Pet Care, Home Services & CareWhen the inventory is a person's labor in someone's home: two-tier supply, FCRA checks, boarding licenses, guarantees, recurring visits and credits.35 min
- 39Gig Work & Worker LawWorker classification, minimum pay and tip rules, deactivation rights, EU algorithmic management, account renting, rideshare insurance and worker payouts.26 min
Trust and Safety
- 40The Law of Hosting User ContentSection 230, the DMCA safe harbors and the DSA hosting exemption, why knowledge is the trigger, the cases reshaping them, and the legal clocks platforms run on.29 min
- 41Moderation at ScaleHow platforms review billions of items: classifiers as prioritizers, vendors, outsourced review, reviewer wellbeing, prevalence sampling and language coverage.18 min
- 42Spam, Bots & Inauthentic BehaviorAccount farms, vote rings, CAPTCHAs and proof of work, SMS pumping, coordinated inauthentic behavior, bot labels and crowd context notes with bridging ranking.19 min
- 43Child Safety: Detection & ReportingHow platforms detect, report and preserve child sexual abuse material: 2258A, CyberTipline reports, hash lists, the IWF, AI imagery, EU and UK rules.41 min
- 44Terrorism, Violent Extremism & Graphic ContentGIFCT hash sharing and incident response, the Christchurch Call, EU one-hour removal orders, livestreamed attacks, and gore, warning screens and newsworthiness.24 min
- 45Intimate Image AbuseThe TAKE IT DOWN Act's 48-hour removal duty, StopNCII and Take It Down hashes, deepfakes and nudify tools, state laws, and UK, EU and Australian duties.20 min
- 46Copyright at ScaleThe DMCA agent, notices, counter-notices and repeat infringers; fingerprinting and Content ID; music in live streams; and the EU Article 17 regime.25 min
- 47Abuse Desks for Hosts & RegistrarsThe web host, CDN and registrar view of abuse: intake, phishing and malware, DMCA for hosts, ICANN DNS abuse duties, CDN scanning, suspension versus takedown.24 min
- 48Crypto Investment Scams & ImpersonationRelationship investment scams across platforms, scam centers, celebrity-bait ads and fake support, the law on fraudulent ads, signals, warnings and referral.26 min
The Rules
- 49Regulators & EnforcementThe DSA, the UK Online Safety Act and Australia's eSafety regime as platforms meet them: tiers, designations, clocks, fines, withdrawals and a ledger.23 min
- 50Minors, Age Assurance & US State LawAge checks on user-generated platforms: methods and vendor risk, teen-by-default, family tools, minimum ages, US state laws in court, KOSA, COPPA, design suits.18 min
- 51Law Enforcement Requests & User DataSubpoenas, court orders, warrants, emergency and preservation requests, user notice, the CLOUD Act and EU e-evidence, and requests versus privacy rights.16 min
- 52Transparency ReportingWhat Reddit, Discord, Pinterest, Snap, Bluesky and others count, the DSA templates, OSA notices and state filings, and how to make the report a query.13 min
Running the Platform
- 53Platform ArchitectureHow user-generated platforms are built at scale: the community as partition key, hot communities, service splits, media and moderation pipelines, events.13 min
- 54AI on User-Generated PlatformsAI moderation and its error budgets, labels for AI-generated uploads, C2PA and IPTC provenance, EU AI Act disclosure, AI answers and training opt-outs.15 min
- 55Operating MetricsThe numbers user-generated platforms run on: daily uniques and MAU, supply and creator health, GMV and take rate, prevalence and action rates, and unit costs.12 min
- 56Migrations, Purges & ShutdownsPolicy-driven purges, storage caps, link rot and tombstones, country withdrawals, data exports and portability, and how to end a feature or a whole service.14 min