FA

fancydirty/ai-companion-benchmarks-2026

Developer tools

Эта страница переведена автоматически. Технические детали смотрите в оригинале. Открыть оригинал

0 stars 0 forks Качество 30 Тренд 8

Open dataset and reproducible evaluation logs from (https://thecompanionlab.com/).

Обзор

Open dataset and reproducible evaluation logs from (https://thecompanionlab.com/). Between 16 and 27 October 2026, we tested (Secrets AI, Nomi AI, SpicyChat AI, Ourdream AI, Kindroid AI, Xotic AI, GirlfriendGPT, Candy AI, DreamGF, and EroLove) using: 1. in identical order (empathy/venting, planting two memory facts, character-specific humor, pushback against a terrible financial idea, a memory quiz three turns later, and a contextual selfie request). 2. , recording the exact merchant descriptor strings printed on the card notifications, renewal pricing, token/coin meters, and cancellation dark patterns. 3. to identify the underlying LLMs, image checkpoints (Z-Image Turbo, Seedream, WAI-Illustrious-SDXL), and video engines (Wan, OmniHuman, Oh.xyz). 4. rebuilt screen-by-screen so readers can inspect each app's onboarding before handing over an email address. (Nine, not ten: EroLove has no character creator, which is a product decision rather than a gap.) 5.

README

Показан фрагмент оригинального README. Открыть оригинал.

AI Companion App Benchmarks, Bank Statement Descriptors & LLM Stack Dataset (2026)

Open dataset and reproducible evaluation logs from The Companion Lab (https://thecompanionlab.com/).

Between 16 and 27 October 2026, we tested 10 AI companion and AI girlfriend apps (Secrets AI, Nomi AI, SpicyChat AI, Ourdream AI, Kindroid AI, Xotic AI, GirlfriendGPT, Candy AI, DreamGF, and EroLove) using:

  1. The same 6 standardized conversation prompts in identical order (empathy/venting, planting two memory facts, character-specific humor, pushback against a terrible financial idea, a memory quiz three turns later, and a contextual selfie request).
  2. 8 paid subscriptions on our own bank card, recording the exact merchant descriptor strings printed on the card notifications, renewal pricing, token/coin meters, and cancellation dark patterns.
  3. Client-side JavaScript bundle and image/video EXIF inspection to identify the underlying LLMs, image checkpoints (Z-Image Turbo, Seedream, WAI-Illustrious-SDXL), and video engines (Wan, OmniHuman, Oh.xyz).
  4. 9 interactive, zero-signup character creator replicas rebuilt screen-by-screen so readers can inspect each app’s onboarding before handing over an email address. (Nine, not ten: EroLove has no character creator, which is a product decision rather than a gap.)
  5. A read of EroLove’s 179 KB inline chat JavaScript and its undocumented API (23 Oct 2026), followed by a 48-hour re-test on 26 Oct 2026 confirming that EroLove patched all four initial defects we reported.

Quick Navigation & Primary Hubs


1. Real Bank Statement Descriptors (bank-statement-descriptors.csv)

Every merchant string below comes from a real payment made on our own card in October 2026.

Открыть полный README на GitHub

Установка

This server does not publish a one-line install command.

Open the repository installation guide Новичок в MCP? Начните с руководства на mcpskill.org →