FA

fancydirty/ai-companion-benchmarks-2026

Developer tools

이 페이지는 AI로 자동 번역되었습니다. 기술적인 세부 사항은 원문을 확인하세요. 원문 보기

0 stars 0 forks 품질 30 트렌드 8

Open dataset and reproducible evaluation logs from (https://thecompanionlab.com/).

개요

Open dataset and reproducible evaluation logs from (https://thecompanionlab.com/). Between 16 and 27 October 2026, we tested (Secrets AI, Nomi AI, SpicyChat AI, Ourdream AI, Kindroid AI, Xotic AI, GirlfriendGPT, Candy AI, DreamGF, and EroLove) using: 1. in identical order (empathy/venting, planting two memory facts, character-specific humor, pushback against a terrible financial idea, a memory quiz three turns later, and a contextual selfie request). 2. , recording the exact merchant descriptor strings printed on the card notifications, renewal pricing, token/coin meters, and cancellation dark patterns. 3. to identify the underlying LLMs, image checkpoints (Z-Image Turbo, Seedream, WAI-Illustrious-SDXL), and video engines (Wan, OmniHuman, Oh.xyz). 4. rebuilt screen-by-screen so readers can inspect each app's onboarding before handing over an email address. (Nine, not ten: EroLove has no character creator, which is a product decision rather than a gap.) 5.

README

원문 README의 일부입니다. 원문 보기.

AI Companion App Benchmarks, Bank Statement Descriptors & LLM Stack Dataset (2026)

Open dataset and reproducible evaluation logs from The Companion Lab (https://thecompanionlab.com/).

Between 16 and 27 October 2026, we tested 10 AI companion and AI girlfriend apps (Secrets AI, Nomi AI, SpicyChat AI, Ourdream AI, Kindroid AI, Xotic AI, GirlfriendGPT, Candy AI, DreamGF, and EroLove) using:

  1. The same 6 standardized conversation prompts in identical order (empathy/venting, planting two memory facts, character-specific humor, pushback against a terrible financial idea, a memory quiz three turns later, and a contextual selfie request).
  2. 8 paid subscriptions on our own bank card, recording the exact merchant descriptor strings printed on the card notifications, renewal pricing, token/coin meters, and cancellation dark patterns.
  3. Client-side JavaScript bundle and image/video EXIF inspection to identify the underlying LLMs, image checkpoints (Z-Image Turbo, Seedream, WAI-Illustrious-SDXL), and video engines (Wan, OmniHuman, Oh.xyz).
  4. 9 interactive, zero-signup character creator replicas rebuilt screen-by-screen so readers can inspect each app’s onboarding before handing over an email address. (Nine, not ten: EroLove has no character creator, which is a product decision rather than a gap.)
  5. A read of EroLove’s 179 KB inline chat JavaScript and its undocumented API (23 Oct 2026), followed by a 48-hour re-test on 26 Oct 2026 confirming that EroLove patched all four initial defects we reported.

Quick Navigation & Primary Hubs


1. Real Bank Statement Descriptors (bank-statement-descriptors.csv)

Every merchant string below comes from a real payment made on our own card in October 2026.

GitHub에서 전체 README 보기

설치

This server does not publish a one-line install command.

Open the repository installation guide MCP 초보자라면? mcpskill.org 가이드부터 시작하세요 →