TL;DR: Dated reports on AI writing tools in this record split four ways across 15 entries: five first-person write-ups by three bloggers, one Capterra user review, six vendor pages and three research papers. Koala drafts run short, Jasper’s long-form rated strongest in one three-way test, and every AI draft needs a fact-check.
Here, a user report is a dated, publicly linkable account written by someone who used the tool, either a reviewer on a platform like Capterra or a blogger who ran drafts through it and published how. Vendor statements and research papers sit beside them, labelled as what they are, so you can see at a glance whose word each claim rests on. Every entry carries a source link, a source date and the date it was re-fetched. The ranked guide built on this record takes its verdicts on the five third-party tools it scores (Koala AI, Writesonic, SEOWriting.ai, Jasper and Rytr) from these entries and from those tools’ own review records. Its founder-owned top pick, HumanizeMyAI, is in none of the 15 entries: that score rests on a separate, disclosed record, read out entry by entry on the HumanizeMyAI review, where the ownership is stated.
Which AI writing tool entries are user reports, and which are vendor or research?
One entry is a platform user review (EV-14, Capterra). Five are first-person test write-ups from three independent, affiliate-disclosed bloggers (EV-04 to EV-08). Six are vendor pages quoted as self-interested sources (EV-09 to EV-13 and EV-15), and three are research papers on the language models underneath every one of these tools (EV-01 to EV-03). Forum threads would add more first-person voices, but none could be re-fetched, so none was logged. Each row shows its EV id (the same codes Mimo’s reviews cite), who wrote it and its source date; the full JSON, with quotes and URLs, lives in the public evidence log.
| ID | Tool / scope | What it documents | Who wrote it | Date |
|---|---|---|---|---|
| EV-01 | LLMs field-wide | Definition of hallucination as a documented failure mode | Research paper | 2025-10-05 |
| EV-02 | LLM apps field-wide | ~3M reviews study; factual incorrectness 38% of 350 confirmed hallucination reports | Research paper | 2025-08-19 |
| EV-03 | ChatGPT | 2024 peer-reviewed test: 65% of produced references non-existent (GPT-3.5/4 era) | Research paper | 2024-04 |
| EV-04 | Koala AI | Long-term reviewer: well-structured one-shot drafts | Independent tester | 2026-04-08 |
| EV-05 | Koala AI | 10+ article test: drafts shorter than the requested length | Independent tester | 2026-01-03 |
| EV-06 | Koala AI | Same test: too shallow on specialist topics for client delivery | Independent tester | 2026-01-03 |
| EV-07 | Jasper | 60+ day, 400+ piece test: strongest long-form of Jasper/Writesonic/Copy.ai | Independent tester | 2025 |
| EV-08 | Writesonic | Same test: strongest short-form social/ad copy of the three | Independent tester | 2025 |
| EV-09 | Koala AI | Vendor pricing: Starter $25/mo, 45,000 words; unused words bank up to 3 months on monthly plans; conditional 15-day refund (July capture: Essentials $9, 15,000 words) | Vendor page | 2026-07-10, re-read 2026-11-06 |
| EV-10 | Rytr | Vendor pricing: free 10K chars/mo; Lite $9/mo or $7.50/mo billed annually, a plan the July page named 'Unlimited' | Vendor page | 2026-07-10, re-read 2026-11-06 |
| EV-11 | Writesonic | Vendor pricing: Starter $79/mo billed annually, 15 AI articles/mo; rollover unstated | Vendor page | 2026-07-10, re-read 2026-11-06 |
| EV-12 | Jasper | Vendor pricing: Pro $69/mo/seat ($59 billed yearly), 7-day trial; no money-back window | Vendor page | 2026-07-10, re-read 2026-11-06 |
| EV-13 | SEOWriting.ai | Vendor marketing: 1-click publish, 50+ languages, bulk auto-post up to 100 articles a batch (July: 48 languages, '1000+ articles in hours') | Vendor page | 2026-07-10, re-read 2026-11-06 |
| EV-14 | SEOWriting.ai | Capterra aggregate 4.8/5 from 77 reviews on the November 6 re-read (78 in July), plus one dated review | User review | 2025-08-15, re-read 2026-11-06 |
| EV-15 | Claude | Vendor pricing: Pro $17/mo annual ($20 monthly); Max from $100/mo | Vendor page | 2026-07-10, re-read 2026-11-06 |
What do users and testers report about each AI writing tool?
Koala AI drafts well-structured one-shot articles that tend to come in short and thin on specialist subjects, and it is the most-documented tool here: 4 entries, three of them from two independent affiliate-disclosed testers plus one vendor page. A long-term reviewer got a one-shot draft that self-structured and built a table (EV-04); a ten-plus article test logs drafts shorter than the length set (EV-05) and too thin on specialist subjects: “I can’t deliver this to my clients” (EV-06). The full Koala AI review turns these into a verdict.
SEOWriting.ai enters on two entries, one vendor page and one user review, and no independent test. That absence is a logged gap. Its homepage, re-read on November 6, 2026, markets 1-click publishing from a title in 50+ languages and bulk auto-posting of up to 100 articles a batch to WordPress (EV-13); in July the same page said 48 languages and “1000+ articles in hours.” Capterra showed 4.8/5 across 77 reviews when a browser re-read it on November 6, one fewer than the 78 logged in July (EV-14). Full write-up: the SEOWriting.ai review. Jasper carries two: the one disclosed-method three-way test rated its long-form the strongest (EV-07); the vendor prices Pro at $69 a seat monthly, or $59 billed yearly, with no money-back window stated (EV-12). Weighing a switch? Our Jasper alternatives guide. Jasper’s Capterra standing, 4.8 out of 5 across 1,855 reviews when captured on July 10, 2026, is logged in the Jasper switching record, not among these 15 entries.
Writesonic appears in that same test, best short-form copy of the three (EV-08), which says nothing about long-form, plus vendor pricing (EV-11). Copy.ai has zero tool-specific entries, so its label here is not yet evidenced until a source verifies. Rytr’s single entry here is vendor pricing: a free plan of 10,000 characters a month and the Lite plan at $9 a month, or $7.50 a month billed annually (EV-10, re-read November 6, 2026). In July the same plan and price went by the name “Unlimited.” This record verified no independent Rytr quality evidence, so quality claims stay off this page; Rytr’s own dated record carries the counted user reviews and published trials.
How do Claude and ChatGPT fit in as no-affiliate AI writing baselines?
Claude and ChatGPT are the control group: a reader who subscribes to a reviewed drafting tool can earn this site a commission, while these two earn it nothing, so logging them under identical rules is the cheapest independence check we can offer. ChatGPT’s one entry is a peer-reviewed 2024 test: of the references it produced for medical case reports, 65% did not exist (EV-03), flagged as a GPT-3.5/4-era, medical-domain result. Claude’s one entry is pricing: Pro at a vendor-stated $17 a month billed annually, $20 month to month, re-read November 6, 2026 (EV-15). No Claude-specific quality evidence passed verification this sweep; the record prints that gap instead of borrowing an impression.
What failure modes do AI writing tools share?
The shared failure is confident wrong facts, and the strongest source here is a 2025 peer-reviewed Scientific Reports study that did at scale what this page does in miniature: it analyzed ~3 million user reviews of 90 LLM-based apps, manually annotated 1,000, and confirmed 350 as hallucination reports. Within those 350, factual incorrectness was the most frequently reported type, at 38%, a defined sample with its denominator printed, not a rate you may apply to any one tool (EV-02). A 2025 field survey pins the definition: fluent output that is factually inaccurate or unsupported (EV-01). The practical reading holds regardless of tool: budget a fact-check pass for every AI draft that ships under your name.
2025 peer-reviewed study, Scientific Reports
From three million reviews to one leading failure
~3 million
user reviews of 90 LLM-based apps analyzed
1,000
reviews annotated by hand
350
confirmed as hallucination reports
38%
of those 350: factual incorrectness, the most frequent type
On credit caps, no complaint passed verification this sweep, so this works from captured quotas and arithmetic alone. Taking a 1,500-word article as the unit: Koala’s 45,000-word Starter quota divides into thirty drafts (~$0.83 each), and on monthly plans the words you leave unused now bank for up to three months (EV-09, re-read November 6, 2026); Writesonic’s 15 articles at $79 billed annually is ~$5.27 each (EV-11); Rytr’s free 10K chars covers ~one draft (EV-10); Jasper prices seats, so per-article math isn’t computable (EV-12). If your calendar says thirty posts a month, run this division before you subscribe.
Do AI writing tools cost sites their Google rankings? What the record holds
This record holds zero verified entries on the question, and refuses to fake one. The evidence class that would answer it (dated before-and-after accounts from site operators, linkable, near a confirmed update) circulates constantly in secondhand summaries, but the platforms hosting the originals blocked re-fetching this sweep, and nothing enters this record from a snippet. The largest exclusion bucket (39 of 91 candidates) was affiliate material asserting conclusions with no method shown, including at least one roundup asserting a Google penalty without linking anything. When verified operator reports arrive they will be logged as dated individual accounts with links, never converted into a rate.
Are "unlimited" AI writing tool plans really unlimited? The vendor-claim audit
Not as a contract term: the word names a plan, and the limits sit in clauses the pricing page leaves out. Vendor pages are admissible here only as quotes with capture dates, and the audit value is often in what a page does not say. First read on July 10, 2026 and re-read live on November 6, 2026:
| Vendor page | The vendor states | Unstated / unresolved at capture |
|---|---|---|
| koala.sh/pricing | Starter $25/mo, 45,000 words; unused words bank up to 3 months on monthly plans; “prompt refund” within 15 days | refund conditional: under 15,000 words and 100 credits (EV-09) |
| rytr.me/pricing | Lite $9/mo, $7.50/mo billed annually, “Unlimited characters per month”; free 10K chars | what “unlimited” excludes: fair-use terms not captured; the July page named this plan “Unlimited” (EV-10) |
| writesonic.com/pricing | Starter $79/mo billed annually, 15 AI articles/mo | whether unused articles roll over (EV-11) |
| jasper.ai/pricing | Pro $69/mo/seat, $59 billed yearly; 7-day trial; cancel anytime, access through cycle | no money-back window stated anywhere (EV-12) |
| seowriting.ai | 1-click publish; 50+ languages; bulk auto-post up to 100 articles a batch | batch claim unverified; July homepage said “1000+ articles in hours” (EV-13) |
| claude.com/pricing | Pro $17/mo annual, $20 monthly; Max from $100/mo | usage ceilings deferred to a separate policy (EV-15) |
A plan sold on “unlimited” characters beside a metered free tier tells you the word is a brand promise, not a quota you can enforce. A refund conditional on staying under the very usage the plan sells is a real constraint a sticker price hides. And “not stated” is not neutral: rollover terms and money-back windows are the clauses people hit at cancellation time. Koala is the one vendor here that now prints a rollover rule.
How was this AI writing tools record sourced, and what can't it show?
Under the Mimo Evidence Protocol (MEP v1.0), the July 10, 2026 sweep ran 21 documented queries plus 8 direct captures, screened every candidate with a recorded exclusion reason, re-fetched each kept source live, and gave every entry two independent coding passes, with a third resolving any split. Of 91 candidates, 39 were affiliate pages with no method shown, 27 could not be verified that run and 12 were off-topic, which left 13 sources and 15 entries. The vendor rows were read again live on November 6, 2026. I ran the sweep myself, and the part worth telling is what fell out: two hallucination-rate figures that circulate widely, attributed to a benchmark paper, dissolved on contact, because the live abstract contained no such numbers. They were a fetch away from being quoted here as fact, and they appear nowhere on this page.
Source flow for this page
- 91 identified
- 91 screened
- 78 excluded
- 13 included
Exclusions: 39 no-methodology-affiliate · 27 unverifiable-this-run · 12 off-topic
What it can’t show. Complaint bias: people who hit problems write more, so negative accounts are over-represented. Platform skew, unusually sharp this run: review platforms and forums largely blocked verification, so the sweep tilts toward vendor pages, peer-reviewed studies, and independent blogs, and only one entry is a platform user review. G2 and Trustpilot ratings are not logged in this record at all, because both sites refused automated capture in the July sweep. All three named testers disclose affiliate links, recorded on their entries. A sample is not the population: 15 entries describe those sources, not the average subscriber. Staleness: every price was true of its page on its capture date; Capterra refused automated fetches, so its November 6 figure was read in a browser, and the ChatGPT accuracy entry is explicitly a 2024, GPT-3.5/4-era result. Perfect agreement between the two passes on 15 items is expected at this sample size and should not impress you. Anecdotes here stay anecdotes: nothing has been turned into a percentage of anyone.
AI Writing Tools Evidence FAQ
What counts as a user report under this protocol?
Why are there no forum threads in the record yet?
Why no percentages?
Maintained by Fırat Mıhcı (ResearchGate) under the Mimo Evidence Protocol (v1.0). Sweep of July 10, 2026: 91 identified → 91 screened → 78 excluded → 13 included → 15 entries; vendor pages re-read November 6, 2026. Raw log: github.com/mimoaitools/mimo-evidence.