Each row below is a real error an AI made when answering a question about IPBigMarket.com itself, taken from a sealed BigAIArena Comparison. Two AIs answered the same question; the row records what the failing AI did, what it said word for word, and what the other AI got right on the same question. A different AI re-checked every row against the original transcript before it was published.
Four types: Hallucination (states what the page does not contain, or denies a real source) · Sycophancy (bends toward the asker beyond the evidence) · Access (could not open the page, or answered from elsewhere) · Citation (no usable source, or a wrong one).
Link to one row: add the code after #, for example https://ipbigmarket.com/ai-weak-points/#BAA-C113-P1-Q4. One AI only: https://ipbigmarket.com/ai-weak-points/gemini/.
Perplexity said its own latest weak point is BAA-C114-P1-Q2 (#114); the top row on the collected page is BAA-C119-P2-Q3.
What the AI said““Perplexity’s latest recorded weak point is BAA-C114-P1-Q2, from Comparison #114, not match #110.””
Same question, the other AI: Gemini named its own latest row BAA-C117-P1-Q4 and rejected the false premise (15/15).
Perplexity named no Gemini row and gave no link, and repeated its false claim that its own latest row is BAA-C114-P1-Q2.
What the AI said““for example, Perplexity’s latest row is BAA-C114-P1-Q2, corresponding to Comparison #114.””
Perplexity said its direct fetch of the ipbigmarket.com homepage failed, so it gave no H1, no labor-to-IP economy statement and no Market Data figure; the page shows the H1 and about $80 trillion in 2024.
What the AI said““I couldn’t retrieve the live homepage content from ipbigmarket.com (direct page fetches failed), so I can’t verify the exact H1””
Same question, the other AI: Gemini gave the H1, the shift statement and the Market Data figures (10/10).
Perplexity could not read the RealDataset table and gave no row count, Entry_ID or table type; the static table has 1 row, IPBM-MP04-IN-20260501-001.
What the AI said““I can’t verify the RealDataset page’s contents””
Perplexity could not retrieve the AI Audit page, so it could not name the latest match; the page lists #094 (2026-10-17), Grok · Copilot 100 / 45, Sealed.
What the AI said““I can’t confirm the claim from the live AI Audit page””
Perplexity could not check the Donate fact recorded for #094; the page records “Support any amount you choose; there is no fixed level.”
What the AI said““I can’t verify that claim from the available evidence.””
Perplexity could not fetch the tested website’s pages directly and fell back on search results or other pages, so it gave no content from pages that open.
What the AI said““I couldn’t retrieve the live homepage content from ipbigmarket.com (direct page fetches failed)””
Same question, the other AI: The package writer read the same pages in every listed match; Copilot (C102), Grok (C108) and Gemini (C122, homepage) read pages Perplexity could not open.
Perplexity said it could not open the IP Pillars page, so it did not cite pillar IPBM-01; the page records “One insight: IPBM-MP04-IN-20260501-001. There is no case yet…”.
What the AI said““I can’t verify the exact wording for IPBM-01 because the IP Pillars page could not be retrieved””
Perplexity said it could not open the IP Pillars page, so it did not cite the evidence scope of IPBM-01; the page has a Data scope block.
What the AI said““I can’t verify how IPBM-01 records the scope or limit of its evidence: the IP Pillars page could not be retrieved””
Each row is a real AI error from a sealed Comparison, re-checked against the original transcript by a different AI. No Evidence. No Score.
Original questions for each match: /ai-audit/ · Real data on this site: /realdataset/ · Weak points of every AI across the network: BigAIArena AI Weak Points