Research Goal
Design one difficult but fair browsing challenge.
Web research • AI evaluation • Benchmark design
An art-history question where the museum's own record confirms the people but not the date.
This benchmark tests whether a solver can combine an institutional catalogue entry, which gives only a year, with an account of the thief's interrogation that fixes the day and weekday. The recovery date two years later is documented as a decoy rather than left as a trap.
Frontier AI browsing systems can answer many questions by locating obvious keywords or matching information from highly ranked webpages. This project explores how to construct a research question that cannot be solved through a single search. The answer must remain short, stable and objectively verifiable, while the clues require the researcher to connect different people, dates, places, organisations, publications, events, records and quantities.
Design one difficult but fair browsing challenge.
A short, stable and objectively verifiable fact.
Every clue must be independently supported by reliable evidence.
A question, answer, clue set, source trail, validation log and JSON record.
AIBRC-007
Portfolio integrity note: Every claim on this page was checked against the cited source before publication. No source, quotation, locator or search result is invented; where a detail could not be verified directly it is described rather than quoted.
Begin with a stable fact that can be confirmed through a reliable primary or authoritative source. Record the exact wording, document title, issuing organisation and publication date.
Develop clues involving different fact types, including dates, people, places, organisations, works, events, records and quantities. Each clue must be independently checkable.
Run obvious, broad and targeted search queries. Record the results to identify accidental shortcuts, direct answer leakage and misleading pages.
Explain how each source supports a specific clue and how the clues logically combine to identify one answer.
Recheck every source, confirm answer uniqueness, document limitations and export the completed benchmark record in a consistent JSON format.
Each clue constrains the answer from a different direction. No single row is sufficient on its own, and every row can be checked against a source another researcher can reach.
Statuses are editable so the matrix can be worked through row by row. Scroll sideways on small screens.
| Clue ID | Fact type | Clue statement | Constraint | Supporting source | Exact locator | Verification status |
|---|---|---|---|---|---|---|
| C01 | Person | The man responsible had worked at the museum as a glazier and was Italian. | One named individual: Vincenzo Peruggia. | Louvre collections record for the painting | Historical note on the work | Verified |
| C02 | Organisation | The institution is a Paris museum whose own catalogue records the theft. | Confirms the venue from the holding institution rather than from press retellings. | Louvre collections record for the painting | Same note | Verified |
| C03 | Method | The thief entered early in the morning wearing the white smock worn by museum staff. | Detail attributed to his own later interrogation, not to legend. | Wikipedia — Vincenzo Peruggia | Section on the theft, citing the Florence interrogation | Verified |
| C04 | Date | He was arrested more than two years later, on 12 December 1913. | Fixes the recovery date, which is a common wrong answer. | Wikipedia — Vincenzo Peruggia | Same section | Verified |
| C05 | Day of week | The theft took place on a Monday. | Combined with the month and year this leaves a single candidate date. | Wikipedia — Vincenzo Peruggia | Interrogation account: “Monday, 21 August 1911, at around 7 am” | Verified |
Each card records a source that was opened and read before it was cited. Excerpts are quoted only where the wording was read directly; otherwise the record describes what the source shows.
A strong benchmark documents the searches a capable researcher or browsing agent would naturally attempt, including the ones that exposed the answer. Leakage is recorded rather than hidden, and the question is rewritten around it.
| Search number | Exact search query | Search engine or database | Date searched | Top relevant results | Answer revealed? | Problem discovered | Action taken |
|---|---|---|---|---|---|---|---|
| S01 | when was the Mona Lisa stolen | 4 September 2026 | Exposes 21 August 1911 in the snippet. | Yes | The plain question is answered without opening anything. | The question was rewritten to avoid naming the painting, the museum and the word 'stolen'. | |
| S02 | Louvre glazier Italian arrested Florence 1913 painting returned | 4 September 2026 | Returns material on the recovery; the 1911 date appears only after reading a record. | No | None — this is the intended path. | Retained as the reference path. | |
| S03 | musée du Louvre catalogue vol 1911 Peruggia | 4 September 2026 | Reaches the Louvre catalogue record used as E01, which gives the year but not the day. | No | The institutional record alone is not sufficient to answer. | Documented; it demonstrates that the chain needs a second source to reach a day-level answer. | |
| S04 | "12 December 1913" Mona Lisa arrest date | 4 September 2026 | Returns the recovery date, the most common wrong answer. | No | Confirms the decoy is live in the search results. | Clue C04 states the arrest date explicitly so it cannot be mistaken for the answer. |
Every candidate source is scored from 1 to 5 against five criteria before it is allowed into the evidence chain.
Who created or issued the information?
Is the source directly connected to the event or record?
Does it support the precise claim being made?
Is the information unlikely to change?
Can another researcher locate the same evidence?
Export a report that maps every clue to the source it rests on, records the verification status and access date of each source, and lists the searches that exposed the answer.
Completion
14 of 15 checks confirmed
93%
The complete challenge is delivered as a single validated JSON document.
aibrc-007-benchmark-record.json
{
"challenge_id": "AIBRC-007",
"title": "Cultural Heritage Benchmark",
"project_type": "independent_demonstration",
"research_domain": "Art History and Museum Records",
"difficulty": "advanced",
"question": "An Italian glazier who had worked for a Paris museum walked out of it early one Monday morning wearing a staff smock, taking a painting that was only recovered after his arrest in December 1913. On what date did he take it?",
"accepted_answers": [
"21 August 1911"
],
"answer_type": "short_text",
"answer_normalisation": {
"case_sensitive": false,
"ignore_punctuation": true,
"accepted_variations": [
"21 August 1911",
"August 21, 1911",
"21/08/1911",
"1911-08-21"
]
},
"clues": [
{
"clue_id": "C01",
"fact_type": "person",
"statement": "The man responsible had worked at the museum as a glazier and was Italian.",
"constraint": "One named individual: Vincenzo Peruggia.",
"source": "Louvre collections record for the painting",
"locator": "Historical note on the work",
"status": "verified"
},
{
"clue_id": "C02",
"fact_type": "organisation",
"statement": "The institution is a Paris museum whose own catalogue records the theft.",
"constraint": "Confirms the venue from the holding institution rather than from press retellings.",
"source": "Louvre collections record for the painting",
"locator": "Same note",
"status": "verified"
},
{
"clue_id": "C03",
"fact_type": "method",
"statement": "The thief entered early in the morning wearing the white smock worn by museum staff.",
"constraint": "Detail attributed to his own later interrogation, not to legend.",
"source": "Wikipedia — Vincenzo Peruggia",
"locator": "Section on the theft, citing the Florence interrogation",
"status": "verified"
},
{
"clue_id": "C04",
"fact_type": "date",
"statement": "He was arrested more than two years later, on 12 December 1913.",
"constraint": "Fixes the recovery date, which is a common wrong answer.",
"source": "Wikipedia — Vincenzo Peruggia",
"locator": "Same section",
"status": "verified"
},
{
"clue_id": "C05",
"fact_type": "day of week",
"statement": "The theft took place on a Monday.",
"constraint": "Combined with the month and year this leaves a single candidate date.",
"source": "Wikipedia — Vincenzo Peruggia",
"locator": "Interrogation account: “Monday, 21 August 1911, at around 7 am”",
"status": "verified"
}
],
"evidence": [
{
"evidence_id": "E01",
"claim_supported": "Clues C01 and C02 — the thief and the institution.",
"source_title": "Portrait de Lisa Gherardini, épouse de Francesco del Giocondo",
"issuing_organisation": "Musée du Louvre (collections catalogue)",
"source_type": "Museum catalogue record",
"url": "https://collections.louvre.fr/en/ark:/53355/cl010062370",
"publication_date": "Standing catalogue entry",
"page_number": "n/a (catalogue record)",
"section": "Historical note",
"access_date": "4 September 2026",
"reliability": "High — the institution that holds the work",
"verification_status": "verified"
},
{
"evidence_id": "E02",
"claim_supported": "The answer, and clues C03, C04 and C05.",
"source_title": "Vincenzo Peruggia",
"issuing_organisation": "Wikipedia",
"source_type": "Reference database",
"url": "https://en.wikipedia.org/wiki/Vincenzo_Peruggia",
"publication_date": "Continuously edited article",
"page_number": "n/a (web page)",
"section": "Theft and arrest",
"access_date": "4 September 2026",
"reliability": "Medium-high — corroborated by the article on the painting",
"verification_status": "verified"
},
{
"evidence_id": "E03",
"claim_supported": "Independent corroboration of the date.",
"source_title": "Mona Lisa",
"issuing_organisation": "Wikipedia",
"source_type": "Reference database",
"url": "https://en.wikipedia.org/wiki/Mona_Lisa",
"publication_date": "Continuously edited article",
"page_number": "n/a (web page)",
"section": "Theft and vandalism",
"access_date": "4 September 2026",
"reliability": "Medium",
"verification_status": "verified"
}
],
"search_validation": [
{
"search_id": "S01",
"query": "when was the Mona Lisa stolen",
"platform": "Google",
"search_date": "4 September 2026",
"relevant_results": "Exposes 21 August 1911 in the snippet.",
"answer_exposed": true,
"notes": "The plain question is answered without opening anything. The question was rewritten to avoid naming the painting, the museum and the word 'stolen'."
},
{
"search_id": "S02",
"query": "Louvre glazier Italian arrested Florence 1913 painting returned",
"platform": "Google",
"search_date": "4 September 2026",
"relevant_results": "Returns material on the recovery; the 1911 date appears only after reading a record.",
"answer_exposed": false,
"notes": "None — this is the intended path. Retained as the reference path."
},
{
"search_id": "S03",
"query": "musée du Louvre catalogue vol 1911 Peruggia",
"platform": "Google",
"search_date": "4 September 2026",
"relevant_results": "Reaches the Louvre catalogue record used as E01, which gives the year but not the day.",
"answer_exposed": false,
"notes": "The institutional record alone is not sufficient to answer. Documented; it demonstrates that the chain needs a second source to reach a day-level answer."
},
{
"search_id": "S04",
"query": "\"12 December 1913\" Mona Lisa arrest date",
"platform": "Google",
"search_date": "4 September 2026",
"relevant_results": "Returns the recovery date, the most common wrong answer.",
"answer_exposed": false,
"notes": "Confirms the decoy is live in the search results. Clue C04 states the arrest date explicitly so it cannot be mistaken for the answer."
}
],
"quality_checks": {
"The answer is short and objectively verifiable.": true,
"The answer is supported by an authoritative source.": true,
"The question has only one defensible answer.": true,
"No single clue directly exposes the answer.": true,
"Each clue is independently checkable.": true,
"The clue set spans multiple fact types.": true,
"The task requires multi-step reasoning.": true,
"Obvious searches have been documented.": true,
"Search-result snippets do not reveal the answer.": false,
"Sources are publicly accessible.": true,
"Exact pages, tables or sections are recorded.": true,
"The evidence chain can be reproduced.": true,
"The question avoids subjective interpretation.": true,
"The answer is stable over time.": true,
"No fabricated evidence is included.": true
},
"researcher": {
"name": "TMK Research Lab",
"portfolio": "https://theophilusmorkporkpor.lovable.app",
"email": "tkudjordjie@gmail.com"
}
}AI-generated statements are never treated as evidence. Every factual claim must be verified against an accessible external source.
This benchmark is complete: the answer is fixed, 3 evidence records are attached to specific clues, and 4 validation searches are documented, including those that exposed the answer. It demonstrates the ability to approach an unfamiliar subject systematically, separate evidence from assumption and document research so that another person can audit it.
Two dates circulate — the 1911 theft and the December 1913 arrest — and the museum's own catalogue gives only the year.
The Louvre catalogue search reached an authoritative record that could not answer the question on its own.
The account of the Florence interrogation, because it fixes the weekday and the hour as well as the date.
Naming the arrest date inside the question removes the most common wrong answer before the solver starts.
Returning December 1913, or giving 1911 without a day because it stopped at the museum record.
The day-level evidence is encyclopaedic rather than archival; a digitised French police or press record from August 1911 would strengthen it.
Add a contemporary Paris newspaper page from the days after the theft, retrieved from a national library archive.
I am available for web research, fact-checking, AI evaluation, benchmark construction, source verification and structured research documentation.
TMK Research Labtkudjordjie@gmail.comhttps://theophilusmorkporkpor.lovable.apphttps://www.linkedin.com/in/theophilus-kudzordzi