{
 "meta": {
  "model": "gemma3:4b",
  "load_s": 41.79,
  "peak_ram_mb_all_ollama": 3483,
  "ollama_ps": [
   {
    "name": "gemma3:4b",
    "model": "gemma3:4b",
    "size": 3533355087,
    "digest": "68ceab7e468a31c988b44d5a4984a0e21f58c4f7158c6ce29c1804babac38df7",
    "details": {
     "parent_model": "",
     "format": "gguf",
     "family": "gemma3",
     "families": [
      "gemma3",
      "clip"
     ],
     "parameter_size": "3.9B",
     "quantization_level": "Q4_K_M"
    },
    "expires_at": "2026-10-22T13:20:17.942497+02:00",
    "size_vram": 2810393394,
    "context_length": 4096,
    "runner": "llamacpp"
   }
  ]
 },
 "rows": [
  {
   "id": "nl01",
   "lang": "nl",
   "q": "Hoeveel water moet ik per persoon per dag opslaan?",
   "retrieved": [
    {
     "id": "P01",
     "score": 0.722
    },
    {
     "id": "NL1",
     "score": 0.5896
    },
    {
     "id": "P04",
     "score": 0.5668
    }
   ],
   "answer": "U moet minstens één gallon (ongeveer 4 liter) water per persoon per dag opslaan, voor minstens drie dagen [P01]. Kinderen, borstvoedende moeders en zieken kunnen meer nodig hebben.",
   "perf": {
    "ttft_s": 77.37,
    "total_s": 93.27,
    "eval_tokens": 50,
    "tok_per_s": 2.7,
    "prompt_tokens": 489,
    "prompt_tok_per_s": 7.8
   },
   "score": {
    "refused": false,
    "cited": [
     "P01"
    ],
    "answer_lang": "nl",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "nl02",
   "lang": "nl",
   "q": "Mag ik mijn aggregaat in de garage laten draaien als de deur openstaat?",
   "retrieved": [
    {
     "id": "P02",
     "score": 0.5587
    },
    {
     "id": "P09",
     "score": 0.4313
    },
    {
     "id": "P16",
     "score": 0.3958
    }
   ],
   "answer": "Nee, dat mag absoluut niet [P02]. U mag een aggregaat NOOIT draaien als de deur openstaat, zelfs niet met ramen open. Houd de generator buiten en minstens 20 meter (6 meter) van ramen, deuren en ventilatieopeningen [P02].",
   "perf": {
    "ttft_s": 28.17,
    "total_s": 43.71,
    "eval_tokens": 67,
    "tok_per_s": 4.5,
    "prompt_tokens": 464,
    "prompt_tok_per_s": 30.2
   },
   "score": {
    "refused": false,
    "cited": [
     "P02"
    ],
    "answer_lang": "nl",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "nl03",
   "lang": "nl",
   "q": "Hoe lang moet ik water koken om het veilig te maken om te drinken?",
   "retrieved": [
    {
     "id": "P04",
     "score": 0.7332
    },
    {
     "id": "P05",
     "score": 0.6236
    },
    {
     "id": "P01",
     "score": 0.6083
    }
   ],
   "answer": "Om water veilig te maken om te drinken, breng het dan 1 minuut lang aan de kook [P04]. Op grote hoogte boven de 6.500 voet (2.000 meter) moet u het 3 minuten laten koken [P04]. Laat het water op natuurlijke wijze afkoelen en bewaar het in schone, afgedekte containers [P04].",
   "perf": {
    "ttft_s": 41.77,
    "total_s": 50.1,
    "eval_tokens": 90,
    "tok_per_s": 11.1,
    "prompt_tokens": 490,
    "prompt_tok_per_s": 28.8
   },
   "score": {
    "refused": false,
    "cited": [
     "P04"
    ],
    "answer_lang": "nl",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": [
     "2.000",
     "6.500"
    ]
   }
  },
  {
   "id": "nl04",
   "lang": "nl",
   "q": "Hoeveel druppels bleekmiddel doe ik in 4 liter water?",
   "retrieved": [
    {
     "id": "P05",
     "score": 0.5978
    },
    {
     "id": "P01",
     "score": 0.5146
    },
    {
     "id": "P04",
     "score": 0.4829
    }
   ],
   "answer": "Gebruik 8 druppels (ongeveer 1/8 theelepel) per 4 liter water [P05]. Roer en wacht 30 minuten voordat u het drinkt [P05].",
   "perf": {
    "ttft_s": 38.79,
    "total_s": 49.82,
    "eval_tokens": 47,
    "tok_per_s": 4.1,
    "prompt_tokens": 490,
    "prompt_tok_per_s": 32.4
   },
   "score": {
    "refused": false,
    "cited": [
     "P05"
    ],
    "answer_lang": "nl",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "nl05",
   "lang": "nl",
   "q": "Hoe lang blijft eten in een dichte koelkast koud als de stroom uitvalt?",
   "retrieved": [
    {
     "id": "P06",
     "score": 0.6823
    },
    {
     "id": "P14",
     "score": 0.5192
    },
    {
     "id": "P07",
     "score": 0.5174
    }
   ],
   "answer": "Een open koelkast houdt onopgeëiste voedsel ongeveer 4 uur koud [P06]. Een gesloten koelkast houdt onopgeëiste voedsel ongeveer 48 uur koud [P06].",
   "perf": {
    "ttft_s": 89.5,
    "total_s": 95.35,
    "eval_tokens": 51,
    "tok_per_s": 8.1,
    "prompt_tokens": 468,
    "prompt_tok_per_s": 10.3
   },
   "score": {
    "refused": false,
    "cited": [
     "P06"
    ],
    "answer_lang": "nl",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "nl06",
   "lang": "nl",
   "q": "Ik ruik gas in huis. Wat moet ik doen?",
   "retrieved": [
    {
     "id": "P09",
     "score": 0.7526
    },
    {
     "id": "P03",
     "score": 0.5773
    },
    {
     "id": "P02",
     "score": 0.5736
    }
   ],
   "answer": "Als je gas ruikt, verlaat dan onmiddellijk het gebouw en laat de deur open [P09]. Schakel nooit licht of elektrische schakelaars in of uit, gebruik geen telefoon of aansteker en veroorzaak geen vonk [P09]. Bel de gasleverancier of het noodnummer vanaf buiten, op een veilige afstand [P09].",
   "perf": {
    "ttft_s": 24.48,
    "total_s": 37.36,
    "eval_tokens": 82,
    "tok_per_s": 5.5,
    "prompt_tokens": 444,
    "prompt_tok_per_s": 28.6
   },
   "score": {
    "refused": false,
    "cited": [
     "P09"
    ],
    "answer_lang": "nl",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "nl07",
   "lang": "nl",
   "q": "Wanneer wordt het luchtalarm getest?",
   "retrieved": [
    {
     "id": "NL2",
     "score": 0.5633
    },
    {
     "id": "P18",
     "score": 0.4609
    },
    {
     "id": "P09",
     "score": 0.4477
    }
   ],
   "answer": "Het luchtalarm wordt getest op de eerste maandag van elke maand om 12:00 uur [P02]. Als de sirene tijdens een test afgaat, ga dan binnen, sluit deuren en ramen, schakel ventilatie uit en volg NL-Alert en de regionale noodbreidingsomroep [P02]. Het is belangrijk om nooit terug te keren in een brandend gebouw [P18].",
   "perf": {
    "ttft_s": 28.59,
    "total_s": 41.15,
    "eval_tokens": 92,
    "tok_per_s": 6.3,
    "prompt_tokens": 457,
    "prompt_tok_per_s": 41.3
   },
   "score": {
    "refused": false,
    "cited": [
     "P02",
     "P18"
    ],
    "answer_lang": "nl",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": false,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": [
     "00",
     "12"
    ]
   }
  },
  {
   "id": "nl08",
   "lang": "nl",
   "q": "Iemand heeft een hitteberoerte. Moet ik hem water laten drinken?",
   "retrieved": [
    {
     "id": "P12",
     "score": 0.6411
    },
    {
     "id": "P11",
     "score": 0.6398
    },
    {
     "id": "P04",
     "score": 0.5809
    }
   ],
   "answer": "Nee, u mag de persoon GEEN water laten drinken [P11]. Bij een hitteberoerte mag u de persoon NIET iets te drinken geven [P11]. Beweeg de persoon naar een koelere plek en gebruik koelende doeken [P11]. Bel direct het noodnummer [P11].",
   "perf": {
    "ttft_s": 36.91,
    "total_s": 42.14,
    "eval_tokens": 73,
    "tok_per_s": 12.3,
    "prompt_tokens": 520,
    "prompt_tok_per_s": 25.8
   },
   "score": {
    "refused": false,
    "cited": [
     "P11"
    ],
    "answer_lang": "nl",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": false,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "nl09",
   "lang": "nl",
   "q": "Hoe repareer ik een lekke autoband?",
   "retrieved": [
    {
     "id": "P13",
     "score": 0.4682
    },
    {
     "id": "P08",
     "score": 0.4223
    },
    {
     "id": "NL1",
     "score": 0.4097
    }
   ],
   "answer": "Het spijt me, maar die informatie staat niet in de bibliotheek [P08, NL1].",
   "perf": {
    "ttft_s": 25.35,
    "total_s": 26.81,
    "eval_tokens": 24,
    "tok_per_s": 13.2,
    "prompt_tokens": 494,
    "prompt_tok_per_s": 28.2
   },
   "score": {
    "refused": false,
    "cited": [],
    "answer_lang": "nl",
    "lang_ok": true,
    "refusal_ok": false
   }
  },
  {
   "id": "nl10",
   "lang": "nl",
   "q": "Welke paddenstoelen in het bos zijn veilig om te eten?",
   "retrieved": [
    {
     "id": "P07",
     "score": 0.3594
    },
    {
     "id": "P06",
     "score": 0.3579
    },
    {
     "id": "P04",
     "score": 0.3458
    }
   ],
   "answer": "NOT_IN_LIBRARY",
   "perf": {
    "ttft_s": 34.83,
    "total_s": 39.67,
    "eval_tokens": 6,
    "tok_per_s": 1.4,
    "prompt_tokens": 497,
    "prompt_tok_per_s": 36.4
   },
   "score": {
    "refused": true,
    "cited": [],
    "answer_lang": "nl",
    "lang_ok": true,
    "refusal_ok": true
   }
  },
  {
   "id": "en01",
   "lang": "en",
   "q": "How much water should I store per person per day?",
   "retrieved": [
    {
     "id": "P01",
     "score": 0.7462
    },
    {
     "id": "P04",
     "score": 0.5804
    },
    {
     "id": "P05",
     "score": 0.549
    }
   ],
   "answer": "You should store at least one gallon (about 4 litres) of water per person per day [P01]. Children, nursing mothers and sick people may need more. This is for drinking and sanitation purposes [P01].",
   "perf": {
    "ttft_s": 41.11,
    "total_s": 49.35,
    "eval_tokens": 48,
    "tok_per_s": 5.2,
    "prompt_tokens": 484,
    "prompt_tok_per_s": 16.2
   },
   "score": {
    "refused": false,
    "cited": [
     "P01"
    ],
    "answer_lang": "en",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "en02",
   "lang": "en",
   "q": "Can I cook on my charcoal grill in the living room during a power cut?",
   "retrieved": [
    {
     "id": "P02",
     "score": 0.5447
    },
    {
     "id": "P19",
     "score": 0.4957
    },
    {
     "id": "P06",
     "score": 0.4646
    }
   ],
   "answer": "No, you should NEVER run a generator, pressure washer, grill, camp stove or any gasoline-, propane- or charcoal-burning device inside a home [P02]. This is to prevent carbon monoxide poisoning. Keep all such devices outdoors and at least 20 feet (6 metres) away from windows and doors [P02].",
   "perf": {
    "ttft_s": 35.65,
    "total_s": 44.6,
    "eval_tokens": 70,
    "tok_per_s": 7.3,
    "prompt_tokens": 465,
    "prompt_tok_per_s": 22.5
   },
   "score": {
    "refused": false,
    "cited": [
     "P02"
    ],
    "answer_lang": "en",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "en03",
   "lang": "en",
   "q": "How far away from the house should my generator be?",
   "retrieved": [
    {
     "id": "P02",
     "score": 0.723
    },
    {
     "id": "P09",
     "score": 0.4708
    },
    {
     "id": "P10",
     "score": 0.467
    }
   ],
   "answer": "The generator should be at least 20 feet (about 6 metres) away from windows, doors and vents [P02]. It must be kept outdoors. Never run a generator inside [P02].",
   "perf": {
    "ttft_s": 12.96,
    "total_s": 25.98,
    "eval_tokens": 45,
    "tok_per_s": 3.3,
    "prompt_tokens": 459,
    "prompt_tok_per_s": 48.8
   },
   "score": {
    "refused": false,
    "cited": [
     "P02"
    ],
    "answer_lang": "en",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "en04",
   "lang": "en",
   "q": "What are the symptoms of carbon monoxide poisoning?",
   "retrieved": [
    {
     "id": "P03",
     "score": 0.8039
    },
    {
     "id": "P12",
     "score": 0.5003
    },
    {
     "id": "P11",
     "score": 0.4934
    }
   ],
   "answer": "According to the library, symptoms of carbon monoxide poisoning include headache, dizziness, weakness, upset stomach, vomiting, chest pain and confusion [P03]. It is crucial to get everyone into fresh air immediately if you suspect poisoning [P03]. Install battery-operated carbon monoxide detectors [P03].",
   "perf": {
    "ttft_s": 17.54,
    "total_s": 20.43,
    "eval_tokens": 63,
    "tok_per_s": 20.7,
    "prompt_tokens": 478,
    "prompt_tok_per_s": 48.6
   },
   "score": {
    "refused": false,
    "cited": [
     "P03"
    ],
    "answer_lang": "en",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "en05",
   "lang": "en",
   "q": "How deep does moving flood water have to be to knock me over?",
   "retrieved": [
    {
     "id": "P10",
     "score": 0.7343
    },
    {
     "id": "P17",
     "score": 0.5386
    },
    {
     "id": "P04",
     "score": 0.4987
    }
   ],
   "answer": "Just 6 inches (15 centimetres) of moving flood water can knock you down [P10]. It is extremely dangerous to walk, swim, or drive through flood waters. NEVER attempt to do so [P10].  Do not approach fast-moving water [P10].",
   "perf": {
    "ttft_s": 43.38,
    "total_s": 50.25,
    "eval_tokens": 61,
    "tok_per_s": 8.8,
    "prompt_tokens": 478,
    "prompt_tok_per_s": 22.5
   },
   "score": {
    "refused": false,
    "cited": [
     "P10"
    ],
    "answer_lang": "en",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "en06",
   "lang": "en",
   "q": "How long does a full freezer keep food frozen without power?",
   "retrieved": [
    {
     "id": "P06",
     "score": 0.709
    },
    {
     "id": "P14",
     "score": 0.5175
    },
    {
     "id": "P07",
     "score": 0.5101
    }
   ],
   "answer": "A full freezer keeps its temperature for about 48 hours [P06]. A half-full freezer keeps its temperature for about 24 hours [P06]. It is important to discard perishable food if it has been above 40 degrees F (4 degrees C) for 2 hours or more [P06]. Never taste food to decide if it is safe [P06].",
   "perf": {
    "ttft_s": 28.4,
    "total_s": 36.06,
    "eval_tokens": 84,
    "tok_per_s": 11.5,
    "prompt_tokens": 460,
    "prompt_tok_per_s": 40.2
   },
   "score": {
    "refused": false,
    "cited": [
     "P06"
    ],
    "answer_lang": "en",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "en07",
   "lang": "en",
   "q": "Where exactly should I put a tourniquet on a bleeding leg?",
   "retrieved": [
    {
     "id": "P13",
     "score": 0.7121
    },
    {
     "id": "P17",
     "score": 0.473
    },
    {
     "id": "P11",
     "score": 0.4543
    }
   ],
   "answer": "You should place a tourniquet 2 to 3 inches (5 to 7 centimetres) above the wound, not on a joint [P13]. Tighten it until the bleeding stops [P13]. Do not remove it yourself [P13].",
   "perf": {
    "ttft_s": 23.2,
    "total_s": 25.38,
    "eval_tokens": 55,
    "tok_per_s": 18.9,
    "prompt_tokens": 480,
    "prompt_tok_per_s": 41.3
   },
   "score": {
    "refused": false,
    "cited": [
     "P13"
    ],
    "answer_lang": "en",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "en08",
   "lang": "en",
   "q": "The ground is shaking. Should I run outside?",
   "retrieved": [
    {
     "id": "P17",
     "score": 0.6075
    },
    {
     "id": "P10",
     "score": 0.5722
    },
    {
     "id": "P18",
     "score": 0.5312
    }
   ],
   "answer": "During an earthquake, you should Drop, Cover, and Hold On [P17]. Do not run outside during shaking and stay away from windows [P17]. If you are in bed, protect your head with a pillow [P17]. NEVER run outside during shaking [P17].",
   "perf": {
    "ttft_s": 22.08,
    "total_s": 24.83,
    "eval_tokens": 62,
    "tok_per_s": 20.4,
    "prompt_tokens": 447,
    "prompt_tok_per_s": 42.7
   },
   "score": {
    "refused": false,
    "cited": [
     "P17"
    ],
    "answer_lang": "en",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "en09",
   "lang": "en",
   "q": "What is the best rifle calibre for hunting deer?",
   "retrieved": [
    {
     "id": "P13",
     "score": 0.3314
    },
    {
     "id": "P04",
     "score": 0.2981
    },
    {
     "id": "P10",
     "score": 0.2962
    }
   ],
   "answer": "NOT_IN_LIBRARY",
   "perf": {
    "ttft_s": 54.8,
    "total_s": 70.51,
    "eval_tokens": 6,
    "tok_per_s": 0.4,
    "prompt_tokens": 493,
    "prompt_tok_per_s": 26.2
   },
   "score": {
    "refused": true,
    "cited": [],
    "answer_lang": "nl",
    "lang_ok": false,
    "refusal_ok": true
   }
  },
  {
   "id": "en10",
   "lang": "en",
   "q": "How do I treat a venomous snake bite?",
   "retrieved": [
    {
     "id": "P13",
     "score": 0.4901
    },
    {
     "id": "P16",
     "score": 0.4537
    },
    {
     "id": "P17",
     "score": 0.4109
    }
   ],
   "answer": "I am sorry, but this information is NOT_IN_LIBRARY. The library does not cover this topic.",
   "perf": {
    "ttft_s": 24.63,
    "total_s": 26.35,
    "eval_tokens": 23,
    "tok_per_s": 11.6,
    "prompt_tokens": 463,
    "prompt_tok_per_s": 29.3
   },
   "score": {
    "refused": true,
    "cited": [],
    "answer_lang": "en",
    "lang_ok": true,
    "refusal_ok": true
   }
  },
  {
   "id": "fr01",
   "lang": "fr",
   "q": "Combien d'eau faut-il stocker par personne et par jour ?",
   "retrieved": [
    {
     "id": "P01",
     "score": 0.7371
    },
    {
     "id": "P04",
     "score": 0.5767
    },
    {
     "id": "P05",
     "score": 0.5534
    }
   ],
   "answer": "Il faut stocker au moins 4 litres d'eau par personne et par jour [P01]. Cela s'applique pour au moins trois jours, pour l'eau potable et l'hygiène personnelle [P01]. Les enfants, les femmes enceintes et les personnes malades peuvent avoir besoin de plus d'eau [P01].",
   "perf": {
    "ttft_s": 33.46,
    "total_s": 43.48,
    "eval_tokens": 73,
    "tok_per_s": 5.8,
    "prompt_tokens": 489,
    "prompt_tok_per_s": 33.4
   },
   "score": {
    "refused": false,
    "cited": [
     "P01"
    ],
    "answer_lang": "fr",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "fr02",
   "lang": "fr",
   "q": "Est-ce que je peux faire tourner un groupe électrogène dans ma cave ?",
   "retrieved": [
    {
     "id": "P02",
     "score": 0.5512
    },
    {
     "id": "P16",
     "score": 0.411
    },
    {
     "id": "P09",
     "score": 0.409
    }
   ],
   "answer": "Non, vous ne pouvez absolument pas faire tourner un groupe électrogène dans votre cave [P02]. Il est strictement interdit de faire fonctionner des appareils à combustion (groupe électrogène, barbecue, etc.) à l'intérieur de bâtiments, même avec des ouvertures [P02]. Maintenez le générateur à l'extérieur, à au moins 20 mètres (6 mètres) des fenêtres et des portes [P02].\n",
   "perf": {
    "ttft_s": 13.95,
    "total_s": 18.05,
    "eval_tokens": 95,
    "tok_per_s": 22.1,
    "prompt_tokens": 463,
    "prompt_tok_per_s": 81.6
   },
   "score": {
    "refused": false,
    "cited": [
     "P02"
    ],
    "answer_lang": "fr",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "fr03",
   "lang": "fr",
   "q": "À partir de quelle altitude faut-il faire bouillir l'eau pendant 3 minutes ?",
   "retrieved": [
    {
     "id": "P04",
     "score": 0.6711
    },
    {
     "id": "P01",
     "score": 0.5068
    },
    {
     "id": "P11",
     "score": 0.4999
    }
   ],
   "answer": "À partir de 6 500 pieds (environ 2 000 mètres) [P04]. Il faut faire bouillir l'eau pendant 3 minutes à ces altitudes. Ne jamais donner de boisson à la personne [P11].",
   "perf": {
    "ttft_s": 34.13,
    "total_s": 35.98,
    "eval_tokens": 57,
    "tok_per_s": 14.1,
    "prompt_tokens": 497,
    "prompt_tok_per_s": 41.4
   },
   "score": {
    "refused": false,
    "cited": [
     "P04",
     "P11"
    ],
    "answer_lang": "fr",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "fr04",
   "lang": "fr",
   "q": "Combien de temps faut-il attendre après avoir mis de l'eau de Javel dans l'eau ?",
   "retrieved": [
    {
     "id": "P05",
     "score": 0.5208
    },
    {
     "id": "P04",
     "score": 0.5199
    },
    {
     "id": "P01",
     "score": 0.4601
    }
   ],
   "answer": "Il faut attendre 30 minutes après avoir ajouté de l'eau de Javel [P05]. La dose est de 8 gouttes par gallon (environ 4 litres) d'eau claire, à mélanger et à laisser reposer. Si l'eau est trouble, doublez la dose [P05].\n",
   "perf": {
    "ttft_s": 31.4,
    "total_s": 35.05,
    "eval_tokens": 69,
    "tok_per_s": 11.8,
    "prompt_tokens": 496,
    "prompt_tok_per_s": 39.6
   },
   "score": {
    "refused": false,
    "cited": [
     "P05"
    ],
    "answer_lang": "fr",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "fr05",
   "lang": "fr",
   "q": "Quel numéro appeler pour le SAMU en France ?",
   "retrieved": [
    {
     "id": "FR1",
     "score": 0.6439
    },
    {
     "id": "P18",
     "score": 0.4663
    },
    {
     "id": "P13",
     "score": 0.4651
    }
   ],
   "answer": "Vous devez appeler le 15 pour le SAMU en France [P01]. [FR1]",
   "perf": {
    "ttft_s": 25.43,
    "total_s": 27.56,
    "eval_tokens": 24,
    "tok_per_s": 6.7,
    "prompt_tokens": 486,
    "prompt_tok_per_s": 35.1
   },
   "score": {
    "refused": false,
    "cited": [
     "FR1",
     "P01"
    ],
    "answer_lang": "fr",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": false,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "fr06",
   "lang": "fr",
   "q": "Comment recevoir les alertes officielles en Belgique ?",
   "retrieved": [
    {
     "id": "BE1",
     "score": 0.6461
    },
    {
     "id": "P16",
     "score": 0.4735
    },
    {
     "id": "P18",
     "score": 0.3961
    }
   ],
   "answer": "Pour recevoir les alertes officielles en Belgique, vous devez vous inscrire gratuitement au service BE-Alert [BE1]. Ces alertes peuvent être envoyées par SMS, appel téléphonique ou e-mail. Le numéro d'urgence est 112 [BE1].",
   "perf": {
    "ttft_s": 34.25,
    "total_s": 51.72,
    "eval_tokens": 56,
    "tok_per_s": 3.2,
    "prompt_tokens": 459,
    "prompt_tok_per_s": 19.0
   },
   "score": {
    "refused": false,
    "cited": [
     "BE1"
    ],
    "answer_lang": "fr",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "fr07",
   "lang": "fr",
   "q": "Est-ce qu'on peut s'éclairer avec des bougies pendant une panne de courant ?",
   "retrieved": [
    {
     "id": "P19",
     "score": 0.6872
    },
    {
     "id": "P08",
     "score": 0.4538
    },
    {
     "id": "P18",
     "score": 0.4324
    }
   ],
   "answer": "NON, on ne peut pas s'éclairer avec des bougies pendant une panne de courant [P01]. Les bougies causent des incendies [P01]. Utilisez plutôt des lampes torches ou des lampes à piles [P01]. Il est également important de débrancher les appareils électriques pour éviter les surtensions [P01].",
   "perf": {
    "ttft_s": 31.65,
    "total_s": 52.07,
    "eval_tokens": 77,
    "tok_per_s": 3.7,
    "prompt_tokens": 450,
    "prompt_tok_per_s": 37.8
   },
   "score": {
    "refused": false,
    "cited": [
     "P01"
    ],
    "answer_lang": "fr",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": false,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "fr08",
   "lang": "fr",
   "q": "Pour combien de jours faut-il garder des médicaments sur ordonnance ?",
   "retrieved": [
    {
     "id": "P14",
     "score": 0.7085
    },
    {
     "id": "P01",
     "score": 0.5543
    },
    {
     "id": "P06",
     "score": 0.5219
    }
   ],
   "answer": "Il faut conserver au moins une réserve de 7 jours de médicaments sur ordonnance, plus des copies des ordonnances et une liste des doses [P14]. Vérifiez régulièrement les dates de péremption. Les médicaments nécessitant une réfrigération peuvent nécessiter un refroidisseur ou des pains de glace pendant une panne de courant, demandez conseil à votre pharmacien quant à leur durée d'utilisation sans refroidissement [P14].",
   "perf": {
    "ttft_s": 27.1,
    "total_s": 32.03,
    "eval_tokens": 91,
    "tok_per_s": 20.7,
    "prompt_tokens": 465,
    "prompt_tok_per_s": 28.8
   },
   "score": {
    "refused": false,
    "cited": [
     "P14"
    ],
    "answer_lang": "fr",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "fr09",
   "lang": "fr",
   "q": "Comment rendre l'eau de mer potable ?",
   "retrieved": [
    {
     "id": "P04",
     "score": 0.5532
    },
    {
     "id": "P05",
     "score": 0.5466
    },
    {
     "id": "P01",
     "score": 0.4968
    }
   ],
   "answer": "Il n'est pas possible de rendre directement l'eau de mer potable. [P05] Vous pouvez la désinfecter en utilisant de l'eau oxygénée (bleiche) à 6%, en ajoutant 8 gouttes par 4 litres d'eau claire, en attendant 30 minutes avant de boire. [P04] Si vous ne pouvez pas utiliser de l'eau oxygénée, vous pouvez faire bouillir l'eau pendant 1 minute à des altitudes inférieures à 2000 mètres, ou 3 minutes à des altitudes supérieures. [P01]\n",
   "perf": {
    "ttft_s": 25.18,
    "total_s": 39.39,
    "eval_tokens": 131,
    "tok_per_s": 9.0,
    "prompt_tokens": 482,
    "prompt_tok_per_s": 44.6
   },
   "score": {
    "refused": false,
    "cited": [
     "P01",
     "P04",
     "P05"
    ],
    "answer_lang": "fr",
    "lang_ok": true,
    "refusal_ok": false
   }
  },
  {
   "id": "fr10",
   "lang": "fr",
   "q": "Comment construire un abri antiatomique dans mon jardin ?",
   "retrieved": [
    {
     "id": "P02",
     "score": 0.4729
    },
    {
     "id": "P16",
     "score": 0.4565
    },
    {
     "id": "P17",
     "score": 0.4324
    }
   ],
   "answer": "Je suis désolé, mais je ne peux pas répondre à cette question. [P16] Si vous êtes informé de la nécessité de se mettre à l'abri, allez immédiatement à l'intérieur, fermez et verrouillez toutes les fenêtres et portes, éteignez les ventilateurs, la climatisation et le chauffage qui aspirent l'air extérieur, et dirigez-vous vers une pièce intérieure avec le moins de fenêtres possible.",
   "perf": {
    "ttft_s": 39.17,
    "total_s": 68.77,
    "eval_tokens": 93,
    "tok_per_s": 3.0,
    "prompt_tokens": 453,
    "prompt_tok_per_s": 36.5
   },
   "score": {
    "refused": false,
    "cited": [
     "P16"
    ],
    "answer_lang": "fr",
    "lang_ok": true,
    "refusal_ok": false
   }
  },
  {
   "id": "c1",
   "lang": "nl",
   "q": "Hoeveel water heb ik per persoon per dag nodig voor een noodpakket?",
   "retrieved": [
    {
     "id": "P01",
     "score": 0.6931
    },
    {
     "id": "NL1",
     "score": 0.6474
    },
    {
     "id": "P07",
     "score": 0.5533
    }
   ],
   "answer": "Volgens [P01] heb je minimaal één gallon (ongeveer 4 liter) water per persoon per dag nodig voor een noodpakket, voor minimaal drie dagen. Kinderen, borstvoedende moeders en zieken kunnen er meer van nodig hebben [P01]. Het is belangrijk om water in goed afgesloten, voedselveilige containers op te slaan en te vervangen na de houdbaarheidsdatum [P01].",
   "perf": {
    "ttft_s": 38.16,
    "total_s": 59.49,
    "eval_tokens": 98,
    "tok_per_s": 4.3,
    "prompt_tokens": 465,
    "prompt_tok_per_s": 27.8
   },
   "score": {
    "refused": false,
    "cited": [
     "P01"
    ],
    "answer_lang": "nl",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "c2",
   "lang": "en",
   "q": "Sorry, let me switch to English. How long does a half-full freezer keep food safe without power?",
   "retrieved": [
    {
     "id": "P06",
     "score": 0.7159
    },
    {
     "id": "P07",
     "score": 0.5527
    },
    {
     "id": "P14",
     "score": 0.5425
    }
   ],
   "answer": "A half-full freezer will keep its temperature for about 24 hours [P02]. Maintaining a full freezer extends this time to approximately 48 hours [P02]. It is crucial to discard perishable items like meat, milk, and leftovers if they have been above 40 degrees F (4 degrees C) for 2 hours or more [P06]. Never taste food to determine if it is safe [P06].",
   "perf": {
    "ttft_s": 39.21,
    "total_s": 49.94,
    "eval_tokens": 93,
    "tok_per_s": 10.8,
    "prompt_tokens": 596,
    "prompt_tok_per_s": 38.3
   },
   "score": {
    "refused": false,
    "cited": [
     "P02",
     "P06"
    ],
    "answer_lang": "en",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": false,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "c3",
   "lang": "fr",
   "q": "Et en français maintenant : si quelqu'un a de l'hypothermie, est-ce que je peux lui donner de l'alcool pour le réchauffer ?",
   "retrieved": [
    {
     "id": "P12",
     "score": 0.6096
    },
    {
     "id": "P11",
     "score": 0.4974
    },
    {
     "id": "P13",
     "score": 0.4707
    }
   ],
   "answer": "NON [P01]. Il est STRICTEMENT INTERDIT de donner de l'alcool à une personne atteinte d'hypothermie [P01]. Cela peut provoquer une chute de la température corporelle et aggraver la situation [P01]. Il faut immédiatement le mettre dans un endroit chaud, retirer les vêtements mouillés et le réchauffer avec des couvertures [P01].",
   "perf": {
    "ttft_s": 98.27,
    "total_s": 105.39,
    "eval_tokens": 83,
    "tok_per_s": 10.7,
    "prompt_tokens": 780,
    "prompt_tok_per_s": 13.5
   },
   "score": {
    "refused": false,
    "cited": [
     "P01"
    ],
    "answer_lang": "fr",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": false,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  }
 ]
}