Empty shelves or lost keys? Recall is the bottleneck for parametric factuality

Researchers introduce knowledge profiling to distinguish between encoding and recall failures in large language models' factual accuracy. Using the WikiProfile benchmark, they find many errors stem from recall issues rather than missing knowledge. This insight suggests improving recall mechanisms could enhance model reliability.