Document understanding

Falcon 2 VLM for Documents: What It Can and Cannot Do

Documents are the obvious commercial use for a vision-language model, and the one where published evidence is thinnest. TII ships no document benchmark for Falcon 2 11B VLM.

Back to the overview

What helps

  • High-resolution dynamic encoding with tiling up to roughly 1008 pixels, which is designed for fine detail.
  • Single-page inputs, so the whole page can use the available resolution.
  • Targeted questions instead of "extract everything", which is easier to verify and easier to evaluate.

What is not documented

There is no published accuracy figure for OCR, table extraction or form parsing with this model, and no claim from TII that it is intended for those tasks. The model card describes general vision-language research use and lists production use without risk assessment as out of scope.

How to evaluate it for real work

  • Build a labelled set from your own documents, including the ugly ones.
  • Score field-level accuracy, not whether the output reads plausibly.
  • Measure the failure mode that matters most: silent wrong values are worse than visible refusals.
  • Keep a human check on any field that carries financial or legal weight.

Related pages

Sources

falcon2.lol is an independent third-party site. It is not affiliated with, endorsed by, sponsored by or operated by the Technology Innovation Institute, and it does not speak for TII. Every number on this page is attributed to the source listed above.

Falcon 2 VLM for Documents: What It Can and Cannot Do