Phi-4-multimodal-instruct

Microsoft

Catalogue only Open weights

Sovereignty and hosting

Catalogue only

This model is catalogued for reference. It is not hosted on LLM EU yet, and no first-party endpoint serves it here. Requests to it go to the provider directly, under that provider's own terms.

Summary

Phi-4-multimodal-instruct is a 5.6B model that accepts text, images and speech in one checkpoint, with a 128K-token context and the MIT licence. The model card reports 55.1 on MMMU, 93.2 on DocVQA and 62.4 on MathVista, and lists the supported languages separately for each input modality. It is a compact option for document and speech pipelines that would otherwise need two models.

Specifications

Provider
Microsoft (US)
Context window
131k
Parameters
5.57B
Modalities
text, vision, audio
License
mit · licence
Open weights
yes
Release date
24 Feb 2025
Tasks
vision, summarization, multilingual-support, cheap

Languages

Strong: en, de, fr, es, it, pt

Adequate: nl, pl, sv, da, fi, cs, ru, uk, ar, zh, ja, ko, hi, tr

Languages

Strong

  • en
  • de
  • fr
  • es
  • it
  • pt

Adequate

  • nl
  • pl
  • sv
  • da
  • fi
  • cs
  • ru
  • uk
  • ar
  • zh
  • ja
  • ko
  • hi
  • tr

Not verified: the provider has not documented this claim. — a language is listed as strong only where a source claims it; the card links the evidence where one exists.

When to use it

Strengths

  • text, image and speech input at 5.6B parameters
  • 128K-token context for document batches
  • MIT licence
  • 23 declared languages including most large EU languages

Limits

  • modality-specific quality is below dedicated single-modality models
  • English-centric training data
  • no evaluation has been run by LLM EU