- Text-to-image search: a text question finds images in the knowledge base by what they show. Pick a vision-capable embedding model. A question like “the org chart” can then match a diagram by what it shows, even if it has no caption or alt text.
- Image-to-image search: an attached image finds visually similar images in the knowledge base. Pick a vision-capable embedding model, so similar images match even when they share no text.
- Image-to-text search: an attached image finds relevant text chunks. Pick a vision-capable reasoning model. It describes the image in words and searches that description against text.
After switching from two text-only models, click Re-index on each document that has images once the change finishes.
How Models Affect Image Behavior
Captions and alt text on images in Markdown and HTML files are searchable regardless of model choice, so well-captioned sources improve image retrieval in every combination.
- Text inside images in PDF files is read when either model accepts images.
- Text inside images in Word, PowerPoint, and Excel files isn’t read, so put anything users will search for in the surrounding text.