here you goThings I’ve made, read and saved — shared here.

Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs

You, Keen, Haotian Zhang, Eldon Schoop, Floris Weers, Amanda Swearngin, Jeffrey Nichols, Yinfei Yang, and Zhe Gan. 2024. “Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs.” arXiv:2404.05719 [cs.CV]. arxiv.org/abs/2404.05719

BibTeX
@misc{you2024ferretui,
  title = {Ferret-{{UI}}: {{Grounded}} Mobile {{UI}} Understanding with Multimodal {{LLMs}}},
  author = {You, Keen and Zhang, Haotian and Schoop, Eldon and Weers, Floris and Swearngin, Amanda and Nichols, Jeffrey and Yang, Yinfei and Gan, Zhe},
  year = 2024,
  eprint = {2404.05719},
  primaryclass = {cs.CV},
  url = {https://arxiv.org/abs/2404.05719},
  archiveprefix = {arXiv},
  keywords = {LLM}
}

Download