PreFLMR

Cambridge Team Open Sources: Empowering Multimodal Large Model RAG Applications

by
Cambridge Team Open Sources: Empowering Multimodal Large Model RAG Applications

The Machine Heart Column The Machine Heart Editorial Team The PreFLMR model is a general-purpose pre-trained multimodal knowledge retriever that can be used to build multimodal RAG applications. The model is based on the Fine-grained Late-interaction Multi-modal Retriever (FLMR) published at NeurIPS 2023 and has undergone model improvements and large-scale pre-training on M2KR. Paper link: … Read more

ACL 2024: Cambridge Team Open Sources Pre-trained Multi-modal Retriever

by
ACL 2024: Cambridge Team Open Sources Pre-trained Multi-modal Retriever

Follow our public account to discover the beauty of CV technology This article shares the ACL 2024 paper PreFLMR: Scaling Up Fine-Grained Late-Interaction Multi-modal Retrievers, open-sourced by the Cambridge University team, empowering multi-modal large model RAG applications, and is the first pre-trained general multi-modal late-interaction knowledge retriever. Paper link: https://arxiv.org/abs/2402.08327 Project homepage: https://preflmr.github.io/ Introduction The … Read more