Facebook AI Research has built and open-sourced BlenderBot 2.0, the first chatbot that can simultaneously build long-term memory it can continually access, search the internet for timely information. By Facebook.
A current trend in machine learning models is to concentrate on training ever-larger models, which requires substantial computational resources. Those models attempt to store what they learn in their model weights. But storing the entire internet — which is always growing and changing – would seem to be next to impossible. Our method instead accesses the internet on the fly.
BlenderBot 2.0 uses a model based on Facebook’s Retrieval Augmented Generation — an approach that enables generating dialogue responses that incorporate knowledge beyond that contained in the conversation itself.
During conversation, the model, which combines an information retrieval component with a seq2seq generator, seeks relevant information both in its long-term memory and from documents it finds by searching the internet Very interesting!
[Read More]