Introducing Sphere: Meta AI’s Web-Scale Corpus for Better Knowledge-Intensive NLP

Metadata

• Author: facebook.com
• Full Title: Introducing Sphere: Meta AI’s Web-Scale Corpus for Better Knowledge-Intensive NLP
• URL: https://ai.facebook.com/blog/introducing-sphere-meta-ais-web-scale-corpus-for-better-knowledge-intensive-nlp/

Highlights

• . FAISS lets us search quickly for similar multimedia documents — a task where traditional query search engines fall short — in billion-scale data sets. The new wrapper, distributed-faiss, helps us apportion indices across multiple machines to manage the computational load. (View Highlight)