Dense retrieval employing progressive distillation training
Topics: AI (Deep Learning), Microsoft, Ranking, Reranking, Search Query Processing, User Signals
The Microsoft patent describes a dense retrieval system for efficiently retrieving relevant search results from a large pool of potential results. It uses machine learning models trained on an order metric that defines a ranked ordering of search results. The system has two main components:
- A dense retriever that computes embeddings of the query and potential results to select candidate results.
- A ranker that uses a cross-encoder to score and rank the candidate results.
The key innovation is progressively distilling knowledge from the order metric to the ranker, and then from the ranker to the retriever. This allows the retriever to quickly identify relevant results while incorporating relevance information from the order metric.
The system aims to improve search relevance over conventional methods while maintaining efficiency for large-scale retrieval tasks
Your advantages:
+ Full analysis of hundreds of well researched active Microsoft and Google patents and research paper.
+ Save a lot of time and get insights in just a few minutes, without having to spend hours analyzing the documents.
+ Get quick exclusive insights about how search engines and Google could work with easy to understand summaries and analysis.
+ All patents classified by topic for targeted research.
+ New patent summaries and analysis every week. Weekly notification via E-Mail
+ Use all 4 AI Research Tools to gain insights from all documents in the database, the Google API Leak, Antitrust trial documents, the whole google support documents, fundamental knowledge from worlds best SEO experts, Bill Slawskis fundamental research work for the industry, books about semantic search and more in seconds.
+ Gain fundamental insights for your SEO work and become a real thought leader.
Get access to the SEO Research Suite and become a SEO thought leader now!
