
This patent application from Google details methods and systems for contextual multimedia search. When a user searches while viewing multimedia content, the system extracts relevant entities from the content and uses them to rewrite the user's query.