CN101021852A - Video search dispatching system based on content - Google Patents

Video search dispatching system based on content Download PDF

Info

Publication number
CN101021852A
CN101021852A CN 200610140493 CN200610140493A CN101021852A CN 101021852 A CN101021852 A CN 101021852A CN 200610140493 CN200610140493 CN 200610140493 CN 200610140493 A CN200610140493 A CN 200610140493A CN 101021852 A CN101021852 A CN 101021852A
Authority
CN
China
Prior art keywords
search
scoring
weighted value
result
content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 200610140493
Other languages
Chinese (zh)
Other versions
CN100423004C (en
Inventor
何晓鹏
苏磊
鲍东山
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Nufront Software Technology Co., Ltd.
Original Assignee
鲍东山
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 鲍东山 filed Critical 鲍东山
Priority to CNB2006101404934A priority Critical patent/CN100423004C/en
Publication of CN101021852A publication Critical patent/CN101021852A/en
Application granted granted Critical
Publication of CN100423004C publication Critical patent/CN100423004C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

This invention provides a video search dispatch system based on contents, which finishes receiving the search request of customer ends, analyzes and transmits the search request to a multimedia database and generates ordered enquiry results, and the system includes a search condition analysis module, a distribution module, a grade strategy module, a grade module for single kind condition search results, a combination and grading module for multi-kind condition combined enquiry results and a search result generation module.

Description

Content-based video search dispatching system
Technical field
The present invention relates to a kind of content-based search dispatching method, specifically, relate to a kind of search dispatching and sort result algorithm that in a plurality of databases of storing different media contents, searches out the video content that meets user expectation most.
Background technology
Content-based video search is the research focus of nearly a period of time industry.Information retrieval system generally includes the searching database of a core, search dispatching system and group of server.Different with common information retrieval system, video searching system is comparatively complicated, and the module that comprises is also more relatively.Traditional video frequency search system will obtain video frequency program for information about by manual annotation, and leaves these information in supply inquiry after this in the database usefulness.This mode has significant limitation.Artificial note not only expends great amount of manpower and time, and often has very big subjectivity, can not make accurate, just portrayal to video program content.For this reason, people are used for video frequency program with graphical analysis, speech analysis and captions analytical technology and handle, and are main tool with the computing machine, obtain the characteristic information relevant with video program content automatically, for content-based search provides support.
Voice in the video content, captions, image, metadata (to the descriptive information of video content, as the director, the performer issues unit etc.) are extracted respectively and are stored in the different databases.How according to user's initial conditions, retrieving video frequency program near user expectation be in a plurality of databases needs another major issue of solving after the decomposition storage that has solved video content.
The search condition of user side input can be any class in the four class video contents, also can be the combination in any of four class contents.Input for captions and classification metadata (because metadata can be divided into polytype, such as by director, performer, the place of production, brief introduction etc.) user side is exactly a pure words information.Then to handle for the picture that the user selects, extract the search condition of the characteristic of picture as reality through user side software as search condition.The voice of importing by microphone for the user also will become the data that can carry out matched and searched in speech database through the client software processing.
No matter be the search of single class condition or the compound search of multiclass condition combination, the results for video of the expectation of being close to the users most, the matching degree between data that just must have set of rule to define to preserve in the multimedia content database and user's initial conditions.Captions, image, voice, this four classes video content of metadata are at the search condition (captions keyword, speech data, picture or video segment, metadata keywords) of correspondence the time, their matching degrees separately must have objective definition, for captions and the such text content of metadata, their matching degree can adopt same standard, often adopts the distance between the characteristic of calculating two width of cloth pictures to characterize for the matching degree of picture in the picture of user input and the database; Matching degree for the data in the voice of user input and the speech database then adopts similar probability to characterize.
Logically between client software and multimedia database, it can only communicate by letter with search dispatching system search dispatching system for client, and it does not also know the existence of multimedia database cluster; For multimedia database, the query interface of every type database is all inequality, and search dispatching system then has the query interface of all types multimedia database, and single class multimedia database only need be accepted the query requests of search dispatching system.Doing making that whole searching system is more flexible like this, is that client or database change all and only to need the upgrading search dispatching system.
The function that search dispatching system is finished is exactly to accept user's querying condition, querying condition is analyzed, the various combination conditions that the user is sended over split out, the searching request that the user is sent is converted into and meets the data that all kinds of multimedia database query interfaces require, and these condition data is forwarded in the corresponding multimedia database query interface again.Single class multimedia database can return to search dispatching system with being similar to the partial results that meets querying condition, if this is the inquiry of a single class condition, search dispatching system only this result need be marked, sorts and additional metadata information just can return to client.If this is the query composition of a multiclass condition,, also to asks union and repeatedly mark a plurality of results sets except the result that types of databases will be returned marks and sorts.
Choose the front that the result who meets user expectation most comes net result among the result that search dispatching system will inquire from database, this problem not only relates to the matching algorithm of underlying database to search condition, also relate to user's mental habit and the problems such as relation between all kinds of content of multimedia, still need a large amount of research just can reach satisfied effect.This search dispatching system is exactly the result who efforts be made so that Search Results is close to the users and expects most, has therefore adopted a lot of experimental scoring algorithms, has obtained reasonable effect.
Summary of the invention
The objective of the invention is to realize a search dispatching system based on video program content, it is the interface between user side and the multimedia database, finish and accept user search request, searching request is dispatched on different types of multimedia database, and the result set that returns of secondary treating database, in an orderly manner Search Results is returned to client according to the matching degree of the search condition of result set and user's input.Relation between search dispatching system and client and the multimedia database such as Fig. 1.
A content-based video search dispatching system comprises: a mixed-media network modules mixed-media; A data library inquiry interface module; A search condition parsing module; A search condition distribution module; A scoring policy module; Single class conditional search is grading module as a result; Multiclass condition query composition result merges, grading module; A Search Results generation module.
-described search condition parsing module has comprised the analysis to searching request, and generates the querying condition that multimedia database is accepted.
-described search condition distribution module, the multimedia database querying condition that the variety classes search condition is generated is distributed to corresponding multimedia database query interface.
-described scoring policy module, the default weighted value that has comprised all kinds of metadata fields when calculating metasearch result marks, the default weighted value of camera lens reproducible results when calculating scene result marks, all kinds of medium results' default weighted value during the net result scoring of calculating multiclass condition combinatorial search.
The default weighted value of-described all kinds of metadata fields has comprised programm name weighted value, PD program director's weighted value, program performer weighted value, program languages weighted value, program place of production weighted value, program classification weighted value, program format weighted value, program brief introduction weighted value; Each weighted value is the floating number between 0 to 1, and all the weighted value sum is 1.
The default weighted value of-described camera lens reproducible results has comprised that the image lens reproducible results is preset weighted value, voice camera lens reproducible results is preset weighted value, the default weighted value of captions camera lens reproducible results.
-described all kinds of medium results' default weighted value has comprised that image result is preset weighted value, sound result is preset weighted value, the default weighted value of captions result, the default weighted value of metadata result; Each weighted value is the floating number between 0 to 1, and all the weighted value sum is 1.
-described single class conditional search is grading module as a result, comprises picture search result's scoring algorithm, the scoring algorithm of captions Search Results, metasearch result's scoring algorithm, the scoring algorithm of camera lens reproducible results.
-described picture search result's scoring algorithm has comprised that the normalization to result scoring transforms to the distance between information drawing picture and result images, when it transforms used image pitch from upper limit sill value be configurable floating number.
The scoring algorithm of-described captions Search Results has comprised word segmentation processing and twice scoring to the actual subtitle fragment that obtains from caption database.
Scoring first in-described twice scoring has comprised in the search subtitle fragment whether comprising complete search criteria character string, and has carried out the statistics of the frequency of occurrences; The high more result's scoring of the frequency of occurrences also can be high more.
The scoring second time in-described twice scoring has comprised the participle to the search criteria character string, and each speech that is partitioned into of search from captions participle string, and the word frequency of adding up each speech then is as score basis.
-described metasearch result's scoring algorithm has comprised to the scoring algorithm of single class metadata with to whole metasearch result's scoring algorithm; The scoring algorithm of single class metadata has been adopted twice scoring algorithm in the captions scoring algorithm, and Ping Fen weight factor is that default weighted value by all kinds of metadata fields converts and draws for the third time.
The scoring algorithm of-described camera lens reproducible results has comprised the scoring algorithm of picture search camera lens reproducible results, the scoring algorithm of audio search camera lens reproducible results, the scoring algorithm of captions search camera lens reproducible results.
The scoring algorithm of-described camera lens reproducible results has comprised in the camera lens reproducible results that search is produced the extraction of the highest scoring and according to the adjustment of the number of times that repeats to scoring.
-described according to the adjustment of the number of times that repeats to scoring, comprised according to the default weighted value of all kinds of camera lens reproducible results and suitably improved the highest scoring.
-described multiclass condition query composition result merges, grading module, has comprised asking union and being weighted summation according to default weighted value scoring to result items when asking union of all kinds of medium results of multiclass Search Results.
-described scoring to result items is weighted summation, adopts that scoring is weighted adjustment to the result in the individual event result set earlier, the identical result of when asking union Different Results the being concentrated summation of marking again.
-described result in individual event result set scoring is weighted adjustment, comprised that scoring is multiplied by weight factor after the conversion to the second Conversion of all kinds of medium results' default weighted value with to the result.
The second Conversion of-described default weighted value to all kinds of medium results is that all kinds of medium results' default weighted value is carried out normalized according to the medium kind in the current search.
-described Search Results generation module, comprised to net result sort according to the descending of scoring and metadatabase in extract program descriptive information generate return results.
System of the present invention provides a kind of search dispatching and sort result algorithm that searches out the video content that meets user expectation most in a plurality of databases of storing different media contents.Finish receiving the client searching request, parsing and forwarding searching request are to multimedia database and generate orderly Query Result.This system comprises search condition parsing module, search condition distribution module, scoring policy module, single class conditional search grading module, the fusion as a result of multiclass condition query composition and grading module, Search Results generation module as a result.
Description of drawings
Fig. 1 is the synoptic diagram of content-based video searching system;
Fig. 2 is the synoptic diagram of each intermodule relation of search dispatching system.
Embodiment
Referring to Fig. 1, Fig. 2:
1, mixed-media network modules mixed-media
The net result collection of the searching request of client and inquiry gained all will receive and send by mixed-media network modules mixed-media, has defined a cover message format between client and the search dispatching system and has been used for communication.
2, data base querying interface module
Video content can be decomposed into captions, voice, image, metadata, and each media content is stored in the different databases, and they are called caption database, speech database, image data base, metadata database.The data-base cluster that every class database all is made up of a plurality of computing machines.Every class data of database institutional framework, storage means, query interface are all inequality.This module package the query interface of all kinds of multimedia databases, and provide unified interface calling module to the upper strata.
3, search condition parsing module
This module is positioned at search dispatching system foremost, receive user's searching request, if user's searching request is single class condition, all possible combination that is input as a pictures (being called picture search), one section voice (being called phonetic search), one section subtitle strings (being called the captions search), one section video segment (being called the fragment search), certain class metadata or a plurality of genre metadata (every have only metadata terms all be called metasearch).
What receive for this module of picture search is not view data but image feature value after handling through client software, analyze be the eigenwert of image after this module to further handle eigenwert, eigenwert is converted into the data structure that image data base is accepted.In like manner also adopt such processing mode for the voice condition.For captions and metasearch condition, client is left intact, but the input of user at the interface directly sent to search dispatching system.This module can be carried out word segmentation processing to captions and metadata after being captions search or metasearch having discerned, and regeneration is fit to the data structure of captions and metadata database query interface.For the fragment search, client can extract a plurality of pictures, and the eigenwert of extracting a plurality of pictures again sends to search dispatching system.It is can handle according to the flow process of picture search after the fragment search that the search condition parsing module identifies.In the processing procedure of this module, a fragment search is equivalent to repeatedly picture search.
4, search condition distribution module
This module is finished the forwarding work from user's condition to the corresponding data bank interface.For picture search and fragment search, condition data is forwarded to the image data base query interface; For phonetic search, condition data is forwarded to the speech database query interface; For the captions search, condition data is forwarded to the caption database query interface; For metasearch, condition data is forwarded to the metadatabase query interface.
5, scoring policy module
The various parameters that needed when this module has been preserved the result marked and the various parameters of system running pattern have mainly comprised 4 class parameters.Preceding 3 classes are relevant with scoring, and the 4th class is relevant with operational mode.These parameters are read in from configuration file in system start-up, do the configurability that has improved system like this, also can change operational factor by saying the word to system in the process of system's operation.
1) the default weighted value of all kinds of metadata fields
Programm name weighted value, PD program director's weighted value, program performer weighted value, program languages weighted value, program place of production weighted value, program classification weighted value, program format weighted value, program brief introduction weighted value have been comprised.Each weighted value is the floating number between 0 to 1, and all the weighted value sum is 1.
2) the default weighted value of camera lens reproducible results
Comprised that the image lens reproducible results is preset weighted value, voice camera lens reproducible results is preset weighted value, the default weighted value of captions camera lens reproducible results.
3) all kinds of medium results' default weighted value
Comprised that image result is preset weighted value, sound result is preset weighted value, the default weighted value of captions result, the default weighted value of metadata result.Each weighted value is the floating number between 0 to 1, and all the weighted value sum is 1.
4) operational mode parameter
The thread mode that has comprised various single classes search, because the dissimilar asynchronism(-nization)s that search consumed is more consuming time such as image and phonetic search, second level often; Metadata and captions search speed are than very fast, generally at 10 milliseconds once.So the speed of query composition is reached the most just must allow the search parallel processing of some class.Our way is to allow picture search and phonetic search use independent thread, and metadata and captions search are adopted serial processing.Just approximate the maximum time that consumes in single class search the T.T. of whole like this query composition.
6, single class conditional search grading module as a result
1) picture search result scoring algorithm
Similarity degree between the image of storing in the image of user's input and the image data base is to weigh with the distance between two width of cloth images, and distance value is more little represents that then two width of cloth images are similar more.But such expression mode can be very inconvenient when handling multiclass condition query composition, because the number percent representation has all been adopted in the search of other kinds in expression condition and result's similarity degree, therefore must be apart from being converted into the similarity of representing with number percent.When transforming a sill value must be set, every record greater than this sill value all is filtered and does not return to the user, is that the benchmark value of adjusting the distance is done normalized with this sill value then, subtracts 1 again and just becomes the similarity of representing with number percent.
2) scoring algorithm of captions Search Results
The main foundation of the matching degree between the program at the subtitle fragment place in the judgement caption database and the program that the user wishes to search out is:
Whether comprise complete condition captions string in A, the subtitle fragment, how many frequencies that condition captions string occurs in subtitle fragment is.
B, condition captions string are divided into after a plurality of speech, and what speech appear in the subtitle fragment, and how many frequencies that each speech occurs is.
If satisfy A then can obtain very high scoring, high more then this result's of frequency that complete condition captions string occurs scoring also can be high more, if do not comprise complete condition captions string in the subtitle fragment then mainly investigate the speech that comprises in the subtitle fragment in what condition captions strings, the scoring more at most that comprises is high more, and the frequency that the speech in the condition captions string occurs is high more, and then scoring also can be high more.As long as but satisfy just affirming of A standard than the scoring height that satisfies the B standard.
3) metasearch result's scoring algorithm
Metasearch is traditional way of search, though content-based search and metasearch have a great difference, but be not isolated fully two classes search between them, if on the contrary program is manually made a catalogue, the search efficiency of metadata and precision all are very high.If content-based search and metasearch combine then can improve the performance of content-based search greatly.So when making up content-based video searching system, we are also included metasearch.Metadata type is very many, here adopted a part of metadata item that function of search can be provided, and they are: the place of production of the performer of the name of program, the director of program, program, the languages of program, program, the type of program, the form of program, the brief introduction of program.The user comprises two classes at the search of metadata, and a kind of is full library searching: the key word of user's input can be used to all metadata type fields in search metadata storehouse.Here our marking mode of employing is the scoring of at first calculating at every this result items of class metadata, computing method are identical with the scoring algorithm of captions Search Results, after the scoring that has obtained at every metadata, we can be according to the importance degree of different metadata to every metadata scoring weighted sum, every class metadata can be distributed a weighted value in advance, and (for example the name of program will be higher than the place of production of program for the importance of video search, the weighted value of program name certainly can be high more a lot of than the weighted value in the place of production), it is the floating number between 0 to 1.What weighted sum obtained is exactly the final scoring of this result items.
Second kind of combinatorial search that form is the multiclass metadata item of metasearch specified the director of search program to comprise the program that Zhang Yimou and performer comprise Li Lianjie such as the user, Here it is combinatorial search that comprises two class metadata.The methods of marking of this class metadata is: at first still in the calculation combination type at the scoring of each genre metadata, then scoring weighted sum at single class metadata, but this moment, the weighted value selected for use was not the default weighted value of original this type of metadata, and will the default weighted value of this type of metadata be converted, the method that converts be with the default weighted value of the whole metadata type in the composite type and be unit one, obtain the weight factor of the shared number percent of the default weighted value of every class metadata in the composite type respectively as weighted sum.
4) phonetic search result's scoring
Scoring for phonetic search then mainly depends on the similarity that the speech database query interface returns, and we just use this to be worth consequent scoring.
5) scoring algorithm of camera lens reproducible results
The situation that has the result of repetition from the result that database returns only is present in content-based search.Why can produce such situation and be because the decomposition granularity of video content and video segment granularity that customer requirements returns are inconsistent.When design of graphics picture, captions, speech data, video content is to be that minimum unit is stored in respectively in the three class databases with the camera lens.What then require to return in client is video scene, can comprise a plurality of video lens in the video scene.When carrying out the search of this three class user's search condition with database in media data all be to be that least unit is carried out matched and searched with the camera lens when mating.Also all be to be the result of unit when returning to search dispatching system with the camera lens.This just requires us only generating a scene result as a result the time in the face of a plurality of camera lenses of Same Scene.
Scene result's scoring mainly depends on the camera lens that occurs in best result in a plurality of camera lens results scoring and Same Scene number as a result.We can pick out the best result among the camera lens result, and further adjust as the benchmark of scene result scoring with it again.Many scenes result's scoring also can be high more more to belong to the camera lens number of results of same scene in the algorithm of adjusting.We can preestablish three values, and they are respectively the default weighted value of image lens reproducible results, the default weighted value of voice camera lens reproducible results, the default weighted value of captions camera lens reproducible results.Adjustment algorithm is to be multiplied by the weighted value of camera lens reproducible results except higher assessment different camera lens results scorings exceptionally, and is then to these value summations, last again with this with add that the highest scoring must arrive scene result's final scoring.
7, multiclass condition query composition result fusion, grading module
The maximum characteristics of content-based video search are exactly according to multiclass media content conditional search video content, utilize the difference of the quantity of information of the inner link of the multiclass media content belong to same video content and the reflection of different media content can improve the efficient and the precision of video search greatly.
So client can send polytype combined retrieval condition to dispatching system in video search, image, voice, captions, these a few class media contents of metadata can combination in any.For the such situation of energy flexible processing, we have preset a weighted value rule of thumb for every class medium, and all weighted value additions get 1, and each weighted value is 0 to 1 floating number.Many times the type of search condition is not to comprise all medium types, calculate the scoring of end product so can not directly use the predetermined weights value, must do linear transformation to the predetermined weights value again, purpose is in keep with the influence of this search different media types to the result.Specific practice is done normalized for the weighted value of medium condition that this search is comprised, for example the default weighted value of metadata is 0.6, the default weighted value of image is 0.2, and then the normalized weight of metadata is 0.6/ (0.6+0.2)=0.75, and the normalized weight of image is 0.25.
8, Search Results generation module
The work that will carry out after the net result scoring is finished is exactly to the descending sort of net result collection according to scoring, fail to provide complete program recommended information for image, voice, captions, part metasearch owing to multimedia database, so also will generate final result according to the counter again metadatabase of looking into of program ID, the user could complete this program of understanding be that he needs like this.

Claims (21)

1, content-based video search dispatching system is characterized in that: comprising:
A mixed-media network modules mixed-media;
A data library inquiry interface module;
A search condition parsing module;
A search condition distribution module;
A scoring policy module;
Single class conditional search is grading module as a result;
Multiclass condition query composition result merges, grading module;
A Search Results generation module.
2, content-based video search dispatching system as claimed in claim 1 is characterized in that: the search condition parsing module has comprised the analysis to searching request, and has generated the querying condition that multimedia database is accepted.
3, content-based video search dispatching system as claimed in claim 1 is characterized in that: the search condition distribution module, the multimedia database querying condition that the variety classes search condition is generated is distributed to corresponding multimedia database query interface.
4, content-based video search dispatching system as claimed in claim 1, it is characterized in that: the scoring policy module, the default weighted value that has comprised all kinds of metadata fields when calculating metasearch result marks, the default weighted value of camera lens reproducible results when calculating scene result marks, all kinds of medium results' default weighted value during the net result scoring of calculating multiclass condition combinatorial search.
5, content-based video search dispatching system as claimed in claim 4, it is characterized in that: the default weighted value of all kinds of metadata fields has comprised programm name weighted value, PD program director's weighted value, program performer weighted value, program languages weighted value, program place of production weighted value, program classification weighted value, program format weighted value, program brief introduction weighted value; Each weighted value is the floating number between 0 to 1, and all the weighted value sum is 1.
6, content-based video search dispatching system as claimed in claim 4, it is characterized in that: the default weighted value of camera lens reproducible results has comprised that the image lens reproducible results is preset weighted value, voice camera lens reproducible results is preset weighted value, the default weighted value of captions camera lens reproducible results.
7, content-based video search dispatching system as claimed in claim 4 is characterized in that: all kinds of medium results' default weighted value has comprised that image result is preset weighted value, sound result is preset weighted value, the default weighted value of captions result, the default weighted value of metadata result; Each weighted value is the floating number between 0 to 1, and all the weighted value sum is 1.
8, content-based video search dispatching system as claimed in claim 1, it is characterized in that: single class conditional search is grading module as a result, comprises picture search result's scoring algorithm, the scoring algorithm of captions Search Results, metasearch result's scoring algorithm, the scoring algorithm of camera lens reproducible results.
9, content-based video search dispatching system as claimed in claim 8, it is characterized in that: picture search result's scoring algorithm, comprised wherein that the normalization to result scoring transforms to the distance between information drawing picture and result images, when it transforms used image pitch from upper limit sill value be configurable floating number.
10, content-based video search dispatching system as claimed in claim 8 is characterized in that: the scoring algorithm of captions Search Results has wherein comprised word segmentation processing and twice scoring to the actual subtitle fragment that obtains from caption database.
11, content-based video search dispatching system as claimed in claim 10 is characterized in that: the scoring first in twice scoring has comprised in the search subtitle fragment whether comprising complete search criteria character string, and has carried out the statistics of the frequency of occurrences; The high more result's scoring of the frequency of occurrences also can be high more.
12, content-based video search dispatching system as claimed in claim 10, it is characterized in that: the scoring second time in twice scoring, comprised participle to the search criteria character string, from captions participle string, search for each speech that is partitioned into then, and the word frequency of adding up each speech, as score basis.
13, content-based video search dispatching system as claimed in claim 8 is characterized in that: metasearch result's scoring algorithm has comprised to the scoring algorithm of single class metadata with to whole metasearch result's scoring algorithm; The scoring algorithm of single class metadata has been adopted twice scoring algorithm in the captions scoring algorithm, and Ping Fen weight factor is that default weighted value by all kinds of metadata fields converts and draws for the third time.
14, content-based video search dispatching system as claimed in claim 8, it is characterized in that: the scoring algorithm of camera lens reproducible results has comprised the scoring algorithm of picture search camera lens reproducible results, the scoring algorithm of audio search camera lens reproducible results, the scoring algorithm of captions search camera lens reproducible results.
15, content-based video search dispatching system as claimed in claim 8 is characterized in that: the scoring algorithm of camera lens reproducible results has comprised in the camera lens reproducible results that search is produced the extraction of the highest scoring and according to the adjustment of the number of times that repeats to scoring.
16, content-based video search dispatching system as claimed in claim 15 is characterized in that: according to the adjustment of the number of times that repeats to scoring, comprised according to the default weighted value of all kinds of camera lens reproducible results and suitably improved the highest scoring.
17, content-based video search dispatching system as claimed in claim 1, it is characterized in that: multiclass condition query composition result merges, grading module, has comprised asking union and being weighted summation according to default weighted value scoring to result items when asking union of all kinds of medium results of multiclass Search Results.
18, content-based video search dispatching system as claimed in claim 17, it is characterized in that: the scoring to result items is weighted summation, adopt that scoring is weighted adjustment to the result in the individual event result set earlier, the identical result of when asking union, Different Results the being concentrated summation of marking again.
19, content-based video search dispatching system as claimed in claim 18, it is characterized in that: the result in individual event result set scoring is weighted adjustment, has comprised that scoring is multiplied by weight factor after the conversion to the second Conversion of all kinds of medium results' default weighted value with to the result.
20, content-based video search dispatching system as claimed in claim 19, it is characterized in that:, be that all kinds of medium results' default weighted value is carried out normalized according to the medium kind in the current search the second Conversion of all kinds of medium results' default weighted value.
21, content-based video search dispatching system as claimed in claim 1, it is characterized in that: the Search Results generation module, comprised to net result sort according to the descending of scoring and metadatabase in extract program descriptive information generate return results.
CNB2006101404934A 2006-10-10 2006-10-10 Video search dispatching system based on content Expired - Fee Related CN100423004C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2006101404934A CN100423004C (en) 2006-10-10 2006-10-10 Video search dispatching system based on content

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2006101404934A CN100423004C (en) 2006-10-10 2006-10-10 Video search dispatching system based on content

Publications (2)

Publication Number Publication Date
CN101021852A true CN101021852A (en) 2007-08-22
CN100423004C CN100423004C (en) 2008-10-01

Family

ID=38709620

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2006101404934A Expired - Fee Related CN100423004C (en) 2006-10-10 2006-10-10 Video search dispatching system based on content

Country Status (1)

Country Link
CN (1) CN100423004C (en)

Cited By (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009140817A1 (en) * 2008-05-21 2009-11-26 Yuvad Technologies Co., Ltd. A method for facilitating the search of video content
CN101833587A (en) * 2010-05-28 2010-09-15 上海交通大学 Network video searching system
CN102063476A (en) * 2010-12-13 2011-05-18 百度时代网络技术(北京)有限公司 Video searching method and system
US8285811B2 (en) 2008-04-17 2012-10-09 Eloy Technology, Llc Aggregating media collections to provide a primary list and sorted sub-lists
US8285810B2 (en) 2008-04-17 2012-10-09 Eloy Technology, Llc Aggregating media collections between participants of a sharing network utilizing bridging
CN103049570A (en) * 2012-12-31 2013-04-17 天津大学 Method for searching and sorting images and videos on basis of relevancy preserving mapping and classifier
US8437555B2 (en) 2007-08-27 2013-05-07 Yuvad Technologies, Inc. Method for identifying motion video content
US8484311B2 (en) 2008-04-17 2013-07-09 Eloy Technology, Llc Pruning an aggregate media collection
US8484227B2 (en) 2008-10-15 2013-07-09 Eloy Technology, Llc Caching and synching process for a media sharing system
US8488835B2 (en) 2008-05-21 2013-07-16 Yuvad Technologies Co., Ltd. System for extracting a fingerprint data from video/audio signals
US8548192B2 (en) 2008-05-22 2013-10-01 Yuvad Technologies Co., Ltd. Method for extracting a fingerprint data from video/audio signals
US8577077B2 (en) 2008-05-22 2013-11-05 Yuvad Technologies Co., Ltd. System for identifying motion video/audio content
US8611701B2 (en) 2008-05-21 2013-12-17 Yuvad Technologies Co., Ltd. System for facilitating the search of video content
CN104054329A (en) * 2012-02-01 2014-09-17 日立麦克赛尔株式会社 Content receiving device, content receiving method and digital broadcast transmitting and receiving system
US8874650B2 (en) 2008-04-17 2014-10-28 Eloy Technology, Llc Method and system for aggregating media collections between participants of a sharing network
US8880599B2 (en) 2008-10-15 2014-11-04 Eloy Technology, Llc Collection digest for a media sharing system
CN105025319A (en) * 2015-07-09 2015-11-04 无锡天脉聚源传媒科技有限公司 Video pushing method and device
US9191229B2 (en) 2009-02-02 2015-11-17 Eloy Technology, Llc Remote participation in a Local Area Network (LAN) based media aggregation network
CN105279172A (en) * 2014-06-30 2016-01-27 惠州市伟乐科技股份有限公司 Video matching method and device
CN106021237A (en) * 2012-02-07 2016-10-12 微软技术许可有限责任公司 Language independent probabilistic content matching
CN106325832A (en) * 2015-06-18 2017-01-11 阿里巴巴集团控股有限公司 Data generation method and device
CN106528879A (en) * 2016-12-14 2017-03-22 北京小米移动软件有限公司 Picture processing method and device
CN107180058A (en) * 2016-03-11 2017-09-19 百度在线网络技术(北京)有限公司 A kind of method and apparatus for being inquired about based on caption information
CN107729410A (en) * 2017-09-26 2018-02-23 广西电网有限责任公司电力科学研究院 A kind of database engine suitable for power equipment big data
CN107766451A (en) * 2017-09-26 2018-03-06 广西电网有限责任公司电力科学研究院 A kind of integration across database associative search method towards electric power big data
CN107810497A (en) * 2015-02-20 2018-03-16 谷歌有限责任公司 Method, system and the medium of search result is presented
CN108268482A (en) * 2016-12-30 2018-07-10 百度在线网络技术(北京)有限公司 Information-pushing method, device and equipment
CN108399223A (en) * 2018-02-12 2018-08-14 北京奇艺世纪科技有限公司 A kind of data capture method, device and electronic equipment
CN108933970A (en) * 2017-05-27 2018-12-04 北京搜狗科技发展有限公司 The generation method and device of video
CN109614515A (en) * 2018-10-30 2019-04-12 北京奇艺世纪科技有限公司 Video search evaluation method and system

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU5862601A (en) * 2000-05-24 2001-12-03 Espotting (Uk) Limited Searching apparatus and a method of searching
GB0029893D0 (en) * 2000-12-07 2001-01-24 Sony Uk Ltd Video information retrieval
KR100451649B1 (en) * 2001-03-26 2004-10-08 엘지전자 주식회사 Image search system and method
US20030107592A1 (en) * 2001-12-11 2003-06-12 Koninklijke Philips Electronics N.V. System and method for retrieving information related to persons in video programs
EP1621020B1 (en) * 2003-04-28 2008-05-14 Koninklijke Philips Electronics N.V. Method and arrangement for automatically searching information sources accessible through a network for contents satisfying predefined criteria
US7487072B2 (en) * 2004-08-04 2009-02-03 International Business Machines Corporation Method and system for querying multimedia data where adjusting the conversion of the current portion of the multimedia data signal based on the comparing at least one set of confidence values to the threshold

Cited By (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8437555B2 (en) 2007-08-27 2013-05-07 Yuvad Technologies, Inc. Method for identifying motion video content
US8452043B2 (en) 2007-08-27 2013-05-28 Yuvad Technologies Co., Ltd. System for identifying motion video content
US8484311B2 (en) 2008-04-17 2013-07-09 Eloy Technology, Llc Pruning an aggregate media collection
US8285811B2 (en) 2008-04-17 2012-10-09 Eloy Technology, Llc Aggregating media collections to provide a primary list and sorted sub-lists
US8285810B2 (en) 2008-04-17 2012-10-09 Eloy Technology, Llc Aggregating media collections between participants of a sharing network utilizing bridging
US9396196B2 (en) 2008-04-17 2016-07-19 Eloy Technology, Llc Method and system for aggregating media collections between participants of a sharing network
US8874650B2 (en) 2008-04-17 2014-10-28 Eloy Technology, Llc Method and system for aggregating media collections between participants of a sharing network
US8370382B2 (en) 2008-05-21 2013-02-05 Ji Zhang Method for facilitating the search of video content
WO2009140817A1 (en) * 2008-05-21 2009-11-26 Yuvad Technologies Co., Ltd. A method for facilitating the search of video content
US8611701B2 (en) 2008-05-21 2013-12-17 Yuvad Technologies Co., Ltd. System for facilitating the search of video content
US8488835B2 (en) 2008-05-21 2013-07-16 Yuvad Technologies Co., Ltd. System for extracting a fingerprint data from video/audio signals
US8548192B2 (en) 2008-05-22 2013-10-01 Yuvad Technologies Co., Ltd. Method for extracting a fingerprint data from video/audio signals
US8577077B2 (en) 2008-05-22 2013-11-05 Yuvad Technologies Co., Ltd. System for identifying motion video/audio content
US8880599B2 (en) 2008-10-15 2014-11-04 Eloy Technology, Llc Collection digest for a media sharing system
US8484227B2 (en) 2008-10-15 2013-07-09 Eloy Technology, Llc Caching and synching process for a media sharing system
US9191229B2 (en) 2009-02-02 2015-11-17 Eloy Technology, Llc Remote participation in a Local Area Network (LAN) based media aggregation network
CN101833587A (en) * 2010-05-28 2010-09-15 上海交通大学 Network video searching system
CN102063476A (en) * 2010-12-13 2011-05-18 百度时代网络技术(北京)有限公司 Video searching method and system
CN102063476B (en) * 2010-12-13 2013-07-10 百度时代网络技术(北京)有限公司 Video searching method and system
CN104054329A (en) * 2012-02-01 2014-09-17 日立麦克赛尔株式会社 Content receiving device, content receiving method and digital broadcast transmitting and receiving system
CN106021237A (en) * 2012-02-07 2016-10-12 微软技术许可有限责任公司 Language independent probabilistic content matching
CN106021237B (en) * 2012-02-07 2019-07-02 微软技术许可有限责任公司 The unrelated probability content matching of language
CN103049570B (en) * 2012-12-31 2015-12-02 天津大学 Based on the image/video search ordering method of relevant Preserving map and a sorter
CN103049570A (en) * 2012-12-31 2013-04-17 天津大学 Method for searching and sorting images and videos on basis of relevancy preserving mapping and classifier
CN105279172A (en) * 2014-06-30 2016-01-27 惠州市伟乐科技股份有限公司 Video matching method and device
CN105279172B (en) * 2014-06-30 2019-07-09 惠州市伟乐科技股份有限公司 Video matching method and device
CN107810497B (en) * 2015-02-20 2021-12-21 谷歌有限责任公司 Method, system, and medium for presenting search results
US11829373B2 (en) 2015-02-20 2023-11-28 Google Llc Methods, systems, and media for presenting search results
CN107810497A (en) * 2015-02-20 2018-03-16 谷歌有限责任公司 Method, system and the medium of search result is presented
CN106325832A (en) * 2015-06-18 2017-01-11 阿里巴巴集团控股有限公司 Data generation method and device
CN105025319A (en) * 2015-07-09 2015-11-04 无锡天脉聚源传媒科技有限公司 Video pushing method and device
CN107180058A (en) * 2016-03-11 2017-09-19 百度在线网络技术(北京)有限公司 A kind of method and apparatus for being inquired about based on caption information
CN106528879A (en) * 2016-12-14 2017-03-22 北京小米移动软件有限公司 Picture processing method and device
CN108268482A (en) * 2016-12-30 2018-07-10 百度在线网络技术(北京)有限公司 Information-pushing method, device and equipment
CN108933970A (en) * 2017-05-27 2018-12-04 北京搜狗科技发展有限公司 The generation method and device of video
CN108933970B (en) * 2017-05-27 2022-02-25 北京搜狗科技发展有限公司 Video generation method and device
CN107729410A (en) * 2017-09-26 2018-02-23 广西电网有限责任公司电力科学研究院 A kind of database engine suitable for power equipment big data
CN107766451A (en) * 2017-09-26 2018-03-06 广西电网有限责任公司电力科学研究院 A kind of integration across database associative search method towards electric power big data
CN108399223A (en) * 2018-02-12 2018-08-14 北京奇艺世纪科技有限公司 A kind of data capture method, device and electronic equipment
CN108399223B (en) * 2018-02-12 2022-06-03 北京奇艺世纪科技有限公司 Data acquisition method and device and electronic equipment
CN109614515A (en) * 2018-10-30 2019-04-12 北京奇艺世纪科技有限公司 Video search evaluation method and system

Also Published As

Publication number Publication date
CN100423004C (en) 2008-10-01

Similar Documents

Publication Publication Date Title
CN100423004C (en) Video search dispatching system based on content
CN101021855B (en) Video searching system based on content
CN109829104B (en) Semantic similarity based pseudo-correlation feedback model information retrieval method and system
EP1396799B1 (en) Content management system
US7945600B1 (en) Techniques for organizing data to support efficient review and analysis
CN101021857A (en) Video searching system based on content analysis
US8949198B2 (en) Systems and methods for building a universal multimedia learner
US7840568B2 (en) Sorting media objects by similarity
US20110270815A1 (en) Extracting structured data from web queries
CN110750995B (en) File management method based on custom map
US20040015485A1 (en) Method and apparatus for improved internet searching
CN107665217A (en) A kind of vocabulary processing method and system for searching service
CN106997390A (en) A kind of equipment part or parts commodity transaction information search method
CN114297415A (en) Multi-source heterogeneous data storage method and retrieval method for full media data space
Berretti et al. Merging results for distributed content based image retrieval
CN107480155A (en) A kind of video searching system
CN103186650A (en) Searching method and device
KR20020089677A (en) Method for classifying a document automatically and system for the performing the same
CN107480156A (en) A kind of video searching method
Hybridised OntoKnowNHS: Ontology Driven Knowledge Centric Novel Hybridised Semantic Scheme for Image Recommendation Using Knowledge Graph
Messina et al. Creating rich metadata in the TV broadcast archives environment: The Prestospace project
KR102281266B1 (en) System and Method for Extracting Keyword and Ranking in Video Subtitle
US20070271264A1 (en) Relating objects in different mediums
US20220156285A1 (en) Data Tagging And Synchronisation System
KR100809751B1 (en) System and method for making analysis of document

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
ASS Succession or assignment of patent right

Owner name: BEIJING NUFRONT NETWORK TECHNOLOGY CO., LTD.

Free format text: FORMER OWNER: BAO DONGSHAN

Effective date: 20071214

C41 Transfer of patent application or patent right or utility model
TA01 Transfer of patent application right

Effective date of registration: 20071214

Address after: A, building 16, building 1, building 8, Qinghua science park, No. 100084, Zhongguancun East Road, Beijing, Haidian District, China

Applicant after: Beijing Nufront Software Technology Co., Ltd.

Address before: A, building 16, building 1, building 8, Qinghua science park, No. 100084, Zhongguancun East Road, Beijing, Haidian District, China

Applicant before: Bao Dongshan

C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20081001

Termination date: 20131010