Title Back Colour Keyoti Title Line Title Curve
Blue Box Top

Search performance/speed - SearchUnit - Forum

Welcome Guest Search | Active Topics | Log In | Register

Options
DMacy
#1 Posted : Friday, June 16, 2017 8:37:34 PM
Rank: Advanced Member

Groups: Registered

Joined: 9/1/2010
Posts: 133
I've been running some simple tests with content categories. One of my content categories is authors' names. The author's name is also included in the text of the documents. I've been doing three searches for each test:

1. A single word (such as "church").
2. A single word ("church") plus an author's name as a content category in the search options ("Smith").
3. The author's name plus the search word ("Smith church") without any content categories in the search options.

In each case, as I've varied the search word between words that are common and others that are less frequent in our documents, case 3 is much quicker than case 2, by a factor of 2:1 or greater.

We have about 80,000 documents in our index. As an example of the three cases, case 1 resulted in 16,332 documents (search results) in 1.07 sec. Case 2 gave 304 documents in 0.60 sec. Case 3 gave 360 documents in 0.20 sec.

Is there a performance hit generally for using content categories? I would have expected content categories to quickly reduce the number of documents needing to be checked for the search word(s), and so be able to do it quicker.

Thanks!

Dan
Jim
#2 Posted : Monday, June 19, 2017 5:27:17 AM
Rank: Advanced Member

Groups: Administrators, Registered

Joined: 8/13/2004
Posts: 2,667
Location: Canada
Quote:
I would have expected content categories to quickly reduce the number of documents needing to be checked for the search word(s), and so be able to do it quicker.


It doesn't really work that way around, because the index links terms to documents, and documents to categories. So you have to start with a term, find its documents and then see which categories the document is in. So yes, using categories will have some hit.


Jim
-your feedback is helpful to other users, thank you!


DMacy
#3 Posted : Monday, June 19, 2017 11:08:44 PM
Rank: Advanced Member

Groups: Registered

Joined: 9/1/2010
Posts: 133
Okay. Thanks for the explanation, Jim! I'll keep that in mind in redesigning our search capabilities.

Dan
Forum Jump  
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.




About | Contact | Site Map | Privacy Policy

Copyright © 2002- Keyoti Inc.