Author |
Topic |
HuwR
Forum Admin
United Kingdom
20584 Posts |
Posted - 01 February 2005 : 09:39:52
|
I have now disabled Full-text indexing for this database, it was using >50% of my dual hyperthreaded Xeons, so I would not advise anybody to use full-text searching on a forum the size of Snitz, it just swamps the server. |
|
|
-gary
Development Team Member
406 Posts |
Posted - 01 February 2005 : 10:37:29
|
I run it on a 250,000 post 9,000 member site on 1 Athlon 2600 with absolutely no ill effects. Sounds like a server configuration problem to me. |
KawiForums.com
|
|
|
HuwR
Forum Admin
United Kingdom
20584 Posts |
Posted - 01 February 2005 : 10:43:02
|
there is nothing wrong with the config of the server, just mssearch when populating the catalog. |
|
|
Podge
Support Moderator
Ireland
3775 Posts |
|
HuwR
Forum Admin
United Kingdom
20584 Posts |
Posted - 01 February 2005 : 11:07:16
|
currently about 400Mb, I discovered you can set it to background process the FTS,which I will try, but to be honest with the new SQL server it doesn't look like it will be necesary, I haven't managed to get it to time out yet, even searching the archives |
|
|
sr_erick
Senior Member
USA
1318 Posts |
Posted - 01 February 2005 : 11:34:16
|
I've had nothing but good luck and fast searches with full text searching. I don't see the results you are reporting HuwR. The initial population is probably the most CPU intensive. I populate the catalog about every 8 hours or so. If I don't have full text enabled the CPU will simply max out while someone does a search via the forum. I think my database is around 250 MB. Honesly, 400 MB is not that big. There are a lot of databases out there which are gigs to terabytes in size and they all use full text indexing just fine and dandy. Just my thoughts. |
Erick Snowmobile Fanatics
|
|
|
ruirib
Snitz Forums Admin
Portugal
26364 Posts |
Posted - 01 February 2005 : 11:49:35
|
sr_erick, there is a huge difference in performance with the search now. I've tried several searches (in the archived topcis) with known results, and they never completed before. Now they complete successfully.
I have to agree with Huw - the new server performs hugely better searching. Full text may be needed in the future, but for now the performance is way better than before, even with Full Text Indexing. |
Snitz 3.4 Readme | Like the support? Support Snitz too |
|
|
HuwR
Forum Admin
United Kingdom
20584 Posts |
Posted - 01 February 2005 : 11:56:31
|
populating the catalog every 8 hrs on this forum means we get inundated by posts saying they can't find stuff they have just posted, so it was set to poulate every two hours, but that maxes out the cpu for 10mins every 2 hrs, not a very good idea when you have 30 or 40 other databases on the server |
|
|
Podge
Support Moderator
Ireland
3775 Posts |
|
-gary
Development Team Member
406 Posts |
Posted - 01 February 2005 : 15:44:05
|
Interesting, since I just did an incrmental on mine and it ran for 15 minutes on 6 hours of posts and never peaked over 20% on the processer above and most of the 15 hovered between 0 and 6%. The msssearch process is also run in low priority while SQL is run high, so any time the server needs the processer, it's available. I've never been much for paying for a server that just sits idle in case I need it either.
Saying that you wouldn't advise it for use on Snitz and that it "swamps the server" is quite misleading and over generalized IMO. If you have a better solution for those of us out there that can't afford a dedicated Dual Xeon box with 6GB of RAM to get our searches to stop timming out, then I'm sure everyone is all ears. |
KawiForums.com
|
|
|
HuwR
Forum Admin
United Kingdom
20584 Posts |
Posted - 01 February 2005 : 16:20:34
|
you have to remember I have about 40 snitz databases running on my server not just this one. I am only reporting what I found, and from the searches I've done on google it is fairly common for mssearch to swamp the cpu. |
|
|
-gary
Development Team Member
406 Posts |
Posted - 01 February 2005 : 17:24:55
|
I wouldn't call saying "I would not advise anybody to use full-text searching on a forum the size of Snitz, it just swamps the server" far more than reporting what you found.
You can construe this as an attack I guess, but as the resident founder of Snitz, people take everything you say as gospel. In this case, I believe you're being overly general and condemning a perfectly functioning process outright by recommending to anyone that uses Snitz to use not full text indexing because it doesn't fit your specific situation. |
KawiForums.com
|
|
|
HuwR
Forum Admin
United Kingdom
20584 Posts |
Posted - 01 February 2005 : 17:50:39
|
I am not one of the founders of Snitz, so perhaps you should get your facts right before launching an attack against me. |
|
|
-gary
Development Team Member
406 Posts |
Posted - 01 February 2005 : 22:44:18
|
I wasn't attacking but I knew with your short temper that it would be construed that way. I do know the facts but I don't know what you prefer to title yourself as.
Either way, it's still an extreme generalization. |
KawiForums.com
|
|
|
HuwR
Forum Admin
United Kingdom
20584 Posts |
Posted - 02 February 2005 : 00:50:18
|
quote: Originally posted by -gary
I wasn't attacking but I knew with your short temper that it would be construed that way.
uh ??? what does this mean then, or are you in the habit of saying what you don't mean quote: You can construe this as an attack I guess
I hadn't considered it one till you mentioned it, you also have no idea how short or long my temper is, or whether I am actually angry at all when I wrote these, so I suggest you shut up. |
|
|
Topic |
|