| Author |
 Topic  |
|
cult_of_frank
Starting Member
Canada
20 Posts |
 Posted - 27 August 2008 : 14:17:51
|
Hi there. I'm using the latest version of Snitz with all the security patches (which, I guess, is why I'm posting in here) and I seem to be having problems with my hosting company. Apparently, my forum is chewing up memory like nobody's business. The section of logs is pretty useless although it is interesting to note that it starts with someone passing a real number into whichpage.
As an addendum, our Search function almost never completes and I'm curious if that's a common problem as forums grow larger? I should make this a separate topic but I'm putting it in here because at the moment my prime suspect for memory hog is the search.
The site: http://forum.frankblack.net
No mods on this forum installation. Thanks for your help.
quote:
Hello,
Currently, the forum is only the part, that is using excessive memory usage.
It appears that you're using some custom forum software, could you please try to optimize it or try to enable caching feature of it so that it won't use excessive memory more than the slot available in shared hosting memory.
Currently, we have been forced to put up the limit on the app pool to prevent it from using excessive memory and this will cause the sessions to recycle in the forum.
Please optimize and reply back as soon as possible.
IISRequestMonitor, StartProcessDump, 0x000020EC, 128642039704866851, 0, 0, 33204, 7, 4, 4, "frankblack.net(domain)(2.0)(pool)", 128642039440630000, 0, 0
IISRequestMonitor, IISRequestInProgress, 0x000020EC, 128642039704866851, 0, 0, {00000000-0000-0000-921c-006082010022}, 24612, "216.227.213.150", 80, "forum.frankblack.net", "frankblack.net(domain)(2.0)(pool)", 2449959856220675216, 33204, "125.115.243.43", "GET", "/topic.asp?whichpage=1.68571428571429&TOPIC_ID=14899#444548;", "Send Async", 119840000, 67650000, 0, 0
IISRequestMonitor, IISRequestInProgress, 0x000020EC, 128642039704866851, 0, 0, {00000000-0000-0000-b344-0060010000fe}, 10591, "216.227.213.150", 80, "www.frankblack.net", "frankblack.net(domain)(2.0)(pool)", 18302628891002422449, 33204, "189.135.211.213", "GET", "/images/splash-forum.gif", "Send Async", 780000, 780000, 0, 0
IISRequestMonitor, IISRequestInProgress, 0x000020EC, 128642039704866851, 0, 0, {00000000-0000-0000-6c1d-006003010022}, 10591, "216.227.213.150", 80, "www.frankblack.net", "frankblack.net(domain)(2.0)(pool)", 2449959310759828843, 33204, "189.135.211.213", "GET", "/images/background-dark.gif", "Send Async", 620000, 620000, 0, 0
IISRequestMonitor, IISRequestInProgress, 0x000020EC, 128642039704866851, 0, 0, {00000000-0000-0000-432d-006003010041}, 10591, "216.227.213.150", 80, "www.frankblack.net", "frankblack.net(domain)(2.0)(pool)", 4683744725935598914, 33204, "189.135.211.213", "GET", "/images/splash.gif", "Send Async", 460000, 460000, 0, 0
IISRequestMonitor, IISRequestInProgress, 0x000020EC, 128642039704866851, 0, 0, {00000000-0000-0000-8b3d-00600000005f}, 10591, "216.227.213.150", 80, "www.frankblack.net", "frankblack.net(domain)(2.0)(pool)"
Should you need any assistance or have further questions, please don't hesitate to contact us back.
< |
|
|
AnonJr
Moderator
United States
5768 Posts |
Posted - 27 August 2008 : 14:41:18
|
| Have you added any MODs or made any customizations other than the edits to config.asp as required by the readme?< |
 |
|
|
modifichicci
Average Member
Italy
787 Posts |
|
|
HuwR
Forum Admin
United Kingdom
20600 Posts |
Posted - 27 August 2008 : 17:04:10
|
what exactly do they class as excessive memory use?
how busy is your forum?
what database are you using?
you can try searching for a script by rui to archive some of your topics (the forums archive is likely to fail with the number of posts you have) there is also a modified search which may help, but to be honest with a forum with > 300K posts you should probably consider looking for better hosting, companies who have set memory limits for sites do so because they have huge amounts of websites sharing limited resources.
A Standard Snitz package running on MSSQL does not use an excessive amount of memory, but it is entirely subjective what excessive is  < |
|
|
|
cult_of_frank
Starting Member
Canada
20 Posts |
Posted - 28 August 2008 : 01:56:31
|
Wow, thanks guys for the quick responses...
AnonJr - No MODs or customizations other than the security changes listed here. I did once try to alter the cookie handling so forum members could use 'secure' parts of a separate app without logging in again but that never did get working and I changed everything back. And actually, come to think of it, I think that code was wiped out when I reinstalled the forum after we were hacked on a separate occasion (where I was _not_ up to date) so it should all be original.
Modifichicci - I did indeed switch servers, though we're now on MS-SQL, so you could be right about the bad index/default value (though it also did this on the old server). Thanks for that tip, I'll have a look for a proper database setup and compare the fields and defaults to what I have.
HuwR - Heh, I asked him the same thing (and am waiting to hear back). The forum is pretty popular but that said we don't have that many posts per day anymore, just people reading and checking up on active topics more than anything - or looking at old ones. I did actually try to archive old posts and it did fail, so I'll definitely be keeping an eye out for that script. I'd love to be on a dedicated server or just get a bigger slice of the pie but it's so expensive and to be honest I'm not really that sophisticated when it comes to these sorts of things. I'll get back to you when I hear what 'excessive' entails and we can see if, for the size and traffic, things seem to be operating normally or there is anything to be done. In the meantime, I'm going to hunt down the search/archive scripts.
A few quick stats:
10,500 members (though only 4800 post)
355k posts (93k archived)
< |
|
|
|
HuwR
Forum Admin
United Kingdom
20600 Posts |
Posted - 28 August 2008 : 02:44:22
|
| I think the search script is called fastsearch but rui may enlighten us later < |
|
|
|
ruirib
Snitz Forums Admin
Portugal
26364 Posts |
Posted - 28 August 2008 : 03:57:59
|
To be true, I don't think I ever posted a script to archive topics. I did write one, though, it definitely is faster than the default one, but it requires both the live and archive tables to have the exact same structure with the fields in the exact same order in each table, to take advantage of bulk post moves and deletions.
What I've posted is a faster search page, yes, but it does have the same name as our default search page: search.asp. It can be found here: http://forum.snitz.com/forum/topic.asp?TOPIC_ID=67315
I also wrote some scripts to update counts. Actually I use them in the updated archiving code, to update counts once the posts are moved to the archive tables.
cult_of_frank, if you migrated the database and didn't follow our recommended procedure, it's quite liekely that your database does not have indexes needed for adequate performance. Better check that.< |
Snitz 3.4 Readme | Like the support? Support Snitz too |
|
|
|
HuwR
Forum Admin
United Kingdom
20600 Posts |
Posted - 28 August 2008 : 04:11:14
|
AH, I thought you had posted an archive script sorry rui
< |
|
|
|
ruirib
Snitz Forums Admin
Portugal
26364 Posts |
Posted - 28 August 2008 : 04:14:30
|
quote:
Originally posted by HuwR
AH, I thought you had posted an archive script sorry rui
No problem . I think there is one posted by Jeepaholic, should be archived by now, but if I remember well, the table structure had quite a few changes added by mods.< |
Snitz 3.4 Readme | Like the support? Support Snitz too |
|
|
|
cult_of_frank
Starting Member
Canada
20 Posts |
Posted - 28 August 2008 : 05:09:38
|
Ruirib, I did follow the recommended procedure (eventually - doing anything else gave me nothing but problems) and used setup to create the new tables and copied the data rather than tables themselves across. It was a bit complicated as shared hosting limits your options on db access and not being able to use Enterprise. But I'm going to double check my table structures anyway just to be sure that I didn't miss something... should be good though if I used setup to create the db, no? In either case, I grabbed the search script and am pretty excited to try it out (search has been a problem for some time). Thanks for that!
I haven't found any archiving script that works. I thought about trying to pull the function out of the admin_functions asp file and making it incrementally archive, but that scares me a bit. Don't want to lose all those old posts (though it would solve memory problems :) ). For now I'm just going month by month and forum by forum...< |
|
|
|
ruirib
Snitz Forums Admin
Portugal
26364 Posts |
Posted - 28 August 2008 : 05:14:50
|
Yes, using setup.asp to create the tables will ensure a reasonable default set of indexes.
As I said, I can provide an alternative archive script, but it requires you to make sure that the topics / a_topics and replies / a_replies tables have the same exact fields in the same exact order. If you are able to ensure that, I can post an alternative archive script. It will require the creation of a stored procedure, to update forum counts.< |
Snitz 3.4 Readme | Like the support? Support Snitz too |
|
|
|
cult_of_frank
Starting Member
Canada
20 Posts |
Posted - 28 August 2008 : 05:49:03
|
| Unfortunately, it seems my reply and a_reply are different. In archive reply, r_status comes after reply_id, where the field in the non-archive table that comes after reply_id is r_mail. Also, point of interest, the reply table has four pks while the archive none...< |
Edited by - cult_of_frank on 28 August 2008 05:57:10 |
|
|
|
ruirib
Snitz Forums Admin
Portugal
26364 Posts |
Posted - 28 August 2008 : 05:53:23
|
The order can be changed, using Enterprise Manager. Alternatively, you can post all the fields here and I'll change the SQL to ensure it will work.
As I said, you will need to be able to create a stored procedure. Without it, it won't be possible.< |
Snitz 3.4 Readme | Like the support? Support Snitz too |
|
|
|
ruirib
Snitz Forums Admin
Portugal
26364 Posts |
|
|
cult_of_frank
Starting Member
Canada
20 Posts |
Posted - 28 August 2008 : 06:26:01
|
Well, that's really awesome of you to go so out of your way.. thanks very much. Here are the fields for the reply tables
forum_TOPICS:
quote:
CAT_ID PK, int, not null
FORUM_ID PK, int, not null
TOPIC_ID PK, int, not null
T_STATUS smallint, null
T_MAIL smallint, null
T_SUBJECT nvarchar(100), null
T_MESSAGE ntext, null
T_AUTHOR int, null
T_REPLIES int, null
T_UREPLIES int, null
T_VIEW_COUNT int, null
T_LAST_POST nvarchar(14), null
T_DATE nvarchar(14), null
T_LAST_POSTER int, null
T_IP nvarchar(15), null
T_LAST_POST_AUTHOR int, null
T_LAST_POST_REPLY_ID int, null
T_ARCHIVE_FLAG int, null
T_LAST_EDIT nvarchar(14), null
T_LAST_EDITBY int, null
T_STICKY smallint, null
T_SIG smallint, null
forum_A_TOPICS:
quote:
CAT_ID int, not null
FORUM_ID int, not null
TOPIC_ID int, not null
T_STATUS smallint, null
T_MAIL smallint, null
T_SUBJECT nvarchar(100), null
T_MESSAGE ntext, null
T_AUTHOR int, null
T_REPLIES int, null
T_UREPLIES int, null
T_VIEW_COUNT int, null
T_LAST_POST nvarchar(14), null
T_DATE nvarchar(14), null
T_LAST_POSTER int, null
T_IP nvarchar(15), null
T_LAST_POST_AUTHOR int, null
T_LAST_POST_REPLY_ID int, null
T_ARCHIVE_FLAG int, null
T_LAST_EDIT nvarchar(14), null
T_LAST_EDITBY int, null
T_STICKY smallint, null
T_SIG smallint, null
forum_REPLY:
quote:
CAT_ID PK, int, not null
FORUM_ID PK, int, not null
TOPIC_ID PK, int, not null
REPLY_ID PK, int, not null
R_MAIL smallint, null
R_AUTHOR int, null
R_MESSAGE ntext, null
R_DATE nvarchar(14), null
R_IP nvarchar(15), null
R_STATUS smallint, null
R_LAST_EDIT nvarchar(14), null
R_LAST_EDITBY int, null
R_SIG smallint, null
forum_A_REPLY:
quote:
CAT_ID int, not null
FORUM_ID int, not null
TOPIC_ID int, not null
REPLY_ID int, not null
R_STATUS smallint, null
R_MAIL smallint, null
R_AUTHOR int, null
R_MESSAGE ntext, null
R_DATE nvarchar(14), null
R_IP nvarchar(15), null
R_LAST_EDIT nvarchar(14), null
R_LAST_EDITBY int, null
R_SIG smallint, null
Thanks again!
EDIT - That's a bit better. It's 5 AM here and I can't think straight.< |
Edited by - cult_of_frank on 28 August 2008 06:32:18 |
|
|
|
cult_of_frank
Starting Member
Canada
20 Posts |
Posted - 28 August 2008 : 06:27:38
|
| Oh, before you get too busy, what's a stored procedure??< |
|
|
|
Topic |
|
|
|
Topic Locked
