Notices
Bugs / Feature Requests Archive This is a read only forum containing old policy topics.

Search Index Problems?!

 
Thread Tools
 
Search this Thread
 
Old 23 February 2004, 07:36 AM
  #1  
ajm
Scooby Regular
Thread Starter
 
ajm's Avatar
 
Join Date: Sep 2002
Location: The biosphere
Posts: 7,824
Likes: 0
Received 0 Likes on 0 Posts
Exclamation Search Index Problems?!

I have noticed a few threads I am searching for are not found, despite the fact I know it exitsts and am putting in words I know are in the post.

For example this post contains "Scrap Heap" in the title, yet if I search for those words in titles only it says no matches!

Could it be a few posts have slipped through indexing?
ajm is offline  
Old 23 February 2004, 07:51 AM
  #2  
SiDHEaD
Scooby Regular
 
SiDHEaD's Avatar
 
Join Date: Apr 2002
Location: Birmingham
Posts: 9,196
Likes: 0
Received 0 Likes on 0 Posts
Default

I think the last 6 months hadn't been indexed yet!
SiDHEaD is offline  
Old 23 February 2004, 10:51 AM
  #3  
ajm
Scooby Regular
Thread Starter
 
ajm's Avatar
 
Join Date: Sep 2002
Location: The biosphere
Posts: 7,824
Likes: 0
Received 0 Likes on 0 Posts
Default

That would explain it, however I thought it had been completed, or was due to be completed, the other week?
ajm is offline  
Old 23 February 2004, 11:28 AM
  #4  
ex-webby
Orange Club
 
ex-webby's Avatar
 
Join Date: Oct 1998
Posts: 13,763
Likes: 0
Received 1 Like on 1 Post
Default

hi chaps

We've been flat out with the new server, etc. But will continue indexing over the next few days.

All the best

Simon
ex-webby is offline  
Old 23 March 2004, 02:09 PM
  #5  
ajm
Scooby Regular
Thread Starter
 
ajm's Avatar
 
Join Date: Sep 2002
Location: The biosphere
Posts: 7,824
Likes: 0
Received 0 Likes on 0 Posts
Default

FYI this still seems to be a problem, is indexing still ongoing?
ajm is offline  
Old 23 March 2004, 02:12 PM
  #6  
ex-webby
Orange Club
 
ex-webby's Avatar
 
Join Date: Oct 1998
Posts: 13,763
Likes: 0
Received 1 Like on 1 Post
Default

Hi

We stopped the indexing in lieu of the new search facility that is being built / tested. But we are currently testing the standard search facility now we have some more performance measures in place. If it ends up working out ok with the standard search facility we'll index the missing 3 months or so of posts.

All the best

Simon
ex-webby is offline  
Old 06 July 2004, 02:29 PM
  #7  
ajm
Scooby Regular
Thread Starter
 
ajm's Avatar
 
Join Date: Sep 2002
Location: The biosphere
Posts: 7,824
Likes: 0
Received 0 Likes on 0 Posts
Default

*bump*

This is still a problem (example in my first post above).

Also, please can we ditch the following:-
  • 30 second search limit - very annoying!!!
  • 100 matches max - on some searches this precludes all posts earlier than about the last 6 months, unless you choose the "prior to one year ago" option which gives you about 18 months back.
I understand you had the initial performance issues, however I have never seen these restrictions kept on any other implementation of vBulletin!
ajm is offline  

Trending Topics

Old 12 July 2004, 01:12 PM
  #8  
ajm
Scooby Regular
Thread Starter
 
ajm's Avatar
 
Join Date: Sep 2002
Location: The biosphere
Posts: 7,824
Likes: 0
Received 0 Likes on 0 Posts
Default

*bump*
ajm is offline  
Old 20 July 2004, 01:40 PM
  #9  
TopBanana
Scooby Regular
 
TopBanana's Avatar
 
Join Date: Jan 2001
Posts: 9,781
Likes: 0
Received 0 Likes on 0 Posts
Default

The indexes were still incomplete when I tried to search for MEC723, which is a type of Bosch coil. Found a thread referring to them after 5 mins of trawling
TopBanana is offline  
Old 22 July 2004, 08:24 AM
  #10  
AndyC_772
Scooby Regular
iTrader: (2)
 
AndyC_772's Avatar
 
Join Date: Mar 2001
Location: Swilling coffee at my lab bench
Posts: 9,096
Likes: 0
Received 0 Likes on 0 Posts
Default

I'm sure I've done recent searches and had no matches at all for anything posted in 2002. Lots of results for 2001 and 2003-4, but not 2002.
AndyC_772 is offline  
Old 22 July 2004, 01:26 PM
  #11  
ajm
Scooby Regular
Thread Starter
 
ajm's Avatar
 
Join Date: Sep 2002
Location: The biosphere
Posts: 7,824
Likes: 0
Received 0 Likes on 0 Posts
Default

Do you think they are reading these bugs that we are kind enough to document?

Show us a sign!!!!
ajm is offline  
Old 28 July 2004, 01:08 PM
  #12  
ajm
Scooby Regular
Thread Starter
 
ajm's Avatar
 
Join Date: Sep 2002
Location: The biosphere
Posts: 7,824
Likes: 0
Received 0 Likes on 0 Posts
Default

*bump*
ajm is offline  
Old 28 July 2004, 06:15 PM
  #13  
vulnax999
Scooby Senior
Support Scoobynet!
iTrader: (7)
 
vulnax999's Avatar
 
Join Date: May 2003
Posts: 4,347
Received 8 Likes on 7 Posts
Default

here's a sign!

Originally Posted by ajm
Do you think they are reading these bugs that we are kind enough to document?

Show us a sign!!!!
vulnax999 is offline  
Old 24 August 2004, 05:02 PM
  #14  
ajm
Scooby Regular
Thread Starter
 
ajm's Avatar
 
Join Date: Sep 2002
Location: The biosphere
Posts: 7,824
Likes: 0
Received 0 Likes on 0 Posts
Default

*bump*
ajm is offline  
Old 01 September 2004, 12:45 PM
  #15  
shamrock
Scooby Regular
 
shamrock's Avatar
 
Join Date: Jun 2004
Posts: 251
Likes: 0
Received 0 Likes on 0 Posts
Default

I'd like to find some threads regarding the m3 vs p1 and I'm sure there are loads but the search engine can't find any:


Sorry - no matches. Please try some different terms.
The following words are either very common, too long, or too short and were not included in your search : m3, vs, p1

Any idea's how I find threads relating to the M3 or P1 ??
shamrock is offline  
Old 01 September 2004, 12:47 PM
  #16  
TopBanana
Scooby Regular
 
TopBanana's Avatar
 
Join Date: Jan 2001
Posts: 9,781
Likes: 0
Received 0 Likes on 0 Posts
Default

Originally Posted by shamrock
I'd like to find some threads regarding the m3 vs p1 and I'm sure there are loads but the search engine can't find any:




Sorry - no matches. Please try some different terms.
The following words are either very common, too long, or too short and were not included in your search : m3, vs, p1


Any idea's how I find threads relating to the M3 or P1 ??
You can't. There should be a list of exceptions from the two-digit rule, including M3, P1, Vs, RA etc... but there aren't and there probably never will be
TopBanana is offline  
Old 01 September 2004, 01:50 PM
  #17  
shamrock
Scooby Regular
 
shamrock's Avatar
 
Join Date: Jun 2004
Posts: 251
Likes: 0
Received 0 Likes on 0 Posts
Default

Dag nab it.

I'll give the phrases "heat soak" and "rice mobile" a go then ....
shamrock is offline  
Old 02 October 2004, 05:13 PM
  #18  
ajm
Scooby Regular
Thread Starter
 
ajm's Avatar
 
Join Date: Sep 2002
Location: The biosphere
Posts: 7,824
Likes: 0
Received 0 Likes on 0 Posts
Default

Search still doesn't work properly. Fix it, or post reasons for not fixing it, lest I have to keep bumping this thread ad infinitum.
ajm is offline  
Old 16 October 2004, 10:52 AM
  #19  
tiggers
Scooby Regular
 
tiggers's Avatar
 
Join Date: Feb 1999
Location: Lots of different places! (Thank you Mr. Lambert)
Posts: 3,037
Likes: 0
Received 0 Likes on 0 Posts
Default

Originally Posted by ajm
Search still doesn't work properly. Fix it, or post reasons for not fixing it, lest I have to keep bumping this thread ad infinitum.
ajm,

As promised I have raised this with the technical team and here are their comments on the current situation.

This is a very difficult issue to work around and I am not sure we can get around it easily. Basically to reindex ALL information requires us to bring the BBS down due to the amount of processing power the process takes, for the amount of data we have we have calculated the board would have to be down for literally days to complete.

Obviously all new posts (since we moved to VB) are now indexed and some of the previous posts/threads are as we tested the index function initially, but operationally due to the amount of time needed (in downtime) to do a full index is realistically not feasible with our current known facilities.

We are however looking at ways (if possible) to get around this and will certainly up date you on progress

I hope this goes some way to explain the issues and complexity involved, which is as frustrating for you as it is for us not to have the facility available
Regards,

tiggers.
tiggers is offline  
Old 16 October 2004, 11:16 AM
  #20  
TopBanana
Scooby Regular
 
TopBanana's Avatar
 
Join Date: Jan 2001
Posts: 9,781
Likes: 0
Received 0 Likes on 0 Posts
Default

What database backend are they using? Isn't it MySQL? It should be possible to export the 'old' data, index that on another machine, then merge the indexes.
TopBanana is offline  
Old 16 October 2004, 11:48 AM
  #21  
tiggers
Scooby Regular
 
tiggers's Avatar
 
Join Date: Feb 1999
Location: Lots of different places! (Thank you Mr. Lambert)
Posts: 3,037
Likes: 0
Received 0 Likes on 0 Posts
Default

Originally Posted by TopBanana
What database backend are they using? Isn't it MySQL? It should be possible to export the 'old' data, index that on another machine, then merge the indexes.
That is the sort of thing that I believe is being researched, but it comes down to time, resources and logistics - remember the database for this site is fairly sizeable.

Regards,

tiggers.
tiggers is offline  
Old 16 October 2004, 11:55 AM
  #22  
ajm
Scooby Regular
Thread Starter
 
ajm's Avatar
 
Join Date: Sep 2002
Location: The biosphere
Posts: 7,824
Likes: 0
Received 0 Likes on 0 Posts
Default

cheers tiggers (so they WERE ignoring me then! )

It would seem there are two ways to approach this:-

1) Do the indexing in smaller batches - say X thousand threads each night. The vB control panel can do this, presumably to get round these sort of problems!

2) Process the indexing offline on another server
- Dump the current database and restore on another machine
- Make a note of the the most recent post ID
- Run the index until complete
- Dump this newer database and restore the processed index table to the current database
- Then index the remaining posts on the live database that have appeared since you noted post ID above

Obviously option 2 does require the loan of some hardware (unless you could do it on the old server?), maybe an appeal to the scoobynet populous could bear fruition!

Last edited by ajm; 16 October 2004 at 11:58 AM.
ajm is offline  
Old 17 October 2004, 01:40 PM
  #23  
ALi-B
Moderator
Support Scoobynet!
iTrader: (1)
 
ALi-B's Avatar
 
Join Date: Apr 2002
Location: The hell where youth and laughter go
Posts: 38,034
Received 301 Likes on 240 Posts
Default

NEWSFLASH:.....

A Moderator Response in "Bugs / Feature Requests " !!!!

<thud>



Hey tiggers - couldn't do us a favour and get some answers to the long, long, long list of unanswered threads below this one could you?

I think some of the techy team need a bit of prodding with a good sized stick to at least tell us to sod off
ALi-B is offline  
 
Related Topics
Thread
Thread Starter
Forum
Replies
Last Post
Abx
Subaru
22
09 January 2016 05:42 PM
TylerD529
General Technical
2
09 October 2015 01:53 AM
PetrolHeadKid
Driving Dynamics
10
05 October 2015 05:19 PM
mistermexican
General Technical
2
01 October 2015 04:30 PM
Matt_182
General Technical
0
30 September 2015 03:20 PM



Quick Reply: Search Index Problems?!



All times are GMT +1. The time now is 02:06 PM.