java - How to speed up IndexReader.open -
when use directoryreader.open open directory of on 100g,but opened long time.(lucene 4.2) can advise me policy/optimization should use speed readers open? perhaps when indexing should noted.
maybe i'm not clear enough description.
every day more 70 million data indexed. each index database storage space 40g.
if retrieval support within 1 month.(30*40g,in fact need support longer)i have open indexreader, add them multireader , reuse them.open them slow.i know set indexwriter's mergefactor values. (large values speed indexing increase number of files need opened simultaneously.)i can set small value optimize.are there other parameters or solutions.
opening indexreader
costly operation. it's better keep same indexreader around , reuse it. can keep current calling directoryreader.openifchanged
:
indexreader newreader = directoryreader.openifchanged(oldreader) if (newreader == null) { readertouse = oldreader; } else { readertouse = newreader; oldreader.close(); //make sure close old one!!
even when there changes index , new reader generated, still lot less costly directoryreader.open
.
Comments
Post a Comment