Ayende @ Rahien

Ayende Rahien commented on NHibernate Search

Thu, 25 Jun 2009 10:30:33 GMT

atma, Yep, that is the way to go

atma commented on NHibernate Search

Thu, 25 Jun 2009 10:12:11 GMT

i'm wondering what is the recommended way of indexing a large quantity of existing data, so i' would be interested in this email thread :) The examples most found on the net regarding Lucene.net integration with Nhibernate.Search deal mainly with automatic event wiring and inserting new data in the db, but i've yet to find an example for the other problem. I haven't done a benchmark for IFullTextSession.Index yet, but i think this will be the simpler way of working in my case: - Page 1024 items - Index them - repeat t'il done But i'm waiting for any other advice :)

Ayende Rahien commented on NHibernate Search

Wed, 24 Jun 2009 05:48:16 GMT

Gokul, Ping me on email so we can discuss this more easily, I would need to see the code for doing the indexes.

Gokul commented on NHibernate Search

Wed, 24 Jun 2009 05:12:06 GMT

Hi Ayende, Could you point to some articles which talks about using threaded parallel indexing to create faster indexes. I am trying to index around 2 million records it takes around 10+hrs. The initial 100K-200K is fast then it slows down very much. Thanks.

Ayende Rahien commented on NHibernate Search

Sat, 06 Jun 2009 14:18:31 GMT

Sebasitjan, Paging

Sebastijan Pistotnik commented on NHibernate Search

Sat, 06 Jun 2009 09:24:47 GMT

How do I index existing data? I am reading in Hibernate in action book about the fact that most of the time index data set cannot fit all in memory. If I attempt to load all objects and then index them, I can face OutOfMemoryException. So there is a method indexAllItems where in java it is used ScrollableResults and a method flushToIndexes on session object. What is the equivalent in .net for ScrollableResults and flushToIndexes. I checked the source code but there is no implementation for them. So is there some example how to do it?

Erik commented on NHibernate Search

Tue, 26 May 2009 11:19:00 GMT

Is it really possible to index the Categories like this, im trying to do exactly that but the items in the list wont get indexed in the file (checked with luke). In my case the ISet

Ayende Rahien commented on NHibernate Search

Tue, 05 May 2009 22:22:22 GMT

jbland, Yes they can be, but be aware that they are done using textual indexing, not value indexing This means that the granularity that you use it important

Ayende Rahien commented on NHibernate Search

Tue, 05 May 2009 22:19:48 GMT

Andrey, No, but feel free to submit a patch to do that.

jbland commented on NHibernate Search

Tue, 05 May 2009 19:31:50 GMT

I assume that DateTime fields can be indexed ? (missing in the code above)

Andrey commented on NHibernate Search

Tue, 05 May 2009 17:56:30 GMT

Ayende, Is there any way to put those attributes dynamically? We have entities with various number of fields (configuration is built in the runtime using dynamic components) and thus we don't have explicit fields. Could you recommend something in this case?

Paul Hatcher commented on NHibernate Search

Tue, 05 May 2009 07:47:02 GMT

Sorry, mis-read the comment - the version of Lucene.NET we are using is almost up to date, we are using 2.31, they recently (March) changed over to 2.3.2 so I'll update to that in the next few days. Paul

Paul Hatcher commented on NHibernate Search

Tue, 05 May 2009 07:41:03 GMT

Marco We can upgrade to Lucene 2.4.1 quite easily - bear in mind that the project hadn't had a formal release for quite a while, we were using the latest. Paul

Ayende Rahien commented on NHibernate Search

Mon, 04 May 2009 18:20:15 GMT

Marco, I can't speak about Lucene.NET catching up to Lucene, but Lucene.NET is most certainly supported by NHibernate Search

Jozef Sevcik commented on NHibernate Search

Mon, 04 May 2009 17:47:12 GMT

Marco: NHibernate.Search project in trunk uses latest stable Lucene 2.0. However, I can confirm NH.Search works well with Lucene.NET trunk version (marked as 2.3). It only requires downloading Lucene.NET from their SVN, building and then building NHibernate.Search with Lucene.NET 2.3 dll.

Marco Parenzan commented on NHibernate Search

Mon, 04 May 2009 13:00:16 GMT

Is Lucene.NET currently supported? I've seen that Lucene was out with version 2.4.1 in March 2009, while Licene.NET have a 2.0 version from 2007. Is valid to use it?

Ayende Rahien commented on NHibernate Search

Mon, 04 May 2009 06:41:17 GMT

Andreas, Luke

Andreas Öhlund commented on NHibernate Search

Mon, 04 May 2009 06:19:20 GMT

Nice post! What tool are you using to display the contents of the index?

josh commented on NHibernate Search

Mon, 04 May 2009 04:13:58 GMT

this is absolute gold; only wish I had this about 2.5 years ago when working on a system with very heavy use of full-text searches. Would have saved us mountains of headaches.