SOLRSearch for Elgg Plugin
I have started to create a plugin to integrate SOLR into Elgg. The combination of SOLR / Solarium looks rather impressive. I have put the plugin onto Github -> https://github.com/domblue/SOLRSearch
It still lacks a lot but if anybody is interested to contribute feel free to contact me. This plugin / integration is definitively not something for beginners! SOLR is a separate Java Server.
There is a readme in the repo explaining the setup and the pre-reqs.
The basic idea is to get sophisticated search for Elgg for 2 main use case scenarios:
1. Search Elgg content (all types)
2. Search Elgg profiles (based on profile manager data)
This will be implemented with 2 SOLR cores / index to get both paths optimized.
There is still a lot to do:
1. Enable semi-dynamic generation of SOLR configs out of Elgg
2. Create the user interface and linkage of the results to Elgg entities.
3. Enable sophisticated profile search.
4. Enable advanced search features like stemming, synonyms, stopwords, highliting, facets, etc.
5. Optimize data import including delta import.
6. Respect Elgg access control
7. and more .... :-)
Attached is a screenshot. Of course the current output is optimized for development and not the way an end user would see it.
Hi Dhrup,
Below is the reference for what I Mean to say.. "http://www.skysql.com/enterprise/sphinx" please see "HOW DOES IT WORK" section in this post .. Please let me know if you need more information.. As I said in above post still I am working on this as this is not fully completed.. I will share you my experience once done..
oh well , i an see where you got that ' available as stand-alone server ' term now ;) and also the ' just like other DB servers ' which is not true about Sphinx - that was puzzling me a lot; it is not a DB server.
Search on Groups (based on profile manager created fields)?
@domblue: I have implemented solr search on my site. My implemetation is not that detailed. I manage most of configurations via the solr.conf and do not have the detailed interface as you mention. Anyway count me in on the effort, I can gladly help in my spare time.
I think elgg is a great platform but lacks heavily on the search aspect. The database structure is not at all search friendly specially the metadata. For me, the native elgg search is way too slow plus the custom profile field search wasn't working properly a while ago. I tried all the above solutions like mysql native search, sphinx but they were not where close to solr's performance.
Have you considered elasticsearch? I think it might fit in better than solr for elgg.
@All: ElasticSearch, yes it is really cool to have. We are using elasticsearch + elgg from last 1.5 years. I believe, elasticsearch dynamic document model is best fit with EAV model of elgg. Where each entity could have different attributes to define the state of the object. Even though the object is of same type. And correspondingly elasticsearch document model fully support this behavior. We are using this model succesfully for more than 2 million entities. Best this about elasticsearch, we can scale up and down anytime we need and it automatically handle all internal complications like to identify the cluster, To work as replica for other shards, and many more advantages of elasticsearch.
- Previous
- 1
- 2
- Next
You must log in to post replies.