[Elasticsearch] [링크 펌]Custom Similarity...
Elastic/Elasticsearch 2013. 7. 15. 23:12http://elasticsearch-users.115913.n3.nabble.com/custom-similarity-setting-does-not-work-with-version-0-20-2-td4029500.html
custom similarity setting does not work with version 0.20.2
Feb 08, 2013; 3:47pmcustom similarity setting does not work with version 0.20.2
 77 posts | Hi, I tried following configurations for my custom similarity provider but none of them worked with version 0.20. Can anyone give me some information about this setting for version 0.20.2? Any sample usages will be enough for me curl -XPOST 'http://host:port/tweeter/' -d '
{
"settings": {
"similarity": {
"index": {
"type": "org.elasticsearch.index.similarity.CustomSimilarityProvider"
},
"search": {
"type": "org.elasticsearch.index.similarity.CustomSimilarityProvider"
}
}
}
}-- Mustafa Sener -- Mustafa Sener www.ifountain.com You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email]. For more options, visit https://groups.google.com/groups/opt_out. |
Feb 08, 2013; 5:33pm
Re: custom similarity setting does not work with version 0.20.2
 13 posts | Hello, you should try this command : curl -XPOST 'http://host:port/tweeter/' -d '
{
"settings": {
"index": {
"similarity": {
"index": {
"type": "org.elasticsearch.index.similarity.CustomSimilarityProvider"
},
"search": {
"type": "org.elasticsearch.index.similarity.CustomSimilarityProvider"
}
}
}
}
}I hope it can help you.Regards Benjamin On Fri, Feb 8, 2013 at 7:47 AM, Mustafa Sener <[hidden email]> wrote:
You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email]. For more options, visit https://groups.google.com/groups/opt_out. |
Feb 08, 2013; 5:40pm
Re: custom similarity setting does not work with version 0.20.2
77 posts | That does not work too. I tried it before. On Fri, Feb 8, 2013 at 10:33 AM, benjamin leviant <[hidden email]> wrote:
-- Mustafa Sener You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email]. For more options, visit https://groups.google.com/groups/opt_out. |
Feb 08, 2013; 6:42pm
Re: custom similarity setting does not work with version 0.20.2
13 posts | Hi, What is your the error message ? How do you get your custom class loaded ? Regards Benjamin On Fri, Feb 8, 2013 at 9:40 AM, Mustafa Sener <[hidden email]> wrote: That does not work too. I tried it before. You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email]. For more options, visit https://groups.google.com/groups/opt_out. |
Feb 08, 2013; 7:00pm
Re: custom similarity setting does not work with version 0.20.2
77 posts | I have no error messages. It seems that this setting is different before version 0.20. Since there is no documentation about this, I cannot configure it properly. On Fri, Feb 8, 2013 at 11:42 AM, benjamin leviant <[hidden email]> wrote:
-- Mustafa Sener You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email]. For more options, visit https://groups.google.com/groups/opt_out. |
Feb 08, 2013; 7:27pm
Re: custom similarity setting does not work with version 0.20.2
13 posts | I use a custom similarity on Elasticsearch 0.20.1 and it work perfectly well. If you dont have any error message when you create your index, then your custom similarity should be enable for search and index operations on this index. May be your problem is caused by the way your similarity provider is implemented. Can you post the code ? Regards Benjamin On Fri, Feb 8, 2013 at 11:00 AM, Mustafa Sener <[hidden email]> wrote: I have no error messages. It seems that this setting is different before version 0.20. Since there is no documentation about this, I cannot configure it properly. You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email]. For more options, visit https://groups.google.com/groups/opt_out. |
Feb 08, 2013; 8:15pm
Re: custom similarity setting does not work with version 0.20.2
77 posts | I use a FloatingPayload filter to create payloads for each term which is separated by '|' character (school|5.8). Then I use following similarity https://gist.github.com/anonymous/4738207 On Fri, Feb 8, 2013 at 12:27 PM, benjamin leviant <[hidden email]> wrote:
-- Mustafa Sener You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email]. For more options, visit https://groups.google.com/groups/opt_out. |
Feb 08, 2013; 8:43pm
Re: custom similarity setting does not work with version 0.20.2
13 posts | Your implementation looks good. But to get payload working in elasticsearch, a custom similarity is not enough. You need also to implement several custom elements : - a token filter : to index payload values - a query parser : to score using payload values Do you have all these elements working ? Regards Benjamin On Fri, Feb 8, 2013 at 12:15 PM, Mustafa Sener <[hidden email]> wrote: I use a FloatingPayload filter to create payloads for each term which is separated by '|' character (school|5.8). Then I use following similarity You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email]. For more options, visit https://groups.google.com/groups/opt_out. |
Feb 08, 2013; 9:03pm
Re: custom similarity setting does not work with version 0.20.2
77 posts | I have token filter. But not query parser. I use more like this query directly. I will not use token payloads on query, I want to use token payloads stored by filter on index time. Do I still need a query parser even if I use more like this query? On Fri, Feb 8, 2013 at 1:43 PM, benjamin leviant <[hidden email]> wrote:
-- Mustafa Sener You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email]. For more options, visit https://groups.google.com/groups/opt_out. |
Feb 08, 2013; 10:20pm
Re: custom similarity setting does not work with version 0.20.2
13 posts | It is not working, because the "more like this" query do not call the scorePayload method to score the results. To use payloads, you need a custom query parser with a query having a scoring method that take in account payloads. You can see documentation about lucene PayloadTermQuery and PayloadNearQuery. Regards Benjamin On Fri, Feb 8, 2013 at 1:03 PM, Mustafa Sener <[hidden email]> wrote: I have token filter. But not query parser. I use more like this query directly. I will not use token payloads on query, I want to use token payloads stored by filter on index time. Do I still need a query parser even if I use more like this query? You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email]. For more options, visit https://groups.google.com/groups/opt_out. |
Feb 08, 2013; 10:32pm
Re: custom similarity setting does not work with version 0.20.2
77 posts | Ok, Thanks for your help. It was very beneficial for me. Regards... On Fri, Feb 8, 2013 at 3:20 PM, benjamin leviant <[hidden email]> wrote:
-- Mustafa Sener You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email]. For more options, visit https://groups.google.com/groups/opt_out. |
Feb 08, 2013; 10:51pm
Re: custom similarity setting does not work with version 0.20.2
77 posts | The best option here to use morelikethis query is modify it to take payloads into account. I think I can do this by sub-classing payload query and multiply tf value used by query by payload of that term. What do you think about this design? Actually I need a categorizer which when I enter a text will return best matching categories based on predefined terms and payloads for categories. I select more like this query for this purpose. Payloads are important because I will assign negative payloads to negative samples or terms. On Fri, Feb 8, 2013 at 3:32 PM, Mustafa Sener <[hidden email]> wrote: Ok, -- Mustafa Sener You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email]. For more options, visit https://groups.google.com/groups/opt_out. |
Feb 09, 2013; 12:41am
Re: custom similarity setting does not work with version 0.20.2
13 posts | Yes you can try by subclassing morelikethis query to customize its scoring logic. Sorry, but I cannot confirm you it will be work. Please, give us update on this. Regards On Fri, Feb 8, 2013 at 2:51 PM, Mustafa Sener <[hidden email]> wrote: The best option here to use morelikethis query is modify it to take payloads into account. I think I can do this by sub-classing payload query and multiply tf value used by query by payload of that term. What do you think about this design? Actually I need a categorizer which when I enter a text will return best matching categories based on predefined terms and payloads for categories. I select more like this query for this purpose. Payloads are important because I will assign negative payloads to negative samples or terms. You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email]. For more options, visit https://groups.google.com/groups/opt_out. |
« Return to ElasticSearch Users | 78 views
| Powered by Nabble | Edit this page |