Setting Elastic search limit to unlimited

Question

How can i get all the results from elastic search as the results only display limit to 10 only  ihave got a query like    data   Athlete search  load   gt  true do           size 15           query do             boolean do               must   string q    fields   gt    name    other names    nickname    short name     phrase slop   gt  5                  unless conditions blank                  conditions each do  condition                    must   eval condition                    end               end               unless excludes blank                  excludes each do  exclude                    must not   eval exclude                    end               end             end           end           sort do             by   score    desc            end         end   i have set the limit to 15 but i wan t to make it unlimited so that i can get all the data I can t set the limit as my data keeps on changing and i want to get all the data

User · Accepted Answer

You can use the from and size parameters to page through all your data   This could be very slow depending on your data and how much is in the index    http   www elastic co guide en elasticsearch reference current search-request-from-size html

User · Answer

use the scan method e g    curl -XGET  localhost 9200  search search type scan amp scroll 10m amp size 50  -d           query              match all                   see here

User · Answer

Another approach is to first do a searchType   count   then and then do a normal search with size set to results count   The advantage here is it avoids depending on a magic number for UPPER BOUND as suggested in this similar SO question  and avoids the extra overhead of building too large of a priority queue that Shay Banon describes here  It also lets you keep your results sorted  unlike scan   The biggest disadvantage is that it requires two requests  Depending on your circumstance  this may be acceptable

User · Answer

From the docs   Note that from   size can not be more than the index max result window index setting which defaults to 10 000   So my admittedly very ad-hoc solution is to just pass size  10000 or 10 000 minus from if I use the from argument    Note that following Matt s comment below  the proper way to do this if you have a larger amount of documents is to use the scroll api  I have used this successfully  but only with the python interface

[ruby] Setting Elastic search limit to "unlimited"

Examples related to ruby

Examples related to elasticsearch