How to get all keys with their values in redis

Question

I know that in order to get all the list of all keys in Redis  I have to use KEYS    but is there a way to output all keys together with their values   Few minutes of searching did not yield any result   P S  thank you very much for answers  but I am looking for a native solution  I can write a function that iterates through all the output of KEYS   by myself

User · Answer

I had the same problem  and I felt on your post    I think the easiest way to solve this issue is by using redis Hashtable    It allows you to save a Hash  with different fields and values associated with every field    To get all the fiels and values client HGETALLL does the trick  It returns an array of   all the fields followed by their values    More informations here https   redis io commands hgetall

User · Answer

You can use MGET to get the values of multiple keys in a single go   Example   redis gt  SET key1  Hello   OK  redis gt  SET key2  World   OK  redis gt  MGET key1 key2 nonexisting 1   Hello  2   World  3   nil    For listing out all keys  amp  values you ll probably have to use bash or something similar  but MGET can help in listing all the values when you know which keys to look for beforehand

User · Answer

Tried the given example  but over VPN and with 400k  keys it was too slow for me  Also it did not give me the key objects  I wrote a small Python called tool redis-mass-get to combine KEYS and MGET requests against Redis    installation  pip install redis-mass-get    pipeline example CSV  redis-mass-get -f csv -och redis   my redis url product     less    write to json-file example with progress indicator  redis-mass-get -d results json -jd redis   my redis url product    It supports JSON  CSV and TXT output to file or stdout for usage in pipes  More info can be found at  Reading multiple key values from Redis

User · Answer

check out my tool  rdd  rdd -v   will output you all keys with data

User · Answer

I refined the bash solution a bit  so that the more efficient scan is used instead of keys  and printing out array and hash values is supported  My solution also prints out the key name   redis print sh      bin bash    Default to     key pattern  meaning all redis keys in the namespace REDIS KEY PATTERN    REDIS KEY PATTERN -    for key in   redis-cli --scan --pattern   REDIS KEY PATTERN   do     type   redis-cli type  key      if    type    list        then         printf   key   gt   n  redis-cli lrange  key 0 -1   sed  s         n      elif    type    hash        then         printf   key   gt   n  redis-cli hgetall  key   sed  s         n      else         printf   key   gt    redis-cli get  key  n      fi done   Note  you can formulate a one-liner of this script by removing the first line of redis print sh and commanding  cat redis print sh   tr   n        awk   1  1

User · Answer

There is no native way of doing this  The Redis command documentation contains no native commands for getting the key and value of multiple keys  The most native way of doing this would be to load a lua script into your redis using the SCRIPT LOAD command or the EVAL command  Bash Haxx solution A workaround would be to use some bash magic  like this  echo  keys YOURKEY     redis-cli   sed  s   get      redis-cli   This will output the data from all the keys which begin with YOURKEY Note that the keys command is a blocking operation and should be used with care

User · Answer

scan 0 MATCH   COUNT 1000     it gets all the keys          if return is  0  as first element then count is less than 1000         if more then it will return the pointer as first element and  scan pointer val MATCH   COUNT 1000          to get the next set of keys it continues till the first value is  0

User · Answer

Below is just a little variant of the script provided by   quot Juuso Ohtonen quot   I have add a password variable and counter so you can can check the progression of your backup  Also I replaced simple brackets    by double brackets      to prevent an error I had on macos  1  Get the total number of keys   sudo redis-cli INFO keyspace AUTH yourpassword INFO keyspace  2  Edit the script    bin bash    Default to     key pattern  meaning all redis keys in the namespace REDIS KEY PATTERN  quot   REDIS KEY PATTERN -   quot  PASS  quot yourpassword quot  i 1 for key in   redis-cli -a  quot  PASS quot  --scan --pattern  quot  REDIS KEY PATTERN quot   do     echo  i        i i 1       type   redis-cli -a  quot  PASS quot  type  key      if     type    quot list quot         then         printf  quot  key   gt   n  redis-cli -a  quot  PASS quot  lrange  key 0 -1   sed  s         n quot      elif     type    quot hash quot         then         printf  quot  key   gt   n  redis-cli -a  quot  PASS quot  hgetall  key   sed  s         n quot      else         printf  quot  key   gt    redis-cli -a  quot  PASS quot  get  key  n quot      fi     echo done  3  Execute the script bash redis print sh  gt  redis bak  4  Check progression tail redis bak

User · Answer

Yes  you can do print all keys using below bash script   for key in   redis-cli -p 6379 keys        do echo  Key     key         redis-cli -p 6379 GET  key  done   where  6379 is a port on which redis is running

User · Answer

I have written a small code for this particular requirement using hiredis   please find the code with a working example at http   rachitjain1 blogspot in 2013 10 how-to-get-all-keyvalue-in-redis-db html  Here is the code that I have written    include  lt stdio h gt   include  lt stdlib h gt   include  lt string h gt   include  hiredis h   int main void            unsigned int i j 0 char   str1          redisContext  c  char  t          redisReply  reply   rep           struct timeval timeout     1  500000       1 5 seconds         c   redisConnectWithTimeout  char   127 0 0 2   6903  timeout           if  c- gt err                    printf  Connection error   s n   c- gt errstr                   exit 1                      reply   redisCommand c  keys              printf  KEY t tVALUE n            printf  ------------------------ n            while   reply- gt element j - gt str    NULL                            rep   redisCommand c  GET   s   reply- gt element j - gt str                   if  strstr rep- gt str  ERR Operation against a key holding                                              printf   s t t s n    reply- gt element j - gt str rep- gt str                           break                                    printf   s t t s n    reply- gt element j - gt str rep- gt str                   j                    freeReplyObject rep

User · Answer

Use this script for redis   5      bin bash redis-cli keys      gt  keys txt cat keys txt   awk    printf  type  s n    1      redis-cli  gt  types txt paste -d    keys txt types txt   awk -F         2     string                  printf  echo   KEY  s  s   nget  s n    1   2   1       2     list      2     set     printf  echo   KEY  s  s   nsort  s by nosort n    1   2   1       2     hash                    printf  echo   KEY  s  s   nhgetall  s n    1   2   1       2     zset                    printf  echo   KEY  s  s   nzrange  s 0 -1 withscores n    1   2  1       redis-cli rm keys txt rm types txt

User · Answer

KEYS command should not be used on Redis production instances if you have a lot of keys  since it may block the Redis event loop for several seconds   I would generate a dump  bgsave   and then use the following Python package to parse it and extract the data   https   github com sripathikrishnan redis-rdb-tools  You can have json output  or customize your own output in Python

[redis] How to get all keys with their values in redis

Examples related to redis