Extract Google Drive zip from Google colab notebook

Question

I already have a zip of  2K images  dataset on a google drive  I have to use it in a ML training algorithm  Below Code extracts the content in a string format   from pydrive auth import GoogleAuth from pydrive drive import GoogleDrive from google colab import auth from oauth2client client import GoogleCredentials import io import zipfile   Authenticate and create the PyDrive client    This only needs to be done once per notebook  auth authenticate user   gauth   GoogleAuth   gauth credentials   GoogleCredentials get application default   drive   GoogleDrive gauth     Download a file based on its file ID      A file ID looks like  laggVyWshwcyP6kEI-y W3P8D26sz file id    1T80o3Jh3tHPO7hI5FBxcX-jFnxEuUE9K   -- Updated File ID for my zip downloaded   drive CreateFile   id   file id    print  Downloaded content       format downloaded GetContentString encoding  cp862       But I have to extract and store it in a separate directory as it would be easier for processing  as well as for understanding  of the dataset   I tried to extract it further  but getting  Not a zipfile error   dataset   io BytesIO downloaded encode  cp862    zip ref   zipfile ZipFile dataset   r   zip ref extractall   zip ref close     Google Drive Dataset  Note  Dataset is just for reference  I have already downloaded this zip to my google drive  and I m referring to file in my drive only

User · Answer

After mounting on drive  use shutil unpack archive  It works with almost all archive formats  e g      zip        tar        gztar        bztar        xztar     and it s simple   import shutil shutil unpack archive  filename    path to extract

User · Answer

Colab research team has a notebook for helping you out  Still  in short  if you are dealing with a zip file  like for me it is mostly thousands of images and I want to store them in a folder within drive then do this --  unzip -u  quot  content drive My Drive folder example zip quot  -d  quot  content drive My Drive folder NewFolder quot  -u part controls extraction only if new necessary  It is important if suddenly you lose connection or hardware switches off  -d creates the directory and extracted files are stored there  Of course before doing this you need to mount your drive from google colab import drive  drive mount   content drive    I hope this helps  Cheers

User · Answer

in my idea  you must go to a certain path for example   from google colab import drive drive mount   content drive    cd drive MyDrive f   then    apt install unzip  unzip zip folder zip -d unzip folder enter image description here

User · Answer

You can simply use this   unzip file location

User · Answer

TO unzip a file to a directory    unzip path to file zip -d path to directory

User · Answer

Mount GDrive   from google colab import drive drive mount   content gdrive     Open the link -  copy authorization code -  paste that into the prompt and press  Enter   Check GDrive access    ls   content gdrive My Drive    Unzip  q stands for  quiet   file from GDrive    unzip -q   content gdrive My Drive dataset zip

User · Answer

Try this   unpack file zip  If its now working or file is 7z try below  apt-get install p7zip-full  p7zip -d file name tar 7z  tar -xvf file name tar  Or  pip install pyunpack  pip install patool  from pyunpack import Archive Archive    file name tar 7z     extractall    path to       tar -xvf file name tar

User · Answer

To extract Google Drive zip from a Google colab notebook    import zipfile from google colab import drive  drive mount   content drive     zip ref   zipfile ZipFile   content drive My Drive ML DataSet zip    r   zip ref extractall   tmp   zip ref close

User · Answer

SIMPLE WAY TO CONNECT    1  You ll have to verify authentication  from google colab import auth auth authenticate user   from oauth2client client import GoogleCredentials creds   GoogleCredentials get application default     2 To fuse google drive   apt-get install -y -qq software-properties-common python-software-properties module-init-tools  add-apt-repository -y ppa alessandro-strada ppa 2 gt  amp 1  gt   dev null  apt-get update -qq 2 gt  amp 1  gt   dev null  apt-get -y install -qq google-drive-ocamlfuse fuse   3 To verify credentials  import getpass  google-drive-ocamlfuse -headless -id  creds client id  -secret  creds client secret   lt   dev null 2 gt  amp 1   grep URL vcode   getpass getpass    echo  vcode    google-drive-ocamlfuse -headless -id  creds client id  -secret  creds client secret    4 Create a drive name to use it in colab   gdrive   and check if it s working   mkdir gdrive  google-drive-ocamlfuse gdrive  ls gdrive  cd gdrive

User · Answer

First  install unzip on colab    apt install unzip   then use unzip to extract your files    unzip  source zip -d destination zip

User · Answer

For Python  Connect to drive   from google colab import drive drive mount   content drive     Check for directory   ls  and  pwd  For unzip   unzip drive  My Drive  images zip

User · Answer

Instead of GetContentString    use  GetContentFile   instead  It will save the file instead of returning the string   downloaded GetContentFile  images zip      Then you can unzip it later with unzip

User · Answer

First create a new directory    mkdir file destination   Now  it s the time to inflate the directory with the unzipped files with this    unzip file location -d file destination

[python] Extract Google Drive zip from Google colab notebook

Examples related to python

Examples related to google-drive-api

Examples related to google-colaboratory

Examples related to zipfile