How to split a string into a list

Question

I want my Python function to split a sentence  input  and store each word in a list  My current code splits the sentence  but does not store the words as a list  How do I do that   def split line text          split the text     words   text split          for each word in the line      for word in words             print the word         print words

User · Answer

Splits the string in text on any consecutive runs of whitespace   words   text split           Split the string in text on delimiter        words   text split           The words variable will be a list and contain the words from text split on the delimiter

User · Answer

Split the words without without harming apostrophes inside words Please find the input 1 and input 2 Moore s law def split into words line       import re     word regex improved   r quot   w  w    w  w  quot      word matcher   re compile word regex improved      return word matcher findall line    Example 1  input 1    quot computational power  see Moore s law  and  quot  split into words input 1     output    computational    power    see    quot Moore s quot    law    and     Example 2  input 2    quot  quot  quot Oh  you can t help that   said the Cat   we re all mad here  I m mad  You re mad  quot  quot  quot   split into words input 2   output   Oh     you     quot can t quot     help     that     said     the     Cat     quot we re quot     all     mad     here     quot I m quot     mad     quot You re quot     mad

User · Answer

Depending on what you plan to do with your sentence-as-a-list  you may want to look at the Natural Language Took Kit   It deals heavily with text processing and evaluation  You can also use it to solve your problem  import nltk words   nltk word tokenize raw sentence   This has the added benefit of splitting out punctuation  Example   gt  gt  gt  import nltk  gt  gt  gt  s    quot The fox s foot grazed the sleeping dog  waking it  quot   gt  gt  gt  words   nltk word tokenize s   gt  gt  gt  words   The    fox    quot  s quot    foot    grazed    the    sleeping    dog          waking    it         This allows you to filter out any punctuation you don t want and use only words  Please note that the other solutions using string split   are better if you don t plan on doing any complex manipulation of the sentence   Edited

User · Answer

I want my python function to split a sentence  input  and store each word in a list   The str   split   method does this  it takes a string  splits it into a list    gt  gt  gt  the string    this is a sentence   gt  gt  gt  words   the string split       gt  gt  gt  print words    this    is    a    sentence    gt  gt  gt  type words   lt type  list  gt    or  lt class  list  gt  in Python 3 0   The problem you re having is because of a typo  you wrote print words  instead of print word    Renaming the word variable to current word  this is what you had   def split line text       words   text split       for current word in words          print words      when you should have done   def split line text       words   text split       for current word in words          print current word    If for some reason you want to manually construct a list in the for loop  you would use the list append   method  perhaps because you want to lower-case all words  for example    my list        make empty list for current word in words      my list append current word lower      Or more a bit neater  using a list-comprehension   my list    current word lower   for current word in words

User · Answer

text split     This should be enough to store each word in a list   words is already a list of the words from the sentence  so there is no need for the loop   Second  it might be a typo  but you have your loop a little messed up  If you really did want to use append  it would be   words append word    not   word append words

User · Answer

How about this algorithm  Split text on whitespace  then trim punctuation  This carefully removes punctuation from the edge of words  without harming apostrophes inside words such as we re    gt  gt  gt  text   Oh  you can t help that   said the Cat   we re all mad here  I m mad  You re mad      gt  gt  gt  text split      Oh     you    can t    help    that      said    the    Cat      we re    all    mad    here     I m    mad     You re    mad       gt  gt  gt  import string  gt  gt  gt   word strip string punctuation  for word in text split      Oh    you    can t    help    that    said    the    Cat    we re    all    mad    here    I m    mad    You re    mad

User · Answer

shlex has a  split   function  It differs from str split   in that it does not preserve quotes and treats a quoted phrase as a single word   gt  gt  gt  import shlex  gt  gt  gt  shlex split  quot sudo echo  foo  amp  amp  bar  quot     sudo    echo    foo  amp  amp  bar    NB  it works well for Unix-like command line strings  It doesn t work for natural-language processing

User · Answer

I think you are confused because of a typo     Replace print words  with print word  inside your loop to have every word printed on a different line

User · Answer

If you want all the chars of a word sentence in a list  do this                   print list  word         w    o    r    d     print list  some sentence         s    o    m    e         s    e    n    t    e    n    c    e

User · Answer

str split       Return a list of the words in the string  using sep as the delimiter        If sep is not specified or is None  a different splitting algorithm is applied  runs of consecutive whitespace are regarded as a single separator  and the result will contain no empty strings at the start or end if the string has leading or trailing whitespace      gt  gt  gt  line  a sentence with a few words   gt  gt  gt  line split     a    sentence    with    a    few    words    gt  gt  gt

[python] How to split a string into a list?

Examples related to python

Examples related to list

Examples related to split

Examples related to text-segmentation