ChatGPT解决这个技术问题 Extra ChatGPT

Writing a list to a file with Python, with newlines

How do I write a list to a file? writelines() doesn't insert newline characters, so I need to do:

f.writelines([f"{line}\n" for line in lines])
do note that writelines doesn't add newlines because it mirrors readlines, which also doesn't remove them.
its between json vs pickle. read all about it - stackoverflow.com/questions/27745500/…

M
Mateen Ulhaq

Use a loop:

with open('your_file.txt', 'w') as f:
    for line in lines:
        f.write(f"{line}\n")

For Python <3.6:

with open('your_file.txt', 'w') as f:
    for line in lines:
        f.write("%s\n" % line)

For Python 2, one may also use:

with open('your_file.txt', 'w') as f:
    for line in lines:
        print >> f, line

If you're keen on a single function call, at least remove the square brackets [], so that the strings to be printed get made one at a time (a genexp rather than a listcomp) -- no reason to take up all the memory required to materialize the whole list of strings.


This isn't terribly complex, but why not just use pickle or json so that you don't have to worry about the serialization and deserialization?
For example because you want an output text file that can be easily read, edited, etc, with one item per line. Hardly a rare desire;-).
This will write an extra newline character at the end... rather than loop, you could just write thefile.write('\n'.join(thelist))
I would add: "Be careful with the list datatype". I was getting some weird results, maybe this can help someone: thefile.write(str(item) + "\n")
Just a little simpler for python 3.7'ish f.write(f'{item}\n')
j
jultty

What are you going to do with the file? Does this file exist for humans, or other programs with clear interoperability requirements?

If you are just trying to serialize a list to disk for later use by the same python app, you should be pickleing the list.

import pickle

with open('outfile', 'wb') as fp:
    pickle.dump(itemlist, fp)

To read it back:

with open ('outfile', 'rb') as fp:
    itemlist = pickle.load(fp)

+1 - Why reinvent the wheel when Python has serialization built in?
+1 - outfile is something like: open( "save.p", "wb" ) infile is something like: open( "save.p", "rb" )
The problem is that the list must fit in memory. If this is not the case, line by line is indeed a possible strategy (or else going with some alternative as in stackoverflow.com/questions/7180212/…)
In Python 2 use 'r' instead of 'rb' when reading the pickle if you get the "ValueError: insecure string pickle"
@serafeim: no; the with: block will close the file before continuing to the next statement outside of the with block.
M
Mateen Ulhaq

Simpler is:

with open("outfile", "w") as outfile:
    outfile.write("\n".join(itemlist))

To ensure that all items in the item list are strings, use a generator expression:

with open("outfile", "w") as outfile:
    outfile.write("\n".join(str(item) for item in itemlist))

Remember that itemlist takes up memory, so take care about the memory consumption.


No trailing newline, uses 2x space compared to the loop.
Of course the first question that springs to mind is whether or not the OP needs it to end in a newline and whether or not the amount of space matters. You know what they say about premature optimizations.
A downside: This constructs the entire contents for the file in memory before writing any of them out, so peak memory usage may be high.
Note from the documentation of the os module: Do not use os.linesep as a line terminator when writing files opened in text mode (the default); use a single '\n' instead, on all platforms.
I can never get this to work. I get this error: "text = '\n'.join(namelist) + '\n' TypeError: sequence item 0: expected string, list found"
o
orluke

Using Python 3 and Python 2.6+ syntax:

with open(filepath, 'w') as file_handler:
    for item in the_list:
        file_handler.write("{}\n".format(item))

This is platform-independent. It also terminates the final line with a newline character, which is a UNIX best practice.

Starting with Python 3.6, "{}\n".format(item) can be replaced with an f-string: f"{item}\n".


i dont want to add "\n" for the last item, what to do? dont want if condition
@pyd Replace the for loop with file_handler.write("\n".join(str(item) for item in the_list))
J
Jason Baker

Yet another way. Serialize to json using simplejson (included as json in python 2.6):

>>> import simplejson
>>> f = open('output.txt', 'w')
>>> simplejson.dump([1,2,3,4], f)
>>> f.close()

If you examine output.txt:

[1, 2, 3, 4]

This is useful because the syntax is pythonic, it's human readable, and it can be read by other programs in other languages.


this is much better for multiline strings
R
RobM

I thought it would be interesting to explore the benefits of using a genexp, so here's my take.

The example in the question uses square brackets to create a temporary list, and so is equivalent to:

file.writelines( list( "%s\n" % item for item in list ) )

Which needlessly constructs a temporary list of all the lines that will be written out, this may consume significant amounts of memory depending on the size of your list and how verbose the output of str(item) is.

Drop the square brackets (equivalent to removing the wrapping list() call above) will instead pass a temporary generator to file.writelines():

file.writelines( "%s\n" % item for item in list )

This generator will create newline-terminated representation of your item objects on-demand (i.e. as they are written out). This is nice for a couple of reasons:

Memory overheads are small, even for very large lists

If str(item) is slow there's visible progress in the file as each item is processed

This avoids memory issues, such as:

In [1]: import os

In [2]: f = file(os.devnull, "w")

In [3]: %timeit f.writelines( "%s\n" % item for item in xrange(2**20) )
1 loops, best of 3: 385 ms per loop

In [4]: %timeit f.writelines( ["%s\n" % item for item in xrange(2**20)] )
ERROR: Internal Python error in the inspect module.
Below is the traceback from this internal error.

Traceback (most recent call last):
...
MemoryError

(I triggered this error by limiting Python's max. virtual memory to ~100MB with ulimit -v 102400).

Putting memory usage to one side, this method isn't actually any faster than the original:

In [4]: %timeit f.writelines( "%s\n" % item for item in xrange(2**20) )
1 loops, best of 3: 370 ms per loop

In [5]: %timeit f.writelines( ["%s\n" % item for item in xrange(2**20)] )
1 loops, best of 3: 360 ms per loop

(Python 2.6.2 on Linux)


B
Big Sam

Because i'm lazy....

import json
a = [1,2,3]
with open('test.txt', 'w') as f:
    f.write(json.dumps(a))

#Now read the file back into a Python list object
with open('test.txt', 'r') as f:
    a = json.loads(f.read())

are lists json serializable?
Yes indeed, they are!
import json ; test_list = [1,2,3]; list_as_a_string = json.dumps(test_list); #list_as_a_string is now the string '[1,2,3]'
I'm doing this with open ('Sp1.txt', 'a') as outfile: json.dump (sp1_segments, outfile) logger.info ("Saved sp_1 segments") ; problem is my program runs thrice, and the results from three runs are getting mashed up. is there any way to add 1-2 empty lines so that the results from each run are discernible?
Absolutely! could you instead do json.dump(sp1_segments + "\n\n", outfile)?
t
themadmax

Serialize list into text file with comma sepparated value

mylist = dir()
with open('filename.txt','w') as f:
    f.write( ','.join( mylist ) )

M
Marvin W

In General

Following is the syntax for writelines() method

fileObject.writelines( sequence )

Example

#!/usr/bin/python

# Open a file
fo = open("foo.txt", "rw+")
seq = ["This is 6th line\n", "This is 7th line"]

# Write sequence of lines at the end of the file.
line = fo.writelines( seq )

# Close opend file
fo.close()

Reference

http://www.tutorialspoint.com/python/file_writelines.htm


b
bricoletc

In python>3 you can use print and * for argument unpacking:

with open("fout.txt", "w") as fout:
    print(*my_list, sep="\n", file=fout)

A
Ahmad Masalha

Simply:

with open("text.txt", 'w') as file:
    file.write('\n'.join(yourList))

m
mtasic85
file.write('\n'.join(list))

One should note that this will require that the file be opened as text to be truly platform-neutral.
How do you get the file variable?
s
shankar
with open ("test.txt","w")as fp:
   for line in list12:
       fp.write(line+"\n")

N
Nandita Damaraju

You can also use the print function if you're on python3 as follows.

f = open("myfile.txt","wb")
print(mylist, file=f)

isn't it only put one line in myfile.txt, something like: ['a','b','c'] instead of writing each a,b,c on each line.
k
kamilazdybal

Using numpy.savetxt is also an option:

import numpy as np

np.savetxt('list.txt', list, delimiter="\n", fmt="%s")

B
Bob

Why don't you try

file.write(str(list))

P
Prox

I recently found Path to be useful. Helps me get around having to with open('file') as f and then writing to the file. Hope this becomes useful to someone :).

from pathlib import Path
import json
a = [[1,2,3],[4,5,6]]
# write
Path("file.json").write_text(json.dumps(a))
# read
json.loads(Path("file.json").read_text())

p
petezurich

This logic will first convert the items in list to string(str). Sometimes the list contains a tuple like

alist = [(i12,tiger), 
(113,lion)]

This logic will write to file each tuple in a new line. We can later use eval while loading each tuple when reading the file:

outfile = open('outfile.txt', 'w') # open a file in write mode
for item in list_to_persistence:    # iterate over the list items
   outfile.write(str(item) + '\n') # write to the file
outfile.close()   # close the file 

M
MRUNAL MUNOT

You can also go through following:

Example:

my_list=[1,2,3,4,5,"abc","def"]
with open('your_file.txt', 'w') as file:
    for item in my_list:
        file.write("%s\n" % item)

Output:

In your_file.txt items are saved like:

1

2

3

4

5

abc

def

Your script also saves as above.

Otherwise, you can use pickle

import pickle
my_list=[1,2,3,4,5,"abc","def"]
#to write
with open('your_file.txt', 'wb') as file:
    pickle.dump(my_list, file)
#to read
with open ('your_file.txt', 'rb') as file:
    Outlist = pickle.load(file)
print(Outlist)

Output: [1, 2, 3, 4, 5, 'abc', 'def']

It save dump the list same as a list when we load it we able to read.

Also by simplejson possible same as above output

import simplejson as sj
my_list=[1,2,3,4,5,"abc","def"]
#To write
with open('your_file.txt', 'w') as file:
    sj.dump(my_list, file)

#To save
with open('your_file.txt', 'r') as file:
    mlist=sj.load(file)
print(mlist)

thank you for adding the output, immensely helpful
A
Alex Ulyanov

Another way of iterating and adding newline:

for item in items:
    filewriter.write(f"{item}" + "\n")

N
Nikhil B

In Python3 You Can use this loop

with open('your_file.txt', 'w') as f:
    for item in list:
        f.print("", item)

Y
Youjun Hu

Redirecting stdout to a file might also be useful for this purpose:

from contextlib import redirect_stdout
with open('test.txt', 'w') as f:
  with redirect_stdout(f):
     for i in range(mylst.size):
        print(mylst[i])

B
Bahae El Hmimdi

i suggest this solution .

with open('your_file.txt', 'w') as f:        
    list(map(lambda item : f.write("%s\n" % item),my_list))   

r
rmrrm

Let avg be the list, then:

In [29]: a = n.array((avg))
In [31]: a.tofile('avgpoints.dat',sep='\n',dtype = '%f')

You can use %e or %s depending on your requirement.


B
BurgerKing Lee

i think you are looking for an answer like this.

f = open('output.txt','w')
list = [3, 15.2123, 118.3432, 98.2276, 118.0043]
f.write('a= {:>3d}, b= {:>8.4f}, c= {:>8.4f}, d= {:>8.4f}, e= 
{:>8.4f}\n'.format(*list))
f.close()

what is this doing?
v
vayah
poem = '''\
Programming is fun
When the work is done
if you wanna make your work also fun:
use Python!
'''
f = open('poem.txt', 'w') # open for 'w'riting
f.write(poem) # write text to file
f.close() # close the file

How It Works: First, open a file by using the built-in open function and specifying the name of the file and the mode in which we want to open the file. The mode can be a read mode (’r’), write mode (’w’) or append mode (’a’). We can also specify whether we are reading, writing, or appending in text mode (’t’) or binary mode (’b’). There are actually many more modes available and help(open) will give you more details about them. By default, open() considers the file to be a ’t’ext file and opens it in ’r’ead mode. In our example, we first open the file in write text mode and use the write method of the file object to write to the file and then we finally close the file.

The above example is from the book "A Byte of Python" by Swaroop C H. swaroopch.com


This writes a string to a file, not a list (of strings) as the OP asks