za
for file in glob . glob ( '*.csv' )
mlzboy@mlzboy-mac:~/my/ide$ file test_compiled.txt test_compiled.txt: ASCII text, with CRLF line terminators
use file xxx.py to check file is end with \r\n
multiprocessing sources
maxtasksperchild is the number of tasks a worker process can complete before it will exit and be replaced with a fresh worker process, to enable unused resources to be freed. The default maxtasksperchild is None, which means worker processes will live as long as the pool.
Note
Worker processes within a Pool typically live for the complete duration of the Pool’s work queue. A frequent pattern found in other systems (such as Apache, mod_wsgi, etc) to free resources held by workers is to allow a worker within a pool to complete only a set amount of work before being exiting, being cleaned up and a new process spawned to replace the old one. The maxtasksperchild argument to the Pool exposes this ability to the end user.
>>> import multiprocessing , logging >>> logger = multiprocessing . log_to_stderr () >>> logger . setLevel ( logging . INFO ) >>> logger . warning ( 'doomed' )