Python multiprocessing broken pipe, access namespace -
Python multiprocessing broken pipe, access namespace -
i have long-running process running simulation using python's multiprocessing. @ end, process sends results through pipe main process.
the problem that, had redefined class results object, knew give me unpickling error. in effort head off, got file descriptor of pipe , tried open os.fdopen. unfortunately, got "bad file descriptor" error, , same if seek receive pipe.
because long simulation, don't want kill process , start over. there way object out of pipe or access namespace of kid process can save disk?
thanks much.
a few suggestions transferring unpicklable raw info multiprocessing
workers:
1) have each worker write database or file (or print console)
2) translate raw info string, homecoming parent. if parent logging things easiest.
3) translate json, homecoming parent. solution best if parent aggregating data, not logging it.
python multiprocessing pipe
Comments
Post a Comment