| 14:2062a7f628ed | ||||
| 2005-09-28 | paulb | changeset files shortlog graph | [project @ 2005-09-28 15:44:53 by paulb] Changed comment. | |
| parallel.py | ||||
| 13:7ca994eb4dc9 | ||||
| 2005-09-27 | paulb | changeset files shortlog graph | [project @ 2005-09-27 18:23:46 by paulb] Added waiting for created processes. | |
| tests/start_indexer.py | ||||
| 12:bcf32e883b5e | ||||
| 2005-09-27 | paulb | changeset files shortlog graph | [project @ 2005-09-27 18:05:09 by paulb] Added channel closure after every window has been processed. Changed the Indexer and Searcher to record where words were found. | |
| tests/Dict.py tests/start_indexer.py | ||||
| 11:73be19436b6c | ||||
| 2005-09-27 | paulb | changeset files shortlog graph | [project @ 2005-09-27 18:04:03 by paulb] Fixed pipe creation, closing the other ends of pipes in each process. Made the Channel class's wait method blocking by default. Added some documentation about polling. Switched to sys.exit from SystemExit - this might avoid unnecessary exception handling in created processes. | |
| parallel.py | ||||
| 10:cadfcdf9a910 | ||||
| 2005-09-27 | paulb | changeset files shortlog graph | [project @ 2005-09-27 17:28:25 by paulb] Changed the organisation of the Dict classes so that a Parser object sends word information back to the creating process via a channel, an Indexer object collects word information and builds an index, and a Searcher object provides a front-end to the index. | |
| tests/Dict.py tests/start_indexer.py | ||||
| 9:0432c66b661e | ||||
| 2005-09-27 | paulb | changeset files shortlog graph | [project @ 2005-09-27 17:26:44 by paulb] Changed the Exchange ready method to use poll rather than select. This should now detect pipe closures and automatically remove channels. Made a separate wait method for the Channel class. Changed the start function to explicitly close the open channel. | |
| parallel.py | ||||
| 8:b18381a29301 | ||||
| 2005-09-27 | paulb | changeset files shortlog graph | [project @ 2005-09-27 14:18:01 by paulb] Introduced active and remove method calls on the Exchange object along with explicit closing of channels. Changed the program arguments so that a directory is supplied and the list of filenames is obtained using that information. | |
| tests/start_indexer.py | ||||
| 7:97103996bad1 | ||||
| 2005-09-27 | paulb | changeset files shortlog graph | [project @ 2005-09-27 14:16:48 by paulb] Introduced explicit closing of channels, along with specific waiting for created/child processes. Added active and remove methods to the Exchange class so that the channels being monitored can be queried and manipulated directly. | |
| parallel.py | ||||
| 6:93f4b77f294f | ||||
| 2005-09-26 | paulb | changeset files shortlog graph | [project @ 2005-09-26 22:27:07 by paulb] Introduced a window size option in order to limit the number of open file descriptors and to help assess performance/scalability. | |
| tests/start_indexer.py | ||||
| 5:5026061df1ca | ||||
| 2005-09-26 | paulb | changeset files shortlog graph | [project @ 2005-09-26 22:26:22 by paulb] Removed the signal handler for now: interrupted system calls caused by signals seem to disrupt the communications. An os.wait method has been added to the Channel __del__ method in order to help tidy up child processes. | |
| parallel.py | ||||