pprocess

Changelog

(0) -10 +10 +100 tip
12:bcf32e883b5e
2005-09-27 paulb changeset files shortlog graph [project @ 2005-09-27 18:05:09 by paulb] Added channel closure after every window has been processed. Changed the Indexer and Searcher to record where words were found.
tests/Dict.py tests/start_indexer.py
11:73be19436b6c
2005-09-27 paulb changeset files shortlog graph [project @ 2005-09-27 18:04:03 by paulb] Fixed pipe creation, closing the other ends of pipes in each process. Made the Channel class's wait method blocking by default. Added some documentation about polling. Switched to sys.exit from SystemExit - this might avoid unnecessary exception handling in created processes.
parallel.py
10:cadfcdf9a910
2005-09-27 paulb changeset files shortlog graph [project @ 2005-09-27 17:28:25 by paulb] Changed the organisation of the Dict classes so that a Parser object sends word information back to the creating process via a channel, an Indexer object collects word information and builds an index, and a Searcher object provides a front-end to the index.
tests/Dict.py tests/start_indexer.py
9:0432c66b661e
2005-09-27 paulb changeset files shortlog graph [project @ 2005-09-27 17:26:44 by paulb] Changed the Exchange ready method to use poll rather than select. This should now detect pipe closures and automatically remove channels. Made a separate wait method for the Channel class. Changed the start function to explicitly close the open channel.
parallel.py
8:b18381a29301
2005-09-27 paulb changeset files shortlog graph [project @ 2005-09-27 14:18:01 by paulb] Introduced active and remove method calls on the Exchange object along with explicit closing of channels. Changed the program arguments so that a directory is supplied and the list of filenames is obtained using that information.
tests/start_indexer.py
7:97103996bad1
2005-09-27 paulb changeset files shortlog graph [project @ 2005-09-27 14:16:48 by paulb] Introduced explicit closing of channels, along with specific waiting for created/child processes. Added active and remove methods to the Exchange class so that the channels being monitored can be queried and manipulated directly.
parallel.py
6:93f4b77f294f
2005-09-26 paulb changeset files shortlog graph [project @ 2005-09-26 22:27:07 by paulb] Introduced a window size option in order to limit the number of open file descriptors and to help assess performance/scalability.
tests/start_indexer.py
5:5026061df1ca
2005-09-26 paulb changeset files shortlog graph [project @ 2005-09-26 22:26:22 by paulb] Removed the signal handler for now: interrupted system calls caused by signals seem to disrupt the communications. An os.wait method has been added to the Channel __del__ method in order to help tidy up child processes.
parallel.py
4:c64efeb60986
2005-09-26 paulb changeset files shortlog graph [project @ 2005-09-26 21:59:16 by paulb] Added a text indexing demonstration using a simple implementation of an indexer along with an example which uses message exchanges to coordinate communications between the parent and child processes.
tests/Dict.py tests/start_indexer.py
3:d5bb6c75e31f
2005-09-26 paulb changeset files shortlog graph [project @ 2005-09-26 21:58:04 by paulb] Added message exchange support for efficient polling of channels. Added signal support for proper tidying of child processes. Added more documentation.
parallel.py
(0) -10 +10 +100 tip