Ecosyste.ms: OpenCollective

An open API service for software projects hosted on Open Collective.

github.com/celery/billiard

Multiprocessing Pool Extensions
https://github.com/celery/billiard

Pool: Adds Process.index that can be used to create as many logfiles as there are processes in the pool

fafba7bddec63f0f73ebec6a3801e078796d295c authored over 12 years ago by Ask Solem <[email protected]>
Bumps version to 2.7.3.12 and updates Changelog

85adfed3bc77f804fddd21f3b7f7686600be5350 authored over 12 years ago by Ask Solem <[email protected]>
Fixes Python 2.5 compatibility

f7995dff79081d8c3404f83b5263532dd382e59a authored over 12 years ago by Ask Solem <[email protected]>
Adds Pool.terminate_job to terminate a job without raising WorkerLostError

2a8e23672b1f6fc9203cafd4cb6242ab2f9d75e7 authored over 12 years ago by Ask Solem <[email protected]>
Bumps version to 2.7.3.11 and updates Changelog

c2191b495eac310babc3ed6d995d9fc700c2a6f3 authored over 12 years ago by Ask Solem <[email protected]>
Adds allow_restart option to pool. Closes #7 (must upgrade to celery master)

728829cb3ed55a17dc8b297aa8b6ce6d9c987cbe authored over 12 years ago by Ask Solem <[email protected]>
Now emits a warning if force_execv is not supported. Closes #5

bb096154cae6eb37668d473b8a682599b2bf1de9 authored over 12 years ago by Ask Solem <[email protected]>
Pool: Emit warning if process did exited and was not recycled

a918cba955ed950151fea80363090169ccfcf578 authored over 12 years ago by Ask Solem <[email protected]>
Fixes bytes for Py <3

a94003599f0003094a895021088d2b9c4e12ca5e authored over 12 years ago by Ask Solem <[email protected]>
Fixes bytes encoding. Closes #11

4efdbe6386968ed15e24f7e1fd4de9c94694361d authored over 12 years ago by Ask Solem <[email protected]>
2.5 compatibility. Closes #9

96f60c7c45746dbbf6187fa3d6727da866b7cc95 authored over 12 years ago by Ask Solem <[email protected]>
Use integer division

e5777b0293e5830b742bedb995aac0570019729e authored over 12 years ago by Ask Solem <[email protected]>
Support for FreeBSD 7+. Thanks to @koobs

3d63cf067b943b37eb4c451c5424d2f086e7a6e1 authored over 12 years ago by Ask Solem <[email protected]>
Bumps version to 2.7.3.10

6d27e82b16582876b2b00eafff99d24e1e20c740 authored over 12 years ago by Ask Solem <[email protected]>
Fixes

ccff84c62471c9c106c472b43797ecde03444fa8 authored over 12 years ago by Ask Solem <[email protected]>
Fixed typo in LaxBoundedSemaphore.shrink

da65e6e0dbb5d973c568124151d1e64cc0a163f3 authored over 12 years ago by Ask Solem <[email protected]>
bdist now works

aae8de4e74f3c598b6abd65cb3275a3bceb3c856 authored over 12 years ago by Ask Solem <[email protected]>
Remove backup files

6834c903047ddead75800b3602e77880b6f710e8 authored over 12 years ago by Ask Solem <[email protected]>
Distutils don't like Unicode

456d26a9cdfe6d098bfc6009162bd8e99aa68af5 authored over 12 years ago by Ask Solem <[email protected]>
Repo moved to celery/billiard

f7fe3c0feaf8cd1d67e7827fab4254c40a72f62b authored over 12 years ago by Ask Solem <[email protected]>
Bumps version to 2.7.3.9 and updates Changelog

bb9c1c43528b2a969c99aa5c57129daf2e1ce646 authored over 12 years ago by Ask Solem <[email protected]>
MP_MAIN_FILE envvar is now set to the path of the __main__m module when execv is enabled

863eabc07aa2405c357013d78d99040b6c2f645c authored over 12 years ago by Ask Solem <[email protected]>
Pool: Report errors occuring in TaskHandler

c5d8e1bf4e333cfbf9ddd8d11dc12d6918d1174c authored over 12 years ago by Ask Solem <[email protected]>
Bumps version to 2.7.3.8 and updates Changelog

598bbb2bc226a327e4f71d6ca48da0df7e4840cc authored over 12 years ago by Ask Solem <[email protected]>
Py3k support

24496483764e6def4d9e61b3e2aa9c590eae7c85 authored over 12 years ago by Ask Solem <[email protected]>
Pool(putlocks=) now sets default for waitforslot argument

d273e8b196664b3d619ac3dbaff8d292b74f05fd authored over 12 years ago by Ask Solem <[email protected]>
Issue #12091: simplify ApplyResult and MapResult with threading.Event

Patch by Charles-François Natali

244f09070a3171e06aadb8b06927a31245c2b766 authored over 12 years ago by Ask Solem <[email protected]>
Pool: Support running without TimeoutHandler thread.

- The with_*_thread arguments has also been replaced with
a single `threads=True` argument.

-...

e3a1f965e21f91ca6b17082ab3d68a4259743415 authored over 12 years ago by Ask Solem <[email protected]>
Python2.5 fixes

42fbb7a9ccfb940ec0d8e38a1dd38341e4541dba authored over 12 years ago by Ask Solem <[email protected]>
Fixes 2.5 support, bumps to 2.7.3.7

31ed246f74438bfec00fb820c6f926613e587228 authored over 12 years ago by Ask Solem <[email protected]>
Bumps version to 2.7.3.6 and updates Changelog

1f85cb6b32b8cb66e03914feddfd308641c18776 authored over 12 years ago by Ask Solem <[email protected]>
on_process_started renamed -> on_process_up

57083862a01772023ccb68fe9ceacb394d35ca5f authored over 12 years ago by Ask Solem <[email protected]>
flake8

97b79ede50a6ff2ae76aa15773ffcf529f21cede authored over 12 years ago by Ask Solem <[email protected]>
Pool: Resuts are now read non-blocking if running in eventloop

698bcbeba443bd91555403215d63205edd48b313 authored over 12 years ago by Ask Solem <[email protected]>
Pool.eventmap renamed to Pool.readers and Pool.timers removed

848a9b3235edeefc54c85cfb111fec6080068345 authored over 12 years ago by Ask Solem <[email protected]>
Adds Pool.did_start_ok: For eventloops to verify that the processes did not immediately exit

73db25f2f9d4058230354ef30b6bc672a946ac35 authored over 12 years ago by Ask Solem <[email protected]>
Pool: Process restart rate protection now only counts process with non-successful exitcodes (to work with maxtasksperchild etc)

a738547bbb43f88019aeb0336358f87c97be060e authored over 12 years ago by Ask Solem <[email protected]>
Merge branch 'master' into override_semaphore

Conflicts:
billiard/pool.py

2c1e247ac98a6d49586127ea745e1bf4071d8fd4 authored over 12 years ago by Ask Solem <[email protected]>
Can now disable task_handler and supervisor threads

By setting with_task_thread=False, or with_supervisor_thread=False.

If supervisor is disabled t...

33aac27c20e6aef666db73dbb4c87e31a12f544e authored over 12 years ago by Ask Solem <[email protected]>
Pool: start_result_thread argument renamed to with_result_thread

b633a8c54a2f81e1a84cc4c05f62145276dc30f2 authored over 12 years ago by Ask Solem <[email protected]>
Allow specifying custom semaphore

c7acda183aa3a125ab1dfc3bd374e119e38261e2 authored over 12 years ago by Ask Solem <[email protected]>
on_readable renamed to handle_event(fileno, event)

87f5817f5444d163faf09d966d94abb4c80e87f3 authored over 12 years ago by Ask Solem <[email protected]>
Pool: Adds option to not start result handler thread, and the possibility to drain results using epoll/kqueue/select

7adfb4264b75f6f63ad41581e9c043de3e66713d authored over 12 years ago by Ask Solem <[email protected]>
PEP8ify

d658f73559c1d3395491ec9cf95736606e3f7e7f authored over 12 years ago by Ask Solem <[email protected]>
Fixes typo

b8d299bc6e903479ffda76e145b1ab3bd13b8496 authored over 12 years ago by Ask Solem <[email protected]>
WorkerLostError now includes the exitcode

8a14e908369358a4e42805a4be1eaae933bb14d2 authored over 12 years ago by Ask Solem <[email protected]>
Max restart freq is now 100 * processes per second, and takes low values of maxtasksperchild into account.

b71db8d411df8e3c8f3aa59ac1e4e589953c8a96 authored over 12 years ago by Ask Solem <[email protected]>
Pool: New options max_restart + max_restart_freq

This means that the supervisor can't restart processes
faster than max_restart' times per max_re...

f46165094e249c94d4563aba7c629c3236dcea47 authored over 12 years ago by Ask Solem <[email protected]>
Fixes rst in CHANGES.txt

73b63782041bff0fdcf9b7a2579e2312bb0a4607 authored over 12 years ago by Ask Solem <[email protected]>
Bumps version to 2.7.3.5 and updates Changelog

582af9d9e32538516d7b3a183c0bce4d6150c384 authored over 12 years ago by Ask Solem <[email protected]>
Clean up after exc_info()

b5ddf3e301c19d84cd024c5976af886923dcec09 authored over 12 years ago by Ask Solem <[email protected]>
Fixes typo

d5f7bfbbd32019848b0f21add1b7d423ac6ae31a authored over 12 years ago by Ask Solem <[email protected]>
forking can now be disabled using MULTIPROCESSING_FORKING_DISABLE envvar

847eb78f67d8852a73b6654be69f960007541faf authored over 12 years ago by Ask Solem <[email protected]>
sem_cleanup process now sets proctitle if setproctitle module installed

681acb7851dd33090cea5a1b1aa584dd1329a4b2 authored over 12 years ago by Ask Solem <[email protected]>
Now sets FORKED_BY_MULTIPROCESSING envvar if execv used

544b39b89a53439b7c956ed23f09d5657baaa035 authored over 12 years ago by Ask Solem <[email protected]>
Bumps version to 2.7.3.4 and updates Changelog

626ed2a11f8ca157264fb0c97bac22e4be949a2c authored over 12 years ago by Ask Solem <[email protected]>
Adds billiard.ensure_multiprocessing

f21df3761d5abde4398e48060e4f56af4f35f1cd authored over 12 years ago by Ask Solem <[email protected]>
Stupid test

49d1344e24a82490a93b17127211075091994548 authored over 12 years ago by Ask Solem <[email protected]>
Bumps version to 2.7.3.3 and updates Changelog

96b18cfc1aae07ff36c92186adaab727a44305e9 authored over 12 years ago by Ask Solem <[email protected]>
flakeplus

477278a4331fd5b2ab7f1cbb256688e02fedcf5f authored over 12 years ago by Ask Solem <[email protected]>
Now works on PyPy (but without execv)

00b8fa8fde27ad3f6000c18d236138ddbd9d5dc9 authored over 12 years ago by Ask Solem <[email protected]>
Adds pavement.py

5bfae2a2b68d7645504555cd1391af0b385d1c06 authored over 12 years ago by Ask Solem <[email protected]>
Merges docs from 3.3

17fc63920733e4d894dc1772becad1189caa1bc8 authored over 12 years ago by Ask Solem <[email protected]>
Test suite, zip_safe=False

6b4e12283752075b723504dd3948cdd17739650a authored over 12 years ago by Ask Solem <[email protected]>
Use more with statements

5ef8eb7094d5386cb1b64733ab179a18a78ad0a1 authored over 12 years ago by Ask Solem <[email protected]>
PEP8ify + pyflakes + use exc_info in logs

5b2241be8e61ce19213a95f19e4509e9655b218d authored over 12 years ago by Ask Solem <[email protected]>
Takes some of the changes from Python 3.3

a44fef8a400c8314d701bfffb6de20f767acb722 authored over 12 years ago by Ask Solem <[email protected]>
Now installs on PyPy/Jython

c023cef9f1029a9505a10a63ba2a2e66024917e4 authored over 12 years ago by Ask Solem <[email protected]>
Bumps version to 2.7.3.1

8f6ff21605370280a551ce70ba297c39f1beba26 authored over 12 years ago by Ask Solem <[email protected]>
Now supports Python 2.5

568b03119ded3692956733faa9ae61d7fa4ed7b3 authored over 12 years ago by Ask Solem <[email protected]>
Removes accidentally added files

f2c262767f71b868570f434a7089d8ce1457d5c7 authored over 12 years ago by Ask Solem <[email protected]>
Typo in init

df68ddfda13a6da6c0f893deb13847e1e749a631 authored over 12 years ago by Ask Solem <[email protected]>
Must incldue .rst

7e9e4e7d46439d8c471833e2e906c0efdfab8576 authored over 12 years ago by Ask Solem <[email protected]>
Fixes typos

020b118b9835d0503b9321aa30851073af6081f8 authored over 12 years ago by Ask Solem <[email protected]>
Distro fixes

68e8ebdc1e6069699eb004816723d4164d290c5a authored over 12 years ago by Ask Solem <[email protected]>
Parse distmeta from module file

9656cdde3911eabd6bab575be9bb4f27f47e8876 authored over 12 years ago by Ask Solem <[email protected]>
Modifies README and CHANGES

1af490c12dde0db2becf2dc5eb0c646e9c099929 authored over 12 years ago by Ask Solem <[email protected]>
Complete fork of multiprocessing 2.7 with no-execv patch and Celery pool

a5846b13412cddbf6b5a131923208acc2cea561a authored over 12 years ago by Ask Solem <[email protected]>
Removes all files for new code

7cea34863ac44885c29b643c07a49f7761615ac7 authored over 12 years ago by Ask Solem <[email protected]>
Use a Semaphore for the putlock

2405f2053f806d18cebdddabd482dd10e397ea17 authored over 14 years ago by Ask Solem <[email protected]>
Remove unused methods

13976d2d1537bf06d8a10035713ea4dffc7a2e32 authored over 14 years ago by Ask Solem <[email protected]>
apply_async: New argument waitforslot, if set to True waits until there are processes able to process the job.

7eb7874982a9599902144e6e3cbe32106b711b05 authored over 14 years ago by Ask Solem <[email protected]>
Revert previous commit, billiard.pool was in a non-working state while debugging.

1eb230a6ff4d8e4566d8e289406e748fbb409d47 authored over 14 years ago by Ask Solem <[email protected]>
find unpickleable: picklefield also deepcopies exceptions, so need to try that as well.

Thanks to jonozzz.

e91cc95893d5fef6788253f10ad691177aae73b6 authored over 14 years ago by Ask Solem <[email protected]>
Pool threads are now classes instead of staticmethods.

92db58db48dec0eb56d804ba19d42f02ab319a03 authored over 14 years ago by Ask Solem <[email protected]>
Moved billiard/_pool -> billiard/pool

9068bba9fe87f40744f5ff99f183ab0007333042 authored over 14 years ago by Ask Solem <[email protected]>
Backported changes to multiprocessing in Python trunk (Revision 78790)

5d33a3af51048ef9fae4d9d55a59ba3b9f5fd31a authored over 14 years ago by Ask Solem <[email protected]>
Fixed typo in copyright. Closes #1. Thanks to fladi

27a7f6358669c2ad48fcb6ee5e16118c7b1cda4a authored over 14 years ago by Ask Solem <[email protected]>
Bumped version to 0.4.0

c2a4d8713cca34b0c41a3069f8bbb6c7204331b9 authored over 14 years ago by Ask Solem <[email protected]>
Bumped version to 0.3.1 and updated Changelog

0598c56586cb8e61f6179fdee4994afba080c551 authored over 14 years ago by Ask Solem <[email protected]>
Fixed broken bool evaluation in supervisor. Thanks to jonozzz

The bug originated from a "a if x else b" vs. "x and a or b" confusion
when porting code to Pyth...

13d1d5e947b4a282f9c775cf26afcb53e0fb6764 authored over 14 years ago by Ask Solem <[email protected]>
Pool() now raises NotImplementedError if soft_timeout set on platform without SIGUSR1

67ba6a255ada2b8f3091a4b798dd70c1b6812bfc authored over 14 years ago by Ask Solem <[email protected]>
Added support for time limits.

* Pool() now supports two additional arguments: timeout and soft_timeout.

When the soft_tim...

ab20249b2dd9af0ba48e83163ff5336188ef4bf1 authored over 14 years ago by Ask Solem <[email protected]>
ApplyResult._set can't delete the result if it's not been accepted.

This also means ApplyResult._ack needs to delete the result if the
job has been marked ready.

e6d70c5e958bfe3f69b95f246d5dc77450b635e7 authored over 14 years ago by Ask Solem <[email protected]>
Move some DynamicPool stuff into ._pool.Pool

cf34b15b94a2d952b99dd6fdf4558fb1e35e678f authored over 14 years ago by Ask Solem <[email protected]>
Bumped version to 0.3.0

048683a9b67ee30d422e6630f162ae203a69572f authored over 14 years ago by Ask Solem <[email protected]>
Added support for accept callbacks!

These callbacks are triggered when the job is accepted.

Usage example::

>>> from billiard....

7281b6b806ca203e56f0e6c4199540adff098243 authored over 14 years ago by Ask Solem <[email protected]>
Bumped version to 0.2.3 and updated the Changelog

d820a1d12e6073a493410bcf0c56873516037dc5 authored almost 15 years ago by Ask Solem <[email protected]>
Forgot to import types

6335c1e31257cf0c2d08018fb50cf37237702e57 authored almost 15 years ago by Ask Solem <[email protected]>
Exception is an old-style class in Python 2.4

e60aa2796dcf5f54f5092ae4aae184bdfbd71ff3 authored almost 15 years ago by Ask Solem <[email protected]>