Mike Frysinger b2fa30a2b8 sync: switch network fetch to multiprocessing ...

This avoids GIL limitations with using threads for parallel processing.

This reworks the fetch logic to return results for processing in the
main thread instead of leaving every thread to do its own processing.

We have to tweak the chunking logic a little here because multiprocessing
favors batching over returning immediate results when using a larger value
for chunksize.  When a single job can be quite slow, this tradeoff is not
good UX.

Bug: https://crbug.com/gerrit/12389
Change-Id: I0f0512d15ad7332d1eb28aff52c29d378acc9e1d
Reviewed-on: https://gerrit-review.googlesource.com/c/git-repo/+/298642
Reviewed-by: Chris Mcdonald <cjmcdonald@google.com>
Tested-by: Mike Frysinger <vapier@google.com>

2021-04-01 14:52:57 +00:00

..

__init__.py

strip python2-only coding:utf-8 & print_function settings

2021-01-06 18:53:05 +00:00

abandon.py

abandon/start: add --jobs support

2021-02-27 19:45:14 +00:00

branches.py

status: improve parallel execution stability

2021-02-22 22:51:34 +00:00

checkout.py

checkout: add --jobs support

2021-02-27 19:56:24 +00:00

cherry_pick.py

git_command: rework stdin handling

2021-02-17 15:15:16 +00:00

diff.py

diff: add --jobs support

2021-02-23 00:31:27 +00:00

diffmanifests.py

diffmanifests/sync: simplify repodir lookup

2021-02-11 02:38:53 +00:00

download.py

download: handle shared projects a bit better

2021-03-01 15:57:17 +00:00

forall.py

forall: handle missing project refs better

2021-03-25 23:08:51 +00:00

gitc_delete.py

drop pyversion & is_python3 checking

2021-01-06 18:53:58 +00:00

gitc_init.py

use simpler super() magic

2021-02-19 20:06:20 +00:00

grep.py

grep: add --jobs support

2021-04-01 14:43:19 +00:00

help.py

strip python2-only coding:utf-8 & print_function settings

2021-01-06 18:53:05 +00:00

info.py

strip python2-only coding:utf-8 & print_function settings

2021-01-06 18:53:05 +00:00

init.py

superproject: pass groups to ToXml method.

2021-03-11 01:24:52 +00:00

list.py

forall/list: delete spurious "

2021-03-19 21:13:49 +00:00

manifest.py

strip python2-only coding:utf-8 & print_function settings

2021-01-06 18:53:05 +00:00

overview.py

strip python2-only coding:utf-8 & print_function settings

2021-01-06 18:53:05 +00:00

prune.py

prune: add --jobs support

2021-03-31 16:28:24 +00:00

rebase.py

strip python2-only coding:utf-8 & print_function settings

2021-01-06 18:53:05 +00:00

selfupdate.py

strip python2-only coding:utf-8 & print_function settings

2021-01-06 18:53:05 +00:00

smartsync.py

strip python2-only coding:utf-8 & print_function settings

2021-01-06 18:53:05 +00:00

stage.py

strip python2-only coding:utf-8 & print_function settings

2021-01-06 18:53:05 +00:00

start.py

start: add a --HEAD alias

2021-03-24 00:32:04 +00:00

status.py

status: improve parallel execution stability

2021-02-22 22:51:34 +00:00

sync.py

sync: switch network fetch to multiprocessing

2021-04-01 14:52:57 +00:00

upload.py

drop pyversion & is_python3 checking

2021-01-06 18:53:58 +00:00

version.py

version: add remote tracking information

2021-01-08 20:41:27 +00:00