copy-approvals: multi-threaded, slice based

This is similar approach like in the change reindexing. We split the
work into slices of changes and then utilize one thread per slice.

When approvals are copied for all changes in a slice we cannot perform
BatchRefUpdate immediately. This is because multiple threads may try to
perform BatchRefUpdate for different slice of the same project and this
will create contention on the locking of the packed-refs. Therefore, we
only prepare all the objects for the ref-updates and save the (pending)
ReceiveCommands in a Map keyed by project. When all slices are processed
we then create a new BatchRefUpdate, add all pending commands and execute
one update per project.

As a side effect of this implementation, we do not perform indexing of
changes after approvals are copied. The indexing was anyway unnecessary
as copy-approvals only changes how data is stored but doesn't change the
data. By skipping reindexing we can dramatically improve the performance
of the copy-approvals program. On a large Gerrit site with a 1.3
millions of changes, the combination of using thread per slice and
skipping indexing reduced the time for the copy-approvals program from 5
hours down to 15-20 minutes.

Forward-Compatible: checked
Release-Notes: use multiple threads for copy-approvals, improve performance
Change-Id: I493b9d7ee0d25b3ad9b741f5eaf3c6b86172a04c
3 files changed
tree: 81fd6451b84c3f9ff1688a6b153c9aa0f7f676da
  1. .settings/
  2. .ts-out/
  3. antlr3/
  4. contrib/
  5. Documentation/
  6. e2e-tests/
  7. java/
  8. javatests/
  9. lib/
  10. modules/
  11. plugins/
  12. polygerrit-ui/
  13. prolog/
  14. prologtests/
  15. proto/
  16. resources/
  17. tools/
  18. webapp/
  19. .bazelignore
  20. .bazelproject
  21. .bazelrc
  22. .bazelversion
  23. .editorconfig
  24. .git-blame-ignore-revs
  25. .gitignore
  26. .gitmodules
  27. .gitreview
  28. .mailmap
  29. .pydevproject
  30. .zuul.yaml
  31. BUILD
  32. COPYING
  33. INSTALL
  34. Jenkinsfile
  35. package.json
  36. README.md
  37. SUBMITTING_PATCHES
  38. version.bzl
  39. WORKSPACE
  40. yarn.lock
README.md

Gerrit Code Review

Gerrit is a code review and project management tool for Git based projects.

Build Status Maven Central

Objective

Gerrit makes reviews easier by showing changes in a side-by-side display, and allowing inline comments to be added by any reviewer.

Gerrit simplifies Git based project maintainership by permitting any authorized user to submit changes to the master Git repository, rather than requiring all approved changes to be merged in by hand by the project maintainer.

Documentation

For information about how to install and use Gerrit, refer to the documentation.

Source

Our canonical Git repository is located on googlesource.com. There is a mirror of the repository on Github.

Reporting bugs

Please report bugs on the issue tracker.

Contribute

Gerrit is the work of hundreds of contributors. We appreciate your help!

Please read the contribution guidelines.

Note that we do not accept Pull Requests via the Github mirror.

Getting in contact

The Developer Mailing list is repo-discuss on Google Groups.

License

Gerrit is provided under the Apache License 2.0.

Build

Install Bazel and run the following:

    git clone --recurse-submodules https://gerrit.googlesource.com/gerrit
    cd gerrit && bazel build release

Install binary packages (Deb/Rpm)

The instruction how to configure GerritForge/BinTray repositories is here

On Debian/Ubuntu run:

    apt-get update & apt-get install gerrit=<version>-<release>

NOTE: release is a counter that starts with 1 and indicates the number of packages that have been released with the same version of the software.

On CentOS/RedHat run:

    yum clean all && yum install gerrit-<version>[-<release>]

On Fedora run:

    dnf clean all && dnf install gerrit-<version>[-<release>]

Use pre-built Gerrit images on Docker

Docker images of Gerrit are available on DockerHub

To run a CentOS 8 based Gerrit image:

    docker run -p 8080:8080 gerritcodereview/gerrit[:version]-centos8

To run a Ubuntu 20.04 based Gerrit image:

    docker run -p 8080:8080 gerritcodereview/gerrit[:version]-ubuntu20

NOTE: release is optional. Last released package of the version is installed if the release number is omitted.