| commit | a552f9c2ce92ff8f7456cb97253683b95b1df035 | [log] [tgz] |
|---|---|---|
| author | Han-Wen Nienhuys <hanwen@google.com> | Mon Jul 11 18:15:58 2016 +0200 |
| committer | Han-Wen Nienhuys <hanwen@google.com> | Thu Jul 14 11:51:58 2016 +0200 |
| tree | e19c5d7e65cb8dc26033129c6102a0fd79ff6e6a | |
| parent | 3677ba90e8e39e3d0ea8fe12f363d6ae5e08116c [diff] |
Speed up population further. * Make .slothfs/tree.json and .slothfs/manifest.xml available * Use tree.json and manifest.xml to construct the repo tree using a few bulk-reads, rather than per-file system calls. * Do all the JSON processing in parallel across repos. * Put population code into separate package "populate" * Add an e2e test against a multifs FUSE mount. Timing (AOSP): Before: 15 secs After: 4.3 secs Change-Id: I8964a39568ff9033258e4d64be47922f06897668
This is a FUSE filesystem that provides light-weight, lazily downloaded, read-only checkouts of Git repositories. It is intended for use with Android.
To start the file system:
go install github.com/google/slothfs/cmd/slothfs-multifs mkdir /tmp/mnt slothfs-multifs -gitiles https://android.googlesource.com/ /tmp/mnt &
To create a workspace “ws” corresponding to the latest manifest version
go install github.com/google/slothfs/cmd/slothfs-expand-manifest slothfs-expand-manifest --gitiles https://android.googlesource.com/ \ > /tmp/m.xml && ln -s /tmp/m.xml /tmp/mnt/config/ws
To populate a checkout
go install github.com/google/slothfs/cmd/slothfs-populate mkdir -p checkout/frameworks cd checkout/frameworks git clone https://android.googlesource.com/platform/frameworks/base cd ../ slothfs-populate -ro /tmp/mnt/ws .
The filesystem daemon uses an on-disk cache, which by default is stored under ~/.cache/slothfs
The FUSE file system clones repositories on-demand. You can avoid cloning altogether for repositories you know you don't need. This is configured through a JSON file.
For example, if you work on Android, and build on a Linux machine, you will never need the Darwin related prebuilts. You can avoid a costly clone for those by doing:
{"Repo": ".*darwin.*", "Clone": false}
Similarly, the build system system will read files (typically called ‘*.mk’) across the entire tree. When any .mk file is opened, this should not trigger a clone. This is achieved with the following entry
{"File": ".*mk$", "Clone": false}
Together, the following config.json file is a good start for working on android:
[{"Repo": ".*darwin.*", "Clone": false},
{"File": ".*mk$", "Clone": false}]
A more elaborate configuration file is included as android.json.
This is not an official Google product.