owned this note
owned this note
Published
Linked with GitHub
# Alternative Filesystem Representations
## Reference Material:
* [OCI V2 Brainstorm](https://hackmd.io/@cyphar/ociv2-brainstorm)
## Background
The current state of image storage in the OCI specification is based on the idea of [layers](https://github.com/opencontainers/image-spec/blob/v1.0.0/layer.md).
Layers are a mechanism to store and distribute the "bits" that make up container images.
They are based on tarballs.
Effectively, the model is to take each layer (tarball), and "apply" it (similar to extraction), with some special rules to handle whiteouts (deleted files and directories).
This design leads us to have a handful of suboptimal experiences.
## Summary of Issues
* Duplication within images
* Duplication within systems running multiple images
* Duplication of data within registries
* Unnecessary information transfer
* Unneeded data
* Data deleted in parent layers
* Unneccessary metadata
* Verifiability of stored image data at rest on runtime system
### Duplication within an image
Layers are typically compressed independently.
This results in an individual layer having good space efficiency, but it means that if similar content exists across two layers in the same image, that data is entirely duplicated.
If a few bytes of a file are modified (for example, a package manager database), it results in a child layer containing that entire file, and that entire file being compressed independently from the parent layer.
### Duplication within systems running multiple images
Many images share the same, or similar files.
For example, two discrete pieces of software from the Node.js® ecosystem that may have hundreds if not thousands of files in common.
This comes about because the installation of the Node.js® packages is typically done where many of the runtime dependencies are bundled together in the resultant artifact (directory) as part of a monolithic build step.
Although a system, or runtime could implement its own post-facto deduplication scheme, the image specification does nothing to help optimize deduplication mechanisms.
### Duplication of data within registries
Duplication of data within registries comes from multiple axises.
It comes from the fact that there is no deduplication of data between layers.
A given package, say, `left-pad`, may be very common, and used across many different layers, but unless it is in its own discrete layer, the layer-level content addressable storage mechanism is not conducive to deduplication.
If `left-pad` was in its own layer, and the location of the installation of `left-pad` was in the same location always, it could be deduplicated by a registry without requiring manipulation of storage at a lower level than a layer, but this is atypical.
Not only is there a problem between different images in different repositories, multiarchitectural images aggregavate the problem.
Although languages that do not compile to specific CPU architectures have made the adoption of new CPU architectures trivial, the layer format does not allow for deduplication of these files without the developer crafting layers specifically to be deduplicated.
### Unnecessary information transfer
There are a few reasons why unnecessary information transfer may occur in the current scheme.
The aformentioned duplication issues not only lead to duplication at rest, but duplication "on the wire" as well. Another problem is around information transfer at container runtime.
A given container may only need to access a subset of the files in its image at runtime.
The current format allows for that, but doesn't allow for fetching files in a runtime defined order.
If files are deleted in a given layer, the parent layer will still contain that data, and even though it wont be presented to the container at runtime, it must still be downloaded.
Sparse files (files with holes) are not recommended by the spec.
### Verifiability of stored image data at rest on runtime system
It is not trivial to go back-and-forth between a runtime-friendly format and the layer format.
This results in a challenge in layer, or image at rest verification.
(TODO: Explain why this is useful)
## Proposal
As a proposal, we should disentangle the storage of file *data* from the filesystem *metadata*.
The metadata should be stored in a canonicalizable, compact format.
A strawman, [OCIX](https://github.com/sargun/ocix) exists.
It is a CBOR-based filesystem metadata format.
[CBOR](https://cbor.io/) is a binary serialization format that lends itself to standardization.
CBOR allows for canonicalization -- in fact, it's in the very standard itself.
CBOR has an associated schema language called [CDDL](https://datatracker.ietf.org/doc/html/rfc8610).
OCIX has a [CDDL schema](https://github.com/sargun/ocix/blob/main/ocix.cddl) for a filesystem layout.
It also contains a tool to convert any other filesystem into a CBOR document.
The idea is that every container image filesystem would have a canonical representation, which can then be hashed, and that canonical representation enables the features above, and allows for extension -- even in place.
A CBOR debug document of an example container filesystem is available at the end of this doc.
The filesystem manifest could be another blob in the registry.
An analysis of container images, and their filesystems shows that a compressed version of the manifest doc would be under 10 MB for ~100 random images chosen from the most popular Docker Hub images.
The idea is that each "regularfile" could be stored as another blob in the registry.
### FAQ
#### Why not ASN.1?
* ASN.1 compilers are difficult to come by for modern languages.
* Canonical BER encoding is not space efficient
#### Why not protobuf?
Protobuf's specification does not support canonicalization.
> By default, repeated invocations of serialization methods on the same protocol buffer message instance may not return the same byte output; i.e. the default serialization is not deterministic.
> Deterministic serialization only guarantees the same byte output for a particular binary. The byte output may change across different versions of the binary.
See: https://developers.google.com/protocol-buffers/docs/encoding#implications
#### Why not JSON with [JCS](https://datatracker.ietf.org/doc/html//rfc8785)?
JSON would work fine for this purpose with JCS, but JCS is a relatively new.
There aren't neccessarily widely available JCS implementations yet.
Also, CBOR's type system is richer and offers extensibility like sets.
JSON lacks formal types for things like dates.
#### Won't this generate a bunch of HTTP requests, and cause crazy latency?
Yes, if each regularfile is stored as an independent blob, it will generate many more requests. There are several mitigations:
* Lazy loading and prioritizing files when they're opened.
* HTTP2 Push
* Streaming deserialization and concurrent fetching
In some situations, this approach is actually much faster than layers because the possibility for concurrent requests.
#### How does this solve dedupe at a level more granular than files?
Efficient file synchronization was somewhat intentionally left out of this document.
There are likely requirements to change both distribution and image spec to make it work (at all).
One such example is BLAKE3 / [Bao](https://github.com/oconnor663/bao) which enables efficient block-level synchronization where blocks are 2048, or some power of two multiple of 2048.
The Bao scheme only allows for deduplication on block-aligned changes.
The reflink feature in Linux works well in conjunction with the Bao scheme.
#### Why not estargz?
Estargz is wonderful, but it doesn't separate metadata from data.
The estargz format contains a "TOC" which is roughly equivalent the the OCI filesystem manifest.
We can very well take the estargz format and formalize it as a JSON-schema or CDDL (for CBOR) and achieve the same thing.
We would want to remove the `chunk` type, chunkOffset, chunkDigest, and chunkSize, size properties.
Chunking of the actual files should be separated from the manifest as different setups may require different chunk sizes, or no chunking at all.
#### What about compression?
That should probably be handled in the distribution-spec.
In HTTP, IANA specifies compression as a content-encoding.
This allows for independent evolution of the filesystem (specification) and compression algorithms.
#### Why isn't there a PoC?
Right now, the runtime side PoC kind of works.
The purpose of this document and exercise is to start a discussion, and if people believe that this is the right direction, the next step would be to release a PoC of a mountable (FUSE) version, as well as a "store".
One of the benefits of this mechanism is that it doesn't actually require FUSE.
For example, you could have the canonical versions of the files under something like:
```
blobs/blake3:cd2e56d2ec0a22926c31548b67882b24ec66222fb78d5372e15b16e4a8d2153d
blobs/blake3:3c49b3c3cdbdc6f72f96bc5c7766ce803ac9bc3f29a6d8f689292ca92f9e3cc5
blobs/blake3:48e8c8dc82ec84ff1e0dec4878c807fd5fd252be841f6897f92047bc04a97a39
blobs/blake3:52d720ab15a5d780a94ea70bd9b9d96441ed2375c5bb31f80b6150d47ba1e1aa
blobs/blake3:a95c1d58b0a01e7bc43f9264302531f8f3d0eba0ea00d78d220eafa9a09e7a16
blobs/blake3:4dfbd3181edcdb0e6f637bc5c5dcafa26d2f7900c28a95db05b9316806c68e79
```
Launching an image would be simply:
```
mkdir -p rootfs/bin
mkdir -p rootfs/etc
alias cp="cp --reflink=always"
cp blobs/blake3:cd2e56d2ec0a22926c31548b67882b24ec66222fb78d5372e15b16e4a8d2153d rootfs/bin/[
cp blobs/blake3:3c49b3c3cdbdc6f72f96bc5c7766ce803ac9bc3f29a6d8f689292ca92f9e3cc5 rootfs/etc/group
cp blobs/blake3:48e8c8dc82ec84ff1e0dec4878c807fd5fd252be841f6897f92047bc04a97a39 rootfs/etc/passwd
cp blobs/blake3:52d720ab15a5d780a94ea70bd9b9d96441ed2375c5bb31f80b6150d47ba1e1aa rootfs/etc/shadow
cp blobs/blake3:a95c1d58b0a01e7bc43f9264302531f8f3d0eba0ea00d78d220eafa9a09e7a16 rootfs/bin/getconf
cp blobs/blake3:4dfbd3181edcdb0e6f637bc5c5dcafa26d2f7900c28a95db05b9316806c68e79 rootfs/etc/localtime
# ... Do whatever is needed to finish populating symlinks, etc..
```
This relies on a Linux feature called [reflinks](https://blogs.oracle.com/linux/post/xfs-data-block-sharing-reflink) that allow for files to have metadata only copies, and copy-on-write for data.
# Example Doc:
```json=
6(1868786040_2({
"files": {
"/": {
"gid": 0,
"uid": 0,
"mode": [
[false, false, false],
[false, false, false],
[false, false, false],
false,
false,
false,
],
"type": "directory",
"directory": [],
},
"/bin": {
"mode": [
[true, true, true],
[true, false, true],
[true, false, true],
false,
false,
false,
],
"type": "directory",
"mtime": "2021-09-13T10:21:01-07:00",
"directory": [],
},
"/dev": {
"mode": [
[true, true, true],
[true, false, true],
[true, false, true],
false,
false,
false,
],
"type": "directory",
"mtime": "2021-09-13T10:21:11-07:00",
"directory": [],
},
"/etc": {
"mode": [
[true, true, true],
[true, false, true],
[true, false, true],
false,
false,
false,
],
"type": "directory",
"mtime": "2021-09-13T10:21:39-07:00",
"directory": [],
},
"/tmp": {
"mode": [
[true, true, true],
[true, true, true],
[true, true, true],
false,
false,
false,
],
"type": "directory",
"mtime": "2021-09-13T10:21:11-07:00",
"directory": [],
},
"/usr": {
"mode": [
[true, true, true],
[true, false, true],
[true, false, true],
false,
false,
false,
],
"type": "directory",
"mtime": "2021-09-13T10:21:20-07:00",
"directory": [],
},
"/var": {
"mode": [
[true, true, true],
[true, false, true],
[true, false, true],
false,
false,
false,
],
"type": "directory",
"mtime": "2021-09-13T10:21:20-07:00",
"directory": [],
},
"/home": {
"gid": 65534_1,
"uid": 65534_1,
"mode": [
[true, true, true],
[true, false, true],
[true, false, true],
false,
false,
false,
],
"type": "directory",
"mtime": "2021-09-13T10:21:20-07:00",
"directory": [],
},
"/root": {
"mode": [
[true, true, true],
[false, false, true],
[false, false, false],
false,
false,
false,
],
"type": "directory",
"mtime": "2021-09-13T10:21:11-07:00",
"directory": [],
},
"/bin/[": {
"mode": [
[true, true, true],
[true, false, true],
[true, false, true],
false,
false,
false,
],
"type": "regularfile",
"mtime": "2021-09-13T10:21:01-07:00",
"regularfile": [
1149272_2,
h'cd2e56d2ec0a22926c31548b67882b24ec66222fb78d5372e15b16e4a8d2153d',
],
},
"/bin/w": {"link": ["/bin/["], "type": "link"},
"/bin/[[": {"link": ["/bin/["], "type": "link"},
"/bin/ar": {"link": ["/bin/["], "type": "link"},
"/bin/bc": {"link": ["/bin/["], "type": "link"},
"/bin/cp": {"link": ["/bin/["], "type": "link"},
"/bin/dc": {"link": ["/bin/["], "type": "link"},
"/bin/dd": {"link": ["/bin/["], "type": "link"},
"/bin/df": {"link": ["/bin/["], "type": "link"},
"/bin/du": {"link": ["/bin/["], "type": "link"},
"/bin/ed": {"link": ["/bin/["], "type": "link"},
"/bin/hd": {"link": ["/bin/["], "type": "link"},
"/bin/id": {"link": ["/bin/["], "type": "link"},
"/bin/ip": {"link": ["/bin/["], "type": "link"},
"/bin/ln": {"link": ["/bin/["], "type": "link"},
"/bin/ls": {"link": ["/bin/["], "type": "link"},
"/bin/mt": {"link": ["/bin/["], "type": "link"},
"/bin/mv": {"link": ["/bin/["], "type": "link"},
"/bin/nc": {"link": ["/bin/["], "type": "link"},
"/bin/nl": {"link": ["/bin/["], "type": "link"},
"/bin/od": {"link": ["/bin/["], "type": "link"},
"/bin/ps": {"link": ["/bin/["], "type": "link"},
"/bin/rm": {"link": ["/bin/["], "type": "link"},
"/bin/rx": {"link": ["/bin/["], "type": "link"},
"/bin/sh": {"link": ["/bin/["], "type": "link"},
"/bin/su": {"link": ["/bin/["], "type": "link"},
"/bin/sv": {"link": ["/bin/["], "type": "link"},
"/bin/tc": {"link": ["/bin/["], "type": "link"},
"/bin/tr": {"link": ["/bin/["], "type": "link"},
"/bin/ts": {"link": ["/bin/["], "type": "link"},
"/bin/vi": {"link": ["/bin/["], "type": "link"},
"/bin/wc": {"link": ["/bin/["], "type": "link"},
"/bin/xz": {"link": ["/bin/["], "type": "link"},
"/bin/arp": {"link": ["/bin/["], "type": "link"},
"/bin/ash": {"link": ["/bin/["], "type": "link"},
"/bin/awk": {"link": ["/bin/["], "type": "link"},
"/bin/cal": {"link": ["/bin/["], "type": "link"},
"/bin/cat": {"link": ["/bin/["], "type": "link"},
"/bin/cmp": {"link": ["/bin/["], "type": "link"},
"/bin/cut": {"link": ["/bin/["], "type": "link"},
"/bin/env": {"link": ["/bin/["], "type": "link"},
"/bin/lpd": {"link": ["/bin/["], "type": "link"},
"/bin/lpq": {"link": ["/bin/["], "type": "link"},
"/bin/lpr": {"link": ["/bin/["], "type": "link"},
"/bin/man": {"link": ["/bin/["], "type": "link"},
"/bin/mim": {"link": ["/bin/["], "type": "link"},
"/bin/pwd": {"link": ["/bin/["], "type": "link"},
"/bin/rev": {"link": ["/bin/["], "type": "link"},
"/bin/rpm": {"link": ["/bin/["], "type": "link"},
"/bin/sed": {"link": ["/bin/["], "type": "link"},
"/bin/seq": {"link": ["/bin/["], "type": "link"},
"/bin/sum": {"link": ["/bin/["], "type": "link"},
"/bin/svc": {"link": ["/bin/["], "type": "link"},
"/bin/tac": {"link": ["/bin/["], "type": "link"},
"/bin/tar": {"link": ["/bin/["], "type": "link"},
"/bin/tee": {"link": ["/bin/["], "type": "link"},
"/bin/top": {"link": ["/bin/["], "type": "link"},
"/bin/tty": {"link": ["/bin/["], "type": "link"},
"/bin/who": {"link": ["/bin/["], "type": "link"},
"/bin/xxd": {"link": ["/bin/["], "type": "link"},
"/bin/yes": {"link": ["/bin/["], "type": "link"},
"/var/www": {
"mode": [
[true, true, true],
[true, false, true],
[true, false, true],
false,
false,
false,
],
"type": "directory",
"mtime": "2021-09-13T10:21:11-07:00",
"directory": [],
},
"/bin/arch": {"link": ["/bin/["], "type": "link"},
"/bin/beep": {"link": ["/bin/["], "type": "link"},
"/bin/chat": {"link": ["/bin/["], "type": "link"},
"/bin/chrt": {"link": ["/bin/["], "type": "link"},
"/bin/chvt": {"link": ["/bin/["], "type": "link"},
"/bin/comm": {"link": ["/bin/["], "type": "link"},
"/bin/cpio": {"link": ["/bin/["], "type": "link"},
"/bin/date": {"link": ["/bin/["], "type": "link"},
"/bin/diff": {"link": ["/bin/["], "type": "link"},
"/bin/dnsd": {"link": ["/bin/["], "type": "link"},
"/bin/dpkg": {"link": ["/bin/["], "type": "link"},
"/bin/echo": {"link": ["/bin/["], "type": "link"},
"/bin/expr": {"link": ["/bin/["], "type": "link"},
"/bin/find": {"link": ["/bin/["], "type": "link"},
"/bin/fold": {"link": ["/bin/["], "type": "link"},
"/bin/free": {"link": ["/bin/["], "type": "link"},
"/bin/fsck": {"link": ["/bin/["], "type": "link"},
"/bin/ftpd": {"link": ["/bin/["], "type": "link"},
"/bin/grep": {"link": ["/bin/["], "type": "link"},
"/bin/gzip": {"link": ["/bin/["], "type": "link"},
"/bin/halt": {"link": ["/bin/["], "type": "link"},
"/bin/head": {"link": ["/bin/["], "type": "link"},
"/bin/hush": {"link": ["/bin/["], "type": "link"},
"/bin/ifup": {"link": ["/bin/["], "type": "link"},
"/bin/init": {"link": ["/bin/["], "type": "link"},
"/bin/ipcs": {"link": ["/bin/["], "type": "link"},
"/bin/kill": {"link": ["/bin/["], "type": "link"},
"/bin/last": {"link": ["/bin/["], "type": "link"},
"/bin/less": {"link": ["/bin/["], "type": "link"},
"/bin/link": {"link": ["/bin/["], "type": "link"},
"/bin/lsof": {"link": ["/bin/["], "type": "link"},
"/bin/lzma": {"link": ["/bin/["], "type": "link"},
"/bin/lzop": {"link": ["/bin/["], "type": "link"},
"/bin/mdev": {"link": ["/bin/["], "type": "link"},
"/bin/mesg": {"link": ["/bin/["], "type": "link"},
"/bin/more": {"link": ["/bin/["], "type": "link"},
"/bin/nice": {"link": ["/bin/["], "type": "link"},
"/bin/ntpd": {"link": ["/bin/["], "type": "link"},
"/bin/nuke": {"link": ["/bin/["], "type": "link"},
"/bin/ping": {"link": ["/bin/["], "type": "link"},
"/bin/pmap": {"link": ["/bin/["], "type": "link"},
"/bin/pwdx": {"link": ["/bin/["], "type": "link"},
"/bin/rdev": {"link": ["/bin/["], "type": "link"},
"/bin/shuf": {"link": ["/bin/["], "type": "link"},
"/bin/sort": {"link": ["/bin/["], "type": "link"},
"/bin/stat": {"link": ["/bin/["], "type": "link"},
"/bin/stty": {"link": ["/bin/["], "type": "link"},
"/bin/svok": {"link": ["/bin/["], "type": "link"},
"/bin/sync": {"link": ["/bin/["], "type": "link"},
"/bin/tail": {"link": ["/bin/["], "type": "link"},
"/bin/test": {"link": ["/bin/["], "type": "link"},
"/bin/tftp": {"link": ["/bin/["], "type": "link"},
"/bin/time": {"link": ["/bin/["], "type": "link"},
"/bin/true": {"link": ["/bin/["], "type": "link"},
"/bin/uniq": {"link": ["/bin/["], "type": "link"},
"/bin/unxz": {"link": ["/bin/["], "type": "link"},
"/bin/wall": {"link": ["/bin/["], "type": "link"},
"/bin/wget": {"link": ["/bin/["], "type": "link"},
"/bin/zcat": {"link": ["/bin/["], "type": "link"},
"/bin/zcip": {"link": ["/bin/["], "type": "link"},
"/usr/sbin": {
"gid": 1,
"uid": 1,
"mode": [
[true, true, true],
[true, false, true],
[true, false, true],
false,
false,
false,
],
"type": "directory",
"mtime": "2021-09-13T10:21:20-07:00",
"directory": [],
},
"/bin/acpid": {"link": ["/bin/["], "type": "link"},
"/bin/blkid": {"link": ["/bin/["], "type": "link"},
"/bin/brctl": {"link": ["/bin/["], "type": "link"},
"/bin/bzcat": {"link": ["/bin/["], "type": "link"},
"/bin/bzip2": {"link": ["/bin/["], "type": "link"},
"/bin/chgrp": {"link": ["/bin/["], "type": "link"},
"/bin/chmod": {"link": ["/bin/["], "type": "link"},
"/bin/chown": {"link": ["/bin/["], "type": "link"},
"/bin/chpst": {"link": ["/bin/["], "type": "link"},
"/bin/cksum": {"link": ["/bin/["], "type": "link"},
"/bin/clear": {"link": ["/bin/["], "type": "link"},
"/bin/crond": {"link": ["/bin/["], "type": "link"},
"/bin/dmesg": {"link": ["/bin/["], "type": "link"},
"/bin/egrep": {"link": ["/bin/["], "type": "link"},
"/bin/eject": {"link": ["/bin/["], "type": "link"},
"/bin/false": {"link": ["/bin/["], "type": "link"},
"/bin/fbset": {"link": ["/bin/["], "type": "link"},
"/bin/fdisk": {"link": ["/bin/["], "type": "link"},
"/bin/fgrep": {"link": ["/bin/["], "type": "link"},
"/bin/flock": {"link": ["/bin/["], "type": "link"},
"/bin/fsync": {"link": ["/bin/["], "type": "link"},
"/bin/fuser": {"link": ["/bin/["], "type": "link"},
"/bin/getty": {"link": ["/bin/["], "type": "link"},
"/bin/httpd": {"link": ["/bin/["], "type": "link"},
"/bin/inetd": {"link": ["/bin/["], "type": "link"},
"/bin/ipcrm": {"link": ["/bin/["], "type": "link"},
"/bin/klogd": {"link": ["/bin/["], "type": "link"},
"/bin/login": {"link": ["/bin/["], "type": "link"},
"/bin/lsmod": {"link": ["/bin/["], "type": "link"},
"/bin/lspci": {"link": ["/bin/["], "type": "link"},
"/bin/lsusb": {"link": ["/bin/["], "type": "link"},
"/bin/lzcat": {"link": ["/bin/["], "type": "link"},
"/bin/mkdir": {"link": ["/bin/["], "type": "link"},
"/bin/mknod": {"link": ["/bin/["], "type": "link"},
"/bin/mount": {"link": ["/bin/["], "type": "link"},
"/bin/nohup": {"link": ["/bin/["], "type": "link"},
"/bin/nproc": {"link": ["/bin/["], "type": "link"},
"/bin/paste": {"link": ["/bin/["], "type": "link"},
"/bin/patch": {"link": ["/bin/["], "type": "link"},
"/bin/pgrep": {"link": ["/bin/["], "type": "link"},
"/bin/pidof": {"link": ["/bin/["], "type": "link"},
"/bin/ping6": {"link": ["/bin/["], "type": "link"},
"/bin/pkill": {"link": ["/bin/["], "type": "link"},
"/bin/pscan": {"link": ["/bin/["], "type": "link"},
"/bin/rdate": {"link": ["/bin/["], "type": "link"},
"/bin/reset": {"link": ["/bin/["], "type": "link"},
"/bin/rmdir": {"link": ["/bin/["], "type": "link"},
"/bin/rmmod": {"link": ["/bin/["], "type": "link"},
"/bin/route": {"link": ["/bin/["], "type": "link"},
"/bin/runsv": {"link": ["/bin/["], "type": "link"},
"/bin/shred": {"link": ["/bin/["], "type": "link"},
"/bin/sleep": {"link": ["/bin/["], "type": "link"},
"/bin/split": {"link": ["/bin/["], "type": "link"},
"/bin/tftpd": {"link": ["/bin/["], "type": "link"},
"/bin/touch": {"link": ["/bin/["], "type": "link"},
"/bin/uname": {"link": ["/bin/["], "type": "link"},
"/bin/unzip": {"link": ["/bin/["], "type": "link"},
"/bin/users": {"link": ["/bin/["], "type": "link"},
"/bin/vlock": {"link": ["/bin/["], "type": "link"},
"/bin/watch": {"link": ["/bin/["], "type": "link"},
"/bin/which": {"link": ["/bin/["], "type": "link"},
"/bin/whois": {"link": ["/bin/["], "type": "link"},
"/bin/xargs": {"link": ["/bin/["], "type": "link"},
"/bin/xzcat": {"link": ["/bin/["], "type": "link"},
"/etc/group": {
"mode": [
[true, true, false],
[true, true, false],
[true, false, false],
false,
false,
false,
],
"type": "regularfile",
"mtime": "2021-09-04T02:53:24-07:00",
"regularfile": [
306_1,
h'3c49b3c3cdbdc6f72f96bc5c7766ce803ac9bc3f29a6d8f689292ca92f9e3cc5',
],
},
"/var/spool": {
"mode": [
[true, true, true],
[true, false, true],
[true, false, true],
false,
false,
false,
],
"type": "directory",
"mtime": "2021-09-13T10:21:20-07:00",
"directory": [],
},
"/bin/arping": {"link": ["/bin/["], "type": "link"},
"/bin/base32": {"link": ["/bin/["], "type": "link"},
"/bin/base64": {"link": ["/bin/["], "type": "link"},
"/bin/chattr": {"link": ["/bin/["], "type": "link"},
"/bin/chroot": {"link": ["/bin/["], "type": "link"},
"/bin/conspy": {"link": ["/bin/["], "type": "link"},
"/bin/depmod": {"link": ["/bin/["], "type": "link"},
"/bin/devmem": {"link": ["/bin/["], "type": "link"},
"/bin/envdir": {"link": ["/bin/["], "type": "link"},
"/bin/expand": {"link": ["/bin/["], "type": "link"},
"/bin/factor": {"link": ["/bin/["], "type": "link"},
"/bin/findfs": {"link": ["/bin/["], "type": "link"},
"/bin/fstrim": {"link": ["/bin/["], "type": "link"},
"/bin/ftpget": {"link": ["/bin/["], "type": "link"},
"/bin/ftpput": {"link": ["/bin/["], "type": "link"},
"/bin/getopt": {"link": ["/bin/["], "type": "link"},
"/bin/groups": {"link": ["/bin/["], "type": "link"},
"/bin/gunzip": {"link": ["/bin/["], "type": "link"},
"/bin/hdparm": {"link": ["/bin/["], "type": "link"},
"/bin/hostid": {"link": ["/bin/["], "type": "link"},
"/bin/i2cget": {"link": ["/bin/["], "type": "link"},
"/bin/i2cset": {"link": ["/bin/["], "type": "link"},
"/bin/ifdown": {"link": ["/bin/["], "type": "link"},
"/bin/insmod": {"link": ["/bin/["], "type": "link"},
"/bin/ionice": {"link": ["/bin/["], "type": "link"},
"/bin/iostat": {"link": ["/bin/["], "type": "link"},
"/bin/ipaddr": {"link": ["/bin/["], "type": "link"},
"/bin/ipcalc": {"link": ["/bin/["], "type": "link"},
"/bin/iplink": {"link": ["/bin/["], "type": "link"},
"/bin/iprule": {"link": ["/bin/["], "type": "link"},
"/bin/logger": {"link": ["/bin/["], "type": "link"},
"/bin/lsattr": {"link": ["/bin/["], "type": "link"},
"/bin/lsscsi": {"link": ["/bin/["], "type": "link"},
"/bin/md5sum": {"link": ["/bin/["], "type": "link"},
"/bin/mke2fs": {"link": ["/bin/["], "type": "link"},
"/bin/mkfifo": {"link": ["/bin/["], "type": "link"},
"/bin/mkswap": {"link": ["/bin/["], "type": "link"},
"/bin/mktemp": {"link": ["/bin/["], "type": "link"},
"/bin/mpstat": {"link": ["/bin/["], "type": "link"},
"/bin/nameif": {"link": ["/bin/["], "type": "link"},
"/bin/nmeter": {"link": ["/bin/["], "type": "link"},
"/bin/openvt": {"link": ["/bin/["], "type": "link"},
"/bin/passwd": {"link": ["/bin/["], "type": "link"},
"/bin/printf": {"link": ["/bin/["], "type": "link"},
"/bin/pstree": {"link": ["/bin/["], "type": "link"},
"/bin/reboot": {"link": ["/bin/["], "type": "link"},
"/bin/renice": {"link": ["/bin/["], "type": "link"},
"/bin/resize": {"link": ["/bin/["], "type": "link"},
"/bin/resume": {"link": ["/bin/["], "type": "link"},
"/bin/script": {"link": ["/bin/["], "type": "link"},
"/bin/setsid": {"link": ["/bin/["], "type": "link"},
"/bin/svlogd": {"link": ["/bin/["], "type": "link"},
"/bin/swapon": {"link": ["/bin/["], "type": "link"},
"/bin/sysctl": {"link": ["/bin/["], "type": "link"},
"/bin/tcpsvd": {"link": ["/bin/["], "type": "link"},
"/bin/telnet": {"link": ["/bin/["], "type": "link"},
"/bin/tunctl": {"link": ["/bin/["], "type": "link"},
"/bin/udhcpc": {"link": ["/bin/["], "type": "link"},
"/bin/udhcpd": {"link": ["/bin/["], "type": "link"},
"/bin/udpsvd": {"link": ["/bin/["], "type": "link"},
"/bin/uevent": {"link": ["/bin/["], "type": "link"},
"/bin/umount": {"link": ["/bin/["], "type": "link"},
"/bin/unlink": {"link": ["/bin/["], "type": "link"},
"/bin/unlzma": {"link": ["/bin/["], "type": "link"},
"/bin/uptime": {"link": ["/bin/["], "type": "link"},
"/bin/usleep": {"link": ["/bin/["], "type": "link"},
"/bin/whoami": {"link": ["/bin/["], "type": "link"},
"/etc/passwd": {
"mode": [
[true, true, false],
[true, false, false],
[true, false, false],
false,
false,
false,
],
"type": "regularfile",
"mtime": "2021-09-04T02:53:24-07:00",
"regularfile": [
340_1,
h'48e8c8dc82ec84ff1e0dec4878c807fd5fd252be841f6897f92047bc04a97a39',
],
},
"/etc/shadow": {
"mode": [
[true, true, false],
[false, false, false],
[false, false, false],
false,
false,
false,
],
"type": "regularfile",
"mtime": "2021-09-13T10:21:11-07:00",
"regularfile": [
136_0,
h'52d720ab15a5d780a94ea70bd9b9d96441ed2375c5bb31f80b6150d47ba1e1aa',
],
},
"/bin/adduser": {"link": ["/bin/["], "type": "link"},
"/bin/bunzip2": {"link": ["/bin/["], "type": "link"},
"/bin/busybox": {"link": ["/bin/["], "type": "link"},
"/bin/crontab": {"link": ["/bin/["], "type": "link"},
"/bin/cryptpw": {"link": ["/bin/["], "type": "link"},
"/bin/deluser": {"link": ["/bin/["], "type": "link"},
"/bin/dirname": {"link": ["/bin/["], "type": "link"},
"/bin/fatattr": {"link": ["/bin/["], "type": "link"},
"/bin/fdflush": {"link": ["/bin/["], "type": "link"},
"/bin/getconf": {
"mode": [
[true, true, true],
[true, false, true],
[true, false, true],
false,
false,
false,
],
"type": "regularfile",
"mtime": "2021-09-13T10:13:00-07:00",
"regularfile": [
85552_2,
h'a95c1d58b0a01e7bc43f9264302531f8f3d0eba0ea00d78d220eafa9a09e7a16',
],
},
"/bin/hexdump": {"link": ["/bin/["], "type": "link"},
"/bin/hexedit": {"link": ["/bin/["], "type": "link"},
"/bin/hwclock": {"link": ["/bin/["], "type": "link"},
"/bin/i2cdump": {"link": ["/bin/["], "type": "link"},
"/bin/ifplugd": {"link": ["/bin/["], "type": "link"},
"/bin/install": {"link": ["/bin/["], "type": "link"},
"/bin/ipneigh": {"link": ["/bin/["], "type": "link"},
"/bin/iproute": {"link": ["/bin/["], "type": "link"},
"/bin/killall": {"link": ["/bin/["], "type": "link"},
"/bin/linux32": {"link": ["/bin/["], "type": "link"},
"/bin/linux64": {"link": ["/bin/["], "type": "link"},
"/bin/linuxrc": {"link": ["/bin/["], "type": "link"},
"/bin/logname": {"link": ["/bin/["], "type": "link"},
"/bin/logread": {"link": ["/bin/["], "type": "link"},
"/bin/losetup": {"link": ["/bin/["], "type": "link"},
"/bin/mkdosfs": {"link": ["/bin/["], "type": "link"},
"/bin/modinfo": {"link": ["/bin/["], "type": "link"},
"/bin/netstat": {"link": ["/bin/["], "type": "link"},
"/bin/nologin": {"link": ["/bin/["], "type": "link"},
"/bin/nsenter": {"link": ["/bin/["], "type": "link"},
"/bin/rtcwake": {"link": ["/bin/["], "type": "link"},
"/bin/setarch": {"link": ["/bin/["], "type": "link"},
"/bin/setfont": {"link": ["/bin/["], "type": "link"},
"/bin/setpriv": {"link": ["/bin/["], "type": "link"},
"/bin/sha1sum": {"link": ["/bin/["], "type": "link"},
"/bin/sha3sum": {"link": ["/bin/["], "type": "link"},
"/bin/showkey": {"link": ["/bin/["], "type": "link"},
"/bin/smemcap": {"link": ["/bin/["], "type": "link"},
"/bin/strings": {"link": ["/bin/["], "type": "link"},
"/bin/sulogin": {"link": ["/bin/["], "type": "link"},
"/bin/swapoff": {"link": ["/bin/["], "type": "link"},
"/bin/syslogd": {"link": ["/bin/["], "type": "link"},
"/bin/taskset": {"link": ["/bin/["], "type": "link"},
"/bin/telnetd": {"link": ["/bin/["], "type": "link"},
"/bin/timeout": {"link": ["/bin/["], "type": "link"},
"/bin/ttysize": {"link": ["/bin/["], "type": "link"},
"/bin/udhcpc6": {"link": ["/bin/["], "type": "link"},
"/bin/unshare": {"link": ["/bin/["], "type": "link"},
"/bin/vconfig": {"link": ["/bin/["], "type": "link"},
"/bin/volname": {"link": ["/bin/["], "type": "link"},
"/etc/network": {
"mode": [
[true, true, true],
[true, false, true],
[true, false, true],
false,
false,
false,
],
"type": "directory",
"mtime": "2021-09-13T10:21:11-07:00",
"directory": [],
},
"/bin/addgroup": {"link": ["/bin/["], "type": "link"},
"/bin/adjtimex": {"link": ["/bin/["], "type": "link"},
"/bin/basename": {"link": ["/bin/["], "type": "link"},
"/bin/blockdev": {"link": ["/bin/["], "type": "link"},
"/bin/chpasswd": {"link": ["/bin/["], "type": "link"},
"/bin/cttyhack": {"link": ["/bin/["], "type": "link"},
"/bin/delgroup": {"link": ["/bin/["], "type": "link"},
"/bin/dos2unix": {"link": ["/bin/["], "type": "link"},
"/bin/dpkg-deb": {"link": ["/bin/["], "type": "link"},
"/bin/dumpkmap": {"link": ["/bin/["], "type": "link"},
"/bin/fbsplash": {"link": ["/bin/["], "type": "link"},
"/bin/fdformat": {"link": ["/bin/["], "type": "link"},
"/bin/fsfreeze": {"link": ["/bin/["], "type": "link"},
"/bin/hostname": {"link": ["/bin/["], "type": "link"},
"/bin/ifconfig": {"link": ["/bin/["], "type": "link"},
"/bin/iptunnel": {"link": ["/bin/["], "type": "link"},
"/bin/kbd_mode": {"link": ["/bin/["], "type": "link"},
"/bin/killall5": {"link": ["/bin/["], "type": "link"},
"/bin/loadfont": {"link": ["/bin/["], "type": "link"},
"/bin/loadkmap": {"link": ["/bin/["], "type": "link"},
"/bin/makedevs": {"link": ["/bin/["], "type": "link"},
"/bin/makemime": {"link": ["/bin/["], "type": "link"},
"/bin/microcom": {"link": ["/bin/["], "type": "link"},
"/bin/mkpasswd": {"link": ["/bin/["], "type": "link"},
"/bin/modprobe": {"link": ["/bin/["], "type": "link"},
"/bin/nanddump": {"link": ["/bin/["], "type": "link"},
"/bin/nslookup": {"link": ["/bin/["], "type": "link"},
"/bin/poweroff": {"link": ["/bin/["], "type": "link"},
"/bin/powertop": {"link": ["/bin/["], "type": "link"},
"/bin/printenv": {"link": ["/bin/["], "type": "link"},
"/bin/readlink": {"link": ["/bin/["], "type": "link"},
"/bin/realpath": {"link": ["/bin/["], "type": "link"},
"/bin/rpm2cpio": {"link": ["/bin/["], "type": "link"},
"/bin/run-init": {"link": ["/bin/["], "type": "link"},
"/bin/runlevel": {"link": ["/bin/["], "type": "link"},
"/bin/runsvdir": {"link": ["/bin/["], "type": "link"},
"/bin/sendmail": {"link": ["/bin/["], "type": "link"},
"/bin/setfattr": {"link": ["/bin/["], "type": "link"},
"/bin/slattach": {"link": ["/bin/["], "type": "link"},
"/bin/truncate": {"link": ["/bin/["], "type": "link"},
"/bin/ubimkvol": {"link": ["/bin/["], "type": "link"},
"/bin/ubirmvol": {"link": ["/bin/["], "type": "link"},
"/bin/ubirsvol": {"link": ["/bin/["], "type": "link"},
"/bin/unexpand": {"link": ["/bin/["], "type": "link"},
"/bin/unix2dos": {"link": ["/bin/["], "type": "link"},
"/bin/uudecode": {"link": ["/bin/["], "type": "link"},
"/bin/uuencode": {"link": ["/bin/["], "type": "link"},
"/bin/watchdog": {"link": ["/bin/["], "type": "link"},
"/bin/add-shell": {"link": ["/bin/["], "type": "link"},
"/bin/deallocvt": {"link": ["/bin/["], "type": "link"},
"/bin/dhcprelay": {"link": ["/bin/["], "type": "link"},
"/bin/envuidgid": {"link": ["/bin/["], "type": "link"},
"/bin/fallocate": {"link": ["/bin/["], "type": "link"},
"/bin/fgconsole": {"link": ["/bin/["], "type": "link"},
"/bin/i2cdetect": {"link": ["/bin/["], "type": "link"},
"/bin/ifenslave": {"link": ["/bin/["], "type": "link"},
"/bin/mkfs.ext2": {"link": ["/bin/["], "type": "link"},
"/bin/mkfs.vfat": {"link": ["/bin/["], "type": "link"},
"/bin/nandwrite": {"link": ["/bin/["], "type": "link"},
"/bin/partprobe": {"link": ["/bin/["], "type": "link"},
"/bin/readahead": {"link": ["/bin/["], "type": "link"},
"/bin/reformime": {"link": ["/bin/["], "type": "link"},
"/bin/run-parts": {"link": ["/bin/["], "type": "link"},
"/bin/setserial": {"link": ["/bin/["], "type": "link"},
"/bin/setuidgid": {"link": ["/bin/["], "type": "link"},
"/bin/sha256sum": {"link": ["/bin/["], "type": "link"},
"/bin/sha512sum": {"link": ["/bin/["], "type": "link"},
"/bin/softlimit": {"link": ["/bin/["], "type": "link"},
"/bin/ubiattach": {"link": ["/bin/["], "type": "link"},
"/bin/ubidetach": {"link": ["/bin/["], "type": "link"},
"/bin/ubirename": {"link": ["/bin/["], "type": "link"},
"/etc/localtime": {
"mode": [
[true, true, false],
[true, false, false],
[true, false, false],
false,
false,
false,
],
"type": "regularfile",
"mtime": "2021-01-24T14:05:23-08:00",
"regularfile": [
118_0,
h'4dfbd3181edcdb0e6f637bc5c5dcafa26d2f7900c28a95db05b9316806c68e79',
],
},
"/bin/blkdiscard": {"link": ["/bin/["], "type": "link"},
"/bin/bootchartd": {"link": ["/bin/["], "type": "link"},
"/bin/dumpleases": {"link": ["/bin/["], "type": "link"},
"/bin/ether-wake": {"link": ["/bin/["], "type": "link"},
"/bin/fakeidentd": {"link": ["/bin/["], "type": "link"},
"/bin/fsck.minix": {"link": ["/bin/["], "type": "link"},
"/bin/mkfs.minix": {"link": ["/bin/["], "type": "link"},
"/bin/mountpoint": {"link": ["/bin/["], "type": "link"},
"/bin/nbd-client": {"link": ["/bin/["], "type": "link"},
"/bin/pivot_root": {"link": ["/bin/["], "type": "link"},
"/bin/popmaildir": {"link": ["/bin/["], "type": "link"},
"/bin/setconsole": {"link": ["/bin/["], "type": "link"},
"/bin/setlogcons": {"link": ["/bin/["], "type": "link"},
"/bin/ssl_client": {"link": ["/bin/["], "type": "link"},
"/bin/traceroute": {"link": ["/bin/["], "type": "link"},
"/var/spool/mail": {
"gid": 8,
"uid": 8,
"mode": [
[true, true, true],
[true, false, true],
[true, false, true],
false,
false,
false,
],
"type": "directory",
"mtime": "2021-09-13T10:21:20-07:00",
"directory": [],
},
"/bin/freeramdisk": {"link": ["/bin/["], "type": "link"},
"/bin/i2ctransfer": {"link": ["/bin/["], "type": "link"},
"/bin/raidautorun": {"link": ["/bin/["], "type": "link"},
"/bin/readprofile": {"link": ["/bin/["], "type": "link"},
"/bin/setkeycodes": {"link": ["/bin/["], "type": "link"},
"/bin/switch_root": {"link": ["/bin/["], "type": "link"},
"/bin/traceroute6": {"link": ["/bin/["], "type": "link"},
"/bin/remove-shell": {"link": ["/bin/["], "type": "link"},
"/bin/scriptreplay": {"link": ["/bin/["], "type": "link"},
"/bin/ubiupdatevol": {"link": ["/bin/["], "type": "link"},
"/bin/dnsdomainname": {"link": ["/bin/["], "type": "link"},
"/bin/pipe_progress": {"link": ["/bin/["], "type": "link"},
"/etc/network/if-up.d": {
"mode": [
[true, true, true],
[true, false, true],
[true, false, true],
false,
false,
false,
],
"type": "directory",
"mtime": "2021-09-13T10:21:11-07:00",
"directory": [],
},
"/bin/start-stop-daemon": {"link": ["/bin/["], "type": "link"},
"/etc/network/if-down.d": {
"mode": [
[true, true, true],
[true, false, true],
[true, false, true],
false,
false,
false,
],
"type": "directory",
"mtime": "2021-09-13T10:21:11-07:00",
"directory": [],
},
"/etc/network/if-pre-up.d": {
"mode": [
[true, true, true],
[true, false, true],
[true, false, true],
false,
false,
false,
],
"type": "directory",
"mtime": "2021-09-13T10:21:11-07:00",
"directory": [],
},
"/etc/network/if-post-down.d": {
"mode": [
[true, true, true],
[true, false, true],
[true, false, true],
false,
false,
false,
],
"type": "directory",
"mtime": "2021-09-13T10:21:11-07:00",
"directory": [],
},
},
"version": 0,
}))
```
Google Drive
Gist
Clipboard
Sign in with Wallet
