S3fs GCS Directory Support

Adds directory support to gcs buckets.

Nextjournal uses the s3fs fuse driver to connect to Amazon S3 buckets as well as Google Cloud Storage buckets. It was made for S3 buckets but also works with GCS buckets.

If GCS directories are created in the web frontend, they are not detected correclty as directories from the s3fs fuse driver, because s3fs checks for content size to be 0 or 1, but it's larger than that (e.g. 11)

This modified s3fs fuse version fixes this:

nextjournal/s3fs-fuse

Public

Install build requirements:

apt-get update
apt-get install fuse automake build-essential make libcurl4 libcurl4-openssl-dev libxml2 libxml2-dev mime-support openssl libssl-dev libfuse-dev libtool pkg-config 
apt-get clean

152.4s

Language:Bash

Github repositories are mounted readonly, so copy it to be able to compile it, which produces output:

cp -r /s3fs-fuse /s3fs-fuse-patched

0.2s

Language:Bash

Validate that we have the correct patch:

cd /s3fs-fuse-patched
git checkout gcs-directories
git show

1.2s

Language:Bash

Build the project...

cd /s3fs-fuse-patched
./autogen.sh
./configure
make
sudo make install

34.3s

Language:Bash

... clean up build dependencies

apt-get remove automake build-essential libcurl4-openssl-dev libxml2-dev  libssl-dev libfuse-dev pkg-config

4.2s

Language:Bash

... and check that the built binary works.

s3fs --help

0.8s

Language:Bash

0.1s

Language:Bash