Auto create S3 Buckets on localstack

I was been able to achieve this with Localstack with kind of "workaround":

  1. Start Localstack
  2. Create expected buckets, e.g.:

    aws --endpoint-url=http://localhost:4572 s3 mb s3://test1   
    
  3. Above line will update the s3_api_calls.json file in the Localstack directory (by default on Linux it's /tmp/localstack/data
  4. Backup the file
  5. Put the copied file in the Localstack directory ( /tmp/localstack/data by default) before starting the stack again
  6. You should be able to see something like 2019-03-21T08:38:28:INFO:localstack.utils.persistence: Restored 2 API calls from persistent file: /tmp/localstack/data/s3_api_calls.json the in startup log after you start Localstack again and the bucket should be available: aws --endpoint-url=http://localhost:4572 s3 ls s3://test1

A change that came in with this commit since version 0.10.0.

When a container is started for the first time, it will execute files with extensions .sh that are found in /docker-entrypoint-initaws.d. Files will be executed in alphabetical order. You can easily create aws resources on localstack using awslocal (or aws) cli tool in the initialization scripts.

version: '3.7'
services:
  localstack:
    image: localstack/localstack
    environment:
      - SERVICES=s3
    ports:
      - "4566:4566"
      # - "4572:4572" Old S3 port
    volumes:
      - ./aws:/docker-entrypoint-initaws.d

With a script in directory ./aws/buckets.sh:

#!/usr/bin/env bash
set -x
awslocal s3 mb s3://bucket
set +x

Note: the set [-/+] x is purely there to turn on and off outputting of the commands being executed.

Will produce this output:

...
localstack_1  | Starting mock S3 (http port 4572)...
localstack_1  | Waiting for all LocalStack services to be ready
localstack_1  | Ready.
localstack_1  | /usr/local/bin/docker-entrypoint.sh: running /docker-entrypoint-initaws.d/buckets.sh
localstack_1  | ++ awslocal s3 mb s3://bucket
localstack_1  | make_bucket: bucket
localstack_1  | ++ set +x
localstack_1  |