Upload files to AWS S3

This page explains how to upload files to AWS S3 with FluentCI.

Before you begin

The instructions on this page assume that you are familiar with AWS S3. In addition:

• Have your project ready, including the files you want to upload.
• Have an AWS account.
• Have an AWS S3 Bucket.
• Have an AWS Access Key.
• Have an AWS Secret Key.

Using the S3 Plugin

You can use FluentCI to upload files to AWS S3 using the r2-sync plugin, no need to install AWS CLI on your machine, FluentCI will handle everything for you.

The following command can be used to upload files to AWS S3:

# Make sure to set the AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY environment variables
fluentci run --wasm r2-sync upload --endpoint-url $ENDPOINT_URL s3://$BUCKET_NAME

CI/CD pipeline integrations

The following examples show how to integrate FluentCI with popular CI providers to upload files to AWS S3:

Github Actions

ci.yml

name: ci
on:
  push:
    branches:
      - main
jobs:
  tasks:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v2
      - name: Setup Fluent CI
        uses: fluentci-io/setup-fluentci@v5
      - name: upload
        run: fluentci run --wasm r2-sync upload --endpoint-url $ENDPOINT_URL s3://$BUCKET_NAME
        env:
          AWS_ACCESS_KEY_ID: ${{ secrets.AWS_ACCESS_KEY_ID }}
          AWS_SECRET_ACCESS_KEY: ${{ secrets.AWS_SECRET_ACCESS_KEY }}
          ENDPOINT_URL: ${{ env.ENDPOINT_URL }}
          BUCKET_NAME: ${{ env.BUCKET_NAME }}
        

GitLab CI

.gitlab-ci.yml

.docker:
  image: denoland/deno:debian-1.42.4
  services:
    - docker:${DOCKER_VERSION}-dind
  variables:
    DOCKER_HOST: tcp://docker:2376
    DOCKER_TLS_VERIFY: "1"
    DOCKER_TLS_CERTDIR: /certs
    DOCKER_CERT_PATH: /certs/client
    DOCKER_DRIVER: overlay2
    DOCKER_VERSION: 20.10.16
    GITLAB_ACCESS_TOKEN: $GITLAB_ACCESS_TOKEN
    AWS_ACCESS_KEY_ID: $AWS_ACCESS_KEY_ID
    AWS_SECRET_ACCESS_KEY: $AWS_SECRET_ACCESS_KEY
    ENDPOINT_URL: $ENDPOINT_URL
    BUCKET_NAME: $BUCKET_NAME
.fluentci:
  extends: .docker
  before_script:
    - apt-get update
    - apt-get install -y curl tar gzip ca-certificates openssl git unzip libncursesw6
    - deno install -A -r https://cli.fluentci.io -n fluentci
    - fluentci --version
    - curl -L https://dl.dagger.io/dagger/install.sh | DAGGER_VERSION=0.12.3 sh
    - mv bin/dagger /usr/local/bin
    - dagger version
upload:
  extends: .fluentci
  script:
    - fluentci run --wasm r2-sync upload --endpoint-url $ENDPOINT_URL s3://$BUCKET_NAME

Circle CI

.circleci/config.yml

version: 2.1
jobs:
  job:
    steps:
      - checkout
      - run: |
          sudo apt-get update && sudo apt-get install -y curl unzip
          curl -fsSL https://cli.fluentci.io | bash
          fluentci --version
        name: Setup FluentCI
      - run: fluentci run --wasm r2-sync upload --endpoint-url $ENDPOINT_URL s3://$BUCKET_NAME
        name: upload
    machine:
      image: ubuntu-2004:2023.07.1
workflows:
  fluentci:
    jobs:
      - job
      

Azure Pipelines

azure-pipelines.yml

trigger:
  - main
pool:
  vmImage: ubuntu-latest
steps:
  - script: |
      curl -fsSL https://cli.fluentci.io | bash
      fluentci --version
      echo "##vso[task.prependpath]${HOME}/.deno/bin
    displayName: Setup FluentCI
  - script: fluentci run --wasm r2-sync upload --endpoint-url $ENDPOINT_URL s3://$BUCKET_NAME
    displayName: upload
  

AWS CodePipeline

buildspec.yml

version: 0.2
phases:
  install:
    commands:
      - curl -fsSL https://cli.fluentci.io | bash
      - fluentci --version
  build:
    commands:
      - fluentci run --wasm r2-sync upload --endpoint-url $ENDPOINT_URL s3://$BUCKET_NAME
  post_build:
    commands:
      - echo Build completed on `date`