Skip to main content

How To Upload files to AWS S3 bucket using golang


You can use the code below to upload files to aws s3 bucket using go :

"import "github.com/aws/aws-sdk-go/service/s3"

Package s3 provides the client and types for making API requests to Amazon Simple Storage Service.

package main

import (
 "bytes"
 "fmt"
 "github.com/aws/aws-sdk-go/aws"
 "github.com/aws/aws-sdk-go/aws/session"
 "github.com/aws/aws-sdk-go/service/s3"
 "log"
 "net/http"
)

Get Bucket Region:

GetBucketRegion will attempt to get the region for a bucket using a region hint to determine which AWS partition to perform the query on. Use this utility to determine the region a bucket is in.
var S3_REGION, S3_BUCKET string

func LS3BucketInitialization() {
 S3REGION, errRegion := "S3_REGION NAME"
 S3BUCKET, errBucket := "S3_BUCKET NAME"

 if errRegion != nil || errBucket != nil {
  log.Fatal(errRegion, errBucket)
  return
 }

 S3_REGION = S3REGION.Value
 S3_BUCKET = S3BUCKET.Value
}


Upload Managers :

The s3manager package's Uploader provides a concurrent upload of content to S3 by taking advantage of S3's Multipart APIs. The Uploader also supports both io. Reader for streaming uploads, and will also take advantage of io.ReadSeeker for optimizations if the Body satisfies that type. Once the Uploader instance is created you can call Upload concurrently from multiple goroutines safely.

// The session the S3 Uploader will use
func SessionS3BucketInFile(fileName string, fileData string) {

 if S3_REGION == "" || S3_BUCKET == "" {
  fmt.Println("*****S3 Variable is empty!********")
  return
 }

/*
Create a single AWS session (we can re use this if we're uploading many files)
*/
 s, err := session.NewSession(&aws.Config{Region: aws.String(S3_REGION)})
 if err != nil {
  log.Fatal(err)
 }

 // Upload
 err = AddFileToS3(s, fileName, fileData)
 if err != nil {
  log.Fatal(err)
 }

 s.Handlers.Clear()
 return
}

Add File To S3 will upload a single file to S3, it will require a pre-built aws session and will set file info like content type and encryption on the uploaded file.

func AddFileToS3(s *session.Session, fileDir string, fileData string) error {
// Get file size and read the file content into a buffer
 buffer := []byte(fileData)
 size := int64(len(fileData))

/* 
Config settings: this is where you choose the bucket, filename, content-type etc.
of the file you're uploading.
*/
 _, err := s3.New(s).PutObject(&s3.PutObjectInput{
  Bucket:               aws.String(S3_BUCKET),
  Key:                  aws.String(fileDir),
  ACL:                  aws.String("private"),
  Body:                 bytes.NewReader(buffer),
  ContentLength:        aws.Int64(size),
  ContentType:          aws.String(http.DetectContentType(buffer)),
  ContentDisposition:   aws.String("attachment"),
  ServerSideEncryption: aws.String("AES256"),
 })

 fmt.Println("s3bucket error:", err)
 return err
}


Comments

Post a Comment

Popular posts from this blog

Java Currency Formatter Solution

Given a  double-precision  number,  , denoting an amount of money, use the  NumberFormat  class'  getCurrencyInstance  method to convert   into the US, Indian, Chinese, and French currency formats. Then print the formatted values as follows: US: formattedPayment India: formattedPayment China: formattedPayment France: formattedPayment where   is   formatted according to the appropriate  Locale 's currency. Note:  India does not have a built-in Locale, so you must  construct one  where the language is  en  (i.e., English). Input Format A single double-precision number denoting  . Constraints Output Format On the first line, print  US: u  where   is   formatted for US currency.  On the second line, print  India: i  where   is   formatted for Indian currency.  On the third line...

Java Loops II print each element of our series as a single line of space-separated values.

We use the integers  ,  , and   to create the following series: You are given   queries in the form of  ,  , and  . For each query, print the series corresponding to the given  ,  , and   values as a single line of   space-separated integers. Input Format The first line contains an integer,  , denoting the number of queries.  Each line   of the   subsequent lines contains three space-separated integers describing the respective  ,  , and   values for that query. Constraints Output Format For each query, print the corresponding series on a new line. Each series must be printed in order as a single line of   space-separated integers. Sample Input 2 0 2 10 5 3 5 Sample Output 2 6 14 30 62 126 254 510 1022 2046 8 14 26 50 98 Explanation We have two queries: We use  ...

Java Static Initializer Block

Static initialization blocks are executed when the class is loaded, and you can initialize static variables in those blocks. It's time to test your knowledge of  Static initialization blocks . You can read about it  here. You are given a class  Solution  with a  main  method. Complete the given code so that it outputs the area of a parallelogram with breadth   and height  . You should read the variables from the standard input. If   or    , the output should be  "java.lang.Exception: Breadth and height must be positive"  without quotes. Input Format There are two lines of input. The first line contains  : the breadth of the parallelogram. The next line contains  : the height of the parallelogram. Constraints Output Format If both values are greater than zero, then the  main  method must output the area of the  parallelogram . Otherwise, pri...