Skip to main content

How To Upload files to AWS S3 bucket using golang


You can use the code below to upload files to aws s3 bucket using go :

"import "github.com/aws/aws-sdk-go/service/s3"

Package s3 provides the client and types for making API requests to Amazon Simple Storage Service.

package main

import (
 "bytes"
 "fmt"
 "github.com/aws/aws-sdk-go/aws"
 "github.com/aws/aws-sdk-go/aws/session"
 "github.com/aws/aws-sdk-go/service/s3"
 "log"
 "net/http"
)

Get Bucket Region:

GetBucketRegion will attempt to get the region for a bucket using a region hint to determine which AWS partition to perform the query on. Use this utility to determine the region a bucket is in.
var S3_REGION, S3_BUCKET string

func LS3BucketInitialization() {
 S3REGION, errRegion := "S3_REGION NAME"
 S3BUCKET, errBucket := "S3_BUCKET NAME"

 if errRegion != nil || errBucket != nil {
  log.Fatal(errRegion, errBucket)
  return
 }

 S3_REGION = S3REGION.Value
 S3_BUCKET = S3BUCKET.Value
}


Upload Managers :

The s3manager package's Uploader provides a concurrent upload of content to S3 by taking advantage of S3's Multipart APIs. The Uploader also supports both io. Reader for streaming uploads, and will also take advantage of io.ReadSeeker for optimizations if the Body satisfies that type. Once the Uploader instance is created you can call Upload concurrently from multiple goroutines safely.

// The session the S3 Uploader will use
func SessionS3BucketInFile(fileName string, fileData string) {

 if S3_REGION == "" || S3_BUCKET == "" {
  fmt.Println("*****S3 Variable is empty!********")
  return
 }

/*
Create a single AWS session (we can re use this if we're uploading many files)
*/
 s, err := session.NewSession(&aws.Config{Region: aws.String(S3_REGION)})
 if err != nil {
  log.Fatal(err)
 }

 // Upload
 err = AddFileToS3(s, fileName, fileData)
 if err != nil {
  log.Fatal(err)
 }

 s.Handlers.Clear()
 return
}

Add File To S3 will upload a single file to S3, it will require a pre-built aws session and will set file info like content type and encryption on the uploaded file.

func AddFileToS3(s *session.Session, fileDir string, fileData string) error {
// Get file size and read the file content into a buffer
 buffer := []byte(fileData)
 size := int64(len(fileData))

/* 
Config settings: this is where you choose the bucket, filename, content-type etc.
of the file you're uploading.
*/
 _, err := s3.New(s).PutObject(&s3.PutObjectInput{
  Bucket:               aws.String(S3_BUCKET),
  Key:                  aws.String(fileDir),
  ACL:                  aws.String("private"),
  Body:                 bytes.NewReader(buffer),
  ContentLength:        aws.Int64(size),
  ContentType:          aws.String(http.DetectContentType(buffer)),
  ContentDisposition:   aws.String("attachment"),
  ServerSideEncryption: aws.String("AES256"),
 })

 fmt.Println("s3bucket error:", err)
 return err
}


Comments

Post a Comment

Popular posts from this blog

Java Currency Formatter Solution

Given a  double-precision  number,  , denoting an amount of money, use the  NumberFormat  class'  getCurrencyInstance  method to convert   into the US, Indian, Chinese, and French currency formats. Then print the formatted values as follows: US: formattedPayment India: formattedPayment China: formattedPayment France: formattedPayment where   is   formatted according to the appropriate  Locale 's currency. Note:  India does not have a built-in Locale, so you must  construct one  where the language is  en  (i.e., English). Input Format A single double-precision number denoting  . Constraints Output Format On the first line, print  US: u  where   is   formatted for US currency.  On the second line, print  India: i  where   is   formatted for Indian currency.  On the third line...

Java Stdin and Stdout II Code

In this challenge, you must read an  integer , a  double , and a  String  from stdin, then print the values according to the instructions in the  Output Format  section below. To make the problem a little easier, a portion of the code is provided for you in the editor. Note:  We recommend completing  Java Stdin and Stdout I  before attempting this challenge. Input Format There are three lines of input: The first line contains an  integer . The second line contains a  double . The third line contains a  String . Output Format There are three lines of output: On the first line, print  String:  followed by the unaltered  String  read from stdin. On the second line, print  Double:  followed by the unaltered  double  read from stdin. On the third line, print  Int:  followed by the unaltered  integer  read from stdin. To make the pr...

Java Date and Time Solution | Returns the day on that date.

The  Calendar class  is an abstract class that provides methods for converting between a specific instant in time and a set of calendar fields such as YEAR, MONTH, DAY_OF_MONTH, HOUR, and so on, and for manipulating the calendar fields, such as getting the date of the next week. You are given a date. To simplify your task, we have provided a portion of the code in the editor. You just need to write the method,  , which returns the  day  on that date. For example, if you are given the date  , the method should return   as the day on that date. Input Format A single line of input containing the space separated month, day and year, respectively, in      format. Constraints Output Format Output the correct day in capital letters. Sample Input 08 05 2015 Sample Output WEDNESDAY Explanation The day on August  th    was  WEDNESDAY . impo...