Skip to main content
Buyerquest Community

Amazon_S3_Configuration_1781592

Amazon_S3_Configuration - BuyerQuest Integration Center

Overview

Prior to the release of Chicago, Amazon S3 configurations were decentralized and all features leveraging these configurations had semi customised S3 file paths. With the release of 6.7,  AWS configurations have been centeralized and the S3 file paths of the features mentioned below have been fixed to maintain consistency across all sites and eliminate complexity

 

  1. Attachments
  2. Supplier Attachment Storage
  3. Content Group Logo File
  4. Customer Profile Pictures (Avatars)

  5. Supplier Placeholders
  6. Product Attachments
  7. Homepage Sliders
  8. Email Logo
  9. Catalog Management
  10. Master Data Loader
  11. Product and Supplier Exports
  12. Product Images

 

Global AWS Configuration

A centralized global AWS configuration has been created to provide access keys to all  features levaraging the S3 file structure. The keys and buckets are managed in the Admin Control Panel under Settings and Configurations > Manage System Configurations > Global > AWS Management > General Settings (tab)

 

S3 Configuration Details

Attachments

Document Attachments utilize the Amazon keys and  "Amazon Public Bucket" field value under 'AWS Management>General Settings'  to store Attachments in S3. The S3 path is concanetaed with the {instanceID} pulled from "global/resources/default_setup/connection/dbname" and concantenated by the hard coded value "Attachments". The final path that is generated is: http://{Amazon Public Bucket value}.s3.amazon.com/{instanceid}/Attachments/*.csv

 

Supplier Attachment Storage

Supplier Attachments utilize the Amazon keys and  "Amazon Public Bucket" field value under 'AWS Management>General Settings'  to store Supplier Attachments in S3. The S3 path is concanetaed with the {instanceID} pulled from "global/resources/default_setup/connection/dbname" and concantenated by the hard coded value "supplier_attachments"/{supplier_id}. The final path that is generated is: http://{Amazon Public Bucket value}.s3.amazon.com/{instanceid}/supplier_attachments/{supplier_id}/*.csv

 

Content Group Logo File

Content Group Logo Files utilize the Amazon keys and  "Amazon Public Bucket" field value under 'AWS Management>General Settings'  to store Logos for each Content Groups in S3. The S3 path is concanetaed with the {instanceID} pulled from "global/resources/default_setup/connection/dbname" and concantenated by the hard coded value "customer/group". The final path that is generated is: http://{Amazon Public Bucket value}.s3.amazon.com/{instanceid}/customer/group/*.jpg

 

User Profiles Pictures (Avatars)

Avatars utilize the Amazon keys and  "Amazon Public Bucket" field value under 'AWS Management>General Settings'  to store User Profile Pictures (Avatars) in S3. The S3 path is concanetaed with the {instanceID} pulled from "global/resources/default_setup/connection/dbname" and concantenated by the hard coded value "avatar". The final path that is generated is: http://{Amazon Public Bucket value}.s3.amazon.com/{instanceid}/avatar/*.jpg

 

Supplier Placeholders

Supplier Placeholders utilize the Amazon keys and  "Amazon Public Bucket" field value under 'AWS Management>General Settings'  to store Supplier Placeholders in S3. The S3 path is concanetaed with the {instanceID} pulled from "global/resources/default_setup/connection/dbname" and concantenated by the hard coded value "supplier_placeholders". The final path that is generated is: http://{Amazon Public Bucket value}.s3.amazon.com/{instanceid}/supplier_placeholders/*.jpg

 

Product Attachments

Product Attachments utilize the Amazon keys and  "Amazon Public Bucket" field value under 'AWS Management>General Settings'  to store Product Attachments in S3. The S3 path is concanetaed with the {instanceID} pulled from "global/resources/default_setup/connection/dbname" and concantenated by the hard coded value "catalog-attachments + special logic" to pull the first and second letter from the file name. The final path that is generated is: http://{Amazon Public Bucket value}.s3.amazon.com/{instanceid}/catalog-attachments/{first_letter of file}/{second_letter of file}/*.jpg

 

Homepage Sliders

Homepage Sliders utilize the Amazon keys and  "Amazon Public Bucket" field value under 'AWS Management>General Settings'  to store Homepage Sliders in S3. The S3 path is concanetaed with the {instanceID} pulled from "global/resources/default_setup/connection/dbname" and concantenated by the hard coded value "sliders". The final path that is generated is: http://{Amazon Public Bucket value}.s3.amazon.com/{instanceid}/sliders/*.jpg

 

Email Logos

Email Logos utilize the Amazon keys and  "Amazon Public Bucket" field value under 'AWS Management>General Settings'  to store Email Logos in S3. The S3 path is concanetaed with the {instanceID} pulled from "global/resources/default_setup/connection/dbname" and concantenated by the hard coded value "email_logo". The final path that is generated is: http://{Amazon Public Bucket value}.s3.amazon.com/{instanceid}/email_logo/*.jpg

 

Catalog Management

Catalog Management utilizes the Amazon keys from 'AWS Management>General Settings', and the bucket name == {instanceId} is pulled from "global/resources/default_setup/connection/dbname". The S3 path is concanetaed with the hard coded value "Staging/{SupplierDirectory}/{File Type}". The {Supplier Directroy} and {File Type} are derived from special logic inside getFilePath(). The final path that is generated is: http://{instanceid}.s3.amazon.com/Staging/{SupplierDirectory}/{File Type}/*.csv.

Example file path is:

http://bw-bqsn-kcc.s3.amazonaws.com/Staging/KCAFCMANUFACTURINGSDERLDECV(NKC0854V)/Common/bsn_common_23_53_46.csv

 

Master Data Loader

Master Data Loader utilizes the Amazon keys from 'AWS Management>General Settings', and the bucket name == {instanceId} is pulled from "global/resources/default_setup/connection/dbname". There are three S3 paths for storing Master Data imports. Each path is concatenated with the following constants FILE_UPLOAD_PATH, REPORT_UPLOAD_PATH and FILE_DOWNLOAD_PATH. The final path that is generated is:

http://{instanceid}.s3.amazon.com/FILE_UPLOAD_PATH/*.csv.

http://{instanceid}.s3.amazon.com/REPORT_UPLOAD_PATH/*.csv.

http://{instanceid}.s3.amazon.com/FILE_DOWNLOAD_PATH/*.csv.

 

Example paths of Accounting Master Data Import are:

https://bw-bqsn.s3.amazonaws.com/Mas...6_08_03_31.csv

https://bw-bqsn.s3.s3.amazonaws.com/...angereport.csv

https://bw-bqsn.s3.s3.amazonaws.com/...6_07_59_23.csv

 

Product and Supplier Exports

Product and Supplier Exports utilize the Amazon keys from 'AWS Management>General Settings', and the bucket name == {instanceId} is pulled from "global/resources/default_setup/connection/dbname". The S3 path is concanetaed with the hard coded value "Exports". The final path that is generated is: http://{instanceid}.s3.amazon.com/Exports/*.csv.

Example file path is:

http://bw-bqsn-kcc.s3.amazonaws.com/Exports/*.csv

 

Product Images

Product Images utilize the Amazon keys and "Amazon Source Bucket" field value under 'AWS Management>Catalog Management'  to store Product Images in S3. The S3 path is concanetaed with the {instanceID} pulled from "global/resources/default_setup/connection/dbname" and concantenated by logic inside Product Image Path commit. The final path that is generated is: http://{Amazon Source Bucket value}.s3.amazon.com/{instanceid}/{image_path}/*.jpg

Example file path is:

http://bw-media-source.s3.amazonaws.com/bw_bqsn_kcc/10081/0000b77cf5f68f8c443b2bc318b2a18c/m/a/MARTIN_SPROCKET_GEAR_CO_00178778.jpg

 

 

Buckets Table

  Bucket Name Sub-Folder Name Path URL
Customer Profile Pictures (Avatars)
media instance_id/avatar http://bw-media.s3.amazonaws.com/bw_bqsn_kcc/avatar/*.jpg
Attachments
media instance_id/Attachments http://bw-media.s3.amazonaws.com/bw_bqsn_kcc/Attachments/*.csv
Supplier Attachment Storage
media instance_id/supplier_attachments http://bw-media.s3.amazonaws.com/bw_bqsn_kcc/supplier_attachments/{supplier_id}/*.csv
Content Group Logo File
media instance_id/customer/group http://bw-media.s3.amazonaws.com/bw_bqsn_kcc/customer/group/customer_group_logo_1.jpg
Catalog Management
instance_id /Staging http://bw-bqsn-kcc.s3.amazonaws.com/Staging/KCAFCMANUFACTURINGSDERLDECV(NKC0854V)/Common/bsn_common_23_53_46.csv
Supplier Placeholder Storage
media instance_id/supplier_placeholders http://bw-media.s3.amazonaws.com/bw_bqsn_kcc/supplier_placeholders/*.jpg
Product Attachments
media instance_id/catalog-attachments http://bw-media.s3.amazonaws.com/bw_bqsn_kcc/catalog-attachments/m/y/myw3schoolsimage.jpg
Product and Supplier Exports
instance_id Exports http://bw-bqsn-kcc.s3.amazonaws.com/Exports/*.csv
Product Images
media-source instance_id http://bw-media-source.s3.amazonaws.com/bw_bqsn_kcc/10081/0000b77cf5f68f8c443b2bc318b2a18c/m/a/MARTIN_SPROCKET_GEAR_CO_00178778.jpg
Master Data Loader

 

instance_id
instance_id/MasterData/Accounting/Staging
instance_id/MasterData/Accounting/Archive
instance_id/MasterData/Accounting/Reports/Archive

Note - each Loader has its own Bucket:

  1. MasterData/Accounting
  2. MasterData/Unspsc
  3. MasterData/ExchangeRate
Currrency Data
instance_id instance_id/MasterData/ExchangeRate  
Homepage Sliders
media instance_id/sliders http://bw-media.s3.amazonaws.com/bw_bqsn_kcc/sliders/myw3schoolsimage.jpg
Email Logo
media instance_id/email/logo http://bw-media.s3.amazonaws.com/bw_bqsn_kcc/email/logo/myw3schoolsimage.jpg
Favicon media instance_id/favicon http://bw-media.s3.amazonaws.com/bw_bqsn_kcc/favicon/myw3schoolsimage.jpg