Skip to content

FMEPRD-281 Update Amazon S3 Integration Documentation #11511

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Sep 12, 2025
Merged

FMEPRD-281 Update Amazon S3 Integration Documentation #11511

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
2bcfb2a
FMEPRD-281
alai97 Sep 8, 2025
ffcee50
SME Review
alai97 Sep 8, 2025
558435b
Copy Nit
alai97 Sep 8, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
25 changes: 23 additions & 2 deletions docs/feature-management-experimentation/80-integrations/amazon-s3.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ sidebar_label: Amazon S3
description: ""
---

Amazon Simple Storage Service (Amazon S3) is an object storage service offered by Amazon as part of Amazon Web Services (AWS) that offers the ability to store and retrieve any amount of data, at any time, from anywhere on the web. With this integration you can easily and reliably send high volumes of event data to Harness FME, as well as export your impression data.
Amazon Simple Storage Service (Amazon S3) is an object storage service offered by Amazon as part of Amazon Web Services (AWS) that offers the ability to store and retrieve any amount of data, at any time, from anywhere on the web. With this integration, you can easily and reliably send high volumes of event data to Harness FME, as well as export your impression data.

## Send events to Harness FME

Expand All @@ -20,7 +20,7 @@ To connect your AWS S3 bucket to Harness FME, you need:
**File restrictions:**

* Compression examples: gzip, bzip2, snappy, or LZO compression.
* File format: _parquet only_
* File format: *Parquet only*
* Schema:
* environmentId: \[String\] Identifier for the environment in Harness FME
* trafficTypeId: \[String\] Identifier for the traffic type in Harness FME
Expand Down Expand Up @@ -379,6 +379,27 @@ To connect your AWS S3 bucket to Harness FME, you need:
* An S3 bucket destination already created.
* An AWS account with the ability to grant Harness FME permission to read, put, and remove data in the bucket. **Note: We only remove transactional files created during the transfer.**

**File specifications**:

* Compression examples: gzip, bzip2, snappy, or LZO
* File format: *Parquet only*
* Schema:

* key: [String] Identifier for the user or system triggering or associated with the impression
* label: [String] Label associated with the impression
* treatment: [String] The treatment shown for this impression
* splitName: [String] Name of the feature flag
* splitVersion: [Long] Version of the feature flag
* properties: [String] Arbitrary properties data providing context to the impression
* environmentId: [String] Identifier for the environment in Harness FME
* trafficTypeId: [String] Identifier for the traffic type in Harness FME
* sdk: [String] Name of the SDK sending the impression
* sdkVersion: [String] Version of the SDK
* machineName: [String, Nullable] Name of the machine sending the impression
* machineIp: [String, Nullable] IP of the machine sending the impression
* timestamp: [Long] The time when the impression occurred, in milliseconds past epoch
* receptionTimestamp: [Long] Timestamp when the impression was received by Harness FME

### Configure integration in Harness FME (outbound)

1. Click the **profile button** at the bottom of the left navigation pane and click **Admin settings**.
Expand Down