📄
SandStorm Analytics
  • Getting Started
    • Platform Overview
  • Data Model
    • People
    • Events
    • Properties
    • Example
  • Integrations
    • API Specifications
    • Unreal Engine
    • Unity
    • Ruby
    • Ruby On Rails
    • PHP
    • Python
    • Android
    • iOS
    • 3rd Party API
  • Features
    • Metrics
      • Metrics Calculations
      • Calculate Average Number of Times
      • Conversion Calculation in Funnels vs. Metrics
      • Daily Metrics Email
    • Funnels
    • Activity
      • Activity Breakdown by Revenue
    • Cohort
      • Cohort Report Options
    • Revenue
      • Segmenting Types of Revenue
    • A/B Testing
      • What Is "Certainty of Improvement"?
      • What other A/B testing experts do when there is no clear winner
    • Path
    • Power
    • Live View
      • Troubleshooting Sandstorm Live
    • SQL
    • Populations
      • Inside Populations
      • Suggested Populations
      • Filters
      • Invalid Populations
    • Person Profile
    • People Search
      • Date Picker
    • Campaigns
      • Unsubscribe from Campaigns
        • Using merge tags in the HTML editor
        • Person Profile settings in Campaigns
        • Campaigns Deliverability tips
    • Data Import
      • Import Existing Data Into Sandstorm
      • JSON Files as an External Data Source
      • One-Time JSON Upload
      • Recurring JSON Import
      • CSV Files as an External Data Source
      • One-Time CSV Upload
      • Recurring CSV Import
      • MySQL Argument Out of Range
      • MySQL and Postgres as an External Data Source
      • Detecting Duplicates
    • Data Export
      • Scheduling Report Exports
      • Data Export
      • Data Export Setup
      • What Can Be Exported To CSV?
      • MailChimp Exports
      • Deleting a Scheduled Report
      • Editing Scheduled Report
  • Account & Billing
    • Account Settings
      • Adding a New Website or Game
      • Removing a Site or Product From Your Account
      • Changing Your Password
      • Product Settings
      • Deleting Data From Your Site
      • Team Permissions
      • Time Zones
    • Billing
Powered by GitBook
On this page
  1. Features
  2. Data Import

Detecting Duplicates

PreviousMySQL and Postgres as an External Data SourceNextData Export

Last updated 1 year ago

Duplicate Data

Any time Sandstorm detects duplicate data, it will only process a single instance of the data while ignoring the duplicate data

Overview

For the Sandstorm instance to be considered a duplicate the following parameters should exactly match (please check our ):

  1. Identity: (_p parameter)

  2. Name of the event: (_n parameter)

  3. Timestamp of the event: (_t parameter)

  4. Name of the property: ([property name] parameter)

  5. Name of the property value: ([property value] parameter)

In other words, if we see the same person doing the same event at the exact same time with the same property name/s that have the exact same property values, then we ignore any duplicates and count one instance only.

📘Additional Notes

  • the duplicates do not reach our data structures, so they will not be included in the .

  • since the duplicate data does not get stored in our data structures, it will not appear in any reporting tools.

API Specifications
Raw Data Export