FTB-C000093 / Data quality concept

Duplicate Record

A duplicate record is an additional representation of the same logical event or state under a declared identity rule.

Also known asduplicate eventduplicate row

Foundation 2 linked topicsPublished

Definitions

In plain terms

Two rows that look alike may be separate trades, while two different-looking messages may be corrections of one event.

Technical

Deduplication requires source-scoped identifiers, sequence and lifecycle semantics, field normalization, time bounds, and a deterministic survivor or merge policy.

Scope

Equal field values alone are not sufficient proof of duplication.

Examples

  • A governed dataset records duplicate record explicitly and preserves the source context needed to interpret it.

Common misconceptions

  • Duplicate Record does not have one universal meaning or policy without its declared source, scope, and data contract.

Concept relationships

Prerequisites

Related

Where this concept is used

Tutorials planned

These catalogued topics use this concept, but their complete build has not shipped yet.

  • D01-F01-A02 Important
  • D01-F02-A05 Primary

Evidence and governance

  1. Daily TAQ Client Specification New York Stock Exchange / Intercontinental Exchange · official exchange

    Supports: preferred label, short definition, technical definition

    Limits: Product-specific and licensed; it does not create universal eligibility, repair, imputation, tolerance, or aggregation rules.

  2. Fintech Builder Glossary Definition Contract The Fintech Builder · internal governed contract

    Supports: variant distinction

    Limits: Defines governed platform behavior rather than claiming these policies are universally prescribed by external McClellan methodology.

Reviewed by
Last reviewed
2026-07-26
Next review
2027-07-26
Record status
published
Written by

Fintech engineer building market-data and financial systems, and the author of every article, glossary record, and reference implementation on The Fintech Builder.