Designing a Gold Layer for Reporting and APIs
How to design the Gold layer that reports, semantic models and APIs consume: modelling choices, stable contracts, serving engines and how to change it without breaking consumers.
Sujets prévus
The curated layer is the contract with consumers. Its design determines how easy it is to change the platform underneath.
- what belongs in the curated layer
- dimensional vs wide tables
- naming and data types as a contract
- versioning changes
- serving through SQL endpoint or Warehouse
- serving APIs: latency, concurrency, pagination and when to use a different store
- data quality checks