CRS Summary Dataset - Overview
Executive Summary
Attribute | Value |
|---|---|
Dataset Name | CRS Summary |
Description | Carrier Rate Shopping data containing order details, shipping quotes, line items, and surcharges |
Source System | Elasticsearch (CRS Summary Index) |
Storage Location | s3://fenixlake/l1_processing/crs_summary/ |
Database stored | fenix_tms_analytics_prod |
File Format | Parquet (Snappy compressed) |
Refresh Frequency |
|
Data Owner |
|
Business Owner | Logistics/Operations |
Tables in this dataset
Table Name | Description | Row Grain | Primary Key | Approx Volume |
|---|---|---|---|---|
order_summary | Order header with shipping address and package info | 1 row per order | order_id |
|
service_quotes | Shipping service quotes (selected, rejected, etc.) | 1 row per quote per order | order_id + service_quote_type + carrier_name + service_code |
|
order_line_items | Product line items in each order | 1 row per product per order | order_id + line_item_id |
|
shipping_surcharges | Shipping surcharges breakdown | 1 row per surcharge + 1 aggregate row | order_id + service_quote_type + carrier_name + service_code + surcharge_code |
|
Table Relationships
Parent Table | Child Table | Join Key(s) | Relationship | Notes |
|---|---|---|---|---|
order_summary | service_quotes | order_id | 1:N | Some orders have 0 quotes (cancelled before CRS) |
order_summary | order_line_items | order_id | 1:N | Every order has at least 1 line item |
service_quotes | shipping_surcharges | order_id, service_quote_type, carrier_name, service_code | 1:N | Only services with surcharges have child rows |
Partition Strategy
Partition Column | Data Type | Description |
|---|---|---|
client_name | STRING | Client/tenant identifier (e.g., http://bombas.myshopify.com ) |
order_year | INT | Year the order was created (e.g., 2025) |
order_month | INT | Month the order was created (1-12) |
order_date | DATE | Date the order was created (e.g., 2025-07-25) |