ECB’s Daily Price Dataset: millions of web-scraped prices show why ‘effective price’ beats sticker price
ECB’s Daily Price Dataset: millions of web-scraped prices show why ‘effective price’ beats sticker price
Central banks are increasingly using web-scraped online prices because they are high-frequency, timely, and closer to the “real” shopping experience than monthly snapshots.
Between 2024 and 2025, the Eurosystem (via the ECB/PRISMA network) published multiple pieces showing how daily online price data can measure price dynamics and even help nowcast food inflation.
What the research built (DPD / PRISMA)
Across Eurosystem publications, a consistent story appears:
- The ECB collected a new daily dataset via web scraping of online supermarket prices to study how price changes behave under high inflation (evidence covering April 2022 to January 2024).
- Banque de France describes a “Daily Price Dataset (DPD)” that collects thousands of prices every day, accumulating several million prices for close to 100,000 food products from supermarkets in large euro-area economies.
- Other central banks (e.g., Malta) highlight that web-scraped supermarket prices can support real-time monitoring / nowcasting of food inflation.
Why this matters for competitive price monitoring
The big lesson is simple: the “price” that matters is rarely a single number on the PDP.
High-frequency datasets work because they track the full offer reality:
- Availability changes (in-stock vs out-of-stock)
- Promo mechanics (temporary discounts, badge changes, coupons)
- Landed price (shipping thresholds, fees, delivery promises)
- Assortment churn (products disappear, variants change)
If central banks need daily granularity to understand inflation, you will need context + cadence to understand competitors.
What to copy for Trackabl (actionable)
-
Track landed price
Store item price + shipping + free-shipping threshold + delivery ETA. -
Track availability
Log in-stock status and “only X left” scarcity claims. -
Separate event types
“Real markdown” vs “promo framing” vs “shipping threshold change” vs “availability change”. -
Use sampling + cooldowns
Daily scraping is powerful, but alerts should be throttled to avoid noise.
A practical benchmark
If you can answer these with data, your pricing intelligence is already closer to how researchers do it:
- Did the competitor really cut price, or did shipping/fees change?
- Did the offer change because the product disappeared/reappeared?
- Was the “discount” just a badge change?
Takeaway: high-frequency research confirms what merchants feel: effective price beats sticker price.
Official sources
- Banque de France (2025): Monitoring food price changes in the euro area in real time (DPD web-scraping; millions of prices; ~100,000 products)
- ECB Occasional Paper (2023): E-commerce and price setting — evidence from Europe (DPD project within PRISMA)
- ECB Economic Bulletin (2024): What does new micro price evidence tell us about inflation? (daily web-scraped dataset April 2022–Jan 2024)
- Central Bank of Malta Research Bulletin (2025): Using product price data to nowcast food inflation (web-scraped supermarket prices)
Latest research briefs
All researchChina online retail reached ¥15.5T in 2024 — and nearly 1B people shop online
Official stats show China’s online retail sales hit ¥15.52T in 2024 (+7.2% YoY), with physical goods at ¥13.08T (26.8% of total retail). CNNIC reports online shopping users rose from 905M (Jun 2024) to 974M (Dec 2024). What this scale means for promo-driven price competition.
EU influencer sweep 2024: 97% posted ads, only 1 in 5 disclosed them properly
An EU-wide CPC sweep screened 576 influencers. Nearly all posted commercial content, but only ~20% consistently disclosed ads. Why this matters for pricing & promo intelligence.
EU online shopping adoption 2014–2024: from 59% to 77% of internet users (Eurostat)
Eurostat data shows the share of EU internet users buying online rose from 59% (2014) to 77% (2024). Country split + implications for competitor price monitoring.
EU sweep 2025: 52% of second-hand online sellers may break consumer-law basics
A CPC Network sweep checked 356 second-hand online traders in 2025. 185 (52%) were flagged. The details reveal why “price” is rarely just a number: returns, legal guarantee, and green claims shape effective value.
US e-commerce hit ~16% of retail in 2025 while online prices kept falling
U.S. Census data puts e-commerce at ~16% of retail sales in 2025, while Adobe’s Digital Price Index reported online prices down 2.9% YoY in Oct 2024 (26 straight months of YoY declines). What this combination implies for competitor price tracking.