hass.tibber_prices/docs/user/period-calculation.md
Julian Pawlowski 457fa7c03f refactor(periods): merge adjacent periods and remove is_extension logic
BREAKING CHANGE: Period overlap resolution now merges adjacent/overlapping periods
instead of marking them as extensions. This simplifies automation logic and provides
clearer period boundaries for users.

Previous Behavior:
- Adjacent periods created by relaxation were marked with is_extension=true
- Multiple short periods instead of one continuous period
- Complex logic needed to determine actual period length in automations

New Behavior:
- Adjacent/overlapping periods are merged into single continuous periods
- Newer period's relaxation attributes override older period's
- Simpler automation: one period = one continuous time window

Changes:
- Period Overlap Resolution (new file: period_overlap.py):
  * Added merge_adjacent_periods() to combine periods and preserve attributes
  * Rewrote resolve_period_overlaps() with simplified merge logic
  * Removed split_period_by_overlaps() (no longer needed)
  * Removed is_extension marking logic
  * Removed unused parameters: min_period_length, baseline_periods

- Relaxation Strategy (relaxation.py):
  * Removed all is_extension filtering from period counting
  * Simplified standalone counting to just len(periods)
  * Changed from period_merging import to period_overlap import
  * Added MAX_FLEX_HARD_LIMIT constant (0.50)
  * Improved debug logging for merged periods

- Code Quality:
  * Fixed all remaining linter errors (N806, PLR2004, PLR0912)
  * Extracted magic values to module-level constants:
    - FLEX_SCALING_THRESHOLD = 0.20
    - SCALE_FACTOR_WARNING_THRESHOLD = 0.8
    - MAX_FLEX_HARD_LIMIT = 0.50
  * Added appropriate noqa comments for unavoidable patterns

- Configuration (from previous work in this session):
  * Removed CONF_RELAXATION_STEP_BEST, CONF_RELAXATION_STEP_PEAK
  * Hard-coded 3% relaxation increment for reliability
  * Optimized defaults: RELAXATION_ATTEMPTS 8→11, ENABLE_MIN_PERIODS False→True,
    MIN_PERIODS undefined→2
  * Removed relaxation_step UI fields from config flow
  * Updated all 5 translation files

- Documentation:
  * Updated period_handlers/__init__.py: period_merging → period_overlap
  * No user-facing docs changes needed (already described continuous periods)

Rationale - Period Merging:
User experience was complicated by fragmented periods:
- Automations had to check multiple adjacent periods
- Binary sensors showed ON/OFF transitions within same cheap time
- No clear way to determine actual continuous period length

With merging:
- One continuous cheap time = one period
- Binary sensor clearly ON during entire period
- Attributes show merge history via merged_from dict
- Relaxation info preserved from newest/highest flex period

Rationale - Hard-Coded Relaxation Increment:
The configurable relaxation_step parameter proved problematic:
- High base flex + high step → rapid explosion (40% base + 10% step → 100% in 6 steps)
- Users don't understand the multiplicative nature
- 3% increment provides optimal balance: 11 attempts to reach 50% hard cap

Impact:
- Existing installations: Periods may appear longer (merged instead of split)
- Automations benefit from simpler logic (no is_extension checks needed)
- Custom relaxation_step values will use new 3% increment
- Users may need to adjust relaxation_attempts if they relied on high step sizes
2025-11-19 20:16:58 +00:00

20 KiB
Raw Blame History

Period Calculation

Learn how Best Price and Peak Price periods work, and how to configure them for your needs.

Table of Contents


Quick Start

What Are Price Periods?

The integration finds time windows when electricity is especially cheap (Best Price) or expensive (Peak Price):

  • Best Price Periods 🟢 - When to run your dishwasher, charge your EV, or heat water
  • Peak Price Periods 🔴 - When to reduce consumption or defer non-essential loads

Default Behavior

Out of the box, the integration:

  1. Best Price: Finds cheapest 1-hour+ windows that are at least 2% below the daily average
  2. Peak Price: Finds most expensive 1-hour+ windows that are at least 2% above the daily average
  3. Relaxation: Automatically loosens filters if not enough periods are found

Most users don't need to change anything! The defaults work well for typical use cases.

Example Timeline

00:00 ████████████████ Best Price Period (cheap prices)
04:00 ░░░░░░░░░░░░░░░░ Normal
08:00 ████████████████ Peak Price Period (expensive prices)
12:00 ░░░░░░░░░░░░░░░░ Normal
16:00 ████████████████ Peak Price Period (expensive prices)
20:00 ████████████████ Best Price Period (cheap prices)

How It Works

The Basic Idea

Each day, the integration analyzes all 96 quarter-hourly price intervals and identifies continuous time ranges that meet specific criteria.

Think of it like this:

  1. Find potential windows - Times close to the daily MIN (Best Price) or MAX (Peak Price)
  2. Filter by quality - Ensure they're meaningfully different from average
  3. Check duration - Must be long enough to be useful
  4. Apply preferences - Optional: only show stable prices, avoid mediocre times

Step-by-Step Process

1. Define the Search Range (Flexibility)

Best Price: How much MORE than the daily minimum can a price be?

Daily MIN: 20 ct/kWh
Flexibility: 15% (default)
→ Search for times ≤ 23 ct/kWh (20 + 15%)

Peak Price: How much LESS than the daily maximum can a price be?

Daily MAX: 40 ct/kWh
Flexibility: -15% (default)
→ Search for times ≥ 34 ct/kWh (40 - 15%)

Why flexibility? Prices rarely stay at exactly MIN/MAX. Flexibility lets you capture realistic time windows.

2. Ensure Quality (Distance from Average)

Periods must be meaningfully different from the daily average:

Daily AVG: 30 ct/kWh
Minimum distance: 2% (default)

Best Price: Must be ≤ 29.4 ct/kWh (30 - 2%)
Peak Price: Must be ≥ 30.6 ct/kWh (30 + 2%)

Why? This prevents marking mediocre times as "best" just because they're slightly below average.

3. Check Duration

Periods must be long enough to be practical:

Default: 60 minutes minimum

45-minute period → Discarded
90-minute period → Kept ✓

4. Apply Optional Filters

You can optionally require:

  • Absolute quality (level filter) - "Only show if prices are CHEAP/EXPENSIVE (not just below/above average)"

5. Statistical Outlier Filtering

Before period identification, price spikes are automatically detected and smoothed:

Raw prices:    18, 19, 35, 20, 19 ct   ← 35 ct is an isolated spike
Smoothed:      18, 19, 19, 20, 19 ct   ← Spike replaced with trend prediction

Result: Continuous period 00:00-01:15 instead of split periods

How it works:

  • Linear regression predicts expected price based on surrounding trend
  • 95% confidence intervals (2 standard deviations) define spike tolerance
  • Symmetry checking preserves legitimate price shifts (morning/evening peaks)
  • Enhanced zigzag detection catches spike clusters without multiple passes

Data integrity:

  • Original prices always preserved for statistics (min/max/avg show real values)
  • Smoothing only affects period formation (which intervals qualify for periods)
  • Attributes show when smoothing was impactful: period_interval_smoothed_count

Example log output:

DEBUG: [2025-11-11T14:30:00+01:00] Outlier detected: 35.2 ct
DEBUG:   Residual: 14.5 ct > tolerance: 4.8 ct (2×2.4 std dev)
DEBUG:   Trend slope: 0.3 ct/interval (gradual increase)
DEBUG:   Smoothed to: 20.7 ct (trend prediction)

Visual Example

Timeline for a typical day:

Hour:  00  01  02  03  04  05  06  07  08  09  10  11  12  13  14  15  16  17  18  19  20  21  22  23
Price: 18  19  20  28  29  30  35  34  33  32  30  28  25  24  26  28  30  32  31  22  21  20  19  18

Daily MIN: 18 ct | Daily MAX: 35 ct | Daily AVG: 26 ct

Best Price (15% flex = ≤20.7 ct):
       ████████                                                                        ████████████████
       00:00-03:00 (3h)                                                               19:00-24:00 (5h)

Peak Price (-15% flex = ≥29.75 ct):
                              ████████████████████████
                              06:00-11:00 (5h)

Configuration Guide

Basic Settings

Flexibility

What: How far from MIN/MAX to search for periods Default: 15% (Best Price), -15% (Peak Price) Range: 0-100%

best_price_flex: 15 # Can be up to 15% more expensive than daily MIN
peak_price_flex: -15 # Can be up to 15% less expensive than daily MAX

When to adjust:

  • Increase (20-25%) → Find more/longer periods
  • Decrease (5-10%) → Find only the very best/worst times

⚠️ Important: Flexibility works together with "Distance from Average" (see below). Very high flexibility (>30%) can conflict with the distance filter and become counterproductive. Recommendation: Start with 15-20% and enable relaxation instead of manually increasing flexibility.

Minimum Period Length

What: How long a period must be to show it Default: 60 minutes Range: 15-240 minutes

best_price_min_period_length: 60
peak_price_min_period_length: 60

When to adjust:

  • Increase (90-120 min) → Only show longer periods (e.g., for heat pump cycles)
  • Decrease (30-45 min) → Show shorter windows (e.g., for quick tasks)

Distance from Average

What: How much better than average a period must be Default: 2% Range: 0-20%

best_price_min_distance_from_avg: 2
peak_price_min_distance_from_avg: 2

When to adjust:

  • Increase (5-10%) → Only show clearly better times
  • Decrease (0-1%) → Show any time below/above average

Note: This filter works independently from flexibility. Both conditions must be met:

  • Price must be within flex range (close to MIN/MAX)
  • AND price must be sufficiently below/above average

Example conflict: If daily MIN is 10 ct, daily AVG is 20 ct, flex is 50%, and min_distance is 5%:

  • Flex allows prices up to 15 ct
  • Distance requires prices ≤ 19 ct (20 - 5%)
  • Both must pass → effective limit is 15 ct (the stricter one)

This is why very high flexibility (>30%) can be counterproductive - the distance filter may become the dominant constraint.

Optional Filters

Level Filter (Absolute Quality)

What: Only show periods with CHEAP/EXPENSIVE intervals (not just below/above average) Default: any (disabled) Options: any | cheap | very_cheap (Best Price) | expensive | very_expensive (Peak Price)

best_price_max_level: any      # Show any period below average
best_price_max_level: cheap    # Only show if at least one interval is CHEAP

Use case: "Only notify me when prices are objectively cheap/expensive"

Gap Tolerance (for Level Filter)

What: Allow some "mediocre" intervals within an otherwise good period Default: 0 (strict) Range: 0-10

best_price_max_level: cheap
best_price_max_level_gap_count: 2 # Allow up to 2 NORMAL intervals per period

Use case: "Don't split periods just because one interval isn't perfectly CHEAP"

Tweaking Strategy: What to Adjust First?

When you're not happy with the default behavior, adjust settings in this order:

1. Start with Relaxation (Easiest)

If you're not finding enough periods:

enable_min_periods_best: true   # Already default!
min_periods_best: 2             # Already default!
relaxation_attempts_best: 11    # Already default!

Why start here? Relaxation automatically finds the right balance for each day. Much easier than manual tuning.

2. Adjust Period Length (Simple)

If periods are too short/long for your use case:

best_price_min_period_length: 90  # Increase from 60 for longer periods
# OR
best_price_min_period_length: 45  # Decrease from 60 for shorter periods

Safe to change: This only affects duration, not price selection logic.

3. Fine-tune Flexibility (Moderate)

If you consistently want more/fewer periods:

best_price_flex: 20  # Increase from 15% for more periods
# OR
best_price_flex: 10  # Decrease from 15% for stricter selection

⚠️ Watch out: Values >25% may conflict with distance filter. Use relaxation instead.

4. Adjust Distance from Average (Advanced)

Only if periods seem "mediocre" (not really cheap/expensive):

best_price_min_distance_from_avg: 5  # Increase from 2% for stricter quality

⚠️ Careful: High values (>10%) can make it impossible to find periods on flat price days.

5. Enable Level Filter (Expert)

Only if you want absolute quality requirements:

best_price_max_level: cheap  # Only show objectively CHEAP periods

⚠️ Very strict: Many days may have zero qualifying periods. Always enable relaxation when using this!

Common Mistakes to Avoid

Don't increase flexibility to >30% manually → Use relaxation instead Don't combine high distance (>10%) with strict level filter → Too restrictive Don't disable relaxation with strict filters → You'll get zero periods on some days Don't change all settings at once → Adjust one at a time and observe results

Do use defaults + relaxation → Works for 90% of cases Do adjust one setting at a time → Easier to understand impact Do check sensor attributes → Shows why periods were/weren't found


Understanding Relaxation

What Is Relaxation?

Sometimes, strict filters find too few periods (or none). Relaxation automatically loosens filters until a minimum number of periods is found.

How to Enable

enable_min_periods_best: true
min_periods_best: 2 # Try to find at least 2 periods per day
relaxation_attempts_best: 11 # Flex levels to test (default: 11 steps = 22 filter combinations)

Good news: Relaxation is enabled by default with sensible settings. Most users don't need to change anything here!

Set the matching relaxation_attempts_peak value when tuning Peak Price periods. Both sliders accept 1-12 attempts, and the default of 11 flex levels translates to 22 filter-combination tries (11 flex levels × 2 filter combos) for each of Best and Peak calculations. Lower it for quick feedback, or raise it when either sensor struggles to hit the minimum-period target on volatile days.

Why Relaxation Is Better Than Manual Tweaking

Problem with manual settings:

  • You set flex to 25% → Works great on Monday (volatile prices)
  • Same 25% flex on Tuesday (flat prices) → Finds "best price" periods that aren't really cheap
  • You're stuck with one setting for all days

Solution with relaxation:

  • Monday (volatile): Uses flex 15% (original) → Finds 2 perfect periods ✓
  • Tuesday (flat): Escalates to flex 21% → Finds 2 decent periods ✓
  • Wednesday (mixed): Uses flex 18% → Finds 2 good periods ✓

Each day gets exactly the flexibility it needs!

How It Works (Adaptive Matrix)

Relaxation uses a matrix approach - trying N flexibility levels (your configured relaxation attempts) with 2 filter combinations per level. With the default of 11 attempts, that means 11 flex levels × 2 filter combinations = 22 total filter-combination tries per day; fewer attempts mean fewer flex increases, while more attempts extend the search further before giving up.

Important: The flexibility increment is fixed at 3% per step (hard-coded for reliability). This means:

  • Base flex 15% → 18% → 21% → 24% → ... → 48% (with 11 attempts)
  • Base flex 20% → 23% → 26% → 29% → ... → 50% (with 11 attempts)

Phase Matrix

For each day, the system tries:

Flexibility Levels (Attempts):

  1. Attempt 1 = Original flex (e.g., 15%)
  2. Attempt 2 = +3% step (18%)
  3. Attempt 3 = +3% step (21%)
  4. Attempt 4 = +3% step (24%)
  5. … Attempts 5-11 (default) continue adding +3% each time
  6. … Additional attempts keep extending the same pattern up to the 12-attempt maximum (up to 51%)

2 Filter Combinations (per flexibility level):

  1. Original filters (your configured level filter)
  2. Remove level filter (level=any)

Example progression:

Flex 15% + Original filters → Not enough periods
Flex 15% + Level=any        → Not enough periods
Flex 18% + Original filters → Not enough periods
Flex 18% + Level=any        → SUCCESS! Found 2 periods ✓
(stops here - no need to try more)

Choosing the Number of Attempts

  • Default (11 attempts) balances speed and completeness for most grids (22 combinations per day for both Best and Peak)
  • Lower (4-8 attempts) if you only want mild relaxation and keep processing time minimal (reaches ~27-39% flex)
  • Higher (12 attempts) for extremely volatile days when you must reach near the 50% maximum (24 combinations)
  • Remember: each additional attempt adds two more filter combinations because every new flex level still runs both filter overrides (original + level=any)

Per-Day Independence

Critical: Each day relaxes independently:

Day 1: Finds 2 periods with flex 15% (original) → No relaxation needed
Day 2: Needs flex 21% + level=any → Uses relaxed settings
Day 3: Finds 2 periods with flex 15% (original) → No relaxation needed

Why? Price patterns vary daily. Some days have clear cheap/expensive windows (strict filters work), others don't (relaxation needed).


Common Scenarios

Scenario 1: Simple Best Price (Default)

Goal: Find the cheapest time each day to run dishwasher

Configuration:

# Use defaults - no configuration needed!
best_price_flex: 15 # (default)
best_price_min_period_length: 60 # (default)
best_price_min_distance_from_avg: 2 # (default)

What you get:

  • 1-3 periods per day with prices ≤ MIN + 15%
  • Each period at least 1 hour long
  • All periods at least 2% cheaper than daily average

Automation example:

automation:
    - trigger:
          - platform: state
            entity_id: binary_sensor.tibber_home_best_price_period
            to: "on"
      action:
          - service: switch.turn_on
            target:
                entity_id: switch.dishwasher

Troubleshooting

No Periods Found

Symptom: binary_sensor.tibber_home_best_price_period never turns "on"

Possible causes:

  1. Filters too strict

    # Try:
    best_price_flex: 20 # Increase from default 15%
    best_price_min_distance_from_avg: 1 # Reduce from default 2%
    
  2. Period length too long

    # Try:
    best_price_min_period_length: 45 # Reduce from default 60 minutes
    
  3. Flat price curve (all prices very similar)

    • Enable relaxation to ensure at least some periods
    enable_min_periods_best: true
    min_periods_best: 1
    

Periods Split Into Small Pieces

Symptom: Many short periods instead of one long period

Possible causes:

  1. Level filter too strict

    # One "NORMAL" interval splits an otherwise good period
    # Solution: Use gap tolerance
    best_price_max_level: cheap
    best_price_max_level_gap_count: 2 # Allow 2 NORMAL intervals
    
  2. Flexibility too tight

    # One interval just outside flex range splits the period
    # Solution: Increase flexibility
    best_price_flex: 20 # Increase from 15%
    
  3. Price spikes breaking periods

    • Statistical outlier filtering should handle this automatically
    • Check logs for smoothing activity:
    DEBUG: [2025-11-11T14:30:00+01:00] Outlier detected: 35.2 ct
    DEBUG:   Smoothed to: 20.7 ct (trend prediction)
    
    • If smoothing isn't working as expected, check:
      • Is spike truly isolated? (3+ similar prices in a row won't be smoothed)
      • Is it a legitimate price shift? (symmetry check preserves morning/evening peaks)

Understanding Sensor Attributes

Check period details:

# Entity: binary_sensor.tibber_home_best_price_period

# Attributes when "on":
start: "2025-11-11T02:00:00+01:00"
end: "2025-11-11T05:00:00+01:00"
duration_minutes: 180
rating_level: "LOW" # All intervals are LOW price
price_avg: 18.5 # Average price in this period
relaxation_active: true # This day used relaxation
relaxation_level: "price_diff_18.0%+level_any" # Found at flex 18%, level filter removed
period_interval_smoothed_count: 2 # 2 outliers were smoothed (only if >0)
period_interval_level_gap_count: 1 # 1 interval kept via gap tolerance (only if >0)

Advanced Topics

For advanced configuration patterns and technical deep-dive, see:

Quick Reference

Configuration Parameters:

Parameter Default Range Purpose
best_price_flex 15% 0-100% Search range from daily MIN
best_price_min_period_length 60 min 15-240 Minimum duration
best_price_min_distance_from_avg 2% 0-20% Quality threshold
best_price_max_level any any/cheap/vcheap Absolute quality
best_price_max_level_gap_count 0 0-10 Gap tolerance
enable_min_periods_best true true/false Enable relaxation
min_periods_best 2 1-10 Target periods per day
relaxation_attempts_best 11 1-12 Flex levels (attempts) per day

Peak Price: Same parameters with peak_price_* prefix (defaults: flex=-15%, same otherwise)

Price Levels Reference

The Tibber API provides price levels for each 15-minute interval:

Levels (based on trailing 24h average):

  • VERY_CHEAP - Significantly below average
  • CHEAP - Below average
  • NORMAL - Around average
  • EXPENSIVE - Above average
  • VERY_EXPENSIVE - Significantly above average

Outlier Filtering Technical Details

Algorithm:

  1. Linear regression: Predicts expected price based on surrounding trend
  2. Confidence intervals: 2 standard deviations (95% confidence)
  3. Symmetry check: Rejects asymmetric outliers (1.5 std dev threshold)
  4. Enhanced zigzag detection: Catches spike clusters with relative volatility (2.0× threshold)

Constants:

  • CONFIDENCE_LEVEL: 2.0 (95% confidence)
  • SYMMETRY_THRESHOLD: 1.5 std dev
  • RELATIVE_VOLATILITY_THRESHOLD: 2.0
  • MIN_CONTEXT_SIZE: 3 intervals minimum

Data integrity:

  • Smoothed intervals stored with _original_price field
  • All statistics (min/max/avg) use original prices
  • Period attributes show impact: period_interval_smoothed_count
  • Smart counting: Only counts smoothing that actually changed period formation

Last updated: November 19, 2025 Integration version: 2.0+