# Temporal Context Loss

## The Problem

Time-sensitive information lacks temporal markers, causing AI to present outdated facts as current or miss important time-based context.

### Symptoms

* ❌ Presents 2022 info as current in 2024
* ❌ "Currently" without date reference
* ❌ Cannot determine fact validity period
* ❌ Mixes past and present tense confusingly
* ❌ No "as of" timestamps

### Real-World Example

```
Chunk from 2022 docs:
"Our API currently supports 10 endpoints"

Chunk from 2024 docs:
"The API now includes 50 endpoints"

Query (2024): "How many endpoints does the API have?"

Retrieved both chunks:
→ AI confused: "The API supports between 10 and 50 endpoints"

Missing temporal context:
→ 10 endpoints (as of 2022) - obsolete
→ 50 endpoints (as of 2024) - current
```

***

## Deep Technical Analysis

### Implicit Temporal References

**Relative Time:**

```
Document: "We recently added feature X"
→ When is "recently"?
→ Doc written: 2022
→ User reading: 2024
→ "Recently" = 2 years ago (not recent anymore)

Ambiguous temporal markers:
→ "currently", "now", "recently", "soon"
→ Relative to document creation, not user query
```

**Missing Timestamps:**

```
Chunk text: "Pricing: $50/month"

No indication:
→ When was this pricing set?
→ Is it still current?
→ Has it changed since?

User assumes current (may be wrong)
```

### Metadata Temporal Tracking

**Document-Level Timestamps:**

```
Store with chunks:
{
  text: "API supports 10 endpoints",
  published_date: "2022-03-15",
  last_updated: "2022-03-15",
  valid_until: null
}

Enables:
→ Filter to recent docs (WHERE published_date > '2023-01-01')
→ Prefer newer over older
→ Display "as of date" in responses
```

**Fact-Level Temporal Validity:**

```
More granular:
{
  fact: "API has 10 endpoints",
  valid_from: "2020-01-01",
  valid_until: "2023-06-30",
  superseded_by: "API has 50 endpoints"
}

Know exactly when fact was true
```

### Temporal Filtering

**Recency Bias:**

```
Retrieval scoring:
→ Base: similarity_score (0-1)
→ Recency boost: 1.0 + (1 / days_old * 0.001)

Effect:
→ Recent docs ranked slightly higher
→ Old docs still retrievable but deprioritized

Balance: Relevance + recency
```

**Time-Bound Queries:**

```
User can specify:
→ "What was the pricing in 2022?"
→ "What's current pricing?"

Filter metadata:
→ Historical: WHERE published_date BETWEEN '2022-01-01' AND '2022-12-31'
→ Current: WHERE is_latest = true
```

### Natural Language Temporal Markers

**Explicit Dates in Text:**

```
Instead of:
"We currently support 10 endpoints"

Better:
"As of March 2022, we support 10 endpoints"

Explicit temporal marker in chunk text:
→ LLM can parse
→ User knows context
```

**Version-Dated Content:**

```
Include version in text:
"API v2.0 (released June 2024) includes 50 endpoints"

Clear temporal + version context
```

***

## How to Solve

**Add published\_date and last\_updated to all chunk metadata + implement recency boosting in retrieval scoring + filter to recent docs by default (e.g., last 12 months) + include explicit temporal markers in chunk text ("as of 2024") + tag time-sensitive content (pricing, features) with validity periods + display "last updated" date in AI responses + allow user to query historical info explicitly.** See [Temporal Metadata](/rag-scenarios-and-solutions/data-quality/temporal-staleness.md).


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://help.twig.so/rag-scenarios-and-solutions/data-quality/temporal-staleness.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.