Observation, Representation, and Sufficiency · Chapter I-04

Minimum Information Repair and Feasible Records

Missing dimension gives a lower bound on repair, while data collection imposes a second feasibility problem. Oracle coordinates chosen after seeing the target can differ sharply from records available before the policy or environment is known. Additivity, cost, timing, and measurement constraints determine attainable repairs.

Conceptual map

  1. I-04.01Missing dimension
  2. I-04.02Lower bounds and constructions
  3. I-04.03Admissible records
  4. I-04.04Additive representations
  5. I-04.05Constrained record dictionaries

1. Unrestricted dimension and feasible records

A rank bound counts how many unrestricted linear coordinates can repair a report. An actual reporting system offers a constrained dictionary whose records may have to be selected in larger bundles.

Let \(A:\mathbb{R}^{n}\to \mathbb{R}^{k}\) be the baseline report, \(B:\mathbb{R}^{n}\to \mathbb{R}^{r}\) the target, and \(r_{j}^{\top}\) the rows in a finite record dictionary \(\mathcal{D}\). For a subset \(S\subseteq \mathcal{D}\), let \(R_{S}\) stack its selected rows.

Definition 1 · Feasible exact repair

A subset \(S\) repairs the target when (\(A,R_{S}\)) is sufficient for \(B\). Its cardinality or acquisition cost is evaluated within the declared dictionary.

2. Exact subset criterion

Proposition 1 · Dictionary repair test

A record subset \(S\) repairs \(B\) exactly if and only if

\[\operatorname{ker}(A)\bigcap \operatorname{ker}(R_{S})\subseteq \operatorname{ker}(B),\](1)

equivalently \(\operatorname{row}(B)\subseteq \operatorname{row}([A;R_{S}])\).

Proof. Apply Proposition I-02 to the stacked observation map. Its kernel is the intersection in (1), and its row space is the span of the baseline and selected record rows. ∎

The unrestricted lower bound remains \(d=\operatorname{rank}(B|\operatorname{\operatorname{ker}}(A))\). Every feasible repair has at least \(d\) records when each record is scalar. Equality depends on the geometry of the available rows.

3. A one-dimensional deficit requiring two records

Take latent state \(x\in \mathbb{R}^{3}\), baseline and target

\[A=[1,1,1], \quad B=[0,0,1].\](2)

Because \(B\) is scalar and varies on \(\operatorname{ker}(A)\), the unrestricted missing dimension is one. The dictionary contains only \(r_{1}^{\top}\)=[1,0,0] and \(r_{2}^{\top}\)=[0,1,0].

Selecting \(r_{1}\) leaves hidden direction (0,1,\(-1\)), which changes the target. Selecting \(r_{2}\) leaves (1,0,\(-1\)). Thus neither singleton repairs the target. Selecting both records gives

\[x_{3}=Ax-r_{1}^{\top }x-r_{2}^{\top }x.\](3)

The feasible minimum is two, strictly above the unrestricted lower bound one.

5. Implementation, exercises, and sources

Precompute a stable row basis for \(A\). For each candidate subset, append its rows, test whether every target row is reconstructed within tolerance, and retain the reconstruction residual and condition number. Exact rational arithmetic is preferable for small integer examples.

Download the volume verification script →

Exercises

  1. Verify the unrestricted deficit and all four dictionary subsets in the example.
  2. Add direct record \(r_{3}=x_{3}\) with cost three while the first two records cost one each; solve the cost problem.
  3. Construct a dictionary with two distinct inclusion-minimal repairs of different cardinalities.
Partial solutions

1. On \(\operatorname{ker}(A)\), vector (0,1,\(-1\)) has nonzero target, so the scalar restricted target has rank one. Each singleton leaves the displayed target-relevant kernel direction; both rows make the three-row observation matrix full rank. 2. The direct record is a one-record repair at cost three. The pair {\(r_{1},r_{2}\)} costs two and is optimal.

  1. Alexander Schrijver, Theory of Linear and Integer Programming, chapters on polyhedra and combinatorial optimization.Finite record-selection formulations.
  2. Gene H. Golub and Charles F. Van Loan, Matrix Computations, §5.5.Stable rank and row-space diagnostics.
  3. III-15 · Set Functions, Möbius Inversion, and Modularity.Minimal enabling antichains and interaction structure.

6. Audit checkpoint

Report the baseline and target maps, unrestricted deficit, complete record dictionary, costs, selected subset, augmented rank, decoder residual, hidden-direction test, and whether the result is lower-bound, feasible, or cost optimal.

7. Scope boundary

The chapter treats exact finite-dimensional linear repair from a finite scalar dictionary. Noisy, approximate, private, and adaptive record design require additional objectives and constraints.

Prerequisites