Home/Resources/Research Auditing: Proofs, Models, Code, and Counterexamples

Research Auditing: Proofs, Models, Code, and Counterexamples

This book presents a reproducible method for checking the chain from assumptions to claims, proofs, computations, and public artifacts. Six self-contained case studies show how the method works across selection, simulation, dynamics, demand, set-valued choice, and inverse problems.

12 chapters60 focused topics

Audit Methods and Reproducibility

V-01

Version, Evidence, and Claim Ledgers

A research audit begins by fixing the object under review. Titles, filenames, and repository labels can survive substantive revisions, so each source needs a version record. A claim ledger then connects quoted propositions to assumptions, proof locations, code paths, data inputs, and the auditor's residual conclusion.

  1. Source hierarchy
  2. Version records
  3. Claim units
  4. Assumption tables
  5. Residual conclusions
→
V-02

Auditing the Arrows in a Proof

A proof is a sequence of typed implications. Every arrow has a domain, quantifiers, fixed and varying objects, and a conclusion. Auditing the arrows often reveals that a result combines a valid component with an unsupported extension, allowing the conclusion to be narrowed without discarding the surrounding argument.

  1. Legality of an implication
  2. Fixed and random objects
  3. Changing ranges
  4. Decomposed conclusions
  5. Proof validity and claim truth
→
V-03

Minimal Counterexamples with Economic Structure

A useful counterexample preserves the disputed assumptions and changes only enough structure to reverse the claimed conclusion. Small state spaces, discrete shocks, or low-dimensional operators expose the mechanism. An economic implementation then shows that the mathematical witness belongs to the model class rather than to an unrelated abstraction.

  1. Dimension reduction
  2. Preserving assumptions
  3. Economic implementation
  4. Strict slack
  5. Minimal repairs
→
V-04

Numerical Illustration versus Mathematical Certificate

Computation can reveal a mechanism, refute a universal statement through an exact witness, or support a bounded certificate. These roles require different evidence. Floating-point roots, ranks, and optimizer statuses are diagnostics unless error bounds, exact arithmetic, intervals, or primal-dual arguments turn them into guarantees.

  1. Exact arithmetic
  2. Verified intervals
  3. Rank and subspace checks
  4. Limits of finite approximation
  5. Optimization certificates
→
V-05

Trace an Equation Through Code

A printed equation becomes a computational result through a chain of data transformations, functions, branches, and parameters. The audit follows that lineage from economic primitives to final output and checks whether normalizations, support restrictions, derivative formulas, and approximation choices remain invariant along the path.

  1. Computational lineage
  2. Reading model code
  3. Economic invariants
  4. Derivative and approximation checks
  5. Missing inputs
→
V-06

Publishing a Reproducible Computational Book

A computational chapter should tell readers what it proves, what it illustrates, which inputs it uses, and how to rerun it. Environment locks, source manifests, deterministic seeds, tests, and clean execution turn a collection of files into a reproducible artifact. Web display and executable computation remain distinct delivery modes.

  1. Chapter contracts
  2. Environment records
  3. Sources and permissions
  4. Tests
  5. Web display and execution
→

Six Applied Audit Case Studies

V-07

Selection after Symmetry

A symmetric vector of shocks can have zero mean coordinate by coordinate while a statistic selected using those shocks has a nonzero expectation. The distinction between a fixed order statistic and a shock-dependent selected statistic is the central audit object in boundary moment inequalities and other post-selection arguments.

  1. The target claim
  2. Fixed and selected statistics
  3. An economic counterexample
  4. Possible repairs
  5. Evidence boundaries
→
V-08

Root-n Simulation Error

Simulation-based dynamic estimators involve the sample size, the number of simulated alternatives or paths, and the number of draws per object. Root-n inference depends on their joint rates. A simulated first stage can add variance or bias to the score even when the population target remains unchanged.

  1. Condition ledgers
  2. A small dynamic model
  3. Competing sequences
  4. Corrected limiting variance
  5. Unresolved boundaries
→
V-09

Determinacy and Persistence in Dynamic Networks

Signed interactions, exact root counts, and observable modes address different questions in dynamic networks. Replacing a signed system by absolute coefficients can yield a useful sufficient contraction condition, yet it may discard cancellations. Repeated roots further require a generalized-mode calculation, with transfer-function cancellation checked separately.

  1. Original dynamic structure
  2. Signed witnesses
  3. Root-count repair
  4. Repeated-pole witnesses
  5. Observable representations
→
V-10

Residual-Income Demand across Implementations

The case compares an exact residual-income utility with a linear price implementation. The two specifications can agree near a base point while producing different affordability, derivatives, purchaser moments, markups, and welfare away from it. The audit follows that difference through the full computational chain.

  1. Exact and approximate operators
  2. A finite demand witness
  3. Transparent reconstruction
  4. Downstream propagation
  5. Reproducibility boundaries
→
V-11

Set-Valued Demand and Coherent Counterfactuals

Channel bundles can be valued by solving a viewing-time problem for each set. Replacing those set values with increments calculated at a reference bundle is exact only under modularity or a corresponding structural restriction. Bargaining and welfare then require the same set-value function and consumer shock law used for demand.

  1. Printed set values
  2. Reference calculations
  3. The modularity condition
  4. Choice-kernel variation
  5. Coherent repairs
→
V-12

Operator Domains in Latent Measurement Models

Nonclassical measurement models use conditional operators to connect latent variables and repeated measurements. Candidate-specific invertibility does not automatically permit similarity transforms across candidates, shared spectral projections, or inverse action on reconstructed probabilities. A wrapped-Gaussian witness makes the range and stability problems visible in Fourier coordinates.

  1. Latent measurement structure
  2. A wrapped-Gaussian witness
  3. Three operator-domain failures
  4. Stronger repairs and their cost
  5. Conclusion boundaries
→