Lei A While
Research Center · OPPR-C
Paper IV · Structured Assessment Framework

Seven dimensions. One auditable record.

A consistent set of dimensions for evaluating submissions at the Initial Publication Gate — a process tool that translates OPPR-C criteria into consistent, reviewable practice.

Purpose

The framework supports more objective, auditable, and standards-tied decision-making by breaking evaluation into clearly defined areas drawn from the OPPR-C policy. It does not replace the requirement for a clear rationale on non-Fly decisions — instead, it ensures rationales and overall assessments are grounded in the published standards rather than holistic impressions or unstated preferences.

Editors record a concise assessment on these dimensions for every submission, creating a transparent record that can be reviewed during second-look processes and internal pattern monitoring.

The Seven Criteria

1

Coherence and Internal Intelligibility

DefinitionWhether the work is internally organized, logically structured, and can be understood and engaged with on its own terms.

What editors assess
  • §Clarity and consistency of key definitions and concepts.
  • §Logical flow between claims, methods, evidence, and conclusions.
  • §Absence of major unexplained contradictions or gaps in reasoning.
  • §Whether a qualified reader can meaningfully examine the work according to its stated scope.
Common concerns · Vague or shifting terminology, contradictory statements, or arguments that cannot be followed without the reader supplying significant unstated assumptions.
Corresponds to OPPR-C § 2.7 (Coherence).
2

Falsifiability or Contestability

DefinitionWhether the work identifies how its claims can be tested, challenged, limited, contradicted, replicated, or found insufficient.

What editors assess
  • §Presence of an explicit falsifiability pathway or, where direct testing is difficult, a clear contestability standard.
  • §Identification of what evidence, observation, formal contradiction, or replication failure would weaken key claims.
  • §Avoidance of presenting claims as self-evident or beyond meaningful challenge.
Common concerns · Central claims presented without any identified pathway for testing or contestation; assertions that the work is immune to scrutiny by its nature.
Corresponds to OPPR-C § 2.8 (Falsifiability or Contestability).
3

Scope Control

DefinitionWhether the work clearly states what it claims and does not claim, and avoids unsupported overextension beyond its evidence, method, or stated purpose.

What editors assess
  • §Explicit boundaries around the claims being made.
  • §Recognition of the limits of the evidence, formalism, dataset, or theoretical structure employed.
  • §Avoidance of broad generalizations that significantly exceed what the work actually demonstrates.
Common concerns · Sweeping conclusions drawn from narrow or preliminary evidence; claims reaching well beyond the work's stated method or data. Especially important for foundational, theoretical, and interdisciplinary submissions.
Corresponds to OPPR-C § 2.9 (Scope Control).
4

Evidence or Formal Support

DefinitionWhether the work provides a usable and appropriate basis for serious scholarly consideration.

What editors assess
  • §Clear identification of supporting material (data, experiment, derivation, formal reasoning, technical implementation, documented observation, literature synthesis).
  • §Alignment between the strength and type of claims and the strength and type of support provided.
  • §Absence of fabrication, misrepresentation, or deceptive framing of the evidentiary basis.
Common concerns · Major claims made with little or no identifiable support; reliance on undisclosed or inaccessible sources for central arguments; mismatch between claim strength and evidence strength.
Corresponds to OPPR-C § 2.10 (Evidence or Formal Support).
5

Contribution Weight & Broader Consideration Warrant

DefinitionWhether the work provides a reasoned explanation of why it merits serious scholarly, scientific, technical, methodological, or professional consideration.

What editors assess
  • §Articulation of originality, explanatory power, methodological value, archival significance, or relevance to an existing problem.
  • §A good-faith case for why broader consideration is justified, even if the work does not claim to be complete or universally accepted.
Common concerns · No meaningful explanation of the work's significance beyond the author's assertion; work presented without context relative to existing literature; purely incremental contributions framed without clear added value.
Corresponds to OPPR-C § 2.11 (Contribution Weight).
6

Ethics, Integrity, Safety & Rights Compliance

DefinitionWhether the work meets baseline requirements regarding authorship, citation, conflicts of interest, confidentiality, safety, intellectual property, and scholarly conduct.

What editors assess
  • §Proper attribution and citation of relevant sources and prior work.
  • §Disclosure of material conflicts of interest, funding relationships, or institutional interests.
  • §Appropriate handling of safety-sensitive, confidential, patent-sensitive, or rights-restricted content.
  • §Absence of plagiarism, fabrication, deceptive presentation, or other integrity failures.
Common concerns · Undisclosed conflicts that could reasonably affect interpretation; safety or IP issues not identified or addressed; clear misrepresentation of sources or data.
Corresponds to OPPR-C §§ 2.17–2.19.
7

Presentation & Metadata Completeness

DefinitionWhether the submission contains sufficient elements for readers and reviewers to assess it properly and for the work to enter the public scholarly record.

What editors assess
  • §Presence of required elements: title, author identity, abstract or summary (where applicable), body text, references (where applicable), version/date information, licensing notice, and rights statement.
  • §Adequate metadata for public identification, citation, and archival purposes.
Common concerns · Missing critical elements that prevent meaningful evaluation — for example, no abstract for complex theoretical work, missing references for heavily cited claims, or incomplete rights and licensing information.
Corresponds to Supports OPPR-C §§ 2.4 and 2.21.

How the Framework Is Applied

  • For every submission, editors produce a concise record of their assessment across these seven dimensions.
  • For Fly decisions, the assessment may be brief but must still be recorded.
  • For Conditional Fly, Revise Before Publication, Desk No-Fly, and No-Fly decisions, the assessment informs and supports the required detailed rationale.
  • The framework is used during the second-look process to help determine whether a gate decision was adequately tied to the published standards.
  • Aggregate patterns across these dimensions are reviewed internally to identify potential inconsistencies or unintended filtering effects.

Relationship to the Author Defense Statement

When an Author Defense Statement is required, its evaluation is integrated with this framework. Editors assess whether the statement adequately addresses the relevant dimensions — particularly coherence basis, falsifiability/contestability, scope, evidence basis, limitations, and contribution weight. A weak or non-compliant Defense Statement is documented within the structured assessment and may support a Conditional Fly, Revise, or negative classification with specific rationale.

Lei A While Research Center · Structured Assessment Framework. Read alongside the Editorial Review Standards and the main OPPR-C policy.