LogoSkills

AMBIGUITY_RUBRIC

5-Dimension Ambiguity Rubric โ€” Lexical precision, reference clarity, completeness, consistency, testability

Ambiguity Rubric#

A 5-dimension rubric for quantitatively evaluating ambiguity in spec documents. Final score = weighted average (0.0 = perfectly clear, 1.0 = completely ambiguous)

Pass Criteria#

GradeScore RangeVerdict
CLEAR0.0 ~ 0.2Pass โ€” Implementation-ready
WARNING 0.2 ~ 0.3 Conditional โ€” Re-evaluate after fixing flagged items
AMBIGUOUS 0.3 ~ 0.5 Fail โ€” Major ambiguities must be resolved
UNCLEAR0.5 ~ 1.0Reject โ€” Spec rewrite required

Dimension 1: Lexical Precision โ€” Weight 0.25#

Whether ambiguous words/expressions have been replaced with specific values or definitions.

Prohibited Word List (Ambiguous Expressions)#

Locale-tagged. The lexical scan MUST match the spec's own language. A Korean spec is scanned with the Korean column; do NOT rely on the English column alone (that misses every Korean vague term and silently scores 0.0 โ†’ see the locale rule below).

English (ambiguous)Korean (ambiguous)Clear Replacement Example
fast, quickly๋น ๋ฅด๊ฒŒ, ์‹ ์†ํžˆp95 response under 200ms
many, large amount๋Œ€๋Ÿ‰, ๋‹ค์ˆ˜, ๋งŽ์ด10,000 or more
appropriate, properly์ ์ ˆํžˆ, ์•Œ๋งž๊ฒŒ{specify concrete criteria}
simple, easy๊ฐ„๋‹จํžˆ, ์‰ฝ๊ฒŒComplete within 3 steps
etc., and so on๋“ฑ๋“ฑ, ๊ธฐํƒ€Enumerate complete list
if needed, depending onํ•„์š”์‹œ, ์ƒํ™ฉ์— ๋”ฐ๋ผ{specify exact conditions}
as much as possible์ตœ๋Œ€ํ•œ{specify quantitative target}
generally๋Œ€์ฒด๋กœ, ์ผ๋ฐ˜์ ์œผ๋กœ{specify including exception conditions}

Scoring Criteria#

ScoreCriteria
0.00 prohibited words, all values specified
0.251-2 prohibited words, most values specified
0.53-5 prohibited words, some values missing
0.756+ prohibited words, many values missing
1.0Pervasive use of ambiguous expressions

Locale coverage rule (unverified โ‰  clear): If the spec's primary language is NOT covered by the prohibited-word table above, this dimension is UNVERIFIED, not 0.0. A keyword miss in an unsupported language must NOT be scored as "0 prohibited words" โ€” that silently pulls the weighted total toward CLEAR/Pass (the LANG-01 fail-open). Mark the dimension UNVERIFIED, surface a warning, and fall back to LLM semantic judgment of vagueness rather than keyword counting.


Dimension 2: Reference Clarity โ€” Weight 0.20#

Whether pronouns, demonstratives, and abbreviations clearly point to specific entities.

Inspection Items#

  • Pronouns: "this", "that", "said" โ†’ Replace with specific entity names
  • Abbreviations: Define full name + abbreviation on first occurrence
  • Implicit subjects: "is processed", "is sent" โ†’ Specify the agent ("the server processes")
  • External references: "as per existing approach" โ†’ Specify reference document + section

Scoring Criteria#

ScoreCriteria
0.0All references have 1:1 mapping, all abbreviations defined
0.251-2 ambiguous references, most abbreviations defined
0.53-5 ambiguous references, some abbreviations undefined
0.75Many ambiguous references, insufficient abbreviation definitions
1.0Key entity references unclear

Dimension 3: Completeness โ€” Weight 0.20#

Whether all features have acceptance criteria (AC) and edge cases have been identified.

Inspection Items#

  • Acceptance criteria: Given-When-Then AC exists for all features/requirements
  • Edge cases: Boundary values, empty inputs, concurrency, timeouts identified
  • Error scenarios: Failure behavior defined (retry, fallback, alerts)
  • Non-functional requirements: Performance, security, accessibility criteria specified

Scoring Criteria#

ScoreCriteria
0.0All features have AC + edge cases + error scenarios
0.2590%+ AC coverage, major edge cases identified
0.570%+ AC coverage, some edge cases missing
0.75Under 50% AC coverage, many edge cases missing
1.0Almost no AC, edge cases not considered

Dimension 4: Consistency โ€” Weight 0.20#

Whether there are no contradictions between sections and terminology is unified.

Inspection Items#

  • Terminology unity: Same term used for same concept (glossary exists)
  • Numeric consistency: Same values consistent throughout the document
  • Logical consistency: Premises in section A and conclusions in section B do not contradict
  • Priority consistency: Must/Should/May consistent across sections

Scoring Criteria#

ScoreCriteria
0.00 contradictions, fully unified terminology
0.251-2 minor inconsistencies
0.53-5 inconsistencies, some terminology mixed
0.751+ major contradictions, extensive terminology mixing
1.0Multiple severe contradictions, non-unified terminology

Dimension 5: Testability โ€” Weight 0.15#

Whether all requirements can be verified through automation or manual testing.

Inspection Items#

  • Measurable: Pass/Fail criteria exist for all requirements
  • Reproducible: Same conditions yield same results during test execution
  • Independent: Each requirement can be tested individually
  • Time-bound: Time limit for test completion specified (when applicable)

Scoring Criteria#

ScoreCriteria
0.0All requirements are automatically testable
0.2590%+ testable, remainder manually verifiable
0.570%+ testable
0.75Under 50% testable
1.0Most require subjective judgment

Final Score Calculation#

ambiguity_score = (lexical ร— 0.25) + (reference ร— 0.20) + (completeness ร— 0.20)
                + (consistency ร— 0.20) + (testability ร— 0.15)

Report Format#

## Ambiguity Evaluation Results

| Dimension | Score | Weight | Weighted Score | Key Findings |
|-----------|-------|--------|---------------|-------------|
| Lexical Precision | {0.0-1.0} | 0.25 | {calculated} | {findings} |
| Reference Clarity | {0.0-1.0} | 0.20 | {calculated} | {findings} |
| Completeness | {0.0-1.0} | 0.20 | {calculated} | {findings} |
| Consistency | {0.0-1.0} | 0.20 | {calculated} | {findings} |
| Testability | {0.0-1.0} | 0.15 | {calculated} | {findings} |
| **Total** | | | **{sum}** | **{verdict}** |

### Improvement Recommendations
1. {Specific improvement item}