Decision Intelligence Analyst
Decision Intelligence Analyst
Team: Product
Location: Flexible / Remote
Reporting to: VP of Product
Role Overview
Rwazi’s platform produces decision-grade outputs powered by structured reasoning and AI-assisted judgment.
The Decision Intelligence Analyst owns decision quality.
This role evaluates system outputs, identifies reasoning weaknesses, and strengthens AI judgment through structured feedback and training loops.
It ensures the platform does not merely generate outputs — but generates sound, defensible decisions.
The Decision Intelligence Analyst is the quality control layer for decision intelligence.
Core Mandate
The Decision Intelligence Analyst is accountable for:
Evaluating decision outputs for logical integrity and sound reasoning
Identifying patterns of judgment failure or inconsistency
Designing structured feedback loops to improve AI reasoning
Training and refining AI judgment frameworks
Defining measurable standards for decision quality
This role governs the reliability of Rwazi’s decision engine.
Key Responsibilities
Decision Output Evaluation
Review system outputs for logical coherence and reasoning rigor
Assess signal interpretation accuracy
Identify tradeoff miscalculations or flawed inference pathways
Document recurring reasoning gaps
AI Judgment Training
Create structured examples to refine reasoning performance
Develop edge-case libraries for training robustness
Formalize evaluation rubrics for decision quality
Collaborate with R&D to improve reasoning architecture
Quality Standards & Metrics
Define measurable criteria for decision-grade output
Track improvements in reasoning consistency
Monitor drift in output quality over time
Establish acceptance thresholds for release
Failure Mode Analysis
Identify systemic reasoning weaknesses
Surface blind spots in signal modeling
Propose structured adjustments to logic layers
Escalate structural flaws early
Cross-Functional Collaboration
Partner with Product to align quality with roadmap goals
Collaborate with R&D on advanced reasoning improvements
Provide structured feedback to Engineering when system behavior deviates
Role Impact
Strong performance in this role results in:
Higher confidence in decision outputs
Reduced reasoning inconsistencies
Improved explainability
Faster detection of system drift
Stronger enterprise trust
This role protects the intellectual credibility of the platform.
What This Role Is Not
This is not general QA
This is not surface-level data validation
This is not simple output review
This role evaluates reasoning quality, not formatting correctness.
Qualifications and Profile
We are looking for individuals who demonstrate:
Strong analytical and logical reasoning ability
Experience evaluating AI systems, decision frameworks, or complex models
Comfort dissecting multi-step reasoning chains
Ability to formalize judgment criteria
Strong written clarity and structured thinking
Comfort working with ambiguity and edge cases
Candidates may come from applied AI evaluation, consulting, operations research, economics, philosophy of logic, or technically rigorous analytical fields.
Cultural Fit
We value analysts who:
Obsess over reasoning integrity
Question outputs rather than accept them
Care about intellectual rigor
Prefer structured evaluation over intuition
Are comfortable holding high standards
How Candidates Are Evaluated
Candidates are evaluated based on:
Their ability to critique and improve structured reasoning
Clarity of their evaluation frameworks
Depth of logical analysis
Ability to identify hidden failure modes
Their rigor in defining measurable quality standards
We prioritize demonstrated reasoning discipline over titles alone.
Summary
The Decision Intelligence Analyst safeguards the quality and integrity of Rwazi’s decision engine.
This role ensures that as AI capabilities expand, decision outputs remain structured, defensible, and enterprise-grade.