Nextcraft
Olu Adeyemi

Olu Adeyemi

Conversation Designer · Dialogue flows, persona systems

Human-AI Product DesignerVerified
Match Score77%

Designed repair flows that reduced user frustration escalations by 35%. Authored a persona consistency framework now used company-wide.

7Artifacts
83Defense Score (avg)
8Microcredentials
3Competencies Mastered

Process Trace Summary

  1. Repository initializedJul 4

    Created project scaffold with README and license.

  2. First commit pushedJul 6

    Initial proof-of-concept with placeholder data.

  3. Evaluation harness addedAug 8

    Wired up 50-question regression suite with LLM-as-judge.

  4. Peer review feedbackAug 10

    Two reviewers flagged edge cases in retrieval fallback path.

  5. Iteration — fallback hardenedSep 12

    Added retry + validation; eval score improved 12 points.

  6. Final submissionSep 14

    Artifact submitted for oral defense scheduling.

Oral Defense Transcripts

Recorded Q&A from each verified oral defense session. Expand a session to read the transcript.

Q1

Walk us through the architecture of your artifact. Why did you choose this approach?

A

I chose a plan-and-execute topology because the task required multi-step retrieval with reflection. The plan node decomposes the query, sub-agents retrieve and draft in parallel, and a reflection node scores and routes for a second pass when below threshold.

Q2

What evaluation did you run, and what were the headline numbers?

A

I ran a 50-query regression suite scored by LLM-as-judge calibrated against a human panel (0.86 agreement). Baseline scored 71%; the reflection pass lifted it to 88% with a 14% latency cost, which stayed within budget.

Q3

Describe a failure mode you found and how you mitigated it.

A

Retrieval fallback returned stale context on schema changes. I added a freshness check + retry with a smaller context window, which reduced stale-grounded answers from 9% to under 2%.

Competency Progress

Agentic Interaction Patterns Mastered
Conversational UX In Progress
AI Transparency Patterns In Progress
Human-in-the-Loop Design In Progress
Prompt UXAvailable
Failure & Fallback DesignAvailable
Multimodal Interface Design Mastered
Trust & Calibration Mastered

Microcredential Verification

Conversational UXIssued Jun 17, 2026
89Verified
AI Transparency PatternsIssued Jul 17, 2026
90Verified
Agentic Interaction PatternsIssued Aug 17, 2026
91Verified