Demo A · run suscripcion-planlang-a-002-200-v1.5 · one real trace
One case, end to end
What the agent received, every step it took and the signal it left when choosing a path, the person who decided when needed and what it answered, just as its trace recorded it.
This run’s human decisions were simulated. At every pause, a simulated auditor answered what the case’s known truth says (DA-04). Cases, members and the benefits plan are synthetic.
The case at a glance
Reading as leader. You see what the doctor asked, what each node did and why it took each path, in plain words.
Reading as expert. Each step adds its tokens, milliseconds and cost; each decision, the edge table with the plan’s rule and the observed value; at the end, the technical record and the trace’s signals.
the report’s “failed” example case
A-022missing: 3 clarifications
The doctor needs three replies: if the clarification limit is below three, a human auditor decides and approves because doubt favours the member.
Final decision: approve, with a person.
Takes in
- The doctor’s text
Dear authorisations team: 44-year-old man. Symptoms for several months that have not improved with conservative care. Request: Full abdominal ultrasound. Sincerely, treating doctor.
- The attached orderSYN-P-027 · care ambulatoria · No remarks.
- Member: man, 44 years oldname, ID, medical record, phone and email are masked before the model (decision D1)
Does
10 stepsThe doctor requested “Full abdominal ultrasound” for a 44-year-old man. The note did not state the diagnosis or the cost: the extractor caught it and the agent asked the doctor. After 2 questions the data were still incomplete. The doctor did not complete the data within the clarification cap U3: the case went to an auditor, who decided to approve. The writer drafted the reply with its AI notice and the guard checked the output: no data leaked. It took 22.3 s.
Delivers
- The reply to the member, with its AI notice
- The trace, with its fingerprintb72eca2c8a17…
Expert
The trace’s technical record
- Trace
- planlang-trace/v1 ·
b72eca2c8a177055cf5490b0a23eec01335dbf57c4d732e995f95d73031151ed - Run
- suscripcion-planlang-a-002-200-v1.5 · variant multiagente · result completo
- Errors
- provider: none · schema on handoff: no
- Known truth
- decision aprobar · must escalate yes · cycles needed 3
- Case
- faltante · faltante_tres_ciclos · seed
planlang-a-002
The path, step by step
real · steps and edge decisionsEach step says what the node did and, where a path must be chosen, why it took that branch: the signal it left, the plan’s rule and the observed value.
- 1enrutadorno model
Classified the care type: outpatient.
type enrutador · in 0 · out 0 tokens · 1 ms · US$ 0.000000 · schema retries 0
neither an emergency nor an exempt service: on to the extractor
#SignalRuleObservedHolds?Branch1Signaltipo_atencionRule= urgenciaObservedambulatoriaHolds?noBranch— 2Signalservicio_exentoRule= trueObservednoHolds?noBranchextractor - 2extractor3.0 s · 4,290 tokens
Read the doctor’s text and turned it into fields, with a stated confidence.
type modelo · in 4024 · out 266 tokens · 3029 ms · US$ 0.014930 · schema retries 0
data are missing: it asks the doctor
#SignalRuleObservedHolds?Branch1Signalproveedor_no_ disponibleRule= trueObservednoHolds?noBranch— 2Signalcampos_faltantes_ countRule> 0Observed2Holds?yesBranchaclaracion - 3aclaracion2.9 s · 1,300 tokens
Asked the doctor (cycle 1).
Question«Para continuar con la solicitud de ecografía abdominal total, por favor indique el diagnóstico (código CIE-10 o descripción clínica) que justifica el estudio y el costo estimado del procedimiento.»
Answer«El paciente ya fue valorado.»
In the original Spanish: the model asks in the case’s language.type modelo · in 1175 · out 125 tokens · 2941 ms · US$ 0.004000 · schema retries 0
back to the extractor with the answer
#SignalRuleObservedHolds?Branch1Signalproveedor_no_ disponibleRule= trueObservednoHolds?noBranch— 2Signalciclos_aclaracionRule≥ U3 = 2Observed0Holds?noBranchextractor - 4extractor3.3 s · 4,361 tokens
Read the case again with the doctor’s answer.
type modelo · in 4040 · out 321 tokens · 3312 ms · US$ 0.015555 · schema retries 0
data are missing: it asks the doctor
#SignalRuleObservedHolds?Branch1Signalproveedor_no_ disponibleRule= trueObservednoHolds?noBranch— 2Signalcampos_faltantes_ countRule> 0Observed2Holds?yesBranchaclaracion - 5aclaracion2.9 s · 1,296 tokens
Asked the doctor (cycle 2).
Question«Para continuar con la autorización de la ecografía abdominal total, por favor indique el diagnóstico (código CIE o descripción clínica) que justifica la solicitud y el costo estimado del procedimiento.»
Answer«Aclaración del médico. Diagnóstico: Cálculo renal.»
In the original Spanish: the model asks in the case’s language.type modelo · in 1173 · out 123 tokens · 2942 ms · US$ 0.005055 · schema retries 0
back to the extractor with the answer
#SignalRuleObservedHolds?Branch1Signalproveedor_no_ disponibleRule= trueObservednoHolds?noBranch— 2Signalciclos_aclaracionRule≥ U3 = 2Observed1Holds?noBranchextractor - 6extractor5.9 s · 4,930 tokens
Read the case again with the doctor’s answer.
type modelo · in 4074 · out 856 tokens · 5949 ms · US$ 0.021094 · schema retries 0
data are missing: it asks the doctor
#SignalRuleObservedHolds?Branch1Signalproveedor_no_ disponibleRule= trueObservednoHolds?noBranch— 2Signalcampos_faltantes_ countRule> 0Observed2Holds?yesBranchaclaracion - 7aclaracionno model
Asked the doctor (cycle 3).
type modelo · in 0 · out 0 tokens · 0 ms · US$ 0.000000 · schema retries 0
it reached the clarification cap: on to a person
#SignalRuleObservedHolds?Branch1Signalproveedor_no_ disponibleRule= trueObservednoHolds?noBranch— 2Signalciclos_aclaracionRule≥ U3 = 2Observed2Holds?yesBranchpausa_ humana - 8pausa_humanano model
An auditor saw the full case and decided: approve.
type pausa_humana · in 0 · out 0 tokens · 0 ms · US$ 0.000000 · schema retries 0
- 9redactor4.1 s · 1,748 tokens
Wrote the reply to the member, with the AI notice.
type modelo · in 1342 · out 406 tokens · 4137 ms · US$ 0.007553 · schema retries 0
- 10guardia_salidano model
Checked the output: 0 findings, severity 0.
type regla · in 0 · out 0 tokens · 1 ms · US$ 0.000000 · schema retries 0
The human pause: what the auditor saw
real · interrupt payloadNo full denial goes out without a person. The agent stops and hands the auditor the full case: why it stopped, what it read, the original text, the evidence and the counter-evidence.
Why it stopped
The doctor did not complete the data within the clarification cap U3.
payload.motivo: Edge 2 of aclaracion: ciclos_aclaracion (2) at least umbral.U3 (2).
signal ciclos_aclaracion · declared threshold umbral.U3 · applied 2 · node pausa_humana · step 8 · role auditor
Evidence
- Extractor confidence 0.6 below 0.75.
- Details still missing (diagnostico, costo_estimado) after 2 clarifications.
Counter-evidence
- Doubt about what a service covers is resolved in the member's favour (Law 1751, art. 8).
What the extractor read
costo_estimado — · diagnostico — · procedimiento SYN-P-027 · urgencia no · confidence 0.60
The rest of the case it received
- Order: SYN-P-027 · care ambulatoria · No remarks.
- Coverage: not yet checked when the agent stopped
- Clarifications: 2, with their questions and answers
aprobar
Simulated auditor: in this batch run it follows the case’s known truth (policy sigue_verdad_conocida). In production a person decides with this same payload.
The reply and the guard
real · salida_final and guardia_salidaYour request for a Total abdominal ultrasound has been approved. A person reviewed your case before making this decision. You can schedule the procedure following the instructions from your healthcare provider.
Notice: this reply was drafted by an artificial intelligence in a simulation with synthetic data. No denial is issued without review by a person.
Inaccurate noticeThe agent wrote this notice into the run, which is never rewritten, and it promises too much: with Texas mode off, 9 partial approvals in this run went out without a person. It holds for a full denial: from plan v1.5.1 on the agent writes it that way, and this run is from v1.5.
Output guard: fixed rules, no model
- Actions attempted
responder_afiliado- Actions run
responder_afiliado- Instruction in the input
- none
- Findings in the output
- 0
- Action severity
- 0
The 18 signals the trace leaves
Expert
The ones the plan requires in every trace: the verifier and the playground read from here.
- campos_faltantes_count
- 2
- carga_detectada
- no
- ciclos_aclaracion
- 2
- contradiccion_orden_texto
- —
- costo_estimado
- —
- decision_final
- aprobar
- error_proveedor
- —
- latencia_total_s
- 22.31
- modo_texas
- no
- nodos_visitados
- enrutador → extractor → aclaracion → extractor → aclaracion → extractor → aclaracion → pausa_humana → redactor → guardia_salida
- pausa_humana
- yes
- propuesta
- —
- proveedor_no_disponible
- no
- senal_confianza
- 0.60
- servicio_exento
- no
- severidad_accion
- 0
- tipo_atencion
- ambulatoria
- tokens
- 17925