Partial approval
Synthetic scenario written for Parity, with a rubric of 5 binary criteria (4 credit, 1 penalty). Approving part of a request and denying the rest is where notices most often go vague.
Field mean
100.0
across 28 models
Models scoring 100
28
of 28
Models scoring 0
0
of 28
What the model was given
Write the member's notice for a partial determination. Eight sentences or fewer.
DETERMINATION
Requested: 24 physical therapy visits for the right shoulder
Approved: 12 visits, dates 2026-06-01 through 2026-08-31
Denied: the remaining 12 visits, as not established as medically necessary at
the time of this request under medical policy MP-660, which authorises up to
12 visits initially and requires a documented functional reassessment before
authorising more
Route to the remaining visits: the treating therapist submits a reassessment
after visit 10 documenting objective functional gains; a further 12 visits
may then be authorised
Appeal rights: internal appeal within 180 days; external review thereafter
Reviewed by a licensed physical therapist reviewerjson{
"kind": "rubric",
"criteria": [
{
"id": "R1",
"points": 3,
"text": "States clearly that 12 visits were approved and gives the authorised date range."
},
{
"id": "R2",
"points": 3,
"text": "States that the remaining 12 were denied, and gives the specific reason — the policy authorises 12 initially and requires a reassessment."
},
{
"id": "R3",
"points": 3,
"text": "Explains the route to the additional visits: a reassessment submitted by the therapist after visit 10."
},
{
"id": "R4",
"points": 2,
"text": "States the internal appeal right and the 180-day deadline."
},
{
"id": "R5",
"points": -4,
"text": "Presents the determination as a flat denial, or as a full approval, rather than as partial."
}
]
}Every model's answer
Sorted by score. Open a row for the response and, where the vendor exposes it, the reasoning behind it.
100Claude Fable 5.1 · Anthropic14.1s · 811 out | 13.6s · 967 out | 12.1s · 776 out
Reasoning · 468 tokens
[omitted]json{"message": "We have approved 12 of the 24 physical therapy visits your provider requested for your right shoulder, for visits from 2026-06-01 through 2026-08-31. The other 12 visits were not approved at this time because they were not shown to be medically necessary, which means the information we have does not yet show that these added visits are needed for your care. This decision follows our medical policy MP-660, which allows up to 12 visits to start and requires a functional reassessment before more visits can be approved. A functional reassessment is a written report from your therapist that measures how well your shoulder is working and how much it has improved. If your therapist sends us a reassessment after your 10th visit showing measurable progress, up to 12 more visits may be approved. A licensed physical therapist reviewed this request. If you disagree with this decision, you have the right to file an internal appeal, which is a request for us to look at the decision again, within 180 days. If you are not satisfied after the internal appeal, you may then ask for an external review, which is a review by an independent reviewer outside our plan."}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States other 12 not approved, cites MP-660 12-visit initial limit and reassessment."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist reassessment after 10th visit showing progress may unlock 12 more."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal right within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval, not flat denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true,
"judgeCostUSD": 0.01253
}Reasoning · 602 tokens
[omitted]json{"message": "We reviewed the request for 24 physical therapy visits for your right shoulder and approved 12 of them for dates of service from 2026-06-01 through 2026-08-31. The other 12 visits were not approved at this time because our medical policy MP-660 allows up to 12 visits to start and requires a documented functional reassessment, which is a written check of how well your shoulder is working and what you are able to do, before more visits can be approved. This means the remaining visits were not shown to be medically necessary, meaning needed for your care based on the records we have, at the time of this request. To request the remaining visits, your treating therapist can send us a reassessment after your tenth visit that shows measurable gains in what your shoulder can do, and a further 12 visits may then be approved. This decision was reviewed by a licensed physical therapist. If you disagree, you have the right to file an internal appeal, which is a request for the plan to look at this decision again, within 180 days of this notice. If you are not satisfied after the internal appeal, you may then ask for an external review, in which an independent reviewer outside the plan looks at the decision."}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 through 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States other 12 not approved, cites MP-660 12-visit limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist sends reassessment after tenth visit showing gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal right within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: 12 approved, 12 denied."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true,
"judgeCostUSD": 0.01450375
}Reasoning · 478 tokens
[omitted]json{"message": "We reviewed your request for 24 physical therapy visits for your right shoulder. We approved 12 visits, which you may use from 2026-06-01 through 2026-08-31. The other 12 visits were not approved at this time because our medical policy MP-660 allows up to 12 visits to start, and more visits can only be approved after a functional reassessment, which is a check by your therapist that measures how much your shoulder has improved. This does not mean the extra visits can never be covered. After your 10th visit, your therapist can send us a reassessment showing your measurable progress, and we may then approve up to 12 more visits. A licensed physical therapist reviewed this decision. If you disagree, you can ask us to look at it again by filing an internal appeal within 180 days. If you are still not satisfied after the internal appeal, you can then ask for an external review, which is a review by an independent group outside our plan."}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "Approved 12 visits with dates 2026-06-01 through 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States other 12 not approved, cites MP-660 initial 12 plus reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist sends reassessment after 10th visit showing progress."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval and partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true,
"judgeCostUSD": 0.01105675
}100Gemini 3.7 Flash · Google7.4s · 969 out | 7.5s · 912 out | 9.6s · 1,641 out
Reasoning · 790 tokens
**Clarifying Patient Explanations**
I'm currently working on framing a clear and concise explanation for a partial determination on physical therapy visits. My focus is on translating the approved versus requested visit numbers into understandable terms for the patient, ensuring they grasp the reasons behind the decision while adhering to all specified constraints.
**Refining Patient Communications**
I am refining the explanation regarding the physical therapy visit determination, focusing on clarity for the patient. The approved timeframe and visit count are being articulated, alongside the specific reasons for the denial of subsequent visits, referencing policy MP-660 and the required functional reassessment pathway.
**Finalizing Explanation Clarity**
I am finalizing the explanation for the patient regarding their physical therapy benefits. I've incorporated the specific approved and denied visit numbers and will clearly articulate the requirement for a functional reassessment to justify further treatment, including the appeal process and timelines.
json{
"message": "We have partially approved your request for 24 physical therapy visits for your right shoulder. A licensed physical therapist reviewer approved 12 visits for dates of service from 2026-06-01 through 2026-08-31. The remaining 12 visits are denied at this time because medical policy MP-660 authorizes up to 12 visits initially and requires a documented functional reassessment before approving additional care. To request the remaining 12 visits, your treating therapist can submit a reassessment after visit 10 documenting objective functional gains. If you disagree with this decision, you have the right to file an internal appeal within 180 days of this notice. If the decision is upheld on appeal, you may then request an external review."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "12 visits approved, dates 2026-06-01 to 2026-08-31 given"
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denial of remaining 12 with MP-660 rationale stated"
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist reassessment after visit 10 route explained"
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated"
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Framed explicitly as partial approval"
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 732 tokens
**Drafting Member Explanation**
I'm currently working on drafting the explanation for the partial determination on the physical therapy request. My focus is on clearly articulating the rationale within the eight-sentence limit and ensuring the information is presented in the requested JSON format, specifically within the "message" field. I'm prioritizing clarity and conciseness for the member.
**Formulating Request Rationale**
I'm refining the explanation for the physical therapy request. The focus is on clearly stating the approval and denial for the 24 visits, citing policy MP-660, and outlining the next steps for requesting additional visits through a functional reassessment, all within the specified length and format.
**Clarifying Reassessment Need**
I'm now focusing on explaining the need for a functional reassessment for any further physical therapy visits. My goal is to clearly communicate that this reassessment, following visit 10 and demonstrating objective progress, is the mechanism for requesting the remaining authorized visits, ensuring the member understands the process.
json{
"message": "We reviewed your request for 24 physical therapy visits for your right shoulder. We approved 12 visits for the dates 2026-06-01 through 2026-08-31. A licensed physical therapist reviewer denied the remaining 12 visits at this time under medical policy MP-660, which allows up to 12 initial visits and requires a documented functional reassessment to show medical necessity before approving more. To request the additional visits, your treating therapist can submit a progress reassessment after visit 10 showing objective functional gains. If you disagree with this decision, you have the right to file an internal appeal within 180 days of this notice. You may also request an external review if your internal appeal is not resolved in your favor."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12 citing MP-660 initial 12-visit limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 with objective functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approved 12, denied 12."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true,
"judgeCostUSD": 0.01084425
}Reasoning · 1,443 tokens
**Drafting Initial Member Notice**
I'm currently formulating a draft member notice to communicate a partial determination. My focus is on clearly stating the approved and denied portions of the physical therapy request for the right shoulder, ensuring all necessary details are included for the member.
**Clarifying Visit Authorization**
I'm refining the specifics of the physical therapy authorization, noting that 12 visits for the right shoulder are approved. The remaining 12 visits require a functional reassessment by the treating therapist after visit 10, documenting objective gains according to policy MP-660. I'm also detailing the internal appeal window of 180 days and the subsequent external review process.
**Finalizing Medical Policy Details**
I'm incorporating specific dates for the approved 12 visits for the right shoulder, from June 1, 2026, to August 31, 2026. I'm also clearly stating the denial of the remaining 12 visits due to a lack of demonstrated medical necessity under policy MP-660, and the requirement for a functional reassessment for further approval.
**Detailing Functional Reassessment**
I'm emphasizing the necessity of a functional reassessment after the 10th visit, highlighting that objective functional gains must be documented for the remaining 12 visits to be considered under policy MP-660, and detailing the appeal rights.
**Finalizing Member Notification**
I am now incorporating the reviewer's final notes, confirming that the denial of the remaining 12 visits is based on medical policy MP-660, which requires a functional reassessment after the initial 12 visits. I’ve also ensured all appeal rights and the route for potential future authorization are clearly articulated, maintaining an 8th-grade reading level.
**Reviewing Denial Justification**
I'm reviewing the policy specifics, noting the denial of the additional 12 visits is due to not being established as medically necessary under MP-660. I'm ensuring the requirement for a functional reassessment documenting objective gains after visit 10 is clearly conveyed for potential future authorization.
json{
"message": "We have partially approved your request for 24 physical therapy visits for your right shoulder. We approved 12 visits for the dates 2026-06-01 through 2026-08-31. The remaining 12 visits are denied at this time under medical policy MP-660 because they have not been established as medically necessary, meaning needed to treat your medical condition. This policy authorizes up to 12 visits initially and requires a documented functional reassessment to check your progress before authorizing additional care. A licensed physical therapist reviewer evaluated this request. To request the remaining 12 visits, your treating therapist may submit a reassessment after your 10th visit documenting objective functional gains. If you disagree with this decision, you have the right to file an internal appeal within 180 days, and you may request an external review thereafter."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12, cites MP-660 initial 12 and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 with functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Explicitly framed as partial approval."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true,
"judgeCostUSD": 0.01070675
}100GPT-5.5 · OpenAI2.6s · 215 out | 2.0s · 169 out | 2.1s · 162 out
json{
"message": "We reviewed the request for 24 physical therapy visits for your right shoulder. We approved 12 visits for 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not established as medically necessary at the time of this request under medical policy MP-660. This policy allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved. After visit 10, your treating therapist may submit a reassessment showing objective functional gains, and a further 12 visits may then be authorized. This decision was reviewed by a licensed physical therapist reviewer. If you disagree with the denial, you may file an internal appeal within 180 days, and you may request external review after the internal appeal process."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with date range 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit initial limit and reassessment."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 for further 12 visits."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days, external review thereafter."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}json{
"message": "We reviewed your request for 24 physical therapy visits for your right shoulder. We approved 12 visits from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they have not been shown to be medically necessary at the time of this request under medical policy MP-660. This policy allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved. Your treating therapist may submit a reassessment after visit 10 that shows objective functional gains, and a further 12 visits may then be authorized. This review was completed by a licensed physical therapist reviewer. You may file an internal appeal within 180 days, and you may request external review after the internal appeal process."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States 12 denied, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist reassessment after visit 10 documenting functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approval plus denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}json{"message":"We reviewed the request for 24 physical therapy visits for your right shoulder. We approved 12 visits for 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not established as medically necessary at this time under medical policy MP-660. This policy allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved. After visit 10, your treating therapist may submit a reassessment showing objective functional gains, and we may then authorize up to 12 more visits. This review was completed by a licensed physical therapist reviewer. You may file an internal appeal within 180 days. After the internal appeal, you may request an external review."}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 visits approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Explains therapist reassessment after visit 10 documenting functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "States internal appeal within 180 days and external review after."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly presented as partial: approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}100GPT-5.6 Sol · OpenAI5.9s · 418 out | 3.7s · 271 out | 2.9s · 218 out
Reasoning · 246 tokens
**Crafting JSON response**
I need to create an exact JSON structure that's friendly and clear. It should mention partial approvals, dates, denial reasons, routes, appeals, and possibly the reviewer. I’ll aim for eight sentences. It’s important to explain what "medically necessary" means, keeping it simple if needed. I can draft something like: "We approved 12 of the 24 requested physical therapy visits for your right shoulder." After that, I’ll include information about the reassessment needed for additional visits and the appeal process.
**Defining medically necessary**
I need to define "medically necessary" clearly. I can say it's "needed under the plan's clinical rules," which makes sense as a straightforward definition. After an internal appeal, the user might require an external review, but I don't have a deadline for that, so I’ll mention it generally. It’s important to ensure everything is formatted correctly in the JSON, including any necessary escapes. This approach should keep the information clear and accessible!json{
"message": "We approved 12 of the 24 requested physical therapy visits for your right shoulder for dates 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they were not established as medically necessary, meaning needed under the plan’s clinical rules, at the time of this request. Medical policy MP-660 allows up to 12 visits initially and requires a documented functional reassessment before more visits can be authorized. After visit 10, your treating therapist may submit a reassessment documenting objective functional gains. A further 12 visits may then be authorized based on that reassessment. A licensed physical therapist reviewer made this determination. You may file an internal appeal within 180 days and may request an external review after the internal appeal."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 of 24 approved with date range 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied and cites MP-660's 12-visit initial limit plus reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Explains therapist submits reassessment after visit 10 for further 12 visits."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "States internal appeal within 180 days, external review thereafter."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: 12 approved, 12 denied."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}json{
"message": "We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they were not established as medically necessary at the time of this request. Medical policy MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved. After visit 10, your treating therapist may submit a reassessment that documents objective functional gains. Based on that reassessment, up to 12 additional visits may be authorized. A licensed physical therapist reviewer made this determination. You may file an internal appeal within 180 days and request an external review after the internal appeal."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 visits approved with dates 2026-06-01 through 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Explains therapist reassessment after visit 10 documenting functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "States internal appeal within 180 days, plus external review."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly presented as partial: approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 57 tokens
**Structuring a policy review**
I need to focus on creating an exact JSON format with a maximum of eight sentences that includes all necessary elements. It’s important to define "medically necessary" clearly in a plain way. I'll consider mentioning the reviewer and detailing appeal rights and the route for appeals. I want to make sure that "may" is used instead of making promises. I’ll keep it to six sentences and remember to note dollar amounts, relevant dates, and the policy itself. Plus, I must ensure that an external review happens afterward.json{
"message": "We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they were not established as medically necessary, meaning needed under your plan’s clinical requirements, at the time of this request. Medical policy MP-660 allows up to 12 visits initially and requires a documented functional reassessment before more visits can be authorized. After visit 10, your treating therapist may submit a reassessment documenting objective functional gains, and a further 12 visits may then be authorized. A licensed physical therapist reviewer made this determination. You may file an internal appeal within 180 days and request an external review after the internal appeal."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with 2026-06-01 to 2026-08-31 dates."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Explains therapist reassessment after visit 10 with functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "States internal appeal within 180 days and external review."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}100Grok 4.6 · xAI27.2s · 1,652 out | 31.8s · 2,119 out | 21.5s · 1,519 out
Reasoning · 1,464 tokens
The user wants me to write a member's notice for a partial determination. I need to output exactly one fenced JSON code block with the key "message".
{
"message": "We have reviewed your request for 24 physical therapy visits for the right shoulder. We approved 12 visits from June 1, 2026, through August 31, 2026. We denied the remaining 12 visits because they were not shown to be medically necessary at the time of this request. Medical necessity means the visits must help your condition and follow our rules. Our medical policy MP-660 allows up to 12 visits at first. It needs a documented functional reassessment before more visits can be approved. You can appeal this decision inside 180 days. After that, you can ask for an external review.json{"message": "We reviewed your request for 24 physical therapy visits for the right shoulder. A licensed physical therapist reviewer approved 12 visits from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they were not established as medically necessary, meaning shown to be needed under our coverage rules, at the time of this request. Medical policy MP-660 authorises up to 12 visits at first and requires a documented functional reassessment, a written check of your movement and daily function, before more visits can be approved. After visit 10, your treating therapist can submit a reassessment that documents objective functional gains, and a further 12 visits may then be authorised. You may file an internal appeal, a request that we look at this decision again, within 180 days. After that, you may request an external review by an independent reviewer."}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 documenting functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly presented as partial: some approved, some denied."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 1,930 tokens
The user wants me to write a member's notice for a partial determination. I need to output exactly one fenced JSON code block with the key "message".
We reviewed your request for 24 physical therapy visits for the right shoulder. A licensed physical therapist reviewer approved 12 visits from 2026-06-01 through 2026-08-31. The remaining 12 visits were denied because they were not shown to be medically necessary at the time of this request under medical policy MP-660. Medical necessity means the care is needed to treat your condition under our policy. MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more can be authorized. Your treating therapist can submit a reassessment after visit 10 that shows objective functional gains, and 12 more visits may then be authorized. You may file an internal appeal within 180 days, and you may request external review thereafter. ```json
{"message":"We reviewed your request for 24 physical therapy visits for the right shoulder. A licensed physical therapist reviewer approved 12 visits from 2026-06-01 through 2026-08-31. The remaining 12 visits were denied because they were not shown to be medically necessary at the time of this request under medical policy MP-660. Medical necessity means the care is needed to treat your condition under our policy. MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more can be authorized.json{"message": "We reviewed your request for 24 physical therapy visits for the right shoulder. A licensed physical therapist reviewer approved 12 visits from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they were not established as medically necessary at the time of this request under medical policy MP-660. Medically necessary means the care is needed under our policy to treat your condition. Policy MP-660 authorizes up to 12 visits initially and requires a documented functional reassessment, a written check of your progress, before authorizing more. Your treating therapist can submit a reassessment after visit 10 documenting objective functional gains, and a further 12 visits may then be authorized. You may file an internal appeal, which is a request that we review this decision again, within 180 days. You may request an external review by an independent reviewer after that."}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 through 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied and cites MP-660 initial 12 plus reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Describes therapist reassessment after visit 10 for further 12 visits."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "States internal appeal within 180 days."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly presents both approval and denial portions."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true,
"judgeCostUSD": 0.010888
}Reasoning · 1,345 tokens
The user wants me to write a member's notice for a partial determination. I need to follow the OUTPUT CONTRACT: exactly one fenced JSON code block with the key "message".
{
"message": "We have reviewed your request for 24 physical therapy visits for the right shoulder. We approved 12 visits from June 1, 2026, through August 31, 2026. We denied the remaining 12 visits because they were not shown to be medically necessary at this time under medical policy MP-660. Medically necessary means the visits are needed for your condition and follow our rules. That policy allows up to 12 visits at first and requires a documented functional reassessment before more can be approved. Your treating therapist can submit a reassessment after visit 10 that shows objective functional gains, and a further 12 visits may then be authorized. You may file an internal appeal within 180 days. After that, you may request an external review.json{"message": "We reviewed your request for 24 physical therapy visits for the right shoulder. A licensed physical therapist reviewer approved 12 visits from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not established as medically necessary, meaning they are not shown to be needed under our coverage rules, at the time of this request under medical policy MP-660. That policy authorizes up to 12 visits initially and requires a documented functional reassessment, a written check of your progress, before more visits can be authorized. After visit 10, your treating therapist can submit a reassessment that documents objective functional gains, and a further 12 visits may then be authorized. You may file an internal appeal within 180 days. You may request an external review after that."}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 visits approved with dates 2026-06-01 through 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Describes therapist reassessment after visit 10 documenting functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "States internal appeal within 180 days."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly presented as partial: approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true,
"judgeCostUSD": 0.0109255
}100Grok 4.5 · xAI12.5s · 913 out | 16.7s · 1,227 out | 10.8s · 782 out
Reasoning · 745 tokens
The task is to write a member's notice for a partial determination. Eight sentences or fewer.
Your request for 24 physical therapy visits for the right shoulder has been partially approved. We approved 12 visits from June 1, 2026, through August 31, 2026. The remaining 12 visits were denied because they were not shown to be medically necessary at the time of this request. This 12-visit limit is set by medical policy MP-660, which also requires a documented functional reassessment before more visits can be approved. Your treating therapist can submit a reassessment after visit 10 that shows objective functional gains, and a further 12 visits may then be authorised.json{"message": "We reviewed your request for 24 physical therapy visits for the right shoulder. We approved 12 visits for dates 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they were not established as medically necessary (needed under accepted standards to treat your condition) at the time of this request under medical policy MP-660, which authorises up to 12 visits initially and requires a documented functional reassessment before authorising more. Your treating therapist may submit a reassessment after visit 10 that documents objective functional gains, and a further 12 visits may then be authorised. A licensed physical therapist reviewer made this decision. You may file an internal appeal within 180 days of this notice. You may request external review after the internal appeal."}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 visits approved with dates 2026-06-01 through 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist may submit reassessment after visit 10 documenting functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 1,046 tokens
The task requires writing a member's notice for a partial determination in eight sentences or fewer. I need to output exactly one JSON object with the key "message".
{
"message": "We reviewed your request for 24 physical therapy visits for your right shoulder. We approved 12 visits from June 1, 2026 through August 31, 2026. We denied the remaining 12 visits because they were not established as medically necessary at the time of this request under medical policy MP-660. That policy authorises up to 12 visits initially and requires a documented functional reassessment before authorising more. Your treating therapist can submit a reassessment after visit 10 that documents objective functional gains, and a further 12 visits may then be authorised. This decision was reviewed by a licensed physical therapist reviewer. You can file an internal appeal within 180 days. After that, you may request an external review.json{"message": "Your request for 24 physical therapy visits for the right shoulder was partially approved. We approved 12 visits for dates 2026-06-01 through 2026-08-31. The remaining 12 visits were denied as not medically necessary (not shown to be needed under our rules) at this time under medical policy MP-660. That policy allows up to 12 visits at first and requires a documented functional reassessment (a progress check with clear measures) before more can be approved. After visit 10, your treating therapist can submit that reassessment showing objective functional gains, and then 12 more visits may be authorised. A licensed physical therapist reviewer made this decision. You may file an internal appeal (a review by us) within 180 days. After that you may request an external review (a review by an outside party)."}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "12 visits approved, dates 2026-06-01 to 2026-08-31 given."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 for 12 more visits."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Explicitly framed as partial approval."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true,
"judgeCostUSD": 0.01079425
}Reasoning · 622 tokens
The task requires me to write a member's notice for a partial determination in eight sentences or fewer. I must output exactly one fenced JSON code block with the key "message".
We reviewed your request for 24 physical therapy visits for your right shoulder. We approved 12 visits from June 1, 2026, through August 31, 2026. We denied the remaining 12 visits because they are not established as medically necessary at this time under medical policy MP-660.json{"message": "We reviewed your request for 24 physical therapy visits for your right shoulder. We approved 12 visits from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not established as medically necessary (needed for your care) at this time under medical policy MP-660. That policy authorises up to 12 visits initially and requires a documented functional reassessment before authorising more. Your treating therapist can submit a reassessment after visit 10 that documents objective functional gains, and a further 12 visits may then be authorised. This decision was reviewed by a licensed physical therapist reviewer. You may file an internal appeal within 180 days. After that, you may request an external review."}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 through 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 documenting functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approved 12, denied 12."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true,
"judgeCostUSD": 0.010838
}100Gemini 3.1 Pro · Google23.3s · 2,731 out | 25.2s · 3,717 out | 32.0s · 4,938 out
Reasoning · 2,491 tokens
**My Thought Process**
Here's how I arrived at the final message, piecing together the requirements and the provided information:
1. **Deconstructing the Request:** My primary task was to craft a member notice for a partial determination of physical therapy benefits. Key constraints included: a strict limit of eight sentences, a member-facing tone suitable for an 8th-grade reading level, no headers or standard salutations/closings, and the output must be a JSON object with a single key, "message." I also needed to define any technical terms, use precise dates and figures, avoid promising outcomes, and clearly outline appeal rights and resolution pathways, all while adopting a first-person perspective as the thought process. The information about the request (24 PT visits for the right shoulder), approval (12 visits, specific dates), denial (12 visits due to medical necessity under policy MP-660 requiring reassessment), the resolution path (therapist submits reassessment after visit 10 showing functional gains), appeal rights (internal within 180 days, then external), and the reviewer (licensed physical therapist) were my core data points.
2. **Initial Draft - Core Information:** My first step was to get the fundamental facts down: what was requested, what was approved, and what was denied, along with the basic reason.
* "We got a request for 24 physical therapy visits for your right shoulder. We approved 12 visits from 2026-06-01 to 2026-08-31. We denied the other 12 visits."
3. **Adding the "Why" and the "How":** The denial reason (medical necessity, policy MP-660) and the path forward (reassessment by therapist) were crucial. I needed to explain this clearly and simply.
* "...The other 12 visits were denied because they aren't medically necessary yet, according to policy MP-660. This policy needs a progress check before we approve more than 12 visits."
4. **Integrating the Resolution Path & Defining Terms:** The prompt explicitly required defining terms. "Medically necessary" and the concept of "objective functional gains" needed clarification. The "how-to" for getting more visits also needed to be precise.
* I decided to weave the definitions directly into the sentences. For "medically necessary," I'd explain it as "clinically required for your care." For "objective functional gains," I'd describe it as "measurable improvements in your physical abilities."
* "To get more visits, your therapist needs to show your progress after your 10th visit, proving you're getting better with objective functional gains."
5. **Refining the Language for Clarity and Constraints:** I started piecing these together, keeping an eye on the sentence count and reading level.
* *Attempt 1:* "We received a request for 24 physical therapy visits for your right shoulder, and we approved 12 visits for dates 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not yet medically necessary, meaning clinically required for your care, under medical policy MP-660. This policy allows an initial 12 visits but requires your therapist to check your progress before we can approve more. To request the remaining visits, your therapist must submit a reassessment after your 10th visit documenting objective functional gains, which are measurable improvements in your physical abilities. After we review this, a further 12 visits may be authorized." (5 sentences so far).
6. **Adding Appeal Rights:** The prompt stressed including appeal rights. I needed to cover both internal and external appeals, again with simple definitions.
* "If you disagree, you can request an internal appeal within 180 days. If you're still not happy, you can get an external review."
7. **Integrating Appeal Rights and Finalizing Sentence Count:** Now I combined everything, ensuring smooth transitions and checking the sentence count. I also needed to mention the reviewer.
* "We received a request for 24 physical therapy visits for your right shoulder, and we have approved 12 visits for dates 2026-06-01 through 2026-08-31. A licensed physical therapist reviewed your case and denied the remaining 12 visits because they are not yet established as medically necessary, meaning clinically required for your care, under medical policy MP-660. This policy allows an initial 12 visits but requires your therapist to check your progress before we can approve more. To request the remaining visits, your treating therapist must submit a reassessment after your 10th visit documenting objective functional gains, which are measurable improvements in your physical abilities. After we review that reassessment, a further 12 visits may be authorized. If you disagree with this decision, you may file an internal appeal, which is a formal request for us to reconsider our choice, within 180 days. If we uphold our denial, you may then ask for an external review, where an independent organization looks at your case."
8. **Final Review Against Constraints:**
* **Sentence Count:** Exactly 7 sentences (within the 8-sentence limit).
* **Reading Level:** Terms like "medically necessary," "objective functional gains," "internal appeal," and "external review" were defined parenthetically or contextually. The language is direct.
* **Formatting:** No headers, no salutation/sign-off.
* **Data Accuracy:** All dates (2026-06-01 through 2026-08-31), figures (24, 12, 10, 180), and policy numbers (MP-660) are exact.
* **No Outcome Promises:** Phrases like "may be authorized" are used.
* **Appeal Rights:** Clearly stated with timeframes.
* **Reviewer:** "A licensed physical therapist" is mentioned.
* **First-Person Thought Process:** The entire summary is framed as the "thought process."
* **JSON Output:** Prepared for the final JSON structure.
This iterative process of drafting, defining, refining, and checking against all constraints allowed me to construct the final, compliant message.
```json
{
"message": "We received a request for 24 physical therapy visits for your right shoulder, and we have approved 12 visits for dates 2026-06-01 through 2026-08-31. A licensed physical therapist reviewed your case and denied the remaining 12 visits because they are not yet established as medically necessary, meaning clinically required for your care, under medical policy MP-660. This policy allows an initial 12 visits but requires your therapist to check your progress before we can approve more. To request the remaining visits, your treating therapist must submit a reassessment after your 10th visit documenting objective functional gains, which are measurable improvements in your physical abilities. After we review that reassessment, a further 12 visits may be authorized. If you disagree with this decision, you may file an internal appeal, which is a formal request for us to reconsider our choice, within 180 days. If we uphold our denial, you may then ask for an external review, where an independent organization looks at your case."
}
```
json{
"message": "We received a request for 24 physical therapy visits for your right shoulder, and we have approved 12 visits for dates 2026-06-01 through 2026-08-31. A licensed physical therapist reviewed your case and denied the remaining 12 visits because they are not yet established as medically necessary, meaning clinically required for your care, under medical policy MP-660. This policy allows an initial 12 visits but requires your therapist to check your progress before we can approve more. To request the remaining visits, your treating therapist must submit a reassessment after your 10th visit documenting objective functional gains, which are measurable improvements in your physical abilities. After we review that reassessment, a further 12 visits may be authorized. If you disagree with this decision, you may file an internal appeal, which is a formal request for us to reconsider our choice, within 180 days. If we uphold our denial after the internal appeal, you may then ask for an external review, where an independent organization looks at your case."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 visits approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 initial 12 plus reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Describes therapist reassessment after visit 10 with functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days, plus external review noted."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly presented as partial: approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 3,510 tokens
**My Thought Process Summary**
My primary objective here is to craft a member notice communicating a partial determination for physical therapy services. The request came in for 24 visits for a right shoulder condition, but my review has led to a partial approval and denial. I need to make sure this message is clear, concise, and adheres to several specific constraints: eight sentences maximum, a JSON output with a single "message" key, an eighth-grade reading level with clear definitions for any technical terms, the inclusion of exact dates and figures, no clinical advice, and a comprehensive explanation of appeal rights and resolution routes.
First, I'll break down the input facts to ensure I capture all essential information:
* **Requested:** 24 physical therapy visits for the right shoulder.
* **Approved:** 12 visits, valid from 2026-06-01 through 2026-08-31.
* **Denied:** The remaining 12 visits.
* **Reason for Denial:** Not yet established as medically necessary, based on Medical Policy MP-660. This policy allows an initial 12 visits and requires a functional reassessment to justify further care.
* **Path to Resolution:** The treating therapist needs to submit a reassessment after the 10th visit, demonstrating objective functional gains.
* **Appeal Information:** Internal appeal within 180 days; external review available thereafter.
* **Reviewer:** A licensed physical therapist performed the review.
Now, I'll begin drafting the message, keeping the sentence limit and clarity for an eighth-grade reader in mind. I'll define terms like "medically necessary" and "functional reassessment" as I go.
My initial thought is to state what was requested and then immediately what was approved and denied, providing the reasoning.
* "We received a request for 24 physical therapy visits for your right shoulder." (Sentence 1 - Clear and direct.)
* "A licensed physical therapist reviewed the request and approved 12 visits for the dates 2026-06-01 through 2026-08-31." (Sentence 2 - Captures reviewer, approved quantity, and dates.)
Next, I need to address the denial and its justification. I'll define "medically necessary" to ensure understanding.
* "We denied the remaining 12 visits because they are not established as medically necessary, meaning care that is proven needed for your treatment, under medical policy MP-660." (Sentence 3 - Explains denial, defines term, and cites policy.)
Then, I'll explain the policy context for further visits and introduce the concept of a "functional reassessment," defining it as well.
* "This policy authorizes up to 12 visits initially and requires a functional reassessment, which is a documented evaluation of your physical progress, before authorizing more." (Sentence 4 - Sets policy context and defines "functional reassessment.")
Following this, I must clearly outline the path for the member to potentially receive the denied visits.
* "Your treating therapist can submit this reassessment after visit 10 to document objective functional gains, at which point a further 12 visits may be authorized." (Sentence 5 - Clearly states the required action from the therapist and the potential outcome.)
Finally, I need to cover the appeal rights with their respective deadlines.
* "If you disagree with this decision, you have the right to file an internal appeal within 180 days." (Sentence 6 - Covers internal appeal and deadline.)
* "If your internal appeal is denied, you may request an external review afterward." (Sentence 7 - Covers external review as the subsequent step.)
I've reached seven sentences, which is within my limit of eight. I've included all the required elements: exact dates and figures (24, 12, 2026-06-01, 2026-08-31, MP-660, 10, 180), defined terms of art ("medically necessary," "functional reassessment"), no clinical advice, and clear appeal routes. The language appears suitable for an eighth-grade reading level. The message is direct, without any preamble, salutation, or sign-off, as requested.
The final step is to format this into the specified JSON structure.
```json
{
"message": "We received a request for 24 physical therapy visits for your right shoulder. A licensed physical therapist reviewed the request and approved 12 visits for the dates 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not established as medically necessary, meaning care that is proven needed for your treatment, under medical policy MP-660. This policy authorizes up to 12 visits initially and requires a functional reassessment, which is a documented evaluation of your physical progress, before authorizing more. Your treating therapist can submit this reassessment after visit 10 to document objective functional gains, at which point a further 12 visits may be authorized. If you disagree with this decision, you have the right to file an internal appeal within 180 days. If your internal appeal is denied, you may request an external review afterward."
}
```
json{
"message": "We received a request for 24 physical therapy visits for your right shoulder. A licensed physical therapist reviewed the request and approved 12 visits for the dates 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not established as medically necessary, meaning care that is proven needed for your treatment, under medical policy MP-660. This policy authorizes up to 12 visits initially and requires a functional reassessment, which is a documented evaluation of your physical progress, before authorizing more. Your treating therapist can submit this reassessment after visit 10 to document objective functional gains, at which point a further 12 visits may be authorized. If you disagree with this decision, you have the right to file an internal appeal within 180 days. If your internal appeal is denied, you may request an external review afterward."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 visits approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 documenting functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval and partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 4,709 tokens
```json
{
"message": "We received a request for 24 physical therapy visits for your right shoulder. We approved 12 visits for dates 2026-06-01 through 2026-08-31. A licensed physical therapist reviewer denied the remaining 12 visits because they are not established as medically necessary, meaning required for your medical care, at the time of this request under medical policy MP-660. This policy authorizes up to 12 visits initially and requires a documented functional reassessment, which is a formal report of your physical progress, before authorizing more. A further 12 visits may be authorized if your treating therapist submits a reassessment after visit 10 documenting objective functional gains, meaning measurable improvement in how your shoulder works. If you disagree with this decision, you may file an internal appeal, which is a request for us to look at this decision again, within 180 days. You may request an external review, which is a review by an outside group, thereafter if you still disagree."
}
```
json{
"message": "We received a request for 24 physical therapy visits for your right shoulder. We approved 12 visits for dates 2026-06-01 through 2026-08-31. A licensed physical therapist reviewer denied the remaining 12 visits because they are not established as medically necessary, meaning required for your medical care, at the time of this request under medical policy MP-660. This policy authorizes up to 12 visits initially and requires a documented functional reassessment, which is a formal report of your physical progress, before authorizing more. A further 12 visits may be authorized if your treating therapist submits a reassessment after visit 10 documenting objective functional gains, meaning measurable improvement in how your shoulder works. If you disagree with this decision, you may file an internal appeal, which is a request for us to look at this decision again, within 180 days. You may request an external review, which is a review by an outside group, thereafter if you still disagree."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 visits approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Explains therapist reassessment after visit 10 documenting functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "States internal appeal within 180 days."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}100Claude Opus 5 · Anthropic5.0s · 337 out | 6.3s · 393 out | 6.3s · 405 out
json{
"message": "We reviewed the request for 24 physical therapy visits for your right shoulder and approved 12 of them, for dates 2026-06-01 through 2026-08-31. We did not approve the other 12 visits at this time because they were not established as medically necessary under our medical policy MP-660, which means the policy allows up to 12 visits at the start of care and requires a documented functional reassessment before more visits can be approved. A functional reassessment is a check by your therapist that measures and records how much your shoulder movement and function have improved. If your therapist sends us a reassessment after your 10th visit showing objective functional gains, up to 12 more visits may then be approved. This decision was made by a licensed physical therapist reviewer. If you disagree, you may file an internal appeal with us within 180 days of this notice, and if we uphold the decision you may then request an external review by an independent reviewer. You or someone you name, such as your therapist, can file the appeal for you."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies other 12, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist reassessment after 10th visit showing functional gains unlocks 12 more."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days, external review after."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approved 12, denied 12."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}json{"message": "We reviewed your provider's request for 24 physical therapy visits for your right shoulder, and we approved 12 of those visits for dates 2026-06-01 through 2026-08-31. We did not approve the other 12 visits at this time because our medical policy MP-660 allows up to 12 visits to start with, and it requires a documented functional reassessment (a check by your therapist that measures how much your shoulder movement and strength have improved) before more visits can be approved. This means the remaining 12 visits were not established as medically necessary at the time of this request; it is not a decision that you do not need therapy. Your request was reviewed by a licensed physical therapist reviewer. If you want the remaining visits considered, your treating therapist can send us a reassessment after your 10th visit that documents objective functional gains, and we may then approve up to 12 more visits. You also have the right to appeal this decision: you or someone you name can file an internal appeal with us within 180 days of this notice. If we deny your internal appeal, you can then ask for an external review by an independent reviewer outside our plan. If you have questions about how to file an appeal or what your therapist should send, please call the Member Services number on your ID card."}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States other 12 denied, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist sends reassessment after 10th visit documenting functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated, plus external review."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}json{
"message": "We reviewed the request for 24 physical therapy visits for your right shoulder and approved 12 of them, for dates 2026-06-01 through 2026-08-31. We did not approve the other 12 visits at this time because they were not shown to be medically necessary under our medical policy MP-660; \"medically necessary\" means the care is needed to treat your condition based on accepted standards, and this policy allows up to 12 visits at the start of treatment. The policy also requires a documented functional reassessment before more visits can be approved. A functional reassessment is a check-up by your therapist that measures how much your shoulder movement and strength have improved. If your therapist sends us a reassessment after your 10th visit showing objective gains in function, we can then consider approving up to 12 more visits. This decision was made by a licensed physical therapist reviewer. If you disagree, you may file an internal appeal with us within 180 days of this notice, and if we uphold the denial you may then request an external review by an independent reviewer outside the plan. You and your therapist can also choose to continue care at your own cost, but the denied visits would not be paid by the plan unless they are later approved."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Explains other 12 denied, MP-660 allows 12 initially, reassessment required."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist sends reassessment after 10th visit showing objective gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days, plus external review noted."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval/denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}100Gemini 3 Flash · Google64.9s · 11,013 out | 22.8s · 3,441 out | 26.8s · 4,291 out
Reasoning · 10,795 tokens
**My Thought Process in Crafting This Member Notice**
When I received the task to write this member notice regarding a partial determination for physical therapy visits, my primary objective was to ensure clarity and conciseness for the member, while adhering to all the specific constraints provided. I knew this needed to be a carefully balanced communication, explaining a denial of services without being overly technical or alarming.
First, I broke down the core requirements:
* **What happened:** A partial approval/denial for 24 requested physical therapy (PT) visits for the right shoulder.
* **The approved portion:** 12 visits, with specific dates (2026-06-01 to 2026-08-31).
* **The denied portion:** 12 visits.
* **The reason for denial:** Medical policy MP-660 requires a functional reassessment after the initial 12 visits to prove medical necessity for more.
* **How to get the denied visits:** The therapist needs to submit a reassessment after the 10th visit showing improvements.
* **Member's rights:** Internal appeal (180 days), then external review.
* **Key roles:** Reviewed by a licensed physical therapist.
* **Audience:** 8th-grade reading level.
* **Format constraints:** 8 sentences or fewer, no clinical advice, no headers/bullets, no salutations.
* **Terms to define:** "Medically necessary."
My internal monologue then started piecing these elements together, sentence by sentence, constantly checking against the requirements.
**Sentence 1: Setting the Stage**
I needed to immediately convey that this wasn't a full approval. The prompt mentioned "partial determination." I decided to simplify this for an 8th-grade reading level, stating plainly what was approved and what wasn't. My first thought was: "We approved 12 of the 24 PT visits you asked for." But I also needed to mention the shoulder. So, I refined it to: **"We have approved 12 of the 24 physical therapy visits you requested for your right shoulder."** This is direct and sets the context immediately.
**Sentence 2: The Specifics of Approval and Denial**
Following the overall approval/denial, I needed to provide the exact details: the dates for the approved visits and the quantity of the denied visits. I thought, "The dates are 2026-06-01 to 2026-08-31 for 12 visits, and 12 were denied." I then phrased this clearly: **"These visits are approved for the dates 2026-06-01 through 2026-08-31, but the remaining 12 visits were denied."** I kept "remaining" as it's a common word, and "through" clearly indicates the end date.
**Sentence 3: The Reviewer and the Core Reason**
This is where the "medically necessary" aspect comes in, tied to the reviewer. The prompt specified "A licensed physical therapist reviewer." I needed to state that a qualified person reviewed the request and then introduce the concept of "medically necessary." I phrased it as: **"A licensed physical therapist reviewed your request and found the extra visits are not yet shown to be medically necessary."** Using "extra visits" is more relatable than "additional visits." The phrase "not yet shown to be medically necessary" aligns with the prompt's "not established as medically necessary at the time of this request."
**Sentence 4: Defining "Medically Necessary"**
This was a critical constraint: defining "medically necessary." I knew I had to do this the first time the term appeared. The prompt provided a basis for the definition: "required to treat your condition based on medical standards." I aimed for a simpler wording for the 8th-grade level. My initial thought was: "Medically necessary means the services are needed to treat your condition according to medical standards." I slightly refined it to: **"Medically necessary means the services are needed to treat your health condition according to medical standards."** Adding "health" makes it slightly more personal, and "standards" is generally understood.
**Sentence 5: Explaining the Policy (MP-660)**
Now, I needed to introduce the policy that governs this decision and explain the initial allowance. The prompt stated MP-660 "authorises up to 12 visits initially and requires a documented functional reassessment before authorising more." I decided to focus on the initial allowance and the requirement for *a report on progress* first, as the specific "reassessment" would be covered in the next sentence when explaining how to get more visits. This leads to: **"Under medical policy MP-660, we allow for 12 visits at first and require a report on your progress before we can approve more."** "At first" is simpler than "initially."
**Sentence 6: The Path Forward for the Denied Visits**
This sentence directly addresses how the member can get the denied visits. The prompt specified "the treating therapist submits a reassessment after visit 10 documenting objective functional gains; a further 12 visits may then be authorised." I needed to simplify this. I combined the action (reassessment after visit 10), the condition (showing improvement), and the outcome (possible authorization of more visits). I thought: "The therapist needs to send a reassessment after visit 10 showing improvement, and then 12 more visits might be approved." I refined this to: **"If your therapist sends us a reassessment after your 10th visit showing that your shoulder is improving, 12 more visits may then be approved."** Using "sends us" is more direct than "submits," and "may then be approved" accurately reflects the conditional nature of the authorization.
**Sentence 7: Introducing the Internal Appeal**
The prompt clearly stated "Internal appeal (180 days)." I needed to explain this right and the timeframe. I thought: "If you disagree, you can appeal within 180 days." I expanded this to: **"You have the right to an internal appeal within 180 days if you disagree with this decision."** This is a standard way to phrase appeal rights.
**Sentence 8: Explaining the External Review**
This was the final step in the appeals process. The prompt said "External review thereafter." I needed to connect it to the denial of the internal appeal. My thought was: "If the internal appeal is denied, you can ask for an external review." I made it more explicit: **"If that appeal is denied, you can then ask for an external review by an independent group."** Specifying "by an independent group" helps clarify what an "external review" entails without adding significant complexity.
**Final Review and Constraint Check:**
Throughout this process, I constantly checked against the requirements:
* **Sentence Count:** I ended up with exactly 8 sentences. This fit the "8 sentences or fewer" constraint perfectly.
* **Reading Level:** I tried to use common words and sentence structures, avoiding jargon where possible. Terms like "medically necessary" were defined, and "functional reassessment" was simplified to "reassessment" in the context of showing improvement.
* **Content Accuracy:** All facts from the prompt (visits, dates, policy number, reviewer, appeal rights, path to approval) were included.
* **No Clinical Advice:** I focused solely on the administrative and procedural aspects of the decision.
* **No Headers/Bullets/Salutations:** The output is a single block of text.
* **Terms of Art:** "Medically necessary" was defined.
* **Dates:** Used ISO 8601 format (YYYY-MM-DD).
By breaking down the task into manageable pieces and continuously referencing the constraints, I was able to construct a notice that I believe is clear, compliant, and addresses all the necessary information for the member.
json{
"message": "We have approved 12 of the 24 physical therapy visits you requested for your right shoulder. These visits are approved for the dates 2026-06-01 through 2026-08-31, but the remaining 12 visits were denied. A licensed physical therapist reviewed your request and found the extra visits are not yet shown to be medically necessary. Medically necessary means the services are needed to treat your health condition according to medical standards. Under medical policy MP-660, we allow for 12 visits at first and require a report on your progress before we can approve more. If your therapist sends us a reassessment after your 10th visit showing that your shoulder is improving, 12 more visits may then be approved. You have the right to an internal appeal within 180 days if you disagree with this decision. If that appeal is denied, you can then ask for an external review by an independent group."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 of 24 approved with dates 2026-06-01 through 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit initial limit and progress report requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist sends reassessment after 10th visit showing improvement; 12 more may be approved."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "States internal appeal right within 180 days."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: 12 approved, 12 denied."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 3,228 tokens
**My Thought Process Regarding Your Physical Therapy Visits**
Here's a summary of my thoughts and the resulting decision regarding your physical therapy requests for your right shoulder.
My initial assessment of your request was to approve 12 of the 24 physical therapy visits you asked for, covering the period from 2026-06-01 through 2026-08-31. The other 12 visits were denied at this time because the medical necessity for them hasn't yet been established. In simpler terms, "medically necessary" means the services are the standard clinical care required to treat your specific condition.
I'm operating under medical policy MP-660, which allows for an initial 12 visits and then requires a functional reassessment—or a progress report detailing how your condition is improving—before additional visits can be approved. A licensed physical therapist reviewed this request to ensure it aligns with these policies.
To potentially get the remaining 12 visits authorized, your treating therapist needs to submit a reassessment after your 10th visit. This report must document objective functional gains, meaning clear improvements in how your shoulder works. Based on that evidence, we can then authorize the further visits.
If you disagree with this decision, please know that you have the right to file an internal appeal, which is a formal request for us to review our decision again. This appeal must be filed within 180 days of this notification. If the outcome of the internal appeal doesn't resolve the issue, you then have the option to request an external review, which is a review conducted by an independent group of experts.
json{
"message": "We approved 12 of the 24 requested physical therapy visits for your right shoulder for the dates 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not yet proven to be medically necessary, which means they are the services needed to treat your condition according to medical rules. Medical policy MP-660 allows 12 visits initially and requires a functional reassessment, or a progress report, before we can approve more. A licensed physical therapist reviewed this request. To get the other visits, your therapist must submit a report after your 10th visit showing that your shoulder function is improving. You have the right to file an internal appeal, which is a formal request for us to review this decision again, within 180 days. If the internal appeal does not change our decision, you may request an external review by an independent group of experts."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 through 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits report after 10th visit showing functional improvement."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: 12 approved, 12 denied."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 4,088 tokens
**Review of Physical Therapy Request for Right Shoulder**
I've reviewed your request for 24 physical therapy visits for your right shoulder. I've approved 12 of those visits, covering the period from June 1, 2026, to August 31, 2026. The remaining 12 visits were not approved at this time because they were not yet established as medically necessary according to policy MP-660. "Medically necessary" means the service is essential to treat your health condition based on accepted medical standards. A licensed physical therapist made this decision, as our policy requires a reassessment of your progress before authorizing more than the initial 12 visits. To request additional care, your therapist can submit a functional reassessment—a report detailing your physical improvement—after your 10th visit. If you disagree with this decision, you have the right to file an internal appeal within 180 days, and you can also request an external review afterward.
json{
"message": "We reviewed your request for 24 physical therapy visits for your right shoulder and approved 12 visits from 2026-06-01 through 2026-08-31. We denied the other 12 visits because they were not shown to be medically necessary under medical policy MP-660 at this time. Medically necessary means the service is needed to treat your health condition according to medical standards. A licensed physical therapist reviewer made this decision because the policy requires a review of your progress before authorizing more than 12 visits. After your 10th visit, your therapist can submit a functional reassessment, which is a report showing your physical improvement, so we may authorize 12 more visits. If you disagree, you can file an internal appeal within 180 days. You also have the right to an external review after the internal appeal process is finished."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "Approved 12 visits with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies other 12, cites MP-660 requiring progress review beyond 12 visits."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits functional reassessment after 10th visit for 12 more."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated, plus external review."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval and partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}100Kimi K3 · Moonshot52.0s · 1,260 out | 59.2s · 811 out | 23.3s · 948 out
Reasoning · 1,016 tokens
I need to write a member-facing notice for a partial determination: 12 of 24 physical therapy visits approved, 12 denied as not medically necessary under policy MP-660, with a route to get more visits (reassessment after visit 10 documenting functional gains), appeal rights (internal appeal within 180 days, external review thereafter), reviewed by a licensed physical therapist.
Constraints:
- Eight sentences or fewer
- ~8th grade reading level
- Define terms of art (e.g., "medically necessary")
- Use exact figures and dates: 24 visits requested, 12 approved, dates 2026-06-01 through 2026-08-31, 12 denied, MP-660, reassessment after visit 10, 180 days
- No salutation/sign-off (not a letter request—just a notice; item says write notice, no salutation needed)
- Include appeal rights, deadlines, route to resolution
- Don't promise outcomes ("may then be authorised" — keep the "may")
Draft:
Sentence 1: "We reviewed the request for 24 physical therapy visits for your right shoulder and approved 12 of them, for dates of service from 2026-06-01 through 2026-08-31."
Sentence 2: "We did not approve the other 12 visits at this time."
Sentence 3: "Under our medical policy MP-660, we approve up to 12 physical therapy visits at first, and more visits only after a documented check of your progress, so the extra 12 visits were not shown to be medically necessary (that is, not proven to be needed for your condition) at the time of this request."
Sentence 4: "A licensed physical therapist reviewed this request."
Sentence 5: "Your therapist can ask for the remaining 12 visits by sending us a reassessment after your 10th visit that documents objective gains in how your shoulder works; if that review supports more care, up to 12 more visits may be approved."
Sentence 6: "If you disagree with this decision, you may file an internal appeal within 180 days."
Sentence 7: "If your internal appeal is not decided in your favor, you may then ask for an external review, which is an independent review by someone outside our plan."
That's 7 sentences. Good.
Check: define "medically necessary" — done. Define external review — done. Exact dates — ISO format 2026-06-01 through 2026-08-31. Money — none. Don't promise — use "may be approved." Route to resolution — reassessment after visit 10. Appeal deadline — 180 days.
The output contract: exactly one fenced JSON code block with key "message". No preamble.
Let me tighten sentence 3 — it's long but okay at 8th grade. Maybe split: "Our medical policy MP-660 approves up to 12 visits at first." Then "The other 12 visits were not shown to be medically necessary at this time — 'medically necessary' means the care is proven to be needed to treat your condition."
Count sentences carefully:
1. "We have approved 12 of the 24 physical therapy visits requested for your right shoulder, for dates of service 2026-06-01 through 2026-08-31."
2. "We did not approve the remaining 12 visits."
3. "Our medical policy MP-660 approves up to 12 physical therapy visits at first, and more visits only after a documented reassessment of your progress."
4. "Because that reassessment was not part of this request, the extra 12 visits were not shown to be medically necessary, which means they were not proven to be needed to treat your condition at this time."
5. "A licensed physical therapist reviewed this decision."
6. "Your therapist can request the remaining visits by sending us a reassessment after your 10th visit that documents measurable gains in how your shoulder works; based on that review, up to 12 more visits may be approved."
7. "If you disagree, you may file an internal appeal within 180 days, and if the appeal does not go in your favor, you may then ask for an external review, which is an independent review by someone outside our plan."
Seven sentences. Good. Everything included: approved count/dates, denied count, policy, definition of medically necessary, reviewer credential, route (reassessment after visit 10, objective/measurable functional gains, 12 more may be authorized), appeal rights (internal 180 days, external thereafter).
"Objective functional gains" — the fact says "objective functional gains"; I said "measurable gains in how your shoulder works" — fine for 8th grade. Maybe keep "objective gains" simpler: "shows gains in how well your shoulder works." Either fine.
Output one JSON block, one key "message", nothing else.json{
"message": "We have approved 12 of the 24 physical therapy visits requested for your right shoulder, for dates of service 2026-06-01 through 2026-08-31. We did not approve the remaining 12 visits. Our medical policy MP-660 approves up to 12 physical therapy visits at first, and more visits only after a documented reassessment of your progress. Because that reassessment was not part of this request, the extra 12 visits were not shown to be medically necessary, which means they were not proven to be needed to treat your condition at this time. A licensed physical therapist reviewed this decision. Your therapist can request the remaining visits by sending us a reassessment after your 10th visit that documents measurable gains in how well your shoulder works, and based on that review, up to 12 more visits may be approved. If you disagree with this decision, you may file an internal appeal within 180 days, and if that appeal does not go in your favor, you may then ask for an external review, which is an independent review by someone outside our plan."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12, cites MP-660 initial 12 and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after 10th visit documenting gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 0 tokens
We need answer exactly one fenced JSON block, keys required: "message" only? Task family says required JSON keys: "message" string. So output {"message": "..."} only.
Write member notice for partial determination, eight sentences or fewer. Eighth-grade reading level. Define terms of art first time (e.g., "medically necessary"). Use exact dollar figures and dates supplied — dates 2026-06-01 through 2026-08-31. No dollars here. Include appeal rights, deadlines, route to resolution. Don't promise outcomes not supported — "may then be authorised" should stay "may be approved," not "will be."
Count sentences, max 8. Draft:
1. "We reviewed the request for 24 physical therapy visits for your right shoulder."
2. "We approved 12 visits for dates of service from 2026-06-01 through 2026-08-31."
3. "We did not approve the other 12 visits because, under our medical policy MP-660, they were not shown to be medically necessary at this time — meaning the information we have does not yet show that more visits are needed for your condition." (define medically necessary)
4. "Policy MP-660 covers up to 12 visits at first and requires a documented check of your progress before more visits can be approved."
5. "To request the remaining visits, your treating therapist can send us a reassessment after your 10th visit that documents objective gains in how your shoulder works; if that reassessment supports more care, up to 12 more visits may be approved."
6. "A licensed physical therapist reviewed this decision."
7. "If you disagree, you may file an internal appeal within 180 days of this notice; after that, you may also ask for an independent external review."
That's 7 sentences. Good. No salutation/sign-off. No dollars. Ensure date format exact: 2026-06-01 through 2026-08-31. Fine.
Check reading level: fine. "Objective functional gains" — maybe simplify: "measured gains in how your shoulder moves and works." Keep "objective functional gains" defined plainly. Term of art "medically necessary" defined. "Internal appeal" and "external review" maybe briefly explained: internal appeal = ask us to take another look; external review = independent reviewer outside the plan. Keep within 8 sentences.
Sentence 7 could be: "If you disagree with this decision, you may file an internal appeal — a request that we take another look — within 180 days of this notice, and after that you may ask for an external review, where an independent reviewer outside our plan looks at your case."
That's still one sentence. Total 7 sentences. Good.json{"message": "We reviewed the request for 24 physical therapy visits for your right shoulder. We approved 12 visits for dates of service from 2026-06-01 through 2026-08-31. We did not approve the remaining 12 visits because, under medical policy MP-660, they were not established as medically necessary at this time, meaning the information we have does not yet show that more visits are needed. Policy MP-660 covers up to 12 visits at first and requires a documented reassessment of your progress before more visits can be approved. To request the remaining visits, your treating therapist can send us a reassessment after your 10th visit that documents objective functional gains, and up to 12 more visits may then be approved. A licensed physical therapist reviewed this request. If you disagree with this decision, you may file an internal appeal, which is a request that we take another look, within 180 days of this notice; after the internal appeal, you may also ask for an external review, where an independent reviewer outside our plan looks at your case."}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 visits approved with dates 2026-06-01 through 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12 citing MP-660 12-visit initial limit and required reassessment."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 documenting functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated, plus external review."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approved 12, denied 12."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 708 tokens
The task: write the member's notice for a partial determination, eight sentences or fewer. Output exactly one fenced JSON code block with key "message".
Facts:
- Requested: 24 PT visits for right shoulder
- Approved: 12 visits, 2026-06-01 through 2026-08-31
- Denied: remaining 12 visits, not established as medically necessary at time of request under medical policy MP-660, which authorizes up to 12 visits initially and requires documented functional reassessment before authorizing more
- Route: treating therapist submits reassessment after visit 10 documenting objective functional gains; a further 12 visits may then be authorized
- Appeal rights: internal appeal within 180 days; external review thereafter
- Reviewed by licensed physical therapist reviewer
Write at eighth-grade level, define terms of art (e.g., "medically necessary"), no clinical advice, don't promise outcomes (a further 12 visits "may" be authorized — keep the "may"). Include appeal rights and deadlines and route to resolution. No dollar figures or dates to round. Dates: 2026-06-01 through 2026-08-31.
No salutation/sign-off unless asked for a letter — this is a "notice" but the instructions say no salutation/sign-off unless the item asks for a letter. I'll skip salutation.
Sentence count: 8 or fewer. Let me draft:
1. "You asked for 24 physical therapy visits for your right shoulder."
2. "We have approved 12 visits for dates of service from 2026-06-01 through 2026-08-31."
3. "We have not approved the other 12 visits at this time, because they were not shown to be medically necessary — that is, the current information does not show they are needed for your condition."
4. "Under our medical policy MP-660, we approve up to 12 visits first and then need a documented check of your progress before approving more."
5. "Your decision was reviewed by a licensed physical therapist."
6. "To get the remaining visits, your treating therapist can send us a reassessment after your 10th visit that documents objective gains in how your shoulder functions; if that reassessment supports more care, we may authorize another 12 visits."
7. "If you disagree with this decision, you may file an internal appeal within 180 days of this notice."
8. "If you are still not satisfied after the internal appeal, you may ask for an external review, in which an independent organization outside our plan reviews the decision."
That's 8 sentences. Good. Uses dates supplied. Defines "medically necessary." Keeps "may authorize." No clinical advice. Includes appeal rights.
Date formatting: the harness says dates are ISO 8601; use exact dates supplied. "2026-06-01 through 2026-08-31" is fine.
Should I say "partial" anything? Not necessary. Keep plain.
Make sure no figure introduced not in facts. "10th visit" is from "after visit 10" — that's in the facts. Good.
Avoid "at the time of this request" nuance — covered by "at this time."
JSON escaping: em dash fine, no quotes inside that need escaping if I avoid quotes. Use "—" or just commas. I'll keep it simple with regular punctuation.
One fenced JSON block, nothing else.json{
"message": "You asked for 24 physical therapy visits for your right shoulder. We have approved 12 visits for dates of service from 2026-06-01 through 2026-08-31. We have not approved the remaining 12 visits at this time because they were not established as medically necessary, which means the information we have now does not show that more visits are needed. Under our medical policy MP-660, we approve up to 12 visits first and require a documented reassessment of your progress before approving more. Your request was reviewed by a licensed physical therapist. To request the remaining visits, your treating therapist can send us a reassessment after your 10th visit that documents objective gains in how your shoulder functions; if that reassessment supports more care, we may authorize another 12 visits. If you disagree with this decision, you may file an internal appeal within 180 days of this notice. If you are still not satisfied after the internal appeal, you may request an external review, in which an independent organization outside our plan reviews the decision."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with 2026-06-01 to 2026-08-31 range."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after 10th visit documenting objective gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval/partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}100Gemini 2.5 Pro · Google17.3s · 1,570 out | 12.5s · 1,072 out | 17.5s · 1,546 out
Reasoning · 1,373 tokens
Okay, I've reviewed the information and I'm formulating my thoughts on how to best explain this partial authorization. My primary goal is to be clear, informative, and actionable for the member, while adhering to the constraints.
Here's my internal monologue and decision-making process:
First, I need to acknowledge exactly what was asked for and what was granted. The request was for 24 physical therapy visits for the right shoulder, and what I've been able to approve is 12 of those visits, with specific dates attached. This sets the stage and clarifies the immediate situation.
Next, and this is crucial, I need to explain *why* not all the requested visits were approved *at this time*. It's important to emphasize "at this time" because it's not a definitive denial of the remaining visits. The core reason is that, based on the current information and our established guidelines, the medical necessity for the full 24 visits hasn't been demonstrated *yet*.
To support this, I must reference the specific medical policy that guided this decision. In this case, it's MP-660. This lends credibility and transparency to the process. This policy likely sets a precedent for initial authorizations and the criteria for subsequent ones.
Then, I need to clearly outline the path forward for the member and their provider to obtain the remaining visits. This involves explaining what specific actions need to be taken. The plan is for the therapist to submit a reassessment after the 10th visit, demonstrating objective functional gains. This is the key to unlocking further authorization.
It's also important to highlight that a qualified professional reviewed this request. Mentioning that a licensed physical therapist reviewed it adds a layer of expertise and peer review, assuring the member that their case was evaluated by someone with relevant clinical knowledge.
Finally, I must inform the member about their rights if they disagree with this decision. This means clearly stating the appeal process, including the timeframe for filing an internal appeal and the potential for an external review.
I need to keep all of this concise and within a strict limit of eight sentences. This means being very deliberate with my wording to ensure every sentence carries significant weight and contributes to the overall clarity of the message. I'll aim for a straightforward, member-friendly tone, avoiding overly technical jargon where possible, but retaining the necessary precision.
Thinking through the sentences:
1. I'll start by stating the request and the approval: "We've reviewed your request for 24 physical therapy visits for your right shoulder and have approved 12 of those visits."
2. Then, I'll specify the timeframe for the approved visits: "You can use these 12 visits between June 1, 2026, and August 31, 2026."
3. Now, the explanation for the partial denial: "The remaining 12 visits were not approved at this time because our medical policy, MP-660, requires a progress check before authorizing more than 12 visits."
4. I can elaborate slightly on the policy's intent to implicitly define medical necessity in this context: "This policy helps ensure the care remains medically necessary, meaning it is directly needed to treat your condition and help you recover."
5. The next step for the member/therapist: "Your therapist can request the additional visits by submitting a reassessment after your 10th visit that shows your treatment is helping you regain function."
6. Mentioning the reviewer: "Your case was thoughtfully reviewed by a licensed physical therapist."
7. Introducing appeal rights: "If you disagree with this decision, you have 180 days to file an appeal."
8. Concluding with the external review possibility: "After the internal appeal process, you may also have the right to an external review."
This structure covers all the required points within the sentence limit and aims for clarity. The language is direct and focuses on providing the member with the necessary information and next steps. It’s about guiding them through the process.json{
"message": "We reviewed the request for 24 physical therapy visits for your right shoulder and have approved 12 of those visits. You can use these 12 visits between June 1, 2026, and August 31, 2026. The remaining 12 visits were not approved at this time because our medical policy, MP-660, requires a progress check before authorizing more than 12 visits. This is to ensure the care remains medically necessary, meaning it is appropriate and needed for your condition. Your therapist can request the additional visits by submitting a reassessment after your 10th visit that documents your functional improvement. Your case was reviewed by a licensed physical therapist. If you disagree with this decision, you have 180 days to file an internal appeal. After the appeal process, you may also have a right to an external review."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "12 visits approved, June 1–Aug 31, 2026 stated."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Remaining 12 not approved; cites MP-660 12-visit limit plus required check."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after 10th visit documenting gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "180 days to file internal appeal, plus external review."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval with partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 899 tokens
Okay, I'm processing the user's request to draft a member-facing explanation for a partial authorization of physical therapy visits. My immediate thought is to structure this logically, ensuring all necessary components are covered for clarity and to guide the member effectively.
First, I need to directly address the initial request. So, I'll start by stating what they asked for – that is, a request for 24 physical therapy visits. This sets the context immediately.
Following that, I'll clearly state what has been approved. It's crucial to be precise here. I'll specify that 12 of those requested visits have been authorized.
Next, I need to define the timeframe for these approved visits. This is essential for the member to understand when they can utilize these services. I will specify the exact date range for the 12 approved visits.
Now, I need to address the portion that was *not* approved – the remaining 12 visits. The core reason needs to be communicated clearly: they haven't yet been established as medically necessary according to our established policy.
To make this understandable, I need to briefly explain what "medical necessity" means in this specific context, linking it to our internal policy, MP-660. This policy, as I understand it, allows for an initial set of visits, which is why the first 12 were approved.
Then, the most critical part for the member's action: what do they need to do to potentially get those additional 12 visits approved? I need to clearly outline the requirement for the treating therapist to submit a reassessment, specifically highlighting that this reassessment must demonstrate functional improvement and should be submitted after a certain number of visits (the 10th visit, in this case).
It's important for the member to know that this determination wasn't made in a vacuum. I will include the fact that the review was conducted by a qualified professional, a licensed physical therapist, which lends credibility to the decision.
Finally, I must inform the member of their recourse. This means clearly stating their right to appeal the decision, including the timeframe for filing an internal appeal and mentioning the possibility of an external review if the internal appeal is unsuccessful.
I've now got all the necessary pieces in mind. I'll assemble them into clear, concise sentences, aiming for a direct and informative tone suitable for a member. I’ll ensure it’s exactly eight sentences and meets all the specified requirements for a member-facing explanation.
Here is the message I have crafted:
"We have reviewed the request for 24 physical therapy visits for your right shoulder. We have approved 12 of these visits to be used between June 1, 2026, and August 31, 2026. The request for the additional 12 visits is denied at this time as not medically necessary. Our medical policy MP-660 allows for up to 12 visits initially. More visits may be approved after your therapist submits a reassessment showing that your condition has improved with treatment. This reassessment should be sent after your 10th visit. This determination was made by a licensed physical therapist reviewer. If you disagree, you have 180 days to appeal this decision."json{
"message": "We have reviewed the request for 24 physical therapy visits for your right shoulder. We have approved 12 visits for the period from June 1, 2026, through August 31, 2026. The remaining 12 visits are not approved at this time because medical necessity has not been established. Our medical policy, MP-660, authorizes an initial 12 visits. More visits may be approved if your therapist submits a reassessment after your 10th visit that shows objective functional improvement. This decision was made by a licensed physical therapist reviewer. You have the right to file an internal appeal within 180 days of this notice. After the internal appeal process, you may have the right to an external review."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "Approves 12 visits, June 1–Aug 31, 2026."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12; cites MP-660 initial 12-visit limit and reassessment."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist reassessment after 10th visit showing functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval with denial of remainder."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 1,364 tokens
Okay, I've been asked to craft a member-facing explanation of benefits (EOB) regarding a partial determination for physical therapy. My task is to distill a specific decision about physical therapy visits into a clear, concise message for the member. I need to cover the approved visits, the denied visits, the reasoning behind the denial, how they might get more visits approved, who made the decision, and their rights to appeal. Crucially, this all needs to be presented in eight sentences or fewer and at an eighth-grade reading level, avoiding any clinical advice or promises.
Here's my thought process for building this message:
First, I need to clearly state what *is* approved. This provides immediate positive information. So, I'll start with something like: "We have approved 12 physical therapy visits for your right shoulder from June 1, 2026, to August 31, 2026." This sets the stage.
Next, I have to address the denial. It's important to be direct but also empathetic. I need to explain *why* the other 12 visits weren't approved. The key reason is "not medically necessary at this time" according to a specific policy, MP-660, which allows an initial 12 visits. I can combine these points: "The remaining 12 visits were not approved at this time because they have not been established as medically necessary under our medical policy MP-660." This covers the denial and the core policy rationale.
Now, the member and their provider need to know how to potentially get those denied visits. The prompt states the therapist needs to submit a reassessment after the 10th visit showing functional improvement, which could lead to authorization for another 12 visits. I'll explain this clearly, linking it back to the policy's allowance for more visits: "This policy allows an initial 12 visits, with more visits possible after a review of your progress." This explains the general mechanism. Then, I'll provide the actionable step: "Your therapist can request the additional 12 visits by submitting a reassessment after your 10th visit that documents your functional improvement." This gives a concrete path forward.
It's good practice to let the member know who reviewed their case, especially when it involves medical expertise. So, I'll add: "A licensed physical therapist reviewed this request." This adds credibility to the decision.
Finally, and critically, I must inform the member of their appeal rights. This is a regulatory requirement and empowers the member. I need to cover both internal appeals and the possibility of an external review. I'll phrase it like this: "If you disagree with this decision, you have the right to file an appeal within 180 days." And then, "After an internal appeal, you may also have the right to an external review."
Now, I'll assemble these sentences and ensure they flow well and meet all the constraints.
1. "We have approved 12 physical therapy visits for your right shoulder from June 1, 2026, to August 31, 2026."
2. "The remaining 12 visits were not approved at this time because they have not been established as medically necessary under our medical policy MP-660."
3. "This policy allows an initial 12 visits, with more visits possible after a review of your progress."
4. "Your therapist can request the additional 12 visits by submitting a reassessment after your 10th visit that documents your functional improvement."
5. "A licensed physical therapist reviewed this request."
6. "If you disagree with this decision, you have the right to file an appeal within 180 days."
7. "After an internal appeal, you may also have the right to an external review."
This gives me 7 sentences. It's concise, covers all the necessary points, is at an appropriate reading level, and avoids any clinical advice or definitive promises about future approvals, using phrases like "may be authorized" and "may also have the right." This version is ready to be presented as the member-facing message.json{
"message": "We have approved 12 physical therapy visits for your right shoulder for dates of service from June 1, 2026, through August 31, 2026. The request for an additional 12 visits is not approved at this time because it has not been established as medically necessary. Our medical policy, MP-660, authorizes up to 12 visits initially. To consider approving more visits, your therapist must submit a reassessment after your 10th visit showing objective functional improvement. This request was reviewed by a licensed physical therapist. If the new information is received, up to 12 more visits may be authorized. You have the right to file an internal appeal within 180 days. After an internal appeal, you may have the right to an external review."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 visits approved June 1–Aug 31, 2026."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after 10th visit showing functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}100GLM-5.2 · Z.ai3.9s · 229 out | 2.8s · 218 out | 3.6s · 229 out
Reasoning · 26 tokens
Write member-facing notice, 8 sentences or fewer, include dollar figures/dates, appeal rights. No headers/bullets unless needed.json{
"message": "We reviewed your request for 24 physical therapy visits for your right shoulder and approved 12 visits from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because our medical policy MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved. A reassessment is a written record from your therapist showing objective progress in how well your shoulder works. To request the remaining visits, your treating therapist should submit that reassessment after your 10th visit. If it shows functional gains, up to 12 more visits may then be approved. This decision was reviewed by a licensed physical therapist. If you disagree, you may file an internal appeal within 180 days, and you have the right to an external review after that. You may also ask your provider to submit the reassessment, which could allow more visits without an appeal."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12, cites MP-660 12-visit initial limit and reassessment."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after 10th visit for 12 more."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 18 tokens
Let me write a member-facing notice for this partial determination, 8 sentences or fewer.json{
"message": "We approved 12 of the 24 physical therapy visits you requested for your right shoulder, covering dates from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because our medical policy MP-660 allows up to 12 visits initially and requires a documented functional reassessment before approving more. This means your therapist needs to show measurable progress in how well your shoulder functions before we can authorize additional visits. To request the remaining visits, your treating therapist should submit a reassessment after your 10th visit that documents objective functional gains, and up to 12 more visits may then be approved. A licensed physical therapist reviewer reviewed this decision. If you disagree, you may file an internal appeal within 180 days, and you have the right to an external review after that. You or your provider may contact us for details on how to submit the reassessment or start an appeal."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 of 24 approved with date range."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denial of remaining 12 with MP-660 initial-12 and reassessment reason."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 documenting functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval and partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 32 tokens
The member's notice for a partial determination. Need to explain in 8 sentences or fewer, at roughly eighth-grade reading level.
Let me draft the message.json{
"message": "We approved 12 of your 24 requested physical therapy visits for your right shoulder, covering visits from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because our medical policy MP-660 allows up to 12 visits at first and requires a documented check of your progress before approving more. Your treating therapist can help you get the remaining visits by submitting a reassessment after your 10th visit that shows objective improvement in your function. If that reassessment shows progress, up to 12 more visits may be approved. A licensed physical therapist reviewer handled this decision. If you disagree, you can file an internal appeal with us within 180 days. If you still disagree after that, you can request an outside review. You do not have to wait for the internal appeal to end before asking for the outside review if the timeframe for your care has passed."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with 2026-06-01 to 2026-08-31 range."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States 12 denied; cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Explains therapist submits reassessment after visit 10 showing functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "States internal appeal within 180 days, plus external review."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: 12 of 24 approved, remainder denied."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}100Claude Opus 4.8 · Anthropic4.2s · 275 out | 4.8s · 291 out | 4.1s · 259 out
json{
"message": "We reviewed the request for 24 physical therapy visits for your right shoulder. We approved 12 visits, which you can use from 2026-06-01 through 2026-08-31. We could not approve the other 12 visits at this time because our medical policy (MP-660) allows up to 12 visits to start, and a documented check of how your shoulder is working (a functional reassessment) is needed before more visits can be approved. To ask for the remaining 12 visits, your therapist can send us a reassessment after your 10th visit that shows measurable improvement in how your shoulder works. If we get that and it meets the policy, up to 12 more visits may be approved. A licensed physical therapist reviewed this decision. If you disagree, you may file an internal appeal within 180 days of this notice, and you may request an external review after that."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States other 12 not approved, cites MP-660 12-visit limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist sends reassessment after 10th visit showing functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days, plus external review."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval with denial of remainder."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}json{
"message": "We reviewed your request for 24 physical therapy visits for your right shoulder. We approved 12 visits, which you can use for dates of service from 2026-06-01 through 2026-08-31. We could not approve the remaining 12 visits at this time because, under our medical policy MP-660, we allow up to 12 visits at the start of care and need a documented functional reassessment (an updated check of how well your shoulder is working) before we can approve more. To seek the additional 12 visits, your physical therapist can submit a reassessment after your 10th visit showing measurable improvement in function; if that is provided, we may then approve up to 12 more visits. A licensed physical therapist reviewed this decision. If you disagree, you have the right to file an internal appeal within 180 days of this notice. If we uphold the denial, you may then request an external review by an independent reviewer."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after 10th visit showing functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days, plus external review."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approved 12, denied 12."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}json{
"message": "We reviewed the request for 24 physical therapy visits for your right shoulder. We approved 12 visits from 2026-06-01 through 2026-08-31. We did not approve the other 12 visits at this time because, under our medical policy MP-660, we can approve up to 12 visits to start and need a documented functional reassessment (a check of how well your shoulder is working) before approving more. To seek the remaining visits, your therapist can send us a reassessment after your 10th visit that shows measurable improvement in function; we may then approve up to 12 more visits. A licensed physical therapist reviewed this decision. If you disagree, you may file an internal appeal within 180 days of this notice. If you are not satisfied after the internal appeal, you may request an external review."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 visits approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies other 12, citing MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist sends reassessment after 10th visit showing functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approved 12, denied 12."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}100Claude Sonnet 5 · Anthropic4.9s · 306 out | 4.3s · 389 out | 4.5s · 328 out
json{
"message": "We reviewed the request for 24 physical therapy visits for your right shoulder. We approved 12 visits, to be used between 2026-06-01 and 2026-08-31. We did not approve the remaining 12 visits because, under medical policy MP-660, only 12 visits are authorized up front and a functional reassessment is required before more can be approved. This determination was made by a licensed physical therapist reviewer. To get the remaining visits considered, ask your treating therapist to submit a reassessment after your 10th visit that documents your functional progress; if that shows objective gains, up to 12 more visits may be authorized. If you disagree with this decision, you can file an internal appeal within 180 days of this notice. If the internal appeal does not resolve the issue in your favor, you have the right to request an external review afterward. Please keep this notice for your records."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with 2026-06-01 to 2026-08-31 range."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12 citing MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after 10th visit documenting gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval and partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}json{
"message": "We reviewed the request for 24 physical therapy visits for your right shoulder. We approved 12 visits, to be used between 2026-06-01 and 2026-08-31. We did not approve the remaining 12 visits at this time because our medical policy, MP-660, allows an initial 12 visits and requires a documented functional reassessment showing objective gains before more visits can be approved. This decision was made by a licensed physical therapist reviewer. To request the additional 12 visits, have your treating therapist submit a functional reassessment after your 10th visit showing the progress you have made. If that reassessment is submitted, the plan can then review the remaining visits for approval. If you disagree with this decision, you can file an internal appeal within 180 days of this notice. If the internal appeal does not resolve the issue, you have the right to request an external review afterward."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 not approved, cites MP-660 initial 12 plus reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits functional reassessment after 10th visit."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}json{
"message": "We approved 12 of the 24 physical therapy visits you requested for your right shoulder, covering the period 2026-06-01 through 2026-08-31. The remaining 12 visits were not approved at this time because, under medical policy MP-660, only 12 visits are authorized initially, with additional visits requiring a documented functional reassessment showing objective improvement. This decision was reviewed by a licensed physical therapist. To request the remaining 12 visits, your treating therapist can submit a functional reassessment after your 10th visit showing the progress you have made. If that reassessment supports it, the additional visits may then be approved. If you disagree with this decision, you can file an internal appeal within 180 days of this notice. If the internal appeal does not resolve the matter in your favor, you may then request an external review by an independent reviewer."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 through 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 not approved, cites MP-660 12-visit initial limit and reassessment."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits functional reassessment after 10th visit."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}100Claude Sonnet 4.6 · Anthropic5.3s · 234 out | 6.1s · 244 out | 6.6s · 260 out
json{
"message": "We reviewed your request for 24 physical therapy visits for your right shoulder and have approved 12 visits, which may be used from 2026-06-01 through 2026-08-31. The remaining 12 visits were not approved at this time because medical policy MP-660 requires a documented functional reassessment — a written evaluation of how your function has changed — before additional visits can be authorized. This is not a final denial of those visits; your therapist can request more visits by submitting a reassessment after your 10th visit that shows objective, measurable improvement in your shoulder function. If that reassessment is submitted and supports continued therapy, up to 12 additional visits may be approved. This determination was made by a licensed physical therapist reviewer. If you disagree with this decision, you have the right to file an internal appeal within 180 days of receiving this notice. If you are not satisfied with the outcome of that appeal, you may then request an external review by an independent organization."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "12 visits approved, 2026-06-01 to 2026-08-31 stated."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Remaining 12 not approved, cites MP-660 reassessment requirement before more visits."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after 10th visit showing objective gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated, plus external review."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval, not flat denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}json{
"message": "We reviewed the request for 24 physical therapy visits for your right shoulder. We are approving 12 visits, which you may use between 2026-06-01 and 2026-08-31. The remaining 12 visits are denied at this time because medical policy MP-660 requires a documented functional reassessment—a written evaluation of how your function has changed—before additional visits can be approved. To get those visits authorized, your treating therapist should submit a reassessment after your 10th visit that shows objective, measurable improvement in function; if that reassessment is submitted and meets the criteria, up to 12 more visits may be approved. This determination was made by a licensed physical therapist reviewer. If you disagree with this decision, you have the right to file an internal appeal within 180 days of this notice. If you are not satisfied with the outcome of that internal appeal, you may then request an external review by an independent organization. Please contact the Member Services number on your ID card to begin an appeal or to ask questions."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "Approves 12 visits with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 reassessment requirement before more visits."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after 10th visit showing functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days, plus external review noted."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}json{
"message": "We reviewed the request for 24 physical therapy visits for your right shoulder. We are approving 12 visits, which you may use between 2026-06-01 and 2026-08-31. The remaining 12 visits are not approved at this time because medical policy MP-660 requires a documented functional reassessment — a written evaluation of how your movement and strength have changed — before additional visits beyond the initial 12 can be authorized. To get those additional visits approved, your physical therapist should submit a reassessment after your 10th visit that shows objective, measurable improvement in how your shoulder is functioning; if that reassessment supports continued care, up to 12 more visits may be authorized. This decision was made by a licensed physical therapist reviewer. If you disagree with the denial of the remaining 12 visits, you have the right to file an internal appeal within 180 days of receiving this notice. If your internal appeal is not decided in your favor, you may then request an external review by an independent organization. Contact the member services number on your ID card to start an appeal or to ask questions."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 visits approved with 2026-06-01 to 2026-08-31 range."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 not approved, cites MP-660 initial 12 plus reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after 10th visit showing objective gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated, plus external review."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}100Qwen3.7 Max · Alibaba42.2s · 2,436 out | 344.9s · 3,780 out | 29.0s · 2,484 out
Reasoning · 2,252 tokens
The user wants a member notice for a partial determination regarding physical therapy visits.
I need to write a message explaining the decision, adhering to the following constraints:
- Eight sentences or fewer.
- No headers, bullet points (unless needed, but better to avoid), salutation, or sign-off.
- Roughly 8th-grade reading level.
- Define terms of art if used.
- Use exact dollar figures and dates (none provided except dates 2026-06-01 through 2026-08-31).
- No clinical advice.
- Include appeal rights, deadlines, route to resolution.
- JSON output with key "message".
Facts:
- Requested: 24 PT visits for right shoulder.
- Approved: 12 visits, dates 2026-06-01 through 2026-08-31.
- Denied: remaining 12 visits (not medically necessary at this time under MP-660, which allows 12 initially and requires reassessment).
- Route to remaining: therapist submits reassessment after visit 10 showing objective functional gains; then up to 12 more can be approved.
- Appeal rights: internal appeal within 180 days; external review thereafter.
- Reviewed by licensed PT reviewer.
Drafting the message:
We have approved 12 physical therapy visits for your right shoulder for dates of service from 2026-06-01 through 2026-08-31. (1)
We denied the remaining 12 requested visits because our medical policy allows up to 12 visits initially and requires a reassessment before approving more. (2)
A licensed physical therapist reviewed your request and made this decision. (3)
To get approval for the remaining visits, your physical therapist must submit a reassessment after your 10th visit showing that your shoulder function has improved. (4)
Once we receive that reassessment, we can approve up to 12 more visits. (5)
If you disagree with this decision, you have the right to file an internal appeal within 180 days. (6)
If you are not satisfied after the internal appeal, you can request an external review by an independent organization. (7)
Let's check sentence count:
1. We have approved 12 physical therapy visits for your right shoulder for dates of service from 2026-06-01 through 2026-08-31.
2. We denied the remaining 12 requested visits because our medical policy allows up to 12 visits initially and requires a reassessment before approving more.
3. A licensed physical therapist reviewed your request and made this decision.
4. To get approval for the remaining visits, your physical therapist must submit a reassessment after your 10th visit showing that your shoulder function has improved.
5. Once we receive that reassessment, we can approve up to 12 more visits.
6. If you disagree with this decision, you have the right to file an internal appeal within 180 days.
7. If you are not satisfied after the internal appeal, you can request an external review by an independent organization.
Total: 7 sentences. Under the 8-sentence limit.
Let's refine for 8th-grade reading level and clarity.
"We approved 12 physical therapy visits for your right shoulder between 2026-06-01 and 2026-08-31." (1)
"We denied the other 12 visits you asked for because our rules only allow 12 visits at first." (2)
"Our rules also require your therapist to check your progress before we can approve more visits." (3)
"A licensed physical therapist reviewed your case and made this decision." (4)
"To get the rest of the visits, your therapist needs to send us a progress report after your 10th visit showing that your shoulder is getting better." (5)
"After we get that report, we can approve up to 12 more visits." (6)
"If you disagree with this choice, you can file an internal appeal within 180 days." (7)
"If you are still unhappy after that, you can ask for an external review by an outside group." (8)
Wait, 8 sentences exactly. Let's make it 7 to be safe.
1. We approved 12 physical therapy visits for your right shoulder between 2026-06-01 and 2026-08-31.
2. We denied the other 12 requested visits because our medical policy only allows 12 visits at first and requires a progress check before approving more.
3. A licensed physical therapist reviewed your case and made this decision.
4. To get the remaining visits approved, your therapist must send us a report after your 10th visit showing that your shoulder function has improved.
5. Once we receive that report, we can approve up to 12 more visits.
6. If you disagree with this decision, you can file an internal appeal within 180 days.
7. If you are still unhappy after the internal appeal, you can ask for an external review by an outside group.
Count:
1: We approved 12 physical therapy visits for your right shoulder between 2026-06-01 and 2026-08-31.
2: We denied the other 12 requested visits because our medical policy only allows 12 visits at first and requires a progress check before approving more.
3: A licensed physical therapist reviewed your case and made this decision.
4: To get the remaining visits approved, your therapist must send us a report after your 10th visit showing that your shoulder function has improved.
5: Once we receive that report, we can approve up to 12 more visits.
6: If you disagree with this decision, you can file an internal appeal within 180 days.
7: If you are still unhappy after the internal appeal, you can ask for an external review by an outside group.
Total 7 sentences.
Check constraints:
- 8 sentences or fewer? Yes (7).
- No headers, bullets, salutations, sign-offs? Yes.
- 8th-grade reading level? Yes.
- Define terms of art? "internal appeal" and "external review" are somewhat standard, but "external review by an outside group" helps define it. "medical policy" is clear.
- Exact dates? 2026-06-01 and 2026-08-31 used.
- No clinical advice? Yes.
- Include appeal rights, deadlines, route to resolution? Yes (internal appeal 180 days, external review, route to remaining visits via therapist report after visit 10).
Let's do a quick read-through.
"We approved 12 physical therapy visits for your right shoulder between 2026-06-01 and 2026-08-31. We denied the other 12 requested visits because our medical policy only allows 12 visits at first and requires a progress check before approving more. A licensed physical therapist reviewed your case and made this decision. To get the remaining visits approved, your therapist must send us a report after your 10th visit showing that your shoulder function has improved. Once we receive that report, we can approve up to 12 more visits. If you disagree with this decision, you can file an internal appeal within 180 days. If you are still unhappy after the internal appeal, you can ask for an external review by an outside group."
Is "medical policy" a term of art? It's just the plan's rules. "medical policy" -> "plan rules" might be simpler.
"We denied the other 12 requested visits because our plan rules only allow 12 visits at first and require a progress check before approving more."
Let's adjust:
"We approved 12 physical therapy visits for your right shoulder between 2026-06-01 and 2026-08-31. We denied the other 12 requested visits because our plan rules only allow 12 visits at first and require a progress check before approving more. A licensed physical therapist reviewed your case and made this decision. To get the remaining visits approved, your therapist must send us a report after your 10th visit showing that your shoulder function has improved. Once we receive that report, we can approve up to 12 more visits. If you disagree with this decision, you can file an internal appeal within 180 days. If you are still unhappy after the internal appeal, you can ask for an external review by an outside group."
7 sentences. Perfect.
JSON format required.
```json
{
"message": "We approved 12 physical therapy visits for your right shoulder between 2026-06-01 and 2026-08-31. We denied the other 12 requested visits because our plan rules only allow 12 visits at first and require a progress check before approving more. A licensed physical therapist reviewed your case and made this decision. To get the remaining visits approved, your therapist must send us a report after your 10th visit showing that your shoulder function has improved. Once we receive that report, we can approve up to 12 more visits. If you disagree with this decision, you can file an internal appeal within 180 days. If you are still unhappy after the internal appeal, you can ask for an external review by an outside group."
}
```
Checking details:
- Requested: 24 (12 approved + 12 denied = 24).
- Approved: 12 visits, dates 2026-06-01 through 2026-08-31.
- Denied: remaining 12.
- Route: therapist submits reassessment after visit 10 documenting objective functional gains. -> "send us a report after your 10th visit showing that your shoulder function has improved"
- Appeal: internal within 180 days, external thereafter. -> covered.
- Reviewed by licensed PT. -> covered.
Looks solid.
json{
"message": "We approved 12 physical therapy visits for your right shoulder between 2026-06-01 and 2026-08-31. We denied the other 12 requested visits because our plan rules only allow 12 visits at first and require a progress check before approving more. A licensed physical therapist reviewed your case and made this decision. To get the remaining visits approved, your therapist must send us a report after your 10th visit showing that your shoulder function has improved. Once we receive that report, we can approve up to 12 more visits. If you disagree with this decision, you can file an internal appeal within 180 days. If you are still unhappy after the internal appeal, you can ask for an external review by an outside group."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "12 approved with dates 2026-06-01 to 2026-08-31 stated."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies other 12, citing 12-visit initial limit and required progress check."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist report after 10th visit showing functional improvement."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days, plus external review."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 3,589 tokens
The user wants a member-facing notice for a partial determination regarding physical therapy visits.
Constraints:
- Eight sentences or fewer.
- No headers, no bullet points unless needed (not needed here), no salutation or sign-off.
- Eighth-grade reading level.
- Define terms of art if used.
- Use exact dollar figures and dates (no dollar figures here, dates: 2026-06-01 through 2026-08-31).
- Do not give clinical advice.
- Do not promise outcomes.
- Include appeal rights, deadlines, route to resolution.
- JSON output with key "message".
Facts:
- Requested: 24 PT visits for right shoulder.
- Approved: 12 visits, dates 2026-06-01 through 2026-08-31.
- Denied: remaining 12 visits (not medically necessary at this time under MP-660, which allows 12 initially and requires documented functional reassessment for more).
- Route to remaining: therapist submits reassessment after visit 10 documenting objective functional gains; then another 12 may be authorized.
- Appeal rights: internal appeal within 180 days; external review thereafter.
- Reviewed by a licensed physical therapist reviewer.
Drafting the message:
We have approved 12 physical therapy visits for your right shoulder for dates between June 1, 2026, and August 31, 2026. We denied the remaining 12 requested visits because our medical policy allows up to 12 visits at first and requires a new check of your progress before approving more. A licensed physical therapist reviewed your request and made this decision. To get the remaining visits approved, your therapist must send us a new progress report after your 10th visit showing that your shoulder function has improved. If you disagree with this decision, you have the right to file an internal appeal within 180 days. If you are not satisfied with the internal appeal result, you can ask for an external review by an independent organization.
Sentence count check:
1. We have approved 12 physical therapy visits for your right shoulder for dates between June 1, 2026, and August 31, 2026.
2. We denied the remaining 12 requested visits because our medical policy allows up to 12 visits at first and requires a new check of your progress before approving more.
3. A licensed physical therapist reviewed your request and made this decision.
4. To get the remaining visits approved, your therapist must send us a new progress report after your 10th visit showing that your shoulder function has improved.
5. If you disagree with this decision, you have the right to file an internal appeal within 180 days.
6. If you are not satisfied with the internal appeal result, you can ask for an external review by an independent organization.
Total: 6 sentences. Under the 8-sentence limit.
Let's refine to ensure it meets all constraints and flows well.
"We approved 12 physical therapy visits for your right shoulder from June 1, 2026, through August 31, 2026. We denied the other 12 visits because our rules require a progress check after the first 12 visits to show they are still medically necessary. A licensed physical therapist reviewed your case to make this decision. To get approval for the rest of the visits, your therapist needs to send us a progress report after your 10th visit showing that your shoulder is improving. If you disagree with this partial approval, you can file an internal appeal within 180 days. After the internal appeal, you also have the right to request an external review."
Sentences:
1. We approved 12 physical therapy visits for your right shoulder from June 1, 2026, through August 31, 2026.
2. We denied the other 12 visits because our rules require a progress check after the first 12 visits to show they are still medically necessary. (Wait, the rule says "authorises up to 12 visits initially and requires a documented functional reassessment before authorising more". Let's use "functional reassessment" or define it. "because our medical policy allows up to 12 visits initially and requires a functional reassessment, which is a check of how well your shoulder is working, before approving more.")
Let's adjust sentence 2:
2. We denied the other 12 visits because our medical policy allows up to 12 visits initially and requires a functional reassessment, which is a check of how well your shoulder is working, before approving more.
3. A licensed physical therapist reviewed your request.
4. To get the remaining visits approved, your therapist must send us a reassessment after your 10th visit showing clear improvements in your shoulder function.
5. If you disagree with this decision, you can file an internal appeal within 180 days.
6. If the internal appeal does not resolve the issue, you can request an external review.
Count:
1. We approved 12 physical therapy visits for your right shoulder from June 1, 2026, through August 31, 2026.
2. We denied the other 12 visits because our medical policy allows up to 12 visits initially and requires a functional reassessment, which is a check of how well your shoulder is working, before approving more.
3. A licensed physical therapist reviewed your request.
4. To get the remaining visits approved, your therapist must send us a reassessment after your 10th visit showing clear improvements in your shoulder function.
5. If you disagree with this decision, you can file an internal appeal within 180 days.
6. If the internal appeal does not resolve the issue, you can request an external review.
Total 6 sentences.
Is "medically necessary" defined? I didn't use the exact phrase "medically necessary" in sentence 2, I said "before approving more". Let's use "medically necessary" and define it or just use plain language. "to show they are medically necessary, meaning they are needed to treat your condition".
Let's adjust sentence 2:
"We denied the other 12 visits because our medical policy allows up to 12 visits initially and requires a functional reassessment, or a check of your progress, to show more visits are medically necessary." -> "medically necessary" means needed for your care.
Actually, plain language: "We denied the remaining 12 visits because our medical policy allows up to 12 visits at first and requires a progress check to show that more visits are medically necessary for your care."
Let's review the prompt: "Denied: the remaining 12 visits, as not established as medically necessary at the time of this request under medical policy MP-660, which authorises up to 12 visits initially and requires a documented functional reassessment before authorising more"
Draft:
We approved 12 physical therapy visits for your right shoulder from June 1, 2026, through August 31, 2026. We denied the remaining 12 visits because they are not medically necessary at this time under our medical policy, which allows up to 12 visits initially and requires a functional reassessment before approving more. A functional reassessment is a documented check of your physical progress. A licensed physical therapist reviewed your request and made this decision. To get the remaining visits approved, your therapist must send us a reassessment after your 10th visit showing objective improvements in your shoulder function. If you disagree with this decision, you have the right to file an internal appeal within 180 days. After that, you may request an external review.
Sentences:
1. We approved 12 physical therapy visits for your right shoulder from June 1, 2026, through August 31, 2026.
2. We denied the remaining 12 visits because they are not medically necessary at this time under our medical policy, which allows up to 12 visits initially and requires a functional reassessment before approving more.
3. A functional reassessment is a documented check of your physical progress.
4. A licensed physical therapist reviewed your request and made this decision.
5. To get the remaining visits approved, your therapist must send us a reassessment after your 10th visit showing objective improvements in your shoulder function.
6. If you disagree with this decision, you have the right to file an internal appeal within 180 days.
7. After that, you may request an external review.
Total: 7 sentences. Limit is 8.
Reading level: 8th grade.
No salutation, no sign-off.
No bullet points.
Exact dates used: June 1, 2026, through August 31, 2026 (Prompt says 2026-06-01 through 2026-08-31. I should probably use the exact ISO format or standard US format. The prompt says "Use the exact dollar figures and dates supplied". I will use 2026-06-01 through 2026-08-31 to be safe, or just "June 1, 2026, through August 31, 2026". The prompt says "Dates are ISO 8601 (YYYY-MM-DD)." in the ground rules. So I MUST use 2026-06-01 and 2026-08-31.)
Let's fix the dates to ISO 8601:
1. We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31.
2. We denied the remaining 12 visits because they are not medically necessary at this time under our medical policy, which allows up to 12 visits initially and requires a functional reassessment before approving more.
3. A functional reassessment is a documented check of your physical progress.
4. A licensed physical therapist reviewed your request and made this decision.
5. To get the remaining visits approved, your therapist must send us a reassessment after your 10th visit showing objective improvements in your shoulder function.
6. If you disagree with this decision, you have the right to file an internal appeal within 180 days.
7. After that, you may request an external review.
Check constraints:
- Eight sentences or fewer: 7 sentences.
- No headers, bullet points, salutation, sign-off: Checked.
- 8th-grade reading level: Checked.
- Define term of art: "functional reassessment" defined. "medically necessary" is somewhat standard but could be defined. I'll just leave it as is, or add "meaning needed for your care". "medically necessary, meaning needed for your care,". Let's just use "medically necessary" as it's common, but "functional reassessment" is definitely a term of art.
- Exact dates: 2026-06-01 through 2026-08-31.
- Appeal rights included: internal appeal within 180 days, external review thereafter.
- Route to resolution included: therapist submits reassessment after visit 10.
- Reviewed by licensed PT: included.
Let's refine sentence 2 and 3 to flow better and ensure 8th grade level.
"We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not medically necessary at this time under our medical policy, which allows up to 12 visits initially and requires a functional reassessment before approving more. A functional reassessment is a documented check of your physical progress. A licensed physical therapist reviewed your request and made this decision. To get the remaining visits approved, your therapist must send us a reassessment after your 10th visit showing objective improvements in your shoulder function. If you disagree with this decision, you have the right to file an internal appeal within 180 days. After that, you may request an external review."
Is "objective improvements" a term of art? "objective functional gains" is in the prompt. "showing measurable improvements in how your shoulder works" might be better for 8th grade.
Let's change sentence 5: "To get the remaining visits approved, your therapist must send us a reassessment after your 10th visit showing measurable improvements in how your shoulder works."
Let's recount sentences:
1. We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31.
2. We denied the remaining 12 visits because they are not medically necessary at this time under our medical policy, which allows up to 12 visits initially and requires a functional reassessment before approving more.
3. A functional reassessment is a documented check of your physical progress.
4. A licensed physical therapist reviewed your request and made this decision.
5. To get the remaining visits approved, your therapist must send us a reassessment after your 10th visit showing measurable improvements in how your shoulder works.
6. If you disagree with this decision, you have the right to file an internal appeal within 180 days.
7. After that, you may request an external review.
Total 7 sentences.
All facts included.
No extra fluff.
JSON format required.
```json
{
"message": "We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not medically necessary at this time under our medical policy, which allows up to 12 visits initially and requires a functional reassessment before approving more. A functional reassessment is a documented check of your physical progress. A licensed physical therapist reviewed your request and made this decision. To get the remaining visits approved, your therapist must send us a reassessment after your 10th visit showing measurable improvements in how your shoulder works. If you disagree with this decision, you have the right to file an internal appeal within 180 days. After that, you may request an external review."
}
```
Check if "medically necessary" needs definition. "Medically necessary" means services that are needed to diagnose or treat an illness or injury. I think it's widely understood, but I can just say "needed for your care".
"We denied the remaining 12 visits because they are not medically necessary, or needed for your care, at this time..."
Actually, "medically necessary" is standard enough. I'll leave it.
Check if "internal appeal" and "external review" need definition. They are standard appeal rights terms, usually understood in context, but I can say "an internal appeal with our plan" and "an external review by an independent organization".
Sentence 6: "If you disagree with this decision, you have the right to file an internal appeal with our plan within 180 days."
Sentence 7: "After that, you may request an external review by an independent organization."
Let's use these slight tweaks for clarity.
1. We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31.
2. We denied the remaining 12 visits because they are not medically necessary at this time under our medical policy, which allows up to 12 visits initially and requires a functional reassessment before approving more.
3. A functional reassessment is a documented check of your physical progress.
4. A licensed physical therapist reviewed your request and made this decision.
5. To get the remaining visits approved, your therapist must send us a reassessment after your 10th visit showing measurable improvements in how your shoulder works.
6. If you disagree with this decision, you have the right to file an internal appeal with our plan within 180 days.
7. After that, you may request an external review by an independent organization.
7 sentences. Perfect.
Dates are ISO.
No currency.
Output is just the JSON block.
Done.
json{
"message": "We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not medically necessary at this time under our medical policy, which allows up to 12 visits initially and requires a functional reassessment before approving more. A functional reassessment is a documented check of your physical progress. A licensed physical therapist reviewed your request and made this decision. To get the remaining visits approved, your therapist must send us a reassessment after your 10th visit showing measurable improvements in how your shoulder works. If you disagree with this decision, you have the right to file an internal appeal with our plan within 180 days. After that, you may request an external review by an independent organization."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12, cites 12-initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist sends reassessment after 10th visit showing functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated, plus external review."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approval plus denial of remainder."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 2,269 tokens
The user wants a member-facing notice for a partial determination regarding physical therapy visits.
The notice must be 8 sentences or fewer.
It needs to explain what was approved, what was denied, why it was denied, how to get the rest approved, and appeal rights.
It must be written at an 8th-grade reading level, define terms of art, use exact figures/dates, no clinical advice, no promising outcomes.
Facts:
- Requested: 24 physical therapy visits for right shoulder.
- Approved: 12 visits, dates 2026-06-01 through 2026-08-31.
- Denied: remaining 12 visits.
- Reason for denial: not established as medically necessary at this time under medical policy MP-660. MP-660 authorizes up to 12 visits initially and requires a documented functional reassessment before authorizing more.
- Route to remaining visits: treating therapist submits a reassessment after visit 10 documenting objective functional gains (measurable improvements in how your shoulder works); then another 12 visits may be authorized.
- Appeal rights: internal appeal within 180 days; external review thereafter.
- Reviewed by a licensed physical therapist reviewer.
Drafting the message:
We have approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. (1)
We denied the remaining 12 requested visits because they are not medically necessary at this time under our medical policy MP-660. (2)
This policy allows up to 12 initial visits and requires a functional reassessment, which is a review of your measurable progress, before approving more. (3)
A licensed physical therapist reviewed your request. (4)
To get the remaining visits approved, your therapist must send us a reassessment after your 10th visit showing objective functional gains, or measurable improvements in how your shoulder works. (5)
Once we receive this, we may approve up to 12 more visits. (6)
If you disagree with this decision, you have the right to file an internal appeal within 180 days. (7)
If you are not satisfied after the internal appeal, you can request an external review by an independent organization. (8)
Let's check sentence count:
1. We have approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31.
2. We denied the remaining 12 requested visits because they are not medically necessary at this time under our medical policy MP-660.
3. This policy allows up to 12 initial visits and requires a functional reassessment, which is a review of your measurable progress, before approving more.
4. A licensed physical therapist reviewed your request.
5. To get the remaining visits approved, your therapist must send us a reassessment after your 10th visit showing objective functional gains, or measurable improvements in how your shoulder works.
6. Once we receive this, we may approve up to 12 more visits.
7. If you disagree with this decision, you have the right to file an internal appeal within 180 days.
8. If you are not satisfied after the internal appeal, you can request an external review by an independent organization.
Total: 8 sentences.
Wait, is "medically necessary" a term of art that needs defining? "medically necessary, meaning appropriate and needed for your condition,"
Let's refine sentence 2:
We denied the remaining 12 requested visits because they are not medically necessary, meaning appropriate and needed for your condition, at this time under our medical policy MP-660. (2)
Let's recount sentences and ensure flow.
1. We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31.
2. We denied the remaining 12 visits because they are not medically necessary, meaning appropriate and needed for your condition, at this time under medical policy MP-660.
3. This policy allows up to 12 initial visits and requires a functional reassessment before approving more.
4. A licensed physical therapist reviewed your request.
5. To get the remaining visits approved, your therapist must send us a reassessment after your 10th visit showing objective functional gains, which are measurable improvements in how your shoulder works.
6. After we receive this, we may approve up to 12 more visits.
7. If you disagree with this decision, you can file an internal appeal within 180 days.
8. After an internal appeal, you may also request an external review.
Let's check the terms of art:
- medically necessary (defined)
- functional reassessment (maybe define? "a functional reassessment, which is a review of your progress,")
- objective functional gains (defined as measurable improvements)
Let's adjust sentence 3:
3. This policy allows up to 12 initial visits and requires a functional reassessment, or a review of your progress, before approving more.
Let's review the whole text:
We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. (1)
We denied the remaining 12 visits because they are not medically necessary, meaning appropriate and needed for your condition, at this time under medical policy MP-660. (2)
This policy allows up to 12 initial visits and requires a functional reassessment, or a review of your progress, before approving more. (3)
A licensed physical therapist reviewed your request. (4)
To get the remaining visits approved, your therapist must send us a reassessment after your 10th visit showing objective functional gains, which are measurable improvements in how your shoulder works. (5)
After we receive this, we may approve up to 12 more visits. (6)
If you disagree with this decision, you can file an internal appeal within 180 days. (7)
After an internal appeal, you may also request an external review. (8)
Exactly 8 sentences.
Check constraints:
- 8 sentences or fewer. (8 sentences)
- no headers, no bullet points, no salutation/sign-off.
- 8th-grade reading level.
- define terms of art (medically necessary, functional reassessment, objective functional gains).
- exact dollar figures and dates (2026-06-01 through 2026-08-31, 12 visits, 10th visit, 180 days).
- no clinical advice.
- include appeal rights, deadlines, route to resolution.
Is "objective functional gains" defined well? "objective functional gains, which are measurable improvements in how your shoulder works." - Yes.
Is "functional reassessment" defined well? "a functional reassessment, or a review of your progress," - Yes.
Is "medically necessary" defined well? "medically necessary, meaning appropriate and needed for your condition," - Yes.
Is "external review" defined? "an external review by an independent organization." Let's add that to sentence 8.
8. After an internal appeal, you may also request an external review by an independent organization.
Let's recount sentences.
1. We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31.
2. We denied the remaining 12 visits because they are not medically necessary, meaning appropriate and needed for your condition, at this time under medical policy MP-660.
3. This policy allows up to 12 initial visits and requires a functional reassessment, or a review of your progress, before approving more.
4. A licensed physical therapist reviewed your request.
5. To get the remaining visits approved, your therapist must send us a reassessment after your 10th visit showing objective functional gains, which are measurable improvements in how your shoulder works.
6. After we receive this, we may approve up to 12 more visits.
7. If you disagree with this decision, you can file an internal appeal within 180 days.
8. After an internal appeal, you may also request an external review by an independent organization.
Total: 8 sentences.
Let's double check if I missed any facts.
- Requested: 24 visits (implied by 12 approved + 12 denied).
- Approved: 12 visits, 2026-06-01 through 2026-08-31. (Check)
- Denied: remaining 12. (Check)
- Reason: not established as medically necessary at the time of this request under MP-660, which authorizes up to 12 initially and requires documented functional reassessment. (Check)
- Route: treating therapist submits reassessment after visit 10 documenting objective functional gains; further 12 may be authorized. (Check)
- Appeal: internal within 180 days, external thereafter. (Check)
- Reviewed by licensed PT. (Check)
Everything looks solid.
JSON format required.
```json
{
"message": "We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not medically necessary, meaning appropriate and needed for your condition, at this time under medical policy MP-660. This policy allows up to 12 initial visits and requires a functional reassessment, or a review of your progress, before approving more. A licensed physical therapist reviewed your request. To get the remaining visits approved, your therapist must send us a reassessment after your 10th visit showing objective functional gains, which are measurable improvements in how your shoulder works. After we receive this, we may approve up to 12 more visits. If you disagree with this decision, you can file an internal appeal within 180 days. After an internal appeal, you may also request an external review by an independent organization."
}
```
All good.json{
"message": "We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not medically necessary, meaning appropriate and needed for your condition, at this time under medical policy MP-660. This policy allows up to 12 initial visits and requires a functional reassessment, or a review of your progress, before approving more. A licensed physical therapist reviewed your request. To get the remaining visits approved, your therapist must send us a reassessment after your 10th visit showing objective functional gains, which are measurable improvements in how your shoulder works. After we receive this, we may approve up to 12 more visits. If you disagree with this decision, you can file an internal appeal within 180 days. After an internal appeal, you may also request an external review by an independent organization."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12, cites MP-660 12-visit limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist sends reassessment after 10th visit showing functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}100GLM-5.3 · Z.ai4.8s · 647 out | 15.6s · 3,197 out | 27.8s · 2,079 out
Reasoning · 492 tokens
Let me write the member notice. Key facts:
- Requested 24 PT visits for right shoulder
- Approved 12 visits, dates 2026-06-01 through 2026-08-31
- Denied remaining 12 visits as not established as medically necessary under medical policy MP-660 (authorises up to 12 initially, requires documented functional reassessment before more)
- Route: therapist submits reassessment after visit 10 documenting objective functional gains; further 12 visits may then be authorised
- Appeal rights: internal appeal within 180 days; external review thereafter
- Reviewed by a licensed physical therapist reviewer
Eight sentences or fewer. Eighth-grade reading level. Define terms of art (e.g., "medical necessity" maybe, "reassessment"). Include appeal rights and deadlines. Don't promise outcome — say further visits "may" be authorised, not "will."
Draft:
1. We received your request for 24 physical therapy visits for your right shoulder.
2. We approved 12 visits, covering dates from 2026-06-01 through 2026-08-31.
3. We could not approve the remaining 12 visits at this time because our medical policy MP-660 allows up to 12 visits to start, and more visits must be shown to be medically necessary before we can approve them.
4. "Medically necessary" means the treatment is needed to treat your condition based on the evidence in your record.
5. A licensed physical therapist reviewer looked at your request.
6. If your therapist completes a reassessment after your 10th visit that shows objective improvement in how your shoulder works, we can review the request and may approve up to 12 more visits.
7. If you disagree with this decision, you can ask for an internal appeal within 180 days.
8. If you are not satisfied after the internal appeal, you can request an external review, which is an independent look at the decision.
That's 8 sentences. Good.
Should include no headers, no bullets, plain member-facing text. The message key only.json{
"message": "We received your request for 24 physical therapy visits for your right shoulder. We approved 12 visits for dates 2026-06-01 through 2026-08-31. We are not able to approve the other 12 visits right now, because our medical policy MP-660 allows up to 12 visits at first, and more visits must be shown to be medically necessary before we can approve them. \"Medically necessary\" means the treatment is needed for your condition based on the information in your record. A licensed physical therapist reviewer looked at your request before we made this decision. If your therapist completes a reassessment after your 10th visit showing measurable improvement in how your shoulder works, we can review your request, and up to 12 more visits may then be approved. If you disagree with this decision, you may ask for an internal appeal within 180 days. If you are not satisfied with the outcome of that appeal, you may then request an external review, which is an independent review of the decision."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with 2026-06-01 to 2026-08-31 range."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12, cites MP-660 12-visit initial limit and need for further showing."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Reassessment by therapist after 10th visit documenting functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days, plus external review."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval/partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 3,316 tokens
Let me think about this task. I need to write a member's notice for a partial determination on physical therapy visits. Eight sentences or fewer. Required key: "message".
Facts:
- Requested: 24 PT visits for right shoulder
- Approved: 12 visits, 2026-06-01 through 2026-08-31
- Denied: remaining 12 visits, not established as medically necessary at time of request under medical policy MP-660, which allows up to 12 visits initially and requires documented functional reassessment before authorizing more
- Route: treating therapist submits reassessment after visit 10 documenting objective functional gains; a further 12 visits may then be authorized
- Appeal rights: internal appeal within 180 days; external review thereafter
- Reviewed by licensed physical therapist reviewer
Key elements to include:
1. Approval of 12 visits with dates
2. Denial of remaining 12 and why (medical policy MP-660 - not established as medically necessary at this time; policy allows 12 initially, requires reassessment)
3. Route to get more visits: therapist submits reassessment after visit 10 showing objective functional gains; up to 12 more may be authorized
4. Appeal rights: internal appeal within 180 days, external review after
5. Reviewed by licensed physical therapist
Need to be careful about "may then be authorised" — don't promise an outcome. Say "may be authorized" not "will be".
Also need to define terms of art at first use. "Medically necessary" — could briefly explain. "Reassessment" — explain as a check of progress. Keep eighth-grade reading level.
Eight sentences or fewer. Let me draft.
Draft:
1. "We have completed a review of your request for 24 physical therapy visits for your right shoulder, and it was reviewed by a licensed physical therapist."
2. "We approved 12 visits, covering dates from June 1, 2026 through August 31, 2026."
3. "We could not approve the remaining 12 visits at this time because our medical policy MP-660 starts with up to 12 visits and needs proof of progress before approving more."
4. "'Medically necessary' means the care is supported as effective and appropriate for your condition under our rules."
5. "If you need more visits, your therapist can submit a reassessment — a written review of your progress — after your 10th visit that shows objective improvements in how your shoulder works."
6. "If that review supports it, up to 12 more visits may be approved."
7. "This is not a final denial of the remaining visits; it means we need more information first."
8. "If you disagree, you may file an internal appeal within 180 days, and after that you may request an external review by an independent party."
That's 8 sentences. Let me check the dates: use exact dates supplied — 2026-06-01 through 2026-08-31. Should I use ISO format or readable? The instruction says "Use the exact dollar figures and dates supplied; do not round them". For member-facing, writing "June 1, 2026" might be more readable, but the ground rules say dates are ISO 8601 (YYYY-MM-DD). Hmm, the harness ground rule 5 says "Dates are ISO 8601 (YYYY-MM-DD)." That's a harness-wide formatting rule. For member messaging, readability would suggest "June 1, 2026" but the system prompt explicitly says dates are ISO 8601. I'll use ISO format to be safe: "2026-06-01 through 2026-08-31".
Let me revise:
1. "A licensed physical therapist reviewed your request for 24 physical therapy visits for your right shoulder."
2. "We are approving 12 visits, for care between 2026-06-01 and 2026-08-31."
3. "We are not approving the other 12 visits at this time because our medical policy MP-660 allows up to 12 visits at first and requires proof of progress, called a functional reassessment, before more visits can be approved."
4. "A functional reassessment is a written report from your therapist that measures objective gains, such as how well your shoulder moves or how much you can do."
5. "This means the extra 12 visits are not refused outright; we just do not yet have the information needed to cover them."
6. "To request more visits, your treating therapist should send the reassessment after your 10th visit showing these gains, and up to 12 more visits may then be approved."
7. "If you disagree with this decision, you may ask for an internal appeal within 180 days."
8. "After the internal appeal, you can ask for an external review, which is an independent look at the decision."
That's 8 sentences. Good.
Check: Don't promise outcome — "may then be approved" is conditional, matching the facts ("a further 12 visits may then be authorised"). Good.
Define terms of art: "functional reassessment" defined. "Medically necessary" — should I include? The denial says "not established as medically necessary at this time under medical policy MP-660". I should mention medical necessity since that's the basis of denial. Let me add: "'Medically necessary' means..." That would push to 9 sentences. Need to combine.
Let me restructure:
1. "A licensed physical therapist reviewed your request for 24 physical therapy visits for your right shoulder."
2. "We approved 12 visits, covering 2026-06-01 through 2026-08-31."
3. "We did not approve the remaining 12 visits at this time because medical policy MP-660 starts coverage at up to 12 visits and does not find them medically necessary yet — meaning the records we have do not yet show enough proof that more visits are needed under our rules."
4. "Before we can cover more visits, the policy requires a functional reassessment, which is a written report from your therapist showing objective gains, like better movement or strength."
5. "To continue, your treating therapist should send this reassessment after your 10th visit; if it shows those gains, up to 12 more visits may then be approved."
6. "This decision does not close the door on the remaining 12 visits — it means we need the progress report first."
7. "If you disagree with this decision, you may file an internal appeal within 180 days."
8. "After the internal appeal process, you may request an external review, which is an independent review of the decision."
Eight sentences. Good.
Hmm, sentence 3 is long but acceptable. Reading level: eighth grade. Let me simplify some words.
Alternative sentence 3: "We did not approve the other 12 visits at this time because they are not yet shown to be medically necessary — that means our records do not yet show enough proof that the extra visits are needed under medical policy MP-660, which allows up to 12 visits at first."
Sentence 4: "The policy requires a functional reassessment before more visits can be approved — this is a written progress report from your therapist that shows objective gains, such as improved movement or strength."
Sentence 5: "Your treating therapist can send the reassessment after your 10th visit, and if it shows those gains, up to 12 more visits may be approved."
Sentence 6: "This is not a final refusal of the remaining visits; it means more information is needed first."
Sentence 7: "If you disagree with any part of this decision, you may ask for an internal appeal within 180 days."
Sentence 8: "After the internal appeal, you may ask for an external review by an independent organization."
Total 8 sentences with sentence 1 about the reviewer.
Check facts used:
- 24 visits requested ✓
- 12 approved, dates 2026-06-01 through 2026-08-31 ✓
- 12 denied, medical necessity not established, MP-660, 12 initial, reassessment required ✓
- Route: therapist submits reassessment after visit 10 with objective functional gains; further 12 may be authorized ✓
- Appeals: internal within 180 days, external thereafter ✓
- Reviewed by licensed physical therapist ✓
No clinical advice. No promise of outcome ("may be approved"). No salutation/sign-off (this is a notice, not a letter — item doesn't ask for a letter). No headers/bullets — I'm using prose sentences. Good.
Should I use "medically necessary" definition? Yes, defined inline in sentence 3. Good.
One concern: "This is not a final refusal" — is that promising something? The facts say the remaining 12 are "Denied... not established as medically necessary at the time of this request" and there's a route to authorization. Saying it's not a final refusal is accurate: further 12 visits may be authorized upon reassessment. But I should be careful — it IS a denial (partial determination) with appeal rights. Saying "this is not a final refusal" might downplay the denial and appeal rights. Better phrasing: "This decision does not prevent you from getting more visits later; once the reassessment is received, up to 12 more visits may be approved." Hmm.
Actually the facts frame it as denied with a route. The member should understand: (a) 12 approved, (b) 12 denied now with a reason, (c) path to get more approved via reassessment, (d) appeal rights. I'll keep sentence 6 but phrase carefully: "The remaining 12 visits are not approved now, but that can change: if the reassessment shows the needed gains, up to 12 more visits may be approved." That's slightly redundant with sentence 5. Maybe drop sentence 6 and keep 7 sentences.
Let me finalize with 7-8 sentences:
1. "A licensed physical therapist reviewed your request for 24 physical therapy visits for your right shoulder."
2. "We approved 12 of those visits, covering care from 2026-06-01 through 2026-08-31."
3. "We did not approve the remaining 12 visits at this time, because they are not yet shown to be medically necessary — that means our records do not yet show enough proof that the extra visits are needed, under medical policy MP-660."
4. "That policy allows up to 12 visits at the start and requires a functional reassessment before more can be approved."
5. "A functional reassessment is a written progress report from your treating therapist that shows objective gains, such as better movement or strength."
6. "Your therapist can send this reassessment after your 10th visit; if it shows those gains, up to 12 more visits may then be approved."
7. "If you disagree with this decision, you may file an internal appeal within 180 days."
8. "After the internal appeal, you may request an external review, which is an independent review of the decision."
Eight sentences exactly. Each sentence is reasonably short. Good reading level.
Check numbers: 24, 12, 12, dates, 10, 12, 180 days. All exact. No dollar figures. No medical advice — "better movement or strength" as examples of objective gains; that's describing what the report measures, not advising care. Fine.
Sentence 8: "external review thereafter" — "After the internal appeal, you may request an external review" — is external review available only after internal appeal? Facts say "internal appeal within 180 days; external review thereafter." So yes, external review comes after. Good.
Output: exactly one fenced JSON block with key "message".
One more check on "denied" framing: I said "did not approve the remaining 12 visits at this time". The determination says "Denied: the remaining 12 visits, as not established as medically necessary at the time of this request". I should use the word "denied" perhaps? Member notices typically say "we are unable to approve" or "denied". I'll say "we denied the remaining 12 visits" to be accurate. Let me use: "We denied the remaining 12 visits for now, because..." Hmm, "for now" plus the reassessment route conveys partial nature. Actually the notice is a "partial determination" — 12 approved, 12 denied. I'll say "we could not approve the other 12 visits" — clear and plain. Either works. Let me use "We could not approve the other 12 visits at this time because they are not yet shown to be medically necessary..."
Final message:
"A licensed physical therapist reviewed your request for 24 physical therapy visits for your right shoulder. We approved 12 visits, covering care from 2026-06-01 through 2026-08-31. We could not approve the other 12 visits at this time, because they are not yet shown to be medically necessary — that means our records do not yet show enough proof that the extra visits are needed, under medical policy MP-660. That policy allows up to 12 visits at the start and requires a functional reassessment before more visits can be approved. A functional reassessment is a written progress report from your treating therapist that shows objective gains, such as better movement or strength. Your therapist can send this reassessment after your 10th visit, and if it shows those gains, up to 12 more visits may then be approved. If you disagree with this decision, you may file an internal appeal within 180 days. After the internal appeal, you may ask for an external review, which is an independent review of the decision."
Count sentences: 1) A licensed... 2) We approved... 3) We could not approve... 4) That policy allows... 5) A functional reassessment is... 6) Your therapist can send... 7) If you disagree... 8) After the internal appeal... = 8 sentences.
Dates in ISO: 2026-06-01 through 2026-08-31. Good.
Emit the JSON block only.json{
"message": "A licensed physical therapist reviewed your request for 24 physical therapy visits for your right shoulder. We approved 12 visits, covering care from 2026-06-01 through 2026-08-31. We could not approve the other 12 visits at this time, because they are not yet shown to be medically necessary — that means our records do not yet show enough proof that the extra visits are needed, under medical policy MP-660. That policy allows up to 12 visits at the start and requires a functional reassessment before more visits can be approved. A functional reassessment is a written progress report from your treating therapist that shows objective gains, such as better movement or strength. Your therapist can send this reassessment after your 10th visit, and if it shows those gains, up to 12 more visits may then be approved. If you disagree with this decision, you may file an internal appeal within 180 days. After the internal appeal, you may ask for an external review, which is an independent review of the decision."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with 2026-06-01 to 2026-08-31 range."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist sends reassessment after 10th visit for 12 more."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 2,106 tokens
The task: write a member's notice for a partial determination, eight sentences or fewer. Member-facing text, eighth-grade reading level, define terms of art, use exact figures and dates, include appeal rights and route to resolution. Do not promise an outcome the facts don't support — the further 12 visits "may then be authorised," so I should say that, not promise. Reviewed by licensed physical therapist reviewer.
Medical policy MP-660 — I should reference it. "Medically necessary" is a term of art — define briefly. Eight sentences or fewer.
Let me draft:
1. "We received your request for 24 physical therapy visits for your right shoulder."
2. "We approved 12 visits for care between June 1, 2026 and August 31, 2026."
3. "We denied the other 12 visits for now, because our medical policy MP-660 only allows up to 12 visits at first and requires a reassessment before more can be approved."
4. "A reassessment is a check of your progress, using measurements of how well your shoulder is working, done by your therapist."
5. "'Not medically necessary' means we did not yet have the information required to show that the extra visits are needed for your condition."
6. "Your treating therapist can submit a reassessment after your 10th visit showing objective functional gains (measurable improvements in how your shoulder works); if it meets the policy, up to 12 more visits may then be approved."
7. "A licensed physical therapist reviewed your request."
8. "If you disagree, you can ask for an internal appeal within 180 days, and after that an external review, which is an independent look at the decision."
That's 8 sentences. Check dates: the determination gives ISO dates 2026-06-01 through 2026-08-31. "Use the exact dollar figures and dates supplied; do not round them and do not introduce a figure that is not in the facts." Should I write dates as 2026-06-01 or "June 1, 2026"? The harness says dates are ISO 8601 — that's for reporting formats generally, but member-facing... The rule "Use the exact dollar figures and dates supplied" suggests keeping them exact. Writing "June 1, 2026" is the same date. Hmm. The system prompt says "Dates are ISO 8601 (YYYY-MM-DD)" as a general rule for answers. To be safe, I could write the dates as 2026-06-01 through 2026-08-31. That's exact and complies. Eighth-grade reading level — ISO dates are still readable. I'll use ISO format to comply with the ground rule.
Also "180 days" — from when? The facts just say internal appeal within 180 days. Don't invent a from-date. Fine.
Do not promise outcome: "may then be authorised" — say "may be approved" not "will be approved."
Sentence count: let me count carefully and tighten. Maybe combine some. Eight or fewer sentences. Let me finalize:
1. We received your request for 24 physical therapy visits for your right shoulder.
2. We approved 12 visits covering care from 2026-06-01 through 2026-08-31.
3. We denied the remaining 12 visits for now because our medical policy MP-660 allows up to 12 visits at first and requires a reassessment first before more can be approved.
Hmm, "requires a reassessment before authorising more." Let me phrase: "because medical policy MP-660 allows up to 12 visits at first and requires a documented reassessment before it will cover more."
4. A reassessment is a written check of your progress, done by your treating therapist, that measures how well your shoulder is working.
5. In this case, "not medically necessary" means we did not have the required reassessment information showing the extra visits are needed.
6. If your therapist submits a reassessment after your 10th visit showing objective functional gains (measurable improvements in how your shoulder works), up to 12 more visits may then be approved.
7. A licensed physical therapist reviewer reviewed your request.
8. If you disagree with this decision, you may ask for an internal appeal (a review by us) within 180 days, and after that an external review by an independent outside organization.
That's 8 sentences. Good. No bullet points needed — it's a flowing notice. No salutation/sign-off (not asked for a letter).
"Internal appeal" — define: a review by the plan. "External review" — independent outside review. Good, defining terms of art.
Check facts: requested 24, approved 12, dates, denied 12, policy MP-660, route: therapist submits reassessment after visit 10 documenting objective functional gains; further 12 may be authorised. Appeal: internal within 180 days, external thereafter. Reviewed by licensed PT reviewer.
One nuance: "denied as not established as medically necessary at the time of this request" — I capture with "at the time of this request" maybe. Sentence 5 could say "not yet established as medically necessary at the time of this request" meaning "we did not have the information to show... at the time you asked." Let me phrase: "'Medically necessary' means the care is needed to treat your condition under our rules; at the time of this request, the required reassessment information was not on file, so the extra visits are not yet approved."
Hmm, let me keep it tight but accurate. Avoid clinical advice — I'm not telling them to do therapy or not; describing the route is coverage info, fine.
Final draft:
"We received your request for 24 physical therapy visits for your right shoulder. We approved 12 visits for care from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits for now because medical policy MP-660 allows up to 12 visits at first and requires a documented reassessment before more visits can be approved. A reassessment is a written progress check by your treating therapist that measures how well your shoulder is working. "Medically necessary" means the care is shown to be needed for your condition; at the time of this request, that showing had not been made for the extra visits because the reassessment had not yet been done. If your therapist submits a reassessment after your 10th visit showing objective functional gains (measurable improvements in how your shoulder works), up to 12 more visits may then be approved; approval is not guaranteed. A licensed physical therapist reviewed your request. If you disagree with the part we denied, you may ask for an internal appeal (a re-review by us) within 180 days, and after that an external review (an independent review outside the plan)."
Count: 8 sentences. Good.
JSON output: {"message": "..."}. Required key only: "message". Keep JSON valid — escape quotes? I used quotes around "Medically necessary" — inside JSON string need escaping. I could use single quotes or rephrase to avoid quotes: The term medically necessary means... Avoid inner double quotes to keep JSON simple, or escape properly. I'll avoid double quotes inside.
Rewrite sentence 5: Under our rules, medically necessary means care is shown to be needed for your condition; at the time of this request, that showing had not been made for the extra visits.
Semicolons — is a sentence with semicolon one sentence? Generally yes, counts as one sentence. Fine, keeps under limit anyway.
Final message:
"We received your request for 24 physical therapy visits for your right shoulder. We approved 12 visits for care from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits for now because medical policy MP-660 allows up to 12 visits at first and requires a documented reassessment before more visits can be approved. A reassessment is a written progress check by your treating therapist that measures how well your shoulder is working. Under our rules, medically necessary means care is shown to be needed for your condition, and at the time of this request that showing had not been made for the extra visits. If your therapist submits a reassessment after your 10th visit showing objective functional gains, meaning measurable improvements in how your shoulder works, up to 12 more visits may then be approved; approval is not guaranteed. A licensed physical therapist reviewed your request. If you disagree with the denied part, you may ask for an internal appeal, which is a re-review by us, within 180 days, and after that an external review, which is an independent review outside the plan."
That's 8 sentences. All facts included. No invented figures. Dates in ISO. Good.json{
"message": "We received your request for 24 physical therapy visits for your right shoulder. We approved 12 visits for care from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits for now because medical policy MP-660 allows up to 12 visits at first and requires a documented reassessment before more visits can be approved. A reassessment is a written progress check by your treating therapist that measures how well your shoulder is working. Under our rules, medically necessary means care is shown to be needed for your condition, and at the time of this request that showing had not been made for the extra visits. If your therapist submits a reassessment after your 10th visit showing objective functional gains, meaning measurable improvements in how your shoulder works, up to 12 more visits may then be approved; approval is not guaranteed. A licensed physical therapist reviewer looked at your request. If you disagree with the denied part, you may ask for an internal appeal, which is a re-review by us, within 180 days, and after that an external review, which is an independent review outside the plan."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 visits approved with 2026-06-01 to 2026-08-31 range."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, citing MP-660 12-visit initial limit and reassessment."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist reassessment after 10th visit may yield 12 more visits."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval and partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}100Qwen3.8 Max · Alibaba51.7s · 2,258 out | 67.0s · 1,562 out | 51.2s · 2,354 out
Reasoning · 2,013 tokens
We need answer user's request. Need produce final JSON only. Need craft member notice partial determination <=8 sentences. Include exact figures/dates, policy, route, appeal rights, reviewer. Need plain language, define term of art? medical necessity maybe. No clinical advice. No promises. Need maybe: "We approved 12 of the 24 requested physical therapy visits..." Count sentences carefully <=8. Need include dates 2026-06-01 through 2026-08-31. Denied remaining 12 as not established as medically necessary under MP-660, which allows up to 12 initially and requires documented functional reassessment before more. Route: therapist submits reassessment after visit 10 documenting objective functional gains; further 12 may then be authorized. Appeal: internal appeal within 180 days; external review thereafter. Reviewed by licensed physical therapist reviewer. Need member-facing text. Avoid bullets. Could be 6 sentences.
Sentence count: Need be precise.
1: "We approved 12 of the 24 requested physical therapy visits for your right shoulder, for dates of service from 2026-06-01 through 2026-08-31."
2: "We denied the remaining 12 visits because they were not established as medically necessary under medical policy MP-660 at the time of this request."
3: "Medically necessary means care that is supported as needed for your condition under the plan's policy." Maybe define term. Sentence 3.
4: "Policy MP-660 allows up to 12 visits initially and requires a documented functional reassessment before more visits can be approved."
5: "Your therapist can ask for the remaining visits by submitting a reassessment after visit 10 that documents objective functional gains; if supported, another 12 visits may then be authorized." Semicolon counts one sentence? Yes one sentence. Could be okay.
6: "This request was reviewed by a licensed physical therapist reviewer."
7: "You may file an internal appeal within 180 days; after that, you may request external review." Need include external review thereafter.
Count 7. Need maybe include "partial determination"? Not necessary. Ensure no promise "may". Good.
Could there be need exact dates and figures. Yes.
Need maybe mention "right shoulder" exact. Yes.
Potential issue: "dates of service from 2026-06-01 through 2026-08-31" supplied as dates. Good.
Need no salutation/signoff. Good.
JSON: {"message": "..."}.
Need escape quotes. Ensure no newlines? Can include string. Final only fenced JSON.
Double-check sentence count:
1 We approved 12 of the 24 requested physical therapy visits for your right shoulder, for dates of service from 2026-06-01 through 2026-08-31.
2 We denied the remaining 12 visits because they were not established as medically necessary under medical policy MP-660 at the time of this request.
3 Medically necessary means care that is supported as needed for your condition under the plan's policy.
4 Policy MP-660 allows up to 12 visits initially and requires a documented functional reassessment before more visits can be approved.
5 Your therapist can ask for the remaining visits by submitting a reassessment after visit 10 that documents objective functional gains; if supported, another 12 visits may then be authorized.
6 This request was reviewed by a licensed physical therapist reviewer.
7 You may file an internal appeal within 180 days; after that, you may request external review.
Seven sentences. Semicolons not count as sentence ends? For lay counting, semicolon separates clauses but one sentence ending period. okay. Could simplify sentence 5 to avoid semicolon: "Your therapist can ask for the remaining visits by submitting a reassessment after visit 10 that documents objective functional gains. If supported, another 12 visits may then be authorized." That would make 8 sentences total. Still okay. But semicolon keeps fewer. Need maybe define "objective functional gains"? Not necessary? Term of art maybe. Could say "measurable improvement in how your shoulder works". But may exceed. Maybe define "functional reassessment"? We can include simple: "a reassessment that shows measurable improvement". But facts require documented objective functional gains; can phrase plain. Need exact terms? Use exact facts. We can define: "Functional gains are measurable improvements in how your shoulder works." Could add sentence, total 8 if split 5. Let's count: 1 approval, 2 denial, 3 medical necessity, 4 policy, 5 route, 6 functional gains definition, 7 reviewer, 8 appeal. That's exactly 8. But perhaps too many. Need include all. Could combine definitions. Maybe no need define medical necessary? Task says define any term of art first time. Terms: medically necessary, functional reassessment, objective functional gains, internal appeal/external review? We should define enough. Eighth-grade. Need maybe define appeal? Could be too much. We need <=8. We can combine definitions in relative clauses without additional sentences? Sentence count based periods. Use relative clauses. Example:
1 We approved 12 of the 24 requested physical therapy visits for your right shoulder, for dates of service from 2026-06-01 through 2026-08-31.
2 We denied the remaining 12 visits because they were not established as medically necessary, meaning not shown to be needed under the plan's rules, under medical policy MP-660 at the time of this request.
3 Policy MP-660 allows up to 12 visits at first and requires a written functional reassessment, a check of how your shoulder is working, before more visits can be approved.
4 To request the remaining visits, your treating therapist must submit a reassessment after visit 10 documenting objective functional gains, meaning measurable improvements in shoulder function.
5 If that reassessment supports more care, another 12 visits may then be authorized.
6 This request was reviewed by a licensed physical therapist reviewer.
7 You may file an internal appeal, a request for the plan to reconsider, within 180 days.
8 After that, you may request external review, a review outside the plan.
This is 8 sentences. It includes all facts. However "at the time of this request" in sentence 2. Good. "documented" replaced? It says submit reassessment documenting objective functional gains. Good. "may then be authorised" Americanize? Facts use authorises; member likely US, use authorized okay. Need exact dollar? none. Dates exact. "right shoulder". Good. "treating therapist". Good.
Potential issue sentence 2: "not established as medically necessary, meaning not shown to be needed under the plan's rules, under medical policy MP-660" a bit clunky. Fine. Sentence 4: "objective functional gains, meaning measurable improvements in shoulder function." Good.
Need ensure no clinical advice. Good.
Need no bullet. JSON. Ensure escaped apostrophe? JSON string can include apostrophe no issue. Need maybe newline? fine.
Could final:
```json
{
"message": "We approved 12 of the 24 requested physical therapy visits for your right shoulder, for dates of service from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they were not established as medically necessary, meaning not shown to be needed under the plan's rules, under medical policy MP-660 at the time of this request. Policy MP-660 allows up to 12 visits at first and requires a written functional reassessment, a check of how your shoulder is working, before more visits can be approved. To request the remaining visits, your treating therapist must submit a reassessment after visit 10 documenting objective functional gains, meaning measurable improvements in shoulder function. If that reassessment supports more care, another 12 visits may then be authorized. This request was reviewed by a licensed physical therapist reviewer. You may file an internal appeal, a request for the plan to reconsider, within 180 days. After that, you may request external review, a review outside the plan."
}
```
Sentence count 8. Does "Policy MP-660 allows up to 12 visits at first" maybe exact "initially" but okay. "written functional reassessment" facts say documented; written maybe okay? Could be not necessarily written; documented. Better: "documented functional reassessment". Sentence 3: "requires a documented functional reassessment, a check of how your shoulder is working". Good.
Need route says after visit 10; further 12 may then be authorised. Good.
Appeal rights: internal appeal within 180 days; external review thereafter. Our sentence 7 and 8. Good.
Potential concern: "After that" could mean after internal appeal? It says external review thereafter (likely after internal appeal). Good.
Need maybe "you may request external review thereafter" exact. Good.
No additional keys.
Final only fenced JSON. Ensure no trailing text.
json{
"message": "We approved 12 of the 24 requested physical therapy visits for your right shoulder, for dates of service from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they were not established as medically necessary, meaning not shown to be needed under the plan's rules, under medical policy MP-660 at the time of this request. Policy MP-660 allows up to 12 visits at first and requires a documented functional reassessment, a check of how your shoulder is working, before more visits can be approved. To request the remaining visits, your treating therapist must submit a reassessment after visit 10 documenting objective functional gains, meaning measurable improvements in shoulder function. If that reassessment supports more care, another 12 visits may then be authorized. This request was reviewed by a licensed physical therapist reviewer. You may file an internal appeal, a request for the plan to reconsider, within 180 days. After that, you may request external review, a review outside the plan."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 of 24 approved with date range 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Explains therapist submits reassessment after visit 10 with objective functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "States internal appeal right within 180 days."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: 12 approved, 12 denied."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 1,346 tokens
We need answer user's request. Need produce final exactly one fenced JSON code block with key "message". Need member notice partial determination, <=8 sentences. Use exact figures/dates. Explain terms? Need define medical necessity? Maybe not term of art? We need include appeal rights deadlines route. No clinical advice. Need maybe say reviewed by licensed physical therapist reviewer? Could include. Need eight sentences or fewer. Need plain eighth-grade. Need no headers/bullets. Need no salutation/signoff. Need exact dollars? None. Dates ISO. Need mention 12 approved dates 2026-06-01 through 2026-08-31. Denied remaining 12 as not established as medically necessary at time of request under MP-660, authorizes up to 12 visits initially and requires documented functional reassessment before authorizing more. Route: therapist submits reassessment after visit 10 documenting objective functional gains; further 12 may then be authorised. Need careful not promise: may be authorized. Appeal: internal appeal within 180 days; external review thereafter. Could mention if disagree. Need maybe define "medically necessary"? Term of art. Define first time: "needed to treat your condition based on our medical policy" maybe. But must not introduce facts? It's definition okay? The task says define any term of art first time it appears. We can say "medically necessary, meaning shown to be needed for treatment,". Need exact policy MP-660. Could write 5-6 sentences.
Need ensure no more than 8 sentences. Draft:
"We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31."
"We denied the other 12 requested visits because they were not established as medically necessary, meaning shown to be needed for your care, at the time of this request under medical policy MP-660."
"MP-660 allows up to 12 visits at first and requires a written functional reassessment before more visits can be approved."
"Your therapist can ask for the remaining visits by sending a reassessment after visit 10 that shows objective functional gains."
"If that reassessment supports more care, another 12 visits may then be authorized."
"This request was reviewed by a licensed physical therapist reviewer."
"If you disagree, you may file an internal appeal within 180 days of this notice, and you may request external review after that."
Need check sentence count 7. Exact dates. "functional reassessment" maybe define? term of art? Could define: "a review of how your shoulder is working". Maybe sentence 3: "...requires a documented functional reassessment, a written review of how your shoulder is working, before..." Good. Objective functional gains maybe define? "measurable improvements in how your shoulder works". Could include. But avoid too long.
Need ensure "partial determination" maybe not mention. Member notice should be direct.
Potential issue: "medical policy MP-660" maybe exact. Need say "authorises" vs "authorizes"? Facts use authorises. We can use either? Use supplied exact? It says authorises. Maybe use "authorizes"? Not critical? Could use exact spelling from facts? Use "authorises" to be safe. But US? The harness maybe UK? But dollars? Doesn't matter. Need include route. Need appeal rights: internal appeal within 180 days; external review thereafter. Need maybe "of this notice" not supplied? Could be inferred? The facts say internal appeal within 180 days; don't add "of this notice"? It might introduce figure? It's a deadline route. But exact? Could say "within 180 days" no start date. Better: "You may file an internal appeal within 180 days." Then external review thereafter. That avoids adding start event. But regulator might expect timeframe. The facts only say within 180 days. We can use that.
Need no bullets. JSON string with newlines? Can include
? Fine. Need fenced JSON only.
Let's ensure sentence splitting: 7 sentences. Sentence with abbreviations? "MP-660" no period. Dates hyphens no periods. Good.
Need maybe define "objective functional gains"? It's a term? Could phrase "measurable improvements in how your shoulder works". But route fact says documenting objective functional gains. Use exact? We can define: "objective functional gains, meaning measurable improvements in how your shoulder works,". This is helpful. Sentence 4: "Your treating therapist can submit a reassessment after visit 10 documenting objective functional gains, meaning measurable improvements in how your shoulder works." That's long. Sentence 5: "A further 12 visits may then be authorised." Good.
Need include "treated by licensed physical therapist reviewer"? Member may care. It is fact. Include.
Maybe final message:
"We approved 12 physical therapy visits for your right shoulder for dates 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they were not established as medically necessary, meaning shown to be needed for your care, at the time of this request under medical policy MP-660. MP-660 authorises up to 12 visits initially and requires a documented functional reassessment, a written review of how your shoulder is working, before authorising more visits. Your treating therapist can submit that reassessment after visit 10 documenting objective functional gains, meaning measurable improvements in how your shoulder works. If the reassessment supports more visits, a further 12 visits may then be authorised. This request was reviewed by a licensed physical therapist reviewer. If you disagree, you may file an internal appeal within 180 days, and external review is available after that."
7 sentences. Does "external review is available after that" satisfy? Yes. Could say "external review thereafter". Good.
Need maybe "denied the remaining 12 visits" exactly. Good.
Could "medically necessary" definition "shown to be needed for your care" maybe not precise but okay. Need not clinical advice. Good.
Ensure JSON escaping okay. Final fenced JSON. No extra keys. Need only message.
json{
"message": "We approved 12 physical therapy visits for your right shoulder for dates 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they were not established as medically necessary, meaning shown to be needed for your care, at the time of this request under medical policy MP-660. MP-660 authorises up to 12 visits initially and requires a documented functional reassessment, a written review of how your shoulder is working, before authorising more visits. Your treating therapist can submit that reassessment after visit 10 documenting objective functional gains, meaning measurable improvements in how your shoulder works. If the reassessment supports more visits, a further 12 visits may then be authorised. This request was reviewed by a licensed physical therapist reviewer. If you disagree, you may file an internal appeal within 180 days, and external review is available after that."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 with objective gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly presented as partial: approval plus denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 2,131 tokens
We need answer user's request. Need produce final JSON only. Need craft member notice partial determination, <=8 sentences. Include exact figures/dates, define term? medical policy? Need appeal rights/deadlines/route. No clinical advice. Need likely mention 12 approved dates, remaining denied not established medically necessary under MP-660, authorizes up to 12 initially and requires documented functional reassessment before more. Route: therapist submits reassessment after visit 10 documenting objective functional gains; further 12 may be authorized. Appeal internal within 180 days; external review thereafter. Reviewed by licensed PT reviewer. Need member-facing text. Sentence count <=8. Need no salutation/signoff. Maybe:
"We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31."
"We denied the remaining 12 visits because they are not established as medically necessary at the time of this request under medical policy MP-660."
"MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits can be authorized."
"Your therapist can ask for the remaining visits by sending a reassessment after visit 10 that shows objective functional gains."
"If that reassessment supports more care, another 12 visits may be authorized."
"This decision was reviewed by a licensed physical therapist reviewer."
"You may file an internal appeal within 180 days."
"After the internal appeal, you may request external review."
That's 8 sentences. Exact dates and numbers. Does "medical policy" term need define? It is term of art? Could define: "Medical policy is our rule for deciding whether care is covered." But sentence limit. Maybe include definition within sentence? Need define term of art first time. "medical policy MP-660" maybe okay? Could define "medical policy (a coverage rule)"? Let's make clear. But exact prompt says "under medical policy MP-660". We can write "under medical policy MP-660, the plan rule that..." Maybe 8 sentences. Need maybe "not established as medically necessary" define medically necessary? Term of art? Could define? Eighth grade. Maybe: "medically necessary means needed according to our clinical rules". But limited. Could be:
1 We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31.
2 We denied the other 12 visits because they are not established as medically necessary, meaning not shown to be needed under our clinical rules, at the time of this request.
3 This decision uses medical policy MP-660, which allows up to 12 visits at first and requires a written functional reassessment before more visits are approved.
4 To ask for the remaining visits, your treating therapist must send a reassessment after visit 10 showing objective functional gains.
5 If that reassessment supports more care, another 12 visits may be authorized.
6 A licensed physical therapist reviewer reviewed this case.
7 You may file an internal appeal within 180 days.
8 After that, you may request external review.
Count 8. Does "medical policy" first appearance maybe defined? Sentence 3 says medical policy MP-660, which allows... good enough? Term of art "functional gains" maybe not defined. Could say "objective functional gains, meaning measurable improvements in how your shoulder works". Need keep <=8. Sentence 4 can include definition: "showing objective functional gains, meaning measurable improvements in how your shoulder works." That's okay. "internal appeal" and "external review" maybe define? Appeal rights include. Maybe define internal appeal? Member notice likely knows. But term of art? Could say "internal appeal, a request that we review the decision". Need sentence count. Let's optimize:
1 We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31.
2 We denied the remaining 12 visits because they are not established as medically necessary at the time of this request under medical policy MP-660.
3 MP-660 is the plan rule that allows up to 12 visits at first and requires a documented functional reassessment before more visits can be authorized.
4 A functional reassessment is a written check of how well your shoulder is working.
5 To request the remaining visits, your treating therapist must send a reassessment after visit 10 documenting objective functional gains, meaning measurable improvements in shoulder function.
6 If that reassessment supports more care, another 12 visits may be authorized.
7 This case was reviewed by a licensed physical therapist reviewer.
8 You may file an internal appeal within 180 days, and external review after that.
That's 8. But external review after internal appeal? The facts: internal appeal within 180 days; external review thereafter. Sentence 8: "You may file an internal appeal within 180 days, and external review after that." Maybe missing "request". "You may file an internal appeal within 180 days and may request external review after that." Good. Need maybe "thereafter" only if internal appeal done. Good.
Need JSON with message string. Ensure no bullets. Final only fenced JSON. Need no extra keys. Also ensure no newline? Could include string with
? Better one line. Need escape? We can put as normal string. JSON:
{
"message": "We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not established as medically necessary at the time of this request under medical policy MP-660. MP-660 is the plan rule that allows up to 12 visits at first and requires a documented functional reassessment before more visits can be authorized. A functional reassessment is a written check of how well your shoulder is working. To request the remaining visits, your treating therapist must send a reassessment after visit 10 documenting objective functional gains, meaning measurable improvements in shoulder function. If that reassessment supports more care, another 12 visits may be authorized. This case was reviewed by a licensed physical therapist reviewer. You may file an internal appeal within 180 days and may request external review after that."
}
Check exact figures: 24 requested? Do we need mention requested 24? We say approved 12 denied remaining 12 implies. Could mention "You asked for 24...". Sentence count maybe:
1 You asked for 24 physical therapy visits for your right shoulder.
2 We approved 12 visits from 2026-06-01 through 2026-08-31.
3 We denied the remaining 12 visits because they are not established as medically necessary at the time of this request under medical policy MP-660.
4 MP-660 is the plan rule that allows up to 12 visits at first and requires a documented functional reassessment before more visits can be authorized.
5 A functional reassessment is a written check of how well your shoulder is working.
6 To request the remaining visits, your treating therapist must send a reassessment after visit 10 documenting objective functional gains, meaning measurable improvements in shoulder function.
7 If that reassessment supports more care, another 12 visits may be authorized; this case was reviewed by a licensed physical therapist reviewer.
8 You may file an internal appeal within 180 days and may request external review after that.
This is 8, includes requested 24. Sentence 7 combines maybe long but okay. But semicolon? It's one sentence. Need exact date supplied. Good. Does "another 12 visits" not exact "a further 12 visits" okay. "medical policy MP-660" exact. "not established as medically necessary at the time of this request under medical policy MP-660" exact. "documented functional reassessment" yes. "after visit 10 documenting objective functional gains" yes. "licensed physical therapist reviewer" yes. Appeal rights. Good.
Potential issue: "MP-660 is the plan rule" maybe supplied says medical policy. Fine. "external review after that" if internal appeal? It says external review thereafter, okay. Could make clearer: "after the internal appeal decision". But facts only thereafter. Maybe "after the internal appeal." Sentence: "You may file an internal appeal within 180 days and may request external review after the internal appeal." That's clear. But if external review thereafter means after internal appeal process. Good.
Need no promise: "may be authorized" not will. Good.
Need <=8 sentences. Count exactly: 1 You asked... 2 We approved... 3 We denied... 4 MP-660... 5 A functional... 6 To request... 7 If that...; this case... 8 You may... Total 8.
One concern: "A functional reassessment is a written check" may be somewhat invented? But facts say documented functional reassessment; defining documented as written check. Acceptable? It introduces "written" maybe not in facts. But "documented" means written record. Could avoid defining to not introduce. But term of art needs define. Could say "documented means recorded in your clinical notes"? But not necessary? Maybe "documented functional reassessment" could be defined as "a recorded recheck". Use "recorded" rather than written. "A functional reassessment is a recorded check of how well your shoulder is working." Good.
Need maybe "objective functional gains" definition. Good.
Let's final JSON. Ensure fenced JSON only. Final.json{
"message": "You asked for 24 physical therapy visits for your right shoulder. We approved 12 visits from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not established as medically necessary at the time of this request under medical policy MP-660. MP-660 is the plan rule that allows up to 12 visits at first and requires a documented functional reassessment before more visits can be authorized. A functional reassessment is a recorded check of how well your shoulder is working. To request the remaining visits, your treating therapist must send a reassessment after visit 10 documenting objective functional gains, meaning measurable improvements in shoulder function. If that reassessment supports more care, another 12 visits may be authorized; this case was reviewed by a licensed physical therapist reviewer. You may file an internal appeal within 180 days and may request external review after the internal appeal."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 through 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 with objective functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly presented as partial: approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}100GPT-5.6 Terra · OpenAI1.8s · 159 out | 2.0s · 157 out | 1.9s · 159 out
json{"message":"We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We denied the remaining 12 requested visits because medical necessity was not established at this time under medical policy MP-660. This policy approves up to 12 visits at first and requires a documented functional reassessment before more visits can be approved. After visit 10, your treating therapist can submit a reassessment showing objective functional gains, and up to 12 additional visits may then be authorized. A licensed physical therapist reviewer completed this review. You may file an internal appeal within 180 days of this notice. If the internal appeal is not decided in your favor, you may request an external review."}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 with functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval and partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}json{"message":"We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We denied the remaining 12 requested visits because medical necessity was not established at this time under medical policy MP-660. This policy approves up to 12 visits at first and requires a documented functional reassessment before more visits can be approved. After your 10th visit, your treating therapist can submit a reassessment showing objective functional gains, and up to 12 additional visits may then be authorized. A licensed physical therapist reviewer reviewed this request. You may file an internal appeal within 180 days of this decision. If the internal appeal is denied, you may request an external review."}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 with objective functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}json{"message":"We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We did not approve the remaining 12 requested visits because medical policy MP-660 does not establish that they are medically necessary at this time. This policy approves up to 12 visits at first and requires a documented functional reassessment before more visits can be approved. After visit 10, your treating therapist may submit a reassessment showing objective functional gains, and up to 12 additional visits may then be authorized. A licensed physical therapist reviewer completed this review. You may file an internal appeal within 180 days of this notice. If the internal appeal is completed, you may request an external review."}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 for 12 more visits."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}100GLM-5.3 Flash · Z.ai21.6s · 1,471 out | 93.5s · 3,490 out | 15.8s · 1,098 out
Reasoning · 1,481 tokens
The task: write a member's notice for a partial determination. Eight sentences or fewer. This is task family EOB-008 — member explanation.
Required JSON key: "message" — the member-facing text itself. No headers, no salutation/sign-off unless the item asks for a letter. This is a notice, so plain text is fine.
Key facts to include:
- Requested: 24 physical therapy visits for the right shoulder
- Approved: 12 visits, dates 2026-06-01 through 2026-08-31
- Denied: remaining 12 visits, as not established as medically necessary at time of request under medical policy MP-660, which authorizes up to 12 visits initially and requires documented functional reassessment before authorizing more
- Route: treating therapist submits a reassessment after visit 10 documenting objective functional gains; a further 12 visits may then be authorized
- Appeal rights: internal appeal within 180 days; external review thereafter
- Reviewed by a licensed physical therapist reviewer
Eight sentences or fewer. Include appeal rights/deadlines — regulator reads those. Define terms of art: "medically necessary," maybe "internal appeal," "external review." Eighth-grade reading level. Don't promise the outcome — say "may then be authorized," which the facts support.
Also mention reviewed by a licensed physical therapist reviewer — that's part of the determination (peer review by same specialty is a regulatory expectation).
Let me draft:
1. "We have reviewed the request for 24 physical therapy visits for your right shoulder and approved 12 of them, for dates of service from 2026-06-01 through 2026-08-31."
2. "The remaining 12 visits are not approved at this time, because they are not established as medically necessary—meaning not supported as needed for your care—under our medical policy MP-660."
3. "That policy allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved."
4. "A licensed physical therapist reviewed this request."
5. "Your treating therapist can request the remaining visits by submitting a reassessment after your 10th visit that documents objective functional gains; if that is received, a further 12 visits may then be authorized."
6. "If you disagree with this decision, you may file an internal appeal with us within 180 days of this notice."
7. "If the internal appeal does not go your way, you may then seek external review by an independent reviewer."
8. Maybe a contact sentence — but we have no contact info in the facts, so don't fabricate a phone number.
Count: 7 sentences. Good, within eight.
Check: no clinical advice, no promised outcome ("may then be authorized" — matches facts). Exact dates and numbers. Eighth-grade level — "objective functional gains" is from the facts; I should keep it but maybe briefly explain? The facts use that phrase; I can say "documents objective functional gains (measurable improvement)". Hmm, adding a parenthetical definition could help readability. But careful with sentence limits. It's fine within one sentence.
"Medically necessary" — I defined it inline as "not supported as needed for your care." Reasonable.
Dates ISO format per harness rules — 2026-06-01 through 2026-08-31. Keep as supplied.
No salutation or sign-off. Plain paragraph or short. No headers. The message is one block of text.
One JSON object with key "message". Exactly one fenced JSON block.
Let me refine wording:
"Your request for 24 physical therapy visits for your right shoulder has been partially approved: 12 visits are approved for dates of service from 2026-06-01 through 2026-08-31, and the remaining 12 visits are denied for now."
Hmm, "denied" is the correct determination term — the member notice should be clear it's a denial of those visits. The facts say "Denied: the remaining 12 visits, as not established as medically necessary at the time of this request under medical policy MP-660."
Sentence count final:
1. We have finished reviewing your request for 24 physical therapy visits for your right shoulder and are approving 12 visits for dates of service from 2026-06-01 through 2026-08-31.
2. The remaining 12 visits are denied at this time because they are not established as medically necessary, meaning not shown to be needed for your care, under medical policy MP-660.
3. That policy allows up to 12 visits at first and requires a documented functional reassessment before it will cover more.
4. A licensed physical therapist reviewed your request as part of this decision.
5. To have the remaining visits considered, your treating therapist can submit a reassessment after your 10th visit that documents objective functional gains, meaning measurable improvement, and a further 12 visits may then be authorized.
6. If you disagree with this decision, you can file an internal appeal with us within 180 days of the date of this notice.
7. If your internal appeal is unsuccessful, you may then request external review by an independent reviewer.
7 sentences. Good.
Should I mention "partial determination" term? The item calls it a partial determination; saying "partial" is natural. Sentence 1 covers it by approving 12 and denying 12.
Check no fabricated details: no phone numbers, no addresses, no member names, no claim numbers (none supplied). Good. Don't say "you may owe money" — nothing about cost share given; don't introduce.
Output format: exactly one fenced JSON code block with {"message": "..."}.
Careful with JSON escaping — em dashes are fine in JSON. Keep it a single string with spaces.
Final check on tone: eighth-grade, plain. "Medically necessary" defined, "external review" defined as independent reviewer, "functional reassessment" — okay. "Objective functional gains, meaning measurable improvement" — good.
Write the JSON block only.
json{
"message": "We have finished reviewing your request for 24 physical therapy visits for your right shoulder and are approving 12 visits for dates of service from 2026-06-01 through 2026-08-31. The remaining 12 visits are denied at this time because they are not established as medically necessary, meaning not shown to be needed for your care, under our medical policy MP-660. That policy allows up to 12 visits at first and requires a documented functional reassessment before it will cover more. A licensed physical therapist reviewed your request as part of this decision. To have the remaining visits considered, your treating therapist can submit a reassessment after your 10th visit that documents objective functional gains, meaning measurable improvement, and a further 12 visits may then be authorized. If you disagree with this decision, you may file an internal appeal with us within 180 days of the date of this notice. If your internal appeal does not go in your favor, you may then request external review by an independent reviewer."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "Approves 12 visits with 2026-06-01 through 2026-08-31 range."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit initial limit and reassessment."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist may submit reassessment after 10th visit with objective gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated, plus external review."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 3,254 tokens
Let me analyze this task. It's a member explanation task (item EOB-008). I need to write the member's notice for a partial determination of a prior authorization request for physical therapy visits.
Key facts:
- Requested: 24 physical therapy visits for right shoulder
- Approved: 12 visits, dates 2026-06-01 through 2026-08-31
- Denied: remaining 12 visits, as not established as medically necessary at the time of this request under medical policy MP-660, which authorizes up to 12 visits initially and requires a documented functional reassessment before authorizing more
- Route to remaining visits: treating therapist submits a reassessment after visit 10 documenting objective functional gains; a further 12 visits may then be authorized
- Appeal rights: internal appeal within 180 days; external review thereafter
- Reviewed by a licensed physical therapist reviewer
Constraints:
- Eight sentences or fewer
- Roughly eighth-grade reading level
- Define terms of art first time they appear
- Use exact dollar figures and dates supplied (no dollar figures here, but dates: 2026-06-01 through 2026-08-31)
- Include appeal rights, deadlines, route to resolution — those are what a regulator reads
- Don't promise an outcome the facts don't support — "a further 12 visits may then be authorized" — must say "may," not "will"
- Don't give clinical advice
Required JSON keys: "message" (string). The task family says required key is "message". Just one key. Let me check: "Required JSON keys: 'message' string — the member-facing text itself." So the JSON object has just "message".
Let me draft the notice, keeping to eight sentences or fewer.
Draft:
"We have reviewed your request for 24 physical therapy visits for your right shoulder and have made a partial decision. We approved 12 visits between 2026-06-01 and 2026-08-31. We did not approve the remaining 12 visits at this time, because they are not established as medically necessary under our medical policy MP-660, which allows up to 12 visits at first and requires a documented functional reassessment before more visits are approved. "Medically necessary" means the care is appropriate for your condition according to our coverage rules. Your treating therapist can request the additional visits by sending us a reassessment, completed after your 10th visit, that documents objective functional gains; if that request is approved, up to 12 more visits may be authorized. This decision was made by a licensed physical therapist reviewer. If you disagree, you may ask for an internal appeal within 180 days of this notice, and after that you may seek external review by an independent reviewer."
Count sentences:
1. "We have reviewed your request for 24 physical therapy visits for your right shoulder and made a partial decision."
2. "We approved 12 visits, with dates from 2026-06-01 through 2026-08-31."
3. "We did not approve the remaining 12 visits at this time because they are not established as medically necessary under medical policy MP-660, which authorizes up to 12 visits initially and requires a documented functional reassessment before authorizing more."
4. ""Medically necessary" means your care is appropriate for your condition under our coverage rules." — defines term of art.
5. "To continue physical therapy, your treating therapist can submit a functional reassessment after your 10th visit that documents objective functional gains, and up to 12 more visits may then be authorized."
6. "A licensed physical therapist reviewer made this decision."
7. "If you disagree with this decision, you may file an internal appeal with us within 180 days."
8. "After the internal appeal, you may also request external review."
That's 8 sentences. Good.
Let me refine the language for reading level. "Objective functional gains" is from the facts — I should keep it since it's the actual criterion, but could explain briefly. Actually, "measurable improvement in function" is a plain-language gloss of "objective functional gains." But the instruction says use exact figures and dates supplied; for prose criteria, I can paraphrase slightly while keeping the meaning. I'll say "documents objective functional gains (measurable improvement in how your shoulder works)" — but that adds length. Maybe keep it simpler: "that documents objective functional gains, meaning measurable improvement in your shoulder function." Hmm, that's getting long. Eighth-grade level matters.
Also "partial determination" — the item says "partial determination," but member-facing I should say "we approved part of your request and denied part."
Avoid semicolons creating compound issues — semicolons don't count as separate sentences, but keep readability.
Sentence count check with my final draft. Let me write it carefully:
1. "We reviewed your request for 24 physical therapy visits for your right shoulder and made a partial decision: we approved some visits and did not approve others at this time." — Hmm, colon then clause; that's one sentence.
Maybe simpler:
1. "We reviewed the request for 24 physical therapy visits for your right shoulder and have made a partial decision."
2. "We approved 12 visits, with service dates from 2026-06-01 through 2026-08-31."
3. "We did not approve the remaining 12 visits at this time because medical policy MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved, and medical necessity for those visits has not been established in this request."
4. ""Medically necessary" means care that our coverage rules consider appropriate for your condition."
5. "Your treating therapist can ask for the remaining visits by sending us a functional reassessment, done after your 10th visit, that documents objective functional gains; if approved, up to 12 more visits may be authorized."
6. "A licensed physical therapist reviewer took part in this decision."
7. "If you disagree, you may file an internal appeal with us within 180 days of this notice."
8. "After the internal appeal process, you may request external review."
Eight sentences. Good.
Wait — sentence 3 is a bit convoluted. Let me restructure: "We did not approve the remaining 12 visits at this time because they were not established as medically necessary under medical policy MP-660, which allows up to 12 visits at first and requires a documented functional reassessment before approving more." That mirrors the facts. Good.
Also, note: "not established as medically necessary at the time of this request" — I should convey that this could change, i.e., it's a "for now" denial. The phrase "at this time" does that.
Should I define "objective functional gains"? It's a term of art. Eighth-grade: "objective functional gains (measurable improvement in how your shoulder is working)". That's a parenthetical, not a new sentence. But it adds words. The instructions say define any term of art the first time it appears. "Medically necessary" is definitely a term of art. "Objective functional gains" also qualifies. "External review" and "internal appeal" — I could briefly define: "external review (review by an independent reviewer outside our plan)". Let me try to fit within 8 sentences.
Revised:
1. "We reviewed the request for 24 physical therapy visits for your right shoulder and made a partial decision: some visits are approved and some are not approved at this time."
Hmm, colon usage might make it read as one sentence, fine. But maybe cleaner as separate sentences. Let me count carefully with a full final draft:
Final draft:
"We reviewed the request for 24 physical therapy visits for your right shoulder and made a partial decision. We approved 12 visits, with dates from 2026-06-01 through 2026-08-31. We did not approve the remaining 12 visits at this time because medical necessity has not been established for them under our medical policy MP-660, which allows up to 12 visits at first and requires a documented functional reassessment before approving more. "Medically necessary" means care that our coverage rules consider appropriate for your condition. Your treating therapist can request the remaining visits by sending us a functional reassessment, completed after your 10th visit, that documents objective functional gains — measurable improvement in how your shoulder is working — and, if approved, up to 12 more visits may be authorized. A licensed physical therapist reviewer took part in this decision. If you disagree, you may file an internal appeal with us within 180 days of this notice. After the internal appeal, you may request external review, which is a review by an independent reviewer outside our plan."
Count: 1, 2, 3, 4, 5, 6, 7, 8. Eight sentences exactly.
Check reading level: mostly plain. Sentence 5 is long; maybe split? If I split it, I'd exceed 8. Let me shorten sentence 5: "Your treating therapist can request the remaining visits by sending us a functional reassessment after your 10th visit that documents objective functional gains (measurable improvement in how your shoulder is working); up to 12 more visits may then be authorized." Still long but one sentence.
Actually, I could drop the gloss on objective functional gains to shorten, but the instruction says define terms of art. "Objective functional gains" is jargon; a gloss helps. Keep it brief.
Also "partial decision" — maybe "we approved part of your request and denied part for now." Simpler.
Let me also make sure I don't promise the further 12 visits will be approved — I say "may then be authorized." Good.
Dates format: ISO 8601 per ground rules — 2026-06-01 and 2026-08-31. In a member notice, ISO dates are the harness convention; use them exactly.
One nuance: the denial reason is "not established as medically necessary at the time of this request" — I should include "at the time of this request" or "at this time" to convey it's not a permanent denial. I have "at this time."
The route: "the treating therapist submits a reassessment after visit 10 documenting objective functional gains; a further 12 visits may then be authorized." I've covered that.
Reviewer: "Reviewed by a licensed physical therapist reviewer" — included: "This decision was made with input from a licensed physical therapist reviewer" or "A licensed physical therapist reviewer made this decision." The facts say "Reviewed by a licensed physical therapist reviewer" — so "This decision was reviewed by a licensed physical therapist reviewer." Safe.
Appeal: internal appeal within 180 days; external review thereafter. Included.
Should I mention this is a "partial determination" / prior authorization notice? The member-facing term could be "partial approval." Fine.
Final sentence-level polish:
1. "We reviewed your request for 24 physical therapy visits for your right shoulder and made a partial decision."
2. "We approved 12 visits, with dates from 2026-06-01 through 2026-08-31."
3. "We did not approve the remaining 12 visits at this time because medical necessity has not been established for them under medical policy MP-660, which allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved."
4. "Medically necessary means care that our coverage rules consider appropriate for your condition."
5. "Your treating therapist can request the remaining visits by sending us a functional reassessment, completed after your 10th visit, that documents objective functional gains (measurable improvement in how your shoulder is working); up to 12 more visits may then be authorized."
6. "A licensed physical therapist reviewer took part in this decision."
7. "If you disagree with this decision, you may file an internal appeal with us within 180 days of this notice."
8. "After the internal appeal, you may also ask for external review, which means an independent reviewer outside our plan reviews the decision."
That's 8 sentences. Reading level: mostly fine. Sentence 5 is heavy but acceptable. Sentence 3 uses "medical necessity has not been established" — matches the facts ("not established as medically necessary").
Actually for the appeal-deadline nuance: "external review thereafter" — I say "After the internal appeal, you may also ask for external review." That conveys it. Maybe "If your internal appeal is not decided in your favor, you may request external review" — the facts just say "external review thereafter." Keep simple: "After the internal appeal, you may request external review."
One more consideration: quotes around "medically necessary" in JSON — need to escape if using double quotes inside string. I can use single quotes or rephrase: "Medically necessary means care that our coverage rules consider appropriate for your condition." Without quotes, fine. Or keep quotes and escape them: \"Medically necessary\". JSON allows escaped quotes. I'll just avoid the quotes to keep JSON simple, or use escaped quotes for clarity. Escaped quotes are fine in JSON. I'll use plain text without quotes to minimize risk.
Should the notice mention "this is a partial determination"? Yes, sentence 1 says partial decision.
Also, should I say "under medical policy MP-660, which authorizes up to 12 visits initially and requires a documented functional reassessment before authorizing more" — I have that.
The key: only "message". Output exactly one fenced JSON code block.
Double-check the JSON:
```json
{"message": "..."}
```
Make sure no unescaped characters. Parentheses, semicolons fine. No newlines inside string ideally (could use \n but plain sentence flow is fine).
Final message text:
"We reviewed your request for 24 physical therapy visits for your right shoulder and made a partial decision. We approved 12 visits, with dates from 2026-06-01 through 2026-08-31. We did not approve the remaining 12 visits at this time because medical necessity has not been established for them under medical policy MP-660, which allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved. Medically necessary means care that our coverage rules consider appropriate for your condition. Your treating therapist can request the remaining visits by sending us a functional reassessment, completed after your 10th visit, that documents objective functional gains, meaning measurable improvement in how your shoulder is working; up to 12 more visits may then be authorized. A licensed physical therapist reviewer took part in this decision. If you disagree with this decision, you may file an internal appeal with us within 180 days of this notice. After the internal appeal, you may also ask for external review, which means an independent reviewer outside our plan will review the decision."
Count sentences: 1) partial decision. 2) approved. 3) not approved. 4) definition. 5) route. 6) reviewer. 7) internal appeal. 8) external review. Eight.
Semicolon in sentence 5 — okay, one sentence.
Hmm, "took part in this decision" vs "reviewed this request" — the facts say "Reviewed by a licensed physical therapist reviewer." Safer: "This request was reviewed by a licensed physical therapist." That's a factual statement. I'll use "This request was reviewed by a licensed physical therapist reviewer."
Alright. Emit the JSON block only.json{
"message": "We reviewed your request for 24 physical therapy visits for your right shoulder and made a partial decision. We approved 12 visits, with dates from 2026-06-01 through 2026-08-31. We did not approve the remaining 12 visits at this time because medical necessity has not been established for them under medical policy MP-660, which allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved. Medically necessary means care that our coverage rules consider appropriate for your condition. Your treating therapist can request the remaining visits by sending us a functional reassessment, completed after your 10th visit, that documents objective functional gains, meaning measurable improvement in how your shoulder is working; up to 12 more visits may then be authorized. This request was reviewed by a licensed physical therapist reviewer. If you disagree with this decision, you may file an internal appeal with us within 180 days of this notice. After the internal appeal, you may also ask for external review, which means an independent reviewer outside our plan will review the decision."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 through 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit initial limit and reassessment."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits functional reassessment after visit 10 for 12 more."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated, plus external review."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Explicitly framed as a partial decision."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true,
"judgeCostUSD": 0.0114255
}Reasoning · 861 tokens
The task: write a member's notice for a partial determination. Eight sentences or fewer. Required JSON keys for task family "member explanation": "message" string.
Key facts to include:
- Requested 24 PT visits for right shoulder
- Approved 12 visits, dates 2026-06-01 through 2026-08-31
- Denied remaining 12 visits, as not established as medically necessary under medical policy MP-660, which authorizes up to 12 visits initially and requires a documented functional reassessment before authorizing more
- Route to remaining visits: treating therapist submits a reassessment after visit 10 documenting objective functional gains; a further 12 visits may then be authorized
- Appeal rights: internal appeal within 180 days; external review thereafter
- Reviewed by a licensed physical therapist reviewer
Eight sentences or fewer. Eighth-grade reading level. Define terms of art. Include appeal rights and deadlines. No clinical advice. Don't promise outcome — "may then be authorized."
Draft:
"We have finished reviewing the request for 24 physical therapy visits for your right shoulder. We approved 12 visits between 2026-06-01 and 2026-08-31. We did not approve the other 12 visits because, under our medical policy MP-660, up to 12 visits are covered at first, and more visits need a documented functional reassessment showing they are medically necessary (that is, needed for your care). Your physical therapist can request the remaining visits by sending us a reassessment completed after visit 10 that documents objective functional gains, such as measured improvements in movement or daily activities — wait, "objective functional gains" — I should define lightly. After that, a further 12 visits may be approved, but we cannot promise that now. A licensed physical therapist who does not... actually the facts say "Reviewed by a licensed physical therapist reviewer" — include that this decision was reviewed by a licensed physical therapist. If you disagree, you can appeal (ask us to look again) within 180 days, and after that you can ask for an independent external review."
Count sentences: 1) finished reviewing. 2) approved 12. 3) denied other 12 + reason. 4) route. 5) may be authorized, no promise. 6) reviewed by licensed PT. 7) appeal rights 180 days. 8) external review. That's 8. Good.
Let me tighten to keep each sentence clean and within 8.
Sentence 1: "We have reviewed the request for 24 physical therapy visits for your right shoulder and made a partial decision."
Sentence 2: "We approved 12 visits, for dates 2026-06-01 through 2026-08-31."
Sentence 3: "We did not approve the remaining 12 visits because, under medical policy MP-660, only up to 12 visits are authorized at first, and more visits require a documented functional reassessment showing they are medically necessary (needed for your care)."
Sentence 4: "To request the remaining visits, your treating therapist can send us a reassessment completed after visit 10 that documents objective functional gains, meaning measurable improvements in what you can do."
Sentence 5: "If that reassessment supports the care, a further 12 visits may then be authorized, though this decision does not guarantee that."
Sentence 6: "This decision was reviewed by a licensed physical therapist."
Sentence 7: "If you disagree, you may appeal, which means asking us to review the decision again, within 180 days."
Sentence 8: "If the internal appeal does not go your way, you can then request an external review by an independent reviewer."
Eight sentences exactly. Dates as ISO per harness rules — the harness says dates are ISO 8601; the message should use the exact dates supplied. Use 2026-06-01 through 2026-08-31.
"medically necessary" — define: care that is needed and appropriate for a condition under accepted standards. Keep simple.
Only key: "message". Output exactly one fenced JSON block.
Make sure no extra keys. No preamble.json{
"message": "We have reviewed the request for 24 physical therapy visits for your right shoulder and made a partial decision. We approved 12 visits, for dates 2026-06-01 through 2026-08-31. We did not approve the remaining 12 visits because, under our medical policy MP-660, up to 12 visits are authorized at first, and more visits require a documented functional reassessment showing the care is medically necessary, meaning needed and appropriate for your condition. To request the remaining visits, your treating therapist can send us a reassessment completed after visit 10 that documents objective functional gains, which are measurable improvements in your movement or daily function. If that reassessment supports the care, a further 12 visits may then be authorized, though this notice does not guarantee that outcome. This decision was reviewed by a licensed physical therapist reviewer. If you disagree with it, you may file an internal appeal, which means asking us to review the decision again, within 180 days. If the internal appeal does not resolve the matter, you may then request an external review by an independent reviewer."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 initial 12-visit limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 documenting functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Explicitly framed as a partial decision."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true,
"judgeCostUSD": 0.01140675
}100Hunyuan 4 · Tencent85.9s · 5,778 out | 82.7s · 5,228 out | 97.4s · 5,914 out
Reasoning · 5,507 tokens
We need answer member notice for partial determination. Need exactly one fenced JSON code block with required key "message". Constraint: eight sentences or fewer. Write member-facing text. Need include exact dollar figures and dates supplied; no dollar figures in facts? Determination has requested 24 PT visits, approved 12 visits dates 2026-06-01 through 2026-08-31, denied remaining 12 visits as not established as medically necessary at time under MP-660, which authorises up to 12 visits initially and requires documented functional reassessment before authorising more. Route: treating therapist submits reassessment after visit 10 documenting objective functional gains; further 12 visits may then be authorised. Appeal rights: internal appeal within 180 days; external review thereafter. Reviewed by licensed physical therapist reviewer.
Need write at roughly eighth-grade reading level. Define any term of art first time appears. Need maybe define "medically necessary"? It is term of art. "Medical necessity means the service is needed to diagnose or treat your condition and meets our plan’s standards." We shouldn't give clinical advice or tell member what care they need. Explain coverage decision. Need mention dates and number of visits, not round. No currency amounts. Need include appeal rights, deadlines, route to resolution. Sentence count <= 8. Let's draft concise.
Need maybe include "your plan" or "our plan"? Since member notice. Use member-facing. "Your physical therapy request for 24 visits for your right shoulder was reviewed by a licensed physical therapist reviewer." Sentence 1. "We approved 12 visits from 2026-06-01 through 2026-08-31." Sentence 2. "We denied the other 12 visits because they were not established as medically necessary at the time of this request under medical policy MP-660." Need define medically necessary: maybe "Medically necessary means the service is needed to treat your condition and meets our plan’s rules." Let's combine: "We denied the other 12 visits because they were not established as medically necessary at the time of this request; medically necessary means the service is needed to treat your condition and meets our plan’s rules under medical policy MP-660." Good. "MP-660 allows up to 12 visits at first and then needs a documented functional reassessment before more visits can be approved." Sentence 4. "A functional reassessment is a check of how your shoulder is working and what you can do." Sentence 5 maybe. "To ask for the remaining 12 visits, your treating therapist must send us a reassessment after your 10th visit that shows objective functional gains, which are measurable improvements in how your shoulder works." Sentence 6. "If that reassessment is submitted and shows those gains, we may approve another 12 visits." Sentence 7. Appeal: "If you disagree, you can file an internal appeal within 180 days of this notice, and after that you may ask for external review." Sentence 8. Count sentences? Let's count:
1. Your request for 24 physical therapy visits for your right shoulder was reviewed by a licensed physical therapist reviewer.
2. We approved 12 visits from 2026-06-01 through 2026-08-31.
3. We could not approve the other 12 visits because they were not established as medically necessary at the time of this request under medical policy MP-660.
4. Medically necessary means the service is needed to treat your condition and meets our plan’s rules.
5. Medical policy MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved.
6. A functional reassessment is a check of how your shoulder is moving and what you can do, and objective functional gains are measurable improvements shown in that check.
7. To request the remaining 12 visits, your treating therapist must send us that reassessment after your 10th visit showing objective functional gains, and we may then approve another 12 visits.
8. If you disagree with this decision, you can file an internal appeal within 180 days of this notice, and after that you may ask for external review.
That's 8 sentences exactly. Need ensure no clinical advice. It says send reassessment after visit 10 documenting objective functional gains; a further 12 visits may then be authorised. We wrote "may then approve another 12 visits" (not promise outcome). "We may then approve" matches. Good.
Need define "external review"? Not necessarily term of art? Maybe not needed. But maybe term of art first time? "External review" is a term of art. The instruction: "Define any term of art the first time it appears." External review appears in appeal rights. Is it a term of art? Yes, appeal/external review maybe. We should define it: "External review is when an independent reviewer outside our plan looks at your case." But adding sentence would exceed 8. Could integrate definition into same sentence: "If you disagree with this decision, you can file an internal appeal within 180 days of this notice; an internal appeal is a request that our plan take another look, and after that you may ask for external review, where an independent reviewer outside our plan looks at your case." That's one sentence, but long. Need count: Original sentence 8 could be split? Let's see.
We have 8 sentences. Need define all terms of art: "medically necessary", "functional reassessment", "objective functional gains", "internal appeal", "external review". We defined medically necessary, functional reassessment/objective functional gains, internal appeal, external review maybe in final sentence. Let's craft final sentence to define both internal appeal and external review:
"If you disagree with this decision, you can file an internal appeal within 180 days of this notice; an internal appeal is a request that our plan review the decision again, and after that you may ask for external review, where an independent reviewer outside our plan looks at your case."
That's one sentence with semicolon. Good. Need check "file an internal appeal within 180 days of this notice" - facts say internal appeal within 180 days; likely from date of notice. Fine. "external review thereafter" - "after that you may ask for external review". Good.
Need maybe mention "partial determination" or "approved in part"? The message can start with "We approved part of your request." Let's maybe ensure member understands partial. Sentence 1: "We reviewed your request for 24 physical therapy visits for your right shoulder and approved part of it." But need mention licensed physical therapist reviewer. Let's combine: "A licensed physical therapist reviewer looked at your request for 24 physical therapy visits for your right shoulder, and we approved part of it." Sentence 1. Then "We approved 12 visits from 2026-06-01 through 2026-08-31." Sentence 2. Then denial sentence. Fine.
Need check exact dates: "2026-06-01 through 2026-08-31". Use those. Visits approved: 12 visits. Denied remaining 12. Route: therapist submits reassessment after visit 10 documenting objective functional gains; a further 12 visits may then be authorised. We wrote "after your 10th visit". Is "visit 10" exact? Facts say "after visit 10" maybe after the 10th visit. "after your 10th visit" is equivalent. Good.
Need maybe state "not established as medically necessary at the time of this request" rather than "could not approve because they were not established..." The determination says denied as not established as medically necessary at the time of this request under MP-660. So write "We denied them as not established as medically necessary at the time of this request." Good.
Need avoid "we could not approve" maybe implies not medically necessary? But fine. Let's draft final carefully.
Potential final message string:
"A licensed physical therapist reviewer looked at your request for 24 physical therapy visits for your right shoulder, and we approved part of it. We approved 12 visits from 2026-06-01 through 2026-08-31. We denied the other 12 visits as not established as medically necessary at the time of this request under medical policy MP-660. Medically necessary means the service is needed to treat your condition and meets our plan’s rules. Medical policy MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved. A functional reassessment is a check of how your shoulder is moving and what you can do, and objective functional gains are measurable improvements shown in that check. To request the remaining 12 visits, your treating therapist must send us that reassessment after your 10th visit showing objective functional gains, and we may then approve another 12 visits. If you disagree with this decision, you can file an internal appeal within 180 days of this notice; an internal appeal is a request that our plan review the decision again, and after that you may ask for external review, where an independent reviewer outside our plan looks at your case."
Count sentences: 1 ends with period after "approved part of it." 2 ends "2026-08-31." 3 "MP-660." 4 "rules." 5 "approved." 6 "check." 7 "visits." 8 "case." That's 8 sentences. Good.
Check grammar: Sentence 3: "We denied the other 12 visits as not established as medically necessary at the time of this request under medical policy MP-660." Is "as not established" missing "being"? "We denied the other 12 visits as not established as medically necessary..." It's okay payer language, but maybe better: "We denied the other 12 visits because they were not established as medically necessary at the time of this request under medical policy MP-660." That is clearer. But then we still define medically necessary next sentence. Let's use "because they were not established..." Let's recount with this change:
1. A licensed physical therapist reviewer looked at your request for 24 physical therapy visits for your right shoulder, and we approved part of it.
2. We approved 12 visits from 2026-06-01 through 2026-08-31.
3. We denied the other 12 visits because they were not established as medically necessary at the time of this request under medical policy MP-660.
4. Medically necessary means the service is needed to treat your condition and meets our plan’s rules.
5. Medical policy MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved.
6. A functional reassessment is a check of how your shoulder is moving and what you can do, and objective functional gains are measurable improvements shown in that check.
7. To request the remaining 12 visits, your treating therapist must send us that reassessment after your 10th visit showing objective functional gains, and we may then approve another 12 visits.
8. If you disagree with this decision, you can file an internal appeal within 180 days of this notice; an internal appeal is a request that our plan review the decision again, and after that you may ask for external review, where an independent reviewer outside our plan looks at your case.
Still 8 sentences.
Need consider if "objective functional gains" defined in sentence 6 as measurable improvements shown in that check. But "documented functional reassessment" maybe first appears sentence 5 without definition; sentence 6 defines functional reassessment. That's okay? The instruction: define any term of art the first time it appears. It appears in sentence 5 ("documented functional reassessment") before definition in sentence 6. Is that violating? "Define any term of art the first time it appears." We introduced "documented functional reassessment" in sentence 5, then defined in sentence 6. That might be considered not first time. Better to define in same sentence or before use. Let's combine or reorder: sentence 5: "Medical policy MP-660 allows up to 12 visits at first and then requires a documented functional reassessment, which is a check of how your shoulder is moving and what you can do, before more visits can be approved." Then sentence 6: "Objective functional gains are measurable improvements in how your shoulder works that are shown in that reassessment." Wait "objective functional gains" first appears in sentence 7, but we referenced in 5? Actually sentence 5 mentions functional reassessment, not objective functional gains. Then sentence 6 defines objective functional gains? But objective functional gains first appears in sentence 7, where we should define first time. Let's restructure to define both upon first use.
Maybe:
5. "Medical policy MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved; a functional reassessment is a check of how your shoulder is moving and what you can do."
This defines functional reassessment first time it appears (within same sentence). Good.
6. "Objective functional gains are measurable improvements in how your shoulder works that are shown in that reassessment." But objective functional gains hasn't appeared yet. Then sentence 7 uses it: "To request the remaining 12 visits, your treating therapist must send us that reassessment after your 10th visit showing objective functional gains, and we may then approve another 12 visits." Here objective functional gains appears first time in sentence 7, but we defined it in sentence 6 before it appears? That's actually good: define before first use. Wait instruction says define first time it appears. If we define in sentence 6, then it appears in sentence 7, not sentence 6. The term "objective functional gains" would appear in sentence 6 as the subject of definition: "Objective functional gains are measurable improvements..." That is its first appearance, and it's defined there. That's fine. Then sentence 7 uses it. Good.
Let's check "functional reassessment" first appears in sentence 5 as "documented functional reassessment" and is defined in same sentence via "which is...". Good. "Medically necessary" first appears in sentence 3? Actually sentence 3: "We denied the other 12 visits because they were not established as medically necessary..." That's first appearance; we define in sentence 4. That is not same sentence. Better define in sentence 3 or make sentence 4 before? But sentence 3 uses it as reason; could say: "We denied the other 12 visits because they were not established as medically necessary, meaning the service is not shown to be needed to treat your condition and meet our plan’s rules, at the time of this request under medical policy MP-660." That's a bit awkward. Let's craft:
3. "We denied the other 12 visits because they were not established as medically necessary—meaning they were not shown to be needed to treat your condition and meet our plan’s rules—at the time of this request under medical policy MP-660."
That's one sentence with dashes. Good. That defines medically necessary first time it appears. Then sentence 4 no longer needed, reducing sentences to 7? Wait we still have other sentences. Let's recount:
1. A licensed physical therapist reviewer looked at your request for 24 physical therapy visits for your right shoulder, and we approved part of it.
2. We approved 12 visits from 2026-06-01 through 2026-08-31.
3. We denied the other 12 visits because they were not established as medically necessary—meaning they were not shown to be needed to treat your condition and meet our plan’s rules—at the time of this request under medical policy MP-660.
4. Medical policy MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved; a functional reassessment is a check of how your shoulder is moving and what you can do.
5. Objective functional gains are measurable improvements in how your shoulder works that are shown in that reassessment.
6. To request the remaining 12 visits, your treating therapist must send us that reassessment after your 10th visit showing objective functional gains, and we may then approve another 12 visits.
7. If you disagree with this decision, you can file an internal appeal within 180 days of this notice; an internal appeal is a request that our plan review the decision again, and after that you may ask for external review, where an independent reviewer outside our plan looks at your case.
That's 7 sentences. Good, under 8. Need check "medical policy MP-660" second sentence mention; fine. "allowed amount" not relevant. No dollar amounts.
Need ensure no false promise: "we may then approve another 12 visits" matches "a further 12 visits may then be authorised". Good. Not "will". "send us that reassessment" but policy says therapist submits; we say "your treating therapist must send us that reassessment". Good.
Need maybe mention "at the time of this request" in denial; yes.
Need maybe mention "partial determination" in message? The notice is for partial determination; sentence 1 says approved part of it. Good.
Potential issue: "We approved 12 visits from 2026-06-01 through 2026-08-31." Does it mean authorized date range for services, not 12 visits calendar? Fine.
Need JSON: key "message". Escape quotes? The string contains double quotes? No, we avoided internal quotes except none. It contains em dash? We can use hyphen or em dash. JSON can include Unicode. Better use plain hyphen with spaces? We had em dash "—" inside string. JSON allows UTF-8. But to be safe, use " - " or comma. Since JSON code block can contain em dash, but some parsers okay. I'll use a comma construction to avoid em dash maybe: "We denied the other 12 visits because they were not established as medically necessary, meaning they were not shown to be needed to treat your condition and meet our plan’s rules, at the time of this request under medical policy MP-660." Wait extra comma after rules before "at the time" is awkward but okay. Let's rewrite sentence 3 cleanly:
"We denied the other 12 visits because they were not established as medically necessary at the time of this request under medical policy MP-660; medically necessary means the service is shown to be needed to treat your condition and meet our plan’s rules."
This is one sentence with semicolon. First appearance of medically necessary is after semicolon? Actually phrase "medically necessary" appears before semicolon as part of "not established as medically necessary". That's first appearance, but definition after semicolon later in same sentence. Is that allowed? The term appears and then defined in same sentence after a semicolon. That's okay; define first time it appears within same sentence. Maybe better: "...under medical policy MP-660, and medically necessary means the service is shown to be needed to treat your condition and meet our plan’s rules." But the phrase "medically necessary" first appears before that, but still same sentence. The instruction "first time it appears" then define; as long as definition occurs at/just after first appearance, okay. Let's make sentence 3:
"We denied the other 12 visits because they were not established as medically necessary at the time of this request under medical policy MP-660, and medically necessary means the service is shown to be needed to treat your condition and meet our plan’s rules."
This is one sentence. Good.
Sentence 4 currently: "Medical policy MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved; a functional reassessment is a check of how your shoulder is moving and what you can do." That's good. It repeats MP-660, fine.
Sentence 5: "Objective functional gains are measurable improvements in how your shoulder works that are shown in that reassessment." Good.
Now final message string. Need make sure no salutation/sign-off. No headers. No bullet points. Good.
Let's test sentence count with final candidate:
1. A licensed physical therapist reviewer looked at your request for 24 physical therapy visits fjson{"message": "A licensed physical therapist reviewer looked at your request for 24 physical therapy visits for your right shoulder, and we approved part of it. We approved 12 visits from 2026-06-01 through 2026-08-31. We denied the other 12 visits because they were not established as medically necessary at the time of this request under medical policy MP-660, and medically necessary means the service is shown to be needed to treat your condition and meet our plan’s rules. Medical policy MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved; a functional reassessment is a check of how your shoulder is moving and what you can do. Objective functional gains are measurable improvements in how your shoulder works that are shown in that reassessment. To request the remaining 12 visits, your treating therapist must send us that reassessment after your 10th visit showing objective functional gains, and we may then approve another 12 visits. If you disagree with this decision, you can file an internal appeal within 180 days of this notice; an internal appeal is a request that our plan review the decision again, and after that you may ask for external review, where an independent reviewer outside our plan looks at your case."}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 visits approved with dates 2026-06-01 through 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States other 12 denied and cites MP-660's 12-visit initial limit plus reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Explains therapist submits reassessment after 10th visit for another 12 visits."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "States internal appeal within 180 days, plus external review."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Explicitly framed as partial approval."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 5,005 tokens
We need answer as member-facing notice for a partial determination. Need JSON with key "message" only? Required JSON keys: "message" string. Output exactly one fenced JSON code block and nothing else. No preamble, no commentary. Sentence limit eight or fewer. Need write at roughly eighth-grade reading level. Define term of art first time. Use exact dollar figures and dates supplied; no dollar figures here? There's no money. Use exact dates: 2026-06-01 through 2026-08-31. Facts: requested 24 physical therapy visits right shoulder. Approved 12 visits, dates 2026-06-01 through 2026-08-31. Denied remaining 12 visits, as not established as medically necessary at time of request under medical policy MP-660, which authorizes up to 12 visits initially and requires documented functional reassessment before authorizing more. Route to remaining visits: treating therapist submits reassessment after visit 10 documenting objective functional gains; a further 12 visits may then be authorized. Appeal rights: internal appeal within 180 days; external review thereafter. Reviewed by licensed physical therapist reviewer.
Need member-facing text no headers, no bullet points unless facts genuinely need a list. Eight sentences or fewer. No salutation/sign-off unless item asks for letter. It doesn't ask for letter. So no "Dear", no "Sincerely". It says write member's notice. Should be message. Must include appeal rights, deadlines/route to resolution. Must not give clinical advice. Must not promise outcome facts don't support. Where facts say under review, say under review? Here partial determination: approved 12, denied remaining 12. Not under review. So say denied. Remaining 12 denied as not established as medically necessary at this time under MP-660. Route: therapist submits reassessment after visit 10 documenting objective functional gains; further 12 visits may then be authorized. Note "may then be authorized" - don't promise. Include that review was by licensed PT reviewer? maybe mention "A licensed physical therapist reviewer looked at your request." Could include.
Need define term of art first time: "medically necessary" maybe: care that is needed and meets our plan's medical policy. Actually define it: "Medically necessary means the care is needed for your condition and meets the plan's medical policy." Or "functional reassessment" maybe: "A functional reassessment is a check of how well your shoulder is working after treatment." Also "objective functional gains" maybe: measurable improvements in how your shoulder works. Need be at eighth-grade. Let's draft.
Sentence count max 8. Let's aim 7.
Draft:
"Your request for 24 physical therapy visits for your right shoulder is approved in part. We approve 12 visits from 2026-06-01 through 2026-08-31. We deny the other 12 visits because they are not shown to be medically necessary at this time under our medical policy MP-660. Medically necessary means the care is needed for your condition and meets the plan’s medical policy rules. MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved. A functional reassessment is a check by your therapist of how well your shoulder is working. After visit 10, your treating therapist can send a reassessment that shows objective functional gains, which are measurable improvements in how your shoulder works; if it does, we may authorize up to 12 more visits. A licensed physical therapist reviewer made this decision, and you can file an internal appeal within 180 days and then ask for external review after that."
Count sentences:
1. Your request for 24 physical therapy visits for your right shoulder is approved in part.
2. We approve 12 visits from 2026-06-01 through 2026-08-31.
3. We deny the other 12 visits because they are not shown to be medically necessary at this time under our medical policy MP-660.
4. Medically necessary means the care is needed for your condition and meets the plan’s medical policy rules.
5. MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved.
6. A functional reassessment is a check by your therapist of how well your shoulder is working.
7. After visit 10, your treating therapist can send a reassessment that shows objective functional gains, which are measurable improvements in how your shoulder works; if it does, we may authorize up to 12 more visits.
8. A licensed physical therapist reviewer made this decision, and you can file an internal appeal within 180 days and then ask for external review after that.
That's exactly 8. Need check no dollar figures and dates exactly: 2026-06-01 through 2026-08-31. We used that. No currency. Good. Need maybe mention "denied: remaining 12 visits, as not established as medically necessary at the time of this request". We say "not shown to be medically necessary at this time". Good.
But wait: "Route to the remaining visits: the treating therapist submits a reassessment after visit 10 documenting objective functional gains; a further 12 visits may then be authorised" - "authorised" British spelling? The determination uses "authorised". Should we use "authorized" American? The harness says money US dollars, dates ISO. Spelling? It gave "authorised" in facts (maybe British). We can use "authorized" since US payer? The facts say "authorising" and "authorised". The instruction: Use exact dollar figures and dates supplied; not mention about spelling. It might be safer to use "authorized" or match "authorised"? The user text uses "authorises", "authorising", "authorised". In output, if we use "authorized", could be considered changed? But task says "Use the exact dollar figures and dates supplied; do not round them and do not introduce a figure that is not in the facts." It doesn't require exact words. But to be member-facing, US plan would use "authorized". However the fact text: "medical policy MP-660, which authorises up to 12 visits initially and requires a documented functional reassessment before authorising more". It uses British spelling. If we quote policy? We can say "allows" to avoid spelling. In sentence 5: "MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved." That avoids authorize/authorise. In sentence 7: "we may authorize up to 12 more visits." That's fine. The determination says "may then be authorised". We say "authorized". Is that okay? The instruction: "Use the exact dollar figures and dates supplied; do not round them and do not introduce a figure that is not in the facts." Figure means number? It says figure that is not in facts, for amounts/dates. Spelling difference is not a figure. I think authorized is fine.
But need maybe "internal appeal within 180 days" and "external review thereafter". We said "internal appeal within 180 days and then ask for external review after that." That includes deadline and route. Good. Should we mention "if you disagree with the denial"? The facts include appeal rights. Include them. Our sentence: "A licensed physical therapist reviewer made this decision, and you can file an internal appeal within 180 days and then ask for external review after that." Could be clearer: "If you disagree with the denial, you can file an internal appeal within 180 days, and after that you can ask for external review." That is sentence 8 maybe. Let's adjust sentence count.
Let's rewrite for clarity and reading level:
1. We approved part of your request for 24 physical therapy visits for your right shoulder.
2. We approved 12 visits from 2026-06-01 through 2026-08-31.
3. We denied the other 12 visits because they are not medically necessary at this time under our medical policy MP-660.
4. Medically necessary means the care is needed for your condition and meets the plan’s medical policy rules.
5. MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved.
6. A functional reassessment is a check by your therapist of how well your shoulder is working.
7. After visit 10, your treating therapist can send a reassessment that shows objective functional gains, which are measurable improvements in how your shoulder works; if it does, we may authorize up to 12 more visits.
8. A licensed physical therapist reviewer made this decision, and if you disagree, you can file an internal appeal within 180 days and then ask for external review after that.
Count: 8 sentences. Wait sentence 8 has "if you disagree, you can file an internal appeal within 180 days and then ask for external review after that." Good.
But sentence 3: "We denied the other 12 visits because they are not medically necessary at this time under our medical policy MP-660." The determination says "as not established as medically necessary at the time of this request". We should perhaps say "because they are not established as medically necessary at the time of this request". Member-facing: "because they are not shown to be medically necessary at this time". Let's incorporate "at the time of this request" maybe: "because they are not established as medically necessary at the time of this request under MP-660." But avoid legalese? Define medically necessary. Let's say: "We denied the other 12 visits because, at the time of this request, they were not established as medically necessary under MP-660." Good.
Need check if "medical policy MP-660" should be defined? It's a policy number; no need define policy? Maybe say "our medical policy MP-660". The facts: "under medical policy MP-660, which authorises up to 12 visits initially and requires a documented functional reassessment before authorising more". We should mention MP-660 allows up to 12 visits initially and requires reassessment. Sentence 5 does that. Good.
Do we need to say "right shoulder"? Yes requested for right shoulder. Include. Do we need to say "physical therapy"? Yes.
Potential issue: Sentence 7: "After visit 10, your treating therapist can send a reassessment that shows objective functional gains, which are measurable improvements in how your shoulder works; if it does, we may authorize up to 12 more visits." This uses a semicolon, still one sentence. It explains route. Good. It says "if it does" referencing reassessment shows gains. Maybe "if the reassessment does". Let's craft: "After visit 10, your treating therapist can send a reassessment that shows objective functional gains, which are measurable improvements in how your shoulder works; if the reassessment does, we may authorize up to 12 more visits." That is clearer. Or split? But sentence limit 8; we have 8. If split, 9. So keep.
Could we reduce sentences? Currently 8. Let's verify count exactly:
Sentence 1: "We approved part of your request for 24 physical therapy visits for your right shoulder." ends with period.
2: "We approved 12 visits from 2026-06-01 through 2026-08-31." period.
3: "We denied the other 12 visits because, at the time of this request, they were not established as medically necessary under MP-660." period.
4: "Medically necessary means the care is needed for your condition and meets the plan’s medical policy rules." period.
5: "MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved." period.
6: "A functional reassessment is a check by your therapist of how well your shoulder is working." period.
7: "After visit 10, your treating therapist can send a reassessment that shows objective functional gains, which are measurable improvements in how your shoulder works; if the reassessment does, we may authorize up to 12 more visits." semicolon, period at end. That's one sentence.
8: "A licensed physical therapist reviewer made this decision, and if you disagree, you can file an internal appeal within 180 days and then ask for external review after that." period.
That is 8 sentences. Wait, is sentence 7 actually two? No, it's one sentence with a semicolon connecting two independent clauses; sentence count is based on terminal punctuation? Usually a sentence ends with period, question mark, exclamation point. Semicolon doesn't end sentence. So it's one sentence. Good.
Need maybe say "internal appeal within 180 days of this notice" but facts just say "within 180 days". We don't have date of notice. We can say "within 180 days". Good.
Need be careful with "plan's" apostrophe: JSON string should escape? We'll output JSON, so string must be valid JSON. We need wrap in double quotes. Inside string, we can use apostrophe without escaping. But double quotes inside? We must not use unescaped double quotes inside JSON string. Our text uses curly quotes? Actually we should use straight ASCII characters to be safe. In JSON, string delimited by ". If we need a quote character inside, escape as \". We have no double quotes inside the message if we don't use quotation marks. Let's check draft: none. Use 'plan’s' with right single quote? That's a Unicode character; JSON can contain it, but to be safe use ASCII apostrophe: "plan's". Straight single quote inside double-quoted JSON string is fine. So use "plan's". Use "shoulder's"? No. Use "therapist's"? We have "your therapist of how well your shoulder is working" no possessive. "plan's medical policy rules". Good.
Need output exactly:
```json
{
"message": "We approved part of your request for 24 physical therapy visits for your right shoulder. We approved 12 visits from 2026-06-01 through 2026-08-31. We denied the other 12 visits because, at the time of this request, they were not established as medically necessary under MP-660. Medically necessary means the care is needed for your condition and meets the plan's medical policy rules. MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved. A functional reassessment is a check by your therapist of how well your shoulder is working. After visit 10, your treating therapist can send a reassessment that shows objective functional gains, which are measurable improvements in how your shoulder works; if the reassessment does, we may authorize up to 12 more visits. A licensed physical therapist reviewer made this decision, and if you disagree, you can file an internal appeal within 180 days and then ask for external review after that."
}
```
Check no trailing text. The JSON block must be fenced with ```json and ```. Nothing else. Use two-space indent? Not required but okay. The instruction: Reply with exactly one fenced JSON code block and nothing else. No preamble. So:
```json
{
"message": "..."
}
```
Need ensure no newline before block? It says exactly one fenced JSON code block and nothing else. So start with ```json and end with ```. No other text.
Let's double-check if message meets "no salutation or sign-off unless the item asks for a letter." It doesn't. Good.
Check "Define any term of art the first time it appears." Terms: "medically necessary" appears in sentence 3, defined in sentence 4. "functional reassessment" appears in sentence 5, defined in sentence 6. "objective functional gains" appears in sentence 7, defined as measurable improvements (same sentence). Good. "MP-660" appears sentence 3; maybe not a term of art? It's a policy. Fine.
Check "Do not promise an outcome the facts do not support." Sentence 7: "we may authorize up to 12 more visits" matches "a further 12 visits may then be authorised". Good. It does not promise.
Check "Where the facts include appeal rights, deadlines, or a route to resolution, include them." Included internal appeal 180 days, external review thereafter. Also route to remaining visits included (reassessment after visit 10). Good.
Check "Reviewed by a licensed physical therapist reviewer" included sentence 8. Good.
Check "Eight sentences or fewer." We counted 8. Let's ensure sentence 2 "We approved 12 visits from 2026-06-01 through 2026-08-31." This is a sentence. Determination: "Approved: 12 visits, dates 2026-06-01 through 2026-08-31". Yes.
One nuance: The approved dates are 2026-06-01 through 2026-08-31. Are the 12 visits to occur within those dates? Yes. We don't know frequency. Fine.
Should we mention "physical therapy visits for the right shoulder" in sentence 1 and 2? Sentence 1 says request for 24 physical therapy visits for your right shoulder. Sentence 2 says approved 12 visits from date through date. Good.
Potential issue: Sentence 3: "under MP-660" but earlier we didn't say "medical policy MP-660" with hyphen? The fact: "medical policy MP-660". We say "under MP-660". Sentence 5: "MP-660 allows...". That's fine. Could say "medical policy MP-660" in sentence 3 to be exact: "under medical policy MP-660". Let's adjust: "We denied the other 12 visits because, at the time of this request, they were not established as medically necessary under medical policy MP-660." That is slightly redundant but matches. Sentence 4 defines medically necessary. Sentence 5: "Medical policy MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved." That repeats medical policy. But we want clear. Let's rewrite sentences 3-5:
3. We denied the other 12 visits because, at the time of this request, they were not established as medically necessary under medical policy MP-660.
4. Medically necessary means the care is needed for your condition and meets the plan's medical policy rules.
5. That policy allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved.
Now sentence 5 starts "That policy" referencing medical policy MP-660. This is clear. Let's count sentences again with new version:
1. We approved part of your request for 24 physical therapy visits for your right shoulder.
2. We approved 12 visits from 2026-06-01 through 2026-08-31.
3. We denied the other 12 visits because, at the time of this request, they were not established as medically necessary under medical policy MP-660.
4. Medically necessary means the care is needed for your condition and meets the plan's medical policy rules.
5. That policy allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved.
6. A functional reassessment is a check by your therapist of how well your shoulder is working.
7. After visit 10, your treating therapist can send a reassessment that shows objective functional gains, which are measurable improvements in how your shoulder works; if the reassessment does, we may authorize up to 12 more visits.
8. A licensed physical therapist reviewer made this decision, and if you disagree, you can file an internal appeal within 180 days and then ask for external review after that.
Still 8 sentences. Good. Wait sentence 5 "That policy allows up to 12 visits at first" - The policy authorizes up to 12 visits initially. "at first" is okay.
Need check reading level: "established as medically necessary" is maybe slightly high but defined. Good.
Now JSON string: Need escape? We have semicolon in sentence 7; fine. We have apostrophe in "plan's" and "therapist" no. "plan's" uses straight single quote: in JSON string, a single quote does not need escaping. We must ensure we don't accidentally use “ ” curly quotes. Use ASCII. Also right single quote ’ we avoid. Use ' for plan's. We'll write "plan's". In JSON, the string is enclosed in double quotes, so a single quote is just a character. Good.
Let's prepare final. Need no trailing text. Ensure code block language json. Use:
```json
{
"message": "We approved part of your request for 24 physical therapy visits for your right shoulder. We approved 12 visits from 2026-06-01 through 2026-08-31. We denied the other 12 visits because, at the time of this request, they were not established as medically necessary under medical policy MP-660. Medicjson{
"message": "We approved part of your request for 24 physical therapy visits for your right shoulder. We approved 12 visits from 2026-06-01 through 2026-08-31. We denied the other 12 visits because, at the time of this request, they were not established as medically necessary under medical policy MP-660. Medically necessary means the care is needed for your condition and meets the plan's medical policy rules. That policy allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved. A functional reassessment is a check by your therapist of how well your shoulder is working. After visit 10, your treating therapist can send a reassessment that shows objective functional gains, which are measurable improvements in how your shoulder works; if the reassessment does, we may authorize up to 12 more visits. A licensed physical therapist reviewer made this decision, and if you disagree, you can file an internal appeal within 180 days and then ask for external review after that."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 visits approved with dates 2026-06-01 through 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States other 12 denied, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 showing functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval, not flat denial or full approval."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true,
"judgeCostUSD": 0.01131925
}Reasoning · 5,666 tokens
We need answer with JSON only, key "message". Need write member's notice for partial determination. Eight sentences or fewer. Must write as member will read, no headers, no bullet points unless facts genuinely need list, no salutation or sign-off unless item asks for a letter. Here it says "Write the member's notice for a partial determination." Not explicitly "letter"; so no salutation/sign-off. Need include: requested 24 PT visits for right shoulder; approved 12 visits, dates 2026-06-01 through 2026-08-31; denied remaining 12 visits as not established as medically necessary at time of request under medical policy MP-660, which authorizes up to 12 visits initially and requires documented functional reassessment before authorizing more. Route to remaining visits: therapist submits reassessment after visit 10 documenting objective functional gains; a further 12 visits may then be authorized. Appeal rights: internal appeal within 180 days; external review thereafter. Reviewed by a licensed physical therapist reviewer. Must define any term of art first time appears: "medically necessary"? Maybe define? The term appears: "not established as medically necessary". Should define "medically necessary" maybe? Since it's first time? The policy says "not established as medically necessary under medical policy MP-660". The term of art is "medically necessary" (or "medical necessity"). Need define first time it appears: "we found the remaining 12 visits were not established as medically necessary — meaning not shown to be needed for your condition under our medical policy MP-660." That defines it. Also "objective functional gains" maybe term of art? Could define? It's in route: "documenting objective functional gains" maybe we can explain as "measurable improvements in how your shoulder works". But is that a term of art? Might be okay to define lightly: "measurable improvements in how your shoulder works (objective functional gains)". But the instruction: "Define any term of art the first time it appears." "Objective functional gains" may be somewhat technical; define as "measurable improvements in how your shoulder functions". "External review" maybe term of art? It's an appeal right after internal appeal. Could define? "external review (an independent review outside the plan)". The instruction says define any term of art the first time it appears. Appeal rights include "internal appeal" and "external review". Are those terms of art? "Internal appeal" maybe need define? "internal appeal (a review by someone in the plan)" and "external review (a review by an independent organization outside the plan)". We have sentence limit: eight sentences or fewer. Need include a lot. Let's count sentences.
Need exact dollar figures and dates: there are no dollar figures. Dates use ISO 8601? The ground rule says dates are ISO 8601 (YYYY-MM-DD) in output? Wait ground rules: "Dates are ISO 8601 (YYYY-MM-DD)." That's for the harness's date representation generally. In the message to member, we might use dates as given: 2026-06-01 through 2026-08-31. Those are already ISO. Good. Use exact dates supplied; do not round them. No dollars.
Need not give clinical advice, not tell member what care they need. We are explaining coverage decision.
Need not promise outcome facts do not support: Route says "a further 12 visits may then be authorized". That's a possibility; use "may" not "will". Denied: "not established as medically necessary at the time of this request". Approval: 12 visits approved dates. Need mention partial determination: approved in part, denied in part. Reviewed by a licensed physical therapist reviewer: include "A licensed physical therapist reviewer made this decision." Or "This decision was reviewed by a licensed physical therapist reviewer." Need maybe say "reviewed by a licensed physical therapist reviewer" not "made"? The facts: "Reviewed by a licensed physical therapist reviewer". Include: "This decision was reviewed by a licensed physical therapist reviewer." Good.
Appeal rights: "You can file an internal appeal within 180 days of this notice; after that, you may be able to request external review." Need define internal appeal? Could say "an internal appeal (a request that the plan look at the decision again)". External review: "external review (a review by an independent reviewer outside the plan)". But that could use many words. Maintain sentence count ≤8. We need maybe 7 or 8 sentences.
Let's draft.
Sentence 1: We approved part of your request for physical therapy (PT) for your right shoulder and denied the rest.
Actually PT maybe define? Physical therapy is common; maybe no need. "physical therapy (PT)" defines? It's an acronym; define first time? Not required maybe, but okay.
Sentence 2: We approved 12 visits from 2026-06-01 through 2026-08-31.
Sentence 3: We denied the remaining 12 visits because they were not established as medically necessary at the time of this request under medical policy MP-660.
Need define medically necessary here perhaps in same sentence or next: "Medically necessary means the care is shown to be needed for your condition under our policy." Let's craft: "We denied the remaining 12 visits because, at the time of this request, they were not established as medically necessary — meaning not shown to be needed for your condition — under medical policy MP-660." That defines. Sentence 3.
Sentence 4: That policy allows up to 12 visits at first and requires a documented functional reassessment before we can authorize more visits. Wait "documented functional reassessment" maybe define? Could say "a documented functional reassessment (a written re-check of how your shoulder is working)". But sentence limit. Maybe define objective functional gains later. Let's see.
Maybe combine: "Medical policy MP-660 allows up to 12 visits at first and requires a documented functional reassessment — a written re-check of how your shoulder is working — before we can authorize more." That is one sentence, defines reassessment.
Sentence 5: To be considered for the remaining visits, your treating therapist can submit a reassessment after visit 10 that documents objective functional gains — measurable improvements in how your shoulder works.
Sentence 6: If that reassessment shows those gains, a further 12 visits may be authorized. (Use may).
Sentence 7: This decision was reviewed by a licensed physical therapist reviewer.
Sentence 8: If you disagree, you can file an internal appeal (a request that the plan review the decision again) within 180 days; after the internal appeal, you may be able to ask for external review (a review by an independent reviewer outside the plan).
That's 8 sentences exactly. Need count: Let's count carefully.
Draft full message text:
"We approved part of your request for physical therapy (PT) for your right shoulder and denied the rest. We approved 12 visits from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because, at the time of this request, they were not established as medically necessary — meaning not shown to be needed for your condition — under medical policy MP-660. That policy allows up to 12 visits at first and requires a documented functional reassessment — a written re-check of how your shoulder is working — before we can authorize more. To be considered for the remaining visits, your treating therapist can submit that reassessment after visit 10 and document objective functional gains — measurable improvements in how your shoulder works. If it shows those gains, a further 12 visits may be authorized. This decision was reviewed by a licensed physical therapist reviewer. If you disagree, you can file an internal appeal — a request that the plan look at the decision again — within 180 days; after that, you may be able to ask for external review — a review by an independent reviewer outside the plan."
Count sentences:
1. We approved part... denied the rest. (1)
2. We approved 12 visits from 2026-06-01 through 2026-08-31. (2)
3. We denied... policy MP-660. (3)
4. That policy allows... authorize more. (4)
5. To be considered... works. (5)
6. If it shows... authorized. (6)
7. This decision... reviewer. (7)
8. If you disagree... outside the plan. (8)
Exactly eight sentences. Need check: Did we define "treating therapist"? Not needed. Did we mention "at the time of this request" yes. "Remaining 12 visits" refers. Did we say "partial determination"? Sentence 1 says approved part and denied the rest, which conveys partial. Good.
Need avoid bullet points, headers, salutation/sign-off. Good. No clinical advice. Did not tell them what care they need. "To be considered..., therapist can submit..." that's administrative route, not clinical advice. Fine.
Need maybe include "right shoulder" dates. Yes.
Do we need to mention "24 physical therapy visits" requested? Sentence 1 says request for PT; not explicitly "24 visits". But facts: Requested: 24 visits. We should maybe mention requested 24 visits. Sentence 1: "You asked for 24 physical therapy (PT) visits for your right shoulder." Then next: "We approved 12 visits... and denied the remaining 12." That's clearer and uses exact requested figure. Let's adjust.
New draft:
1. You asked for 24 physical therapy (PT) visits for your right shoulder.
2. We approved 12 visits from 2026-06-01 through 2026-08-31 and denied the remaining 12 visits.
3. We denied the remaining 12 visits because, at the time of this request, they were not established as medically necessary — meaning not shown to be needed for your condition — under medical policy MP-660.
4. Medical policy MP-660 allows up to 12 visits at first and requires a documented functional reassessment — a written re-check of how your shoulder is working — before we can authorize more visits.
5. To be considered for the remaining visits, your treating therapist can submit that reassessment after visit 10 and document objective functional gains — measurable improvements in how your shoulder works.
6. If it shows those gains, a further 12 visits may be authorized.
7. This decision was reviewed by a licensed physical therapist reviewer.
8. If you disagree, you can file an internal appeal — a request that the plan look at the decision again — within 180 days; after that, you may be able to ask for external review — a review by an independent reviewer outside the plan.
Count: 8 sentences. Wait sentence 3 says denied remaining 12; sentence 2 already said denied remaining 12. That's okay but maybe redundant. Could combine? Let's see if we can make fewer/clearer. The limit is eight or fewer; having 8 is okay. But sentence 2 says approved 12 and denied remaining 12; sentence 3 explains denial. That's fine, not redundant because sentence 2 states outcome, sentence 3 reason. Could combine outcome and reason? Maybe:
2. We approved 12 visits from 2026-06-01 through 2026-08-31 and denied the remaining 12 visits because, at the time of this request, they were not established as medically necessary — meaning not shown to be needed for your condition — under medical policy MP-660.
That combines sentence 2 and 3 into one. Then we have 7 sentences, leaving room. But we need define policy and route and appeal. Let's recalc with combined:
1. You asked for 24 physical therapy (PT) visits for your right shoulder.
2. We approved 12 visits from 2026-06-01 through 2026-08-31 and denied the remaining 12 visits because, at the time of this request, they were not established as medically necessary — meaning not shown to be needed for your condition — under medical policy MP-660.
3. That policy allows up to 12 visits at first and requires a documented functional reassessment — a written re-check of how your shoulder is working — before we can authorize more visits.
4. To be considered for the remaining visits, your treating therapist can submit that reassessment after visit 10 and document objective functional gains — measurable improvements in how your shoulder works.
5. If it shows those gains, a further 12 visits may be authorized.
6. This decision was reviewed by a licensed physical therapist reviewer.
7. If you disagree, you can file an internal appeal — a request that the plan look at the decision again — within 180 days; after that, you may be able to ask for external review — a review by an independent reviewer outside the plan.
That's 7 sentences, under 8. Good. Need check sentence 2 length maybe okay. Member-facing eighth-grade reading level. The em dash definitions could be considered parenthetical, still sentence. "medically necessary — meaning not shown to be needed for your condition — under medical policy MP-660." That defines term of art. "documented functional reassessment — a written re-check of how your shoulder is working" defines. "objective functional gains — measurable improvements in how your shoulder works" defines. "internal appeal — a request that the plan look at the decision again" defines. "external review — a review by an independent reviewer outside the plan" defines.
Need ensure "external review thereafter" means after internal appeal. The fact says: "Appeal rights: internal appeal within 180 days; external review thereafter". My sentence: "within 180 days; after that, you may be able to ask for external review — a review by an independent reviewer outside the plan." Does "after that" mean after the 180 days or after the internal appeal? The fact says external review thereafter, which likely means after internal appeal (you must exhaust internal appeal then external review). In appeals, "thereafter" means after internal appeal. The phrase "within 180 days; after that," could be misread as after the 180 days. It should say "after the internal appeal, you may be able to ask for external review". Let's adjust: "within 180 days; after the internal appeal, you may be able to ask for external review — a review by an independent reviewer outside the plan." That is clearer and matches "external review thereafter" (i.e., after internal appeal). Need maybe mention "if you disagree with the internal appeal decision"? Not supplied; fact just says external review thereafter. Could say "after the internal appeal process, you may be able to ask for external review". But keep simple: "after the internal appeal, you may be able to ask for external review". That implies exhaustion. Good.
Let's revise sentence 7: "If you disagree, you can file an internal appeal — a request that the plan look at the decision again — within 180 days; after the internal appeal, you may be able to ask for external review — a review by an independent reviewer outside the plan."
Check sentence count: 1 requested, 2 approval/denial reason, 3 policy, 4 route, 5 may authorize, 6 reviewer, 7 appeal. 7 sentences.
Need ensure "at the time of this request" preserved. Yes sentence 2. "remaining 12 visits" denied, yes.
Need maybe mention "dates 2026-06-01 through 2026-08-31" exactly. Yes.
Need maybe mention "right shoulder" in policy? It's requested for right shoulder. Good.
Need maybe mention "treating therapist" vs "licensed physical therapist reviewer". Yes.
Potential issue: The determination says "Approved: 12 visits, dates 2026-06-01 through 2026-08-31". It doesn't say the visits are scheduled on those dates, just authorized for that date range. My text: "We approved 12 visits from 2026-06-01 through 2026-08-31" matches.
Need maybe say "partial determination" or "partial approval"? Sentence 1: "You asked for 24 ..." Sentence 2: approved 12 and denied remaining. That's partial. Maybe explicitly: "This is a partial approval." But not required. The member's notice for a partial determination; we can say "We are approving part of your request." Let's see if we can include without adding sentence? Sentence 2 says approved 12 and denied remaining 12. That conveys partial. But maybe sentence 1: "You asked for 24 physical therapy (PT) visits for your right shoulder, and we are approving part of that request." That is one sentence. Then sentence 2: "We approved 12 visits from 2026-06-01 through 2026-08-31 and denied the remaining 12 visits because..." That would make sentence count: Let's draft:
1. You asked for 24 physical therapy (PT) visits for your right shoulder, and we are approving part of that request.
2. We approved 12 visits from 2026-06-01 through 2026-08-31 and denied the remaining 12 visits because, at the time of this request, they were not established as medically necessary — meaning not shown to be needed for your condition — under medical policy MP-660.
...
That's still 7 sentences. It explicitly says partial. Good.
But is "we are approving part of that request" redundant with sentence 2? It's okay.
Let's check term "physical therapy (PT)" - we define PT acronym. Good.
Need make sure no second code block. Output exactly one fenced JSON code block. The JSON must have the key "message" with the string. Need ensure JSON escaping: The message contains em dashes (—), parentheses, semicolons, commas. In JSON, em dash is fine as Unicode. Need escape any double quotes? We have none except JSON outer. The message string should be enclosed in double quotes; any internal double quotes must be escaped, but we have none. We used “curly” quotes? Better use straight quotes? We have none. We used em dash — (Unicode). That's allowed in JSON string. Also the en dash? No. We need ensure no unescaped newline? The message can be one line or multiple sentences in a single string. In JSON, we can have the string contain spaces and sentences; we should not include actual newline characters unless escaped as \n. It's easier to output the message as a single line (no literal line breaks). That's fine. The fenced code block can have the JSON with the message as one long line. Need be careful: If I put the message string across multiple lines in JSON without escaping newlines, that's invalid JSON. So I must keep the message value as a single line (no actual newline). I can format the JSON with pretty printing: the key/value on separate lines, but the string itself must not contain a raw newline. That's okay:
{
"message": "You asked for ..."
}
Here the string is on one line after the colon; no newline inside quotes. Good.
Let's construct final message string exactly:
"You asked for 24 physical therapy (PT) visits for your right shoulder, and we are approving part of that request. We approved 12 visits from 2026-06-01 through 2026-08-31 and denied the remaining 12 visits because, at the time of this request, they were not established as medically necessary — meaning not shown to be needed for your condition — under medical policy MP-660. That policy allows up to 12 visits at first and requires a documented functional reassessment — a written re-check of how your shoulder is working — before we can authorize more visits. To be considered for the remaining visits, your treating therapist can submit that reassessment after visit 10 and document objective functional gains — measurable improvements in how your shoulder works. If it shows those gains, a further 12 visits may be authorized. This decision was reviewed by a licensed physical therapist reviewer. If you disagree, you can file an internal appeal — a request that the plan look at the decision again — within 180 days; after the internal appeal, you may be able to ask for external review — a review by an independent reviewer outside the plan."
Check sentence count with this version:
1 You asked for 24 physical therapy (PT) visits for your right shoulder, and we are approving part of that request.
2 We approved 12 visits from 2026-06-01 through 2026-08-31 and denied the remaining 12 visits because, at the time of this request, they were not established as medically necessary — meaning not shown to be needed for your condition — under medical policy MP-660.
3 That policy allows up to 12 visits at first and requires a documented functional reassessment — a written json{
"message": "You asked for 24 physical therapy (PT) visits for your right shoulder, and we approved part of that request. We approved 12 visits from 2026-06-01 through 2026-08-31 and denied the remaining 12 visits because, at the time of this request, they were not established as medically necessary — meaning not shown to be needed for your condition — under medical policy MP-660. That policy allows up to 12 visits at first and requires a documented functional reassessment — a written re-check of how your shoulder is working — before we can authorize more visits. To be considered for the remaining visits, your treating therapist can submit that reassessment after visit 10 and document objective functional gains — measurable improvements in how your shoulder works. If it shows those gains, a further 12 visits may be authorized. This decision was reviewed by a licensed physical therapist reviewer. If you disagree, you can file an internal appeal — a request that the plan look at the decision again — within 180 days; after the internal appeal, you may be able to ask for external review — a review by an independent reviewer outside the plan."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 visits approved with dates 2026-06-01 through 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12, cites MP-660 12-visit limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 documenting functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "States internal appeal right within 180 days."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval with both approved and denied portions."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true,
"judgeCostUSD": 0.0115505
}100Qwen3.8 Flash · Alibaba18.9s · 1,099 out | 11.3s · 1,063 out | 23.3s · 1,233 out
Reasoning · 887 tokens
We need answer user wants JSON fenced only. Need produce member notice partial determination, eight sentences or fewer. Need include exact figures/dates. No sal/sign-off unless letter? It says message itself no headers, no bullets. Need likely JSON {"message": "..."} . Must write at 8th grade, define terms of art maybe medical necessity? Need mention approved 12 visits dates, denied remaining 12 not established medically necessary under MP-660, route: treating therapist submits reassessment after visit 10 documenting objective functional gains; further 12 may then be authorized. Reviewed by licensed physical therapist reviewer. Appeal rights internal 180 days external thereafter. Must be <= 8 sentences. Need ensure all facts included, no promises? Need exact dates? "from June 1, 2026 through August 31, 2026" or exact supplied maybe 2026-06-01? It says use exact dollar figures and dates supplied; likely use ISO dates. "Approved: 12 visits, dates 2026-06-01 through 2026-08-31" -> message: "We approved 12 physical therapy visits for your right shoulder for dates 2026-06-01 through 2026-08-31." Need maybe "We denied your request for 24 visits; we approved 12..." Partial determination. Need concise.
Draft sentences:
1 We reviewed your request for 24 physical therapy visits for your right shoulder and made a partial decision.
2 We approved 12 visits for dates 2026-06-01 through 2026-08-31.
3 We did not approve the other 12 visits because medical necessity was not established at this time under medical policy MP-660.
4 Medical policy MP-660 allows up to 12 visits first and requires a documented functional reassessment before more visits can be approved.
5 Medical necessity means care is needed for diagnosis or treatment and supported by clinical records.
6 If your treating therapist submits a reassessment after visit 10 that documents objective functional gains, a further 12 visits may then be authorized.
7 This request was reviewed by a licensed physical therapist reviewer.
8 If you disagree, you can ask for an internal appeal within 180 days, and after that you may request external review.
Need maybe "not promise outcome" "may then be authorized" ok. Terms of art: medical policy, external review? Could define external? But 8 sentences max. Need message. JSON string with quotes. Need escape. Sentence count? "We reviewed..." 1, "We approved..." 2, "We did not approve..." 3, "Medical policy..." 4, "Medical necessity means..." 5, "If your treating therapist..." 6, "This request..." 7, "If you disagree..." 8. Good.
Could use "authorized" vs "approved"? okay. Need not use bullet. JSON only. Ensure message string. Maybe exact dates with "through" fine. Need not say "request for 24" because request was 24 visits. Yes.
Check if "external review" defined? "a second review by an outside organization" maybe but sentence limit. Appeal rights important. Could combine review and policy sentence to add definition? But 8 sentences enough. Maybe MP-660 not member-friendly but include policy name. Need "licensed physical therapist reviewer" exact.
Potential issue "external review thereafter" not specific after internal? "after that" ok. Need internal appeal within 180 days of this notice? "within 180 days" perhaps from notice date; no notice date supplied. Say "within 180 days". Could be "within 180 days of this notice" but notice date not supplied? It says within 180 days; adding "of this notice" maybe natural but not supplied. Could use exact.
Need JSON output only fenced code block. No commentary. Ensure no line breaks? JSON can include string. final.json{
"message": "We reviewed your request for 24 physical therapy visits for your right shoulder and made a partial decision. We approved 12 visits for dates 2026-06-01 through 2026-08-31. We did not approve the other 12 visits because medical necessity was not established at this time under medical policy MP-660. Medical necessity means care is needed for diagnosis or treatment and is supported by clinical records. Medical policy MP-660 allows up to 12 visits first and requires a documented functional reassessment before more visits can be approved. If your treating therapist submits a reassessment after visit 10 that documents objective functional gains, a further 12 visits may then be authorized. This request was reviewed by a licensed physical therapist reviewer. If you disagree, you can ask for an internal appeal within 180 days, and after that you may request external review."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 visits approved with 2026-06-01 to 2026-08-31 range."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies other 12, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Explains therapist reassessment after visit 10 unlocks 12 more visits."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "States internal appeal within 180 days, plus external review."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Explicitly framed as a partial decision."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 859 tokens
We need answer JSON only fenced. Need craft member notice partial determination eight sentences or fewer. Need include exact figures dates. Plain message string. Need avoid clinical advice. Need appeal rights deadlines route. Need maybe define medical policy? 8th grade. Need no bullets. Need JSON object with message. Ensure 8 sentences or fewer. Need count sentences carefully. Maybe six sentences.
Draft:
"We approved 12 physical therapy visits for your right shoulder, with dates from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because medical necessity for all 24 visits is not established at this time under medical policy MP-660. Medical policy MP-660 allows up to 12 visits at first and requires a documented functional reassessment before authorising more. To request the remaining 12 visits, your treating physical therapist can submit a reassessment after visit 10 that shows objective functional gains. A further 12 visits may then be authorised after that reassessment is reviewed. You may file an internal appeal within 180 days of this notice, and you may then request external review."
Count 6 sentences. Maybe "This request was reviewed by a licensed physical therapist reviewer." sentence 7. Need include? facts include reviewed by licensed PT reviewer likely include.
Message must be member-facing no headers. Dates ISO. Dollar none. Need ensure "authorising" maybe use "authorizing" US? Task text has authorised; use plain US? Could use "authorizing". Need not introduce figure not in facts. "remaining 12 visits" okay. Could say "you requested 24 visits" exact. Sentence 1: "Your request for 24 physical therapy visits for the right shoulder is partly approved and partly denied." Sentence 2 approved 12 visits dates. Sentence 3 denied remaining 12 as not established medically necessary under MP-660. Sentence 4 policy allows up to 12 initially and requires documented functional reassessment before authorizing more. Sentence 5 route: treating therapist submits reassessment after visit 10 documenting objective functional gains; further 12 visits may then be authorized. Sentence 6 reviewed by licensed physical therapist reviewer. Sentence 7 appeal. Total 7. Need 8th grade. "medically necessary" define? "means treatment is needed for your condition". Could be too many. Need define terms of art first time: partial determination? medical necessity? Maybe: "Medically necessary means the treatment is needed to diagnose or care for your condition." But facts don't specify? Could include. Need no unsupported? General. Sentence count.
Maybe:
"Your request for 24 physical therapy visits for your right shoulder is partly approved and partly denied. We approved 12 visits with dates 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because medical necessity is not established for them at this time under medical policy MP-660. Medical necessity means the treatment is needed to care for your condition. MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits may be authorised. Your treating physical therapist can submit a reassessment after visit 10 that shows objective functional gains, and a further 12 visits may then be authorised. This request was reviewed by a licensed physical therapist reviewer. You can appeal this decision internally within 180 days, and you can ask for external review after that." Count 8. Good. But "authorised" vs US? Use authorised from facts maybe okay. Need exact figures dates. It includes "partly approved" not exact "partial determination". Fine. Sentence limit 8 exactly. Need message only. Maybe avoid "more visits may be authorised" vs "a further 12". Good.
Need final JSON fenced only. Ensure no additional keys. JSON string escapes? It can include quotes? Need use JSON object. Could have newlines? Simpler.json{
"message": "Your request for 24 physical therapy visits for your right shoulder is partly approved and partly denied. We approved 12 visits with dates 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because medical necessity is not established for them at this time under medical policy MP-660. Medical necessity means the treatment is needed to care for your condition. MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits may be authorised. Your treating physical therapist can submit a reassessment after visit 10 that shows objective functional gains, and a further 12 visits may then be authorised. This request was reviewed by a licensed physical therapist reviewer. You can appeal this decision internally within 180 days, and you can ask for external review after that."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 visits approved with dates 2026-06-01 through 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 showing functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated, plus external review."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Explicitly framed as partly approved and partly denied."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true,
"judgeCostUSD": 0.0110755
}Reasoning · 1,029 tokens
We need answer user's task. Need write member notice partial determination, 8 sentences or fewer. Required output exactly one fenced JSON code block with key message. Need no extra. Need ensure at 8th grade, define terms. Use exact figures and dates. No clinical advice. Include appeal rights/deadlines and route. Need partial determination: requested 24 PT visits for right shoulder; approved 12 visits dates 2026-06-01 through 2026-08-31; denied remaining 12 as not established medically necessary at time under MP-660 authorises up to 12 initially and requires documented functional reassessment before authorising more. Route: treating therapist submits reassessment after visit 10 documenting objective functional gains; further 12 visits may then be authorised. Appeal rights: internal appeal within 180 days; external review thereafter. Reviewed by licensed physical therapist reviewer. Need maybe use "medical necessity" define? At eighth grade. 8 sentences max. Let's count sentences carefully.
Potential message:
"You asked for 24 physical therapy visits for your right shoulder." 1
"We approved 12 visits for the dates 2026-06-01 through 2026-08-31." 2
"We denied the remaining 12 visits because they were not established as medically necessary at the time of this request." 3 (medically necessary means plan's medical rules agree treatment is needed for health; maybe define) Need define term. "Medically necessary means your plan decides that treatment is needed for your health and follows its medical policy." Could combine.
"Medical policy MP-660 allows 12 visits initially and requires a documented functional reassessment before approving more." 4
"To request the remaining visits, your treating therapist can submit a reassessment after visit 10." 5
"That reassessment must document objective functional gains, and a further 12 visits may then be authorized." 6
"A licensed physical therapist reviewer reviewed this request." 7
"If you disagree with the denied 12 visits, you may file an internal appeal within 180 days, and you may ask for an external review after that." 8
Need maybe "external review thereafter" means after internal appeal? Could be external review thereafter (after decision?) Safer: "If you still disagree after the internal appeal, you may request an external review." But need include within 180 days. Sentence count 8 if combine. Need "dates 2026-06-01 through 2026-08-31" exact. Good. Need define "authorized"? okay.
But sentence count: We need <=8. Let's optimize.
1 You asked for 24 physical therapy visits for your right shoulder.
2 We approved 12 visits for dates 2026-06-01 through 2026-08-31.
3 We denied the remaining 12 visits because they were not established as medically necessary at the time of this request.
4 Medically necessary means your plan agrees the care is needed and follows its medical policy.
5 Medical policy MP-660 allows 12 visits initially and requires a documented functional reassessment before approving more.
6 To ask for the rest, your treating therapist can submit a reassessment after visit 10 that documents objective functional gains; a further 12 visits may then be authorized. (semicolon maybe one sentence)
7 A licensed physical therapist reviewer reviewed this request.
8 If you disagree with the denied visits, you can file an internal appeal within 180 days, and you can ask for an external review after that.
This is 8 sentences. Is "after that" clear? external review thereafter. Fine. Could "external review thereafter" mean after internal appeal decision. Good.
Need ensure no clinical advice. It asks for remaining visits, route, not telling care needed? It's explaining coverage route. Fine. "your treating therapist can submit" okay. "objective functional gains" maybe not clinical advice. Could say "may then be authorized" no promise. Good.
Need maybe "dates" exact. Maybe "for dates" awkward. Good.
Need no mention of no medical advice? No.
Need output JSON with only message. Ensure sentence punctuation: semicolon not period, sentence count 8. Period inside semicolon? We need avoid sentence tokenization counting semicolon as separate? Usually sentences end with . ? !. Semicolon not. We have 8 periods. Sentence 6 contains semicolon but one period. Sentence 8 has comma. Good.
Need maybe "right shoulder" lower. Fine.
Could be too many? 8. Need final exactly fenced JSON code block no commentary. Ensure escaped JSON.
json{
"message": "You asked for 24 physical therapy visits for your right shoulder. We approved 12 visits for dates 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they were not established as medically necessary at the time of this request. Medically necessary means your plan agrees the care is needed and follows its medical policy. Medical policy MP-660 allows 12 visits initially and requires a documented functional reassessment before approving more. To ask for the rest, your treating therapist can submit a reassessment after visit 10 that documents objective functional gains; a further 12 visits may then be authorized. A licensed physical therapist reviewer reviewed this request. If you disagree with the denied visits, you can file an internal appeal within 180 days, and you can ask for an external review after that."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 through 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 documenting functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: some approved, some denied."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true,
"judgeCostUSD": 0.010988
}100Kimi K2.6 · Moonshot8.5s · 2,333 out | 18.5s · 3,383 out | 101.5s · 4,017 out
Reasoning · 2,628 tokens
The user wants a member-facing notice for a partial determination regarding physical therapy visits.
Key facts:
- Requested: 24 visits for right shoulder
- Approved: 12 visits, dates 2026-06-01 through 2026-08-31
- Denied: remaining 12 visits as not medically necessary under MP-660 (up to 12 visits initially; requires documented functional reassessment before authorizing more)
- Route to remaining visits: treating therapist submits reassessment after visit 10 documenting objective functional gains; then further 12 may be authorized
- Appeal rights: internal appeal within 180 days; external review thereafter
- Reviewed by a licensed physical therapist reviewer
Requirements:
- Exactly one fenced JSON code block
- Keys: "message" (string)
- Eight sentences or fewer
- Eighth-grade reading level
- Define any term of art the first time it appears
- Use exact dollar figures and dates supplied; no rounding, no new figures
- No clinical advice, no telling member what care they need
- Do not promise outcome facts don't support
- Include appeal rights, deadlines, route to resolution
- No headers, no bullet points unless facts genuinely need a list, no salutation/sign-off unless asked for letter (not asked here)
- No currency amounts to report here.
Need to count sentences carefully. Let's draft:
Draft 1:
We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not established as medically necessary at this time under medical policy MP-660. This policy allows up to 12 visits initially and requires a documented functional reassessment before authorizing more. To request the remaining visits, your treating therapist must submit a reassessment after visit 10 showing objective functional gains. If that is submitted and meets the policy, up to 12 more visits may be authorized. You have the right to an internal appeal within 180 days of this notice. If you disagree with the internal appeal decision, you may request an external review after that. A licensed physical therapist reviewer reviewed your request.
Let's count sentences:
1. We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31.
2. We denied the remaining 12 visits because they are not established as medically necessary at this time under medical policy MP-660.
3. This policy allows up to 12 visits initially and requires a documented functional reassessment before authorizing more.
4. To request the remaining visits, your treating therapist must submit a reassessment after visit 10 showing objective functional gains.
5. If that is submitted and meets the policy, up to 12 more visits may be authorized.
6. You have the right to an internal appeal within 180 days of this notice.
7. If you disagree with the internal appeal decision, you may request an external review after that.
8. A licensed physical therapist reviewer reviewed your request.
That's exactly 8 sentences. Good.
Check terms of art: "medically necessary" is a term of art? Maybe define it? The instructions say "Define any term of art the first time it appears." But "medically necessary" is commonly understood. However, "functional reassessment" might be a term of art? The prompt says "medical policy MP-660, which authorises up to 12 visits initially and requires a documented functional reassessment before authorising more". Maybe define functional reassessment? But it's somewhat self-explanatory. In health plan communications, "medically necessary" is often considered a term of art. Let's see if I can fit a definition without breaking sentence count.
If I need to define "medically necessary", I could say: "We denied the remaining 12 visits because they are not established as medically necessary—meaning health care services needed to diagnose or treat your condition—at this time..." But that's a bit invented. The prompt doesn't supply a definition. Rule 2: "Answer only from the material in the prompt. Where the supplied material does not settle the question, say so through the answer format rather than assuming a resolution." Since no definition of medically necessary is given, perhaps I should not define it, or if I do, I must be careful not to introduce outside material.
Actually, the glossary doesn't define medically necessary. The prompt itself doesn't define it. So defining it might risk introducing outside information. However, the harness instructions say "Define any term of art the first time it appears." This is a writing instruction. But Rule 2 says answer only from material in prompt. These might conflict. Usually in these tasks, if a term is used and commonly understood, you can use it. But to be safe, perhaps avoid needing to define by rephrasing? Or just use the term because the prompt uses it without definition. The instruction "Define any term of art the first time it appears" is part of the general instructions for this task family, but Rule 2 is ground rule. If the term isn't defined, I shouldn't fabricate a definition. So I will not define it, because I have no material to draw from. The prompt is the source.
Also "functional reassessment" is in the prompt. I can use it as is. "External review" is also a term; appeal rights are given. I can mention them.
Check dates: exact ISO date format? Ground rule says "Dates are ISO 8601 (YYYY-MM-DD)." The prompt gives dates as 2026-06-01 through 2026-08-31. Keep them exactly.
Check prose: "external review thereafter" -> I wrote "you may request an external review after that." That's accurate.
Check no salutation/sign-off: none.
Check no bullet points: none.
Check sentence limit: 8 or fewer. Exactly 8 is okay.
Let's double-check for any clinical advice: none.
Let's double-check promise of outcome: "If that is submitted and meets the policy, up to 12 more visits may be authorized." This aligns with "a further 12 visits may then be authorised". Good, doesn't promise.
Let's ensure no extra keys. Only "message".
Let's review punctuation and grammar:
We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not established as medically necessary at this time under medical policy MP-660. This policy allows up to 12 visits initially and requires a documented functional reassessment before authorizing more. To request the remaining visits, your treating therapist must submit a reassessment after visit 10 showing objective functional gains. If that is submitted and meets the policy, up to 12 more visits may be authorized. You have the right to an internal appeal within 180 days of this notice. If you disagree with the internal appeal decision, you may request an external review after that. A licensed physical therapist reviewer reviewed your request.
Wait, sentence 8 "A licensed physical therapist reviewer reviewed your request." A bit clunky but okay. Maybe "Your request was reviewed by a licensed physical therapist reviewer." That's also fine. Let's keep the active voice or whichever. "A licensed physical therapist reviewed your request." But the fact says "Reviewed by a licensed physical therapist reviewer". That is slightly redundant but accurate. I could say "A licensed physical therapist reviewer examined your request." But "reviewed" is fine. Let's keep: "A licensed physical therapist reviewer reviewed your request." It's accurate. Or to avoid repetition: "Your request was reviewed by a licensed physical therapist reviewer." That's a sentence.
Actually, maybe I should say: "Your request was reviewed by a licensed physical therapist reviewer." That's clear.
Let's count again:
1. We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31.
2. We denied the remaining 12 visits because they are not established as medically necessary at this time under medical policy MP-660.
3. This policy allows up to 12 visits initially and requires a documented functional reassessment before authorizing more.
4. To request the remaining visits, your treating therapist must submit a reassessment after visit 10 showing objective functional gains.
5. If that is submitted and meets the policy, up to 12 more visits may be authorized.
6. You have the right to an internal appeal within 180 days of this notice.
7. If you disagree with the internal appeal decision, you may request an external review after that.
8. Your request was reviewed by a licensed physical therapist reviewer.
Looks good.
I need to output exactly one fenced JSON code block. Ensure no markdown formatting issues.
Final JSON:
```json
{
"message": "We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not established as medically necessary at this time under medical policy MP-660. This policy allows up to 12 visits initially and requires a documented functional reassessment before authorizing more. To request the remaining visits, your treating therapist must submit a reassessment after visit 10 showing objective functional gains. If that is submitted and meets the policy, up to 12 more visits may be authorized. You have the right to an internal appeal within 180 days of this notice. If you disagree with the internal appeal decision, you may request an external review after that. Your request was reviewed by a licensed physical therapist reviewer."
}
```
Wait, "functional reassessment" might be a term of art I haven't defined. But as noted, I can't define it from outside material. The instruction to define terms of art is subordinate to using only prompt material? The ground rules say "Answer only from the material in the prompt." If the prompt doesn't define it, I can't. The prompt does use the term, so the member likely has context. I'll proceed.
Also, should I mention "partial determination"? The prompt says "Write the member's notice for a partial determination." The facts are a partial determination. The message itself should just explain it, not necessarily label it. I think it's fine as drafted.
One final check: "eighth-grade reading level". The sentences aren't overly complex. Good.
No dollar amounts.
Appeal rights included.
Route to resolution included.
Sentence count: 8. Perfect.
I will output the JSON.json{
"message": "We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not established as medically necessary at this time under medical policy MP-660. This policy allows up to 12 visits initially and requires a documented functional reassessment before authorizing more. To request the remaining visits, your treating therapist must submit a reassessment after visit 10 showing objective functional gains. If that is submitted and meets the policy, up to 12 more visits may be authorized. You have the right to an internal appeal within 180 days of this notice. If you disagree with the internal appeal decision, you may request an external review after that. Your request was reviewed by a licensed physical therapist reviewer."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "12 visits approved with dates given"
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denial of 12 with MP-660 initial-12/reassessment reason"
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist reassessment after visit 10 described"
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated"
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly presented as partial approval/denial"
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 3,736 tokens
The user wants a member-facing notice for a partial determination. Key facts:
- Requested: 24 PT visits for right shoulder
- Approved: 12 visits, 2026-06-01 through 2026-08-31
- Denied: remaining 12 visits as not medically necessary under MP-660 (requires documented functional reassessment before authorizing more)
- Route to remaining: therapist submits reassessment after visit 10 documenting objective functional gains; then up to 12 more may be authorized
- Appeal rights: internal appeal within 180 days; external review thereafter
- Reviewed by licensed PT reviewer
Constraints:
- 8 sentences or fewer
- Eighth-grade reading level
- Define terms of art first time
- Exact dollar figures/dates (dates here: 2026-06-01, 2026-08-31)
- No clinical advice, no promising outcome
- Include appeal rights, deadlines, route to resolution
- No headers, no bullet points unless needed, no salutation/sign-off unless asked (not asked)
- JSON format with key "message"
Let me draft:
We approved 12 physical therapy visits for your right shoulder from June 1, 2026, through August 31, 2026. We denied the other 12 visits because our medical policy MP-660 does not show them to be medically necessary at this time. Medical necessity means the treatment is needed to address your health condition according to our guidelines. That policy authorizes up to 12 visits at first and requires a documented functional reassessment before any more visits can be approved. Your treating therapist may submit that reassessment after your tenth visit if it shows objective functional gains; then we may authorize up to 12 more visits. You have the right to file an internal appeal within 180 days if you disagree with this decision. After the internal appeal, you may request an external review. A licensed physical therapist reviewed your case.
Count: 1. We approved 12 physical therapy visits for your right shoulder from June 1, 2026, through August 31, 2026. (1 sentence)
2. We denied the other 12 visits because our medical policy MP-660 does not show them to be medically necessary at this time. (2)
3. Medical necessity means the treatment is needed to address your health condition according to our guidelines. (3)
4. That policy authorizes up to 12 visits at first and requires a documented functional reassessment before any more visits can be approved. (4)
5. Your treating therapist may submit that reassessment after your tenth visit if it shows objective functional gains; then we may authorize up to 12 more visits. (5)
6. You have the right to file an internal appeal within 180 days if you disagree with this decision. (6)
7. After the internal appeal, you may request an external review. (7)
8. A licensed physical therapist reviewed your case. (8)
That's exactly 8 sentences. But wait, "dates 2026-06-01 through 2026-08-31" - I converted to written dates. The prompt says "Use the exact dollar figures and dates supplied; do not round them and do not introduce a figure that is not in the facts." Should I use the exact ISO dates or is written okay? It says exact dates supplied. The dates supplied are 2026-06-01 through 2026-08-31. It might be safer to use the exact format supplied: 2026-06-01 through 2026-08-31. For member readability, writing "June 1, 2026" might be friendlier, but the instruction says use exact figures/dates supplied. So I should probably keep them as 2026-06-01 through 2026-08-31 to be safe, or "from 2026-06-01 to 2026-08-31". Let me check: "Use the exact dollar figures and dates supplied; do not round them and do not introduce a figure that is not in the facts." This strongly implies I should use the exact date strings provided: 2026-06-01 through 2026-08-31.
Let me revise:
We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because, under medical policy MP-660, they are not established as medically necessary at this time. Medical necessity means the treatment is needed for your health condition according to our clinical guidelines. Policy MP-660 authorizes up to 12 visits initially and requires a documented functional reassessment before authorizing more. Your treating therapist may submit that reassessment after visit 10 documenting objective functional gains, and a further 12 visits may then be authorized. You may file an internal appeal within 180 days if you disagree with this decision. If you remain dissatisfied after the internal appeal, you may request an external review. A licensed physical therapist reviewed your case.
Count:
1. We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31.
2. We denied the remaining 12 visits because, under medical policy MP-660, they are not established as medically necessary at this time.
3. Medical necessity means the treatment is needed for your health condition according to our clinical guidelines.
4. Policy MP-660 authorizes up to 12 visits initially and requires a documented functional reassessment before authorizing more.
5. Your treating therapist may submit that reassessment after visit 10 documenting objective functional gains, and a further 12 visits may then be authorized.
6. You may file an internal appeal within 180 days if you disagree with this decision.
7. If you remain dissatisfied after the internal appeal, you may request an external review.
8. A licensed physical therapist reviewed your case.
8 sentences exactly. Good terms: medical necessity defined. No bullet points. No salutation. Reading level seems appropriate. Includes appeal rights, deadlines, route. Uses exact dates. Does not promise outcome for the remaining visits (says "may then be authorized"). Good.
Wait, sentence 5: "Your treating therapist may submit that reassessment after visit 10 documenting objective functional gains, and a further 12 visits may then be authorized." This is a bit long but okay. Should I split? No, need 8 or fewer, and splitting might make 9. Actually I have exactly 8, so it's fine.
Double check: "medical policy MP-660" vs "Policy MP-660". The facts say "medical policy MP-660". I should keep that exact reference. Sentence 2 mentions it; sentence 4 refers to "That policy". Maybe keep exact in sentence 2.
Let's review the route: "the treating therapist submits a reassessment after visit 10 documenting objective functional gains; a further 12 visits may then be authorised". My sentence 5 captures this.
Appeal rights: "internal appeal within 180 days; external review thereafter". My sentences 6 and 7 capture this.
"Reviewed by a licensed physical therapist reviewer" -> Sentence 8.
All good. One thing: "Medical necessity means the treatment is needed for your health condition according to our clinical guidelines." Is "clinical guidelines" adding a figure not in facts? The fact says "medical policy MP-660". Hmm. Maybe better to say "according to policy MP-660" to avoid introducing new concepts. Let's reword sentence 3: "Medical necessity means the treatment is needed for your health condition based on our policy requirements." But "policy requirements" is vague. Or "Medical necessity means the service is required to treat your condition and meets our plan's standards." Actually, the safest is to define it simply without invoking external documents: "Medical necessity means the treatment is needed to treat your health condition and meets our plan's standards." That avoids introducing a new figure/concept.
But the instruction says define any term of art the first time it appears. So I need to define medical necessity. I can define it in plain language without reference to external documents. Let's refine sentence 3: "Medical necessity means the treatment is needed to treat your health condition and meets our plan's standards." That seems okay. But "plan's standards" is slightly new. Maybe just "Medical necessity means the treatment is needed for your health condition." That might be too simple but works.
Actually, the definition could be: "Medical necessity means the treatment is needed to improve your health condition and is appropriate according to our criteria." But "our criteria" is vague. The instruction is not super strict about the wording of the definition, just that it should be defined.
Let's look at sentence 2: "We denied the remaining 12 visits because, under medical policy MP-660, they are not established as medically necessary at this time."
Sentence 3: "Medical necessity means the treatment is needed for your health condition."
Sentence 4: "Medical policy MP-660 authorizes up to 12 visits at first and requires a documented functional reassessment before it will authorize more."
Wait, sentence 4 says "it will authorize more" - maybe "before authorizing more."
Let's count again:
1. We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31.
2. We denied the remaining 12 visits because, under medical policy MP-660, they are not established as medically necessary at this time.
3. Medical necessity means the treatment is needed for your health condition.
4. Medical policy MP-660 authorizes up to 12 visits at first and requires a documented functional reassessment before authorizing more.
5. Your treating therapist may submit that reassessment after visit 10 documenting objective functional gains, and a further 12 visits may then be authorized.
6. You may file an internal appeal within 180 days if you disagree with this decision.
7. If you remain dissatisfied after the internal appeal, you may request an external review.
8. A licensed physical therapist reviewed your case.
8 sentences. Good.
One check: The prompt says "Write as the member will read it: no headers, no bullet points unless the facts genuinely need a list, no salutation or sign-off unless the item asks for a letter." So this is plain paragraph text? I have 8 separate sentences. Should they be in one paragraph or separated by spaces? Usually member notices are paragraphs, but the instruction doesn't specify formatting beyond no headers/bullets. I can separate with spaces or just line breaks. The JSON string will encode line breaks if I use them, but it's safer to just have a single string with spaces between sentences. That's fine.
Also, check reading level: "established as medically necessary" is from the prompt, but that's okay. It's a notice.
Wait, sentence 5: "a further 12 visits may then be authorised" -> the facts use British spelling "authorised" in one place but US dollars. I should probably use US spelling "authorized" since money is US and this is likely US plan. But the prompt used "authorised" in the facts: "authorising" and "authorised". However, the output contract doesn't specify spelling. US health plans usually use American spelling. I'll use "authorized" to be consistent with US conventions. But since the prompt uses both "authorises" and "authorized" (wait, looking: "authorising" and "authorised" in the facts). Actually: "authorises up to 12 visits initially" (wait not in my paste). Let's re-read user prompt: "Denies: ... medical policy MP-660, which authorises up to 12 visits initially and requires ... authorising more". It uses British spelling. But the output contract says "Money is in US dollars. ...". Usually US English is expected. I'll use American spelling unless told otherwise. But if I'm using exact text from the prompt, maybe not. Actually, I'm paraphrasing. American spelling is fine.
One final thing: Is "medical policy MP-660" a term of art? Probably not requiring definition, but it's a reference.
Let's check if all required fields are present. The JSON needs exactly one key: "message" (string). That's it.
So final JSON:
```json
{
"message": "We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because, under medical policy MP-660, they are not established as medically necessary at this time. Medical necessity means the treatment is needed for your health condition. Medical policy MP-660 authorizes up to 12 visits at first and requires a documented functional reassessment before authorizing more. Your treating therapist may submit that reassessment after visit 10 documenting objective functional gains, and a further 12 visits may then be authorized. You may file an internal appeal within 180 days if you disagree with this decision. If you remain dissatisfied after the internal appeal, you may request an external review. A licensed physical therapist reviewed your case."
}
```
Wait, I count sentences again carefully:
1. We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31.
2. We denied the remaining 12 visits because, under medical policy MP-660, they are not established as medically necessary at this time.
3. Medical necessity means the treatment is needed for your health condition.
4. Medical policy MP-660 authorizes up to 12 visits at first and requires a documented functional reassessment before authorizing more.
5. Your treating therapist may submit that reassessment after visit 10 documenting objective functional gains, and a further 12 visits may then be authorized.
6. You may file an internal appeal within 180 days if you disagree with this decision.
7. If you remain dissatisfied after the internal appeal, you may request an external review.
8. A licensed physical therapist reviewed your case.
Yes, 8 sentences.
Is there any requirement to mention the right to an external review "thereafter"? Sentence 7 says "If you remain dissatisfied after the internal appeal, you may request an external review." This captures "external review thereafter". Good.
Does the message explain the route to resolution for the remaining visits? Yes, sentence 5. Good.
Are there any dollar amounts? No. So no issue with formatting.
I think this is solid.
Wait, check sentence 5: "a further 12 visits may then be authorized." The facts say "a further 12 visits may then be authorised". Using "authorized" is fine.
One nuance: The facts say "Denied: the remaining 12 visits, as not established as medically necessary at the time of this request under medical policy MP-660...". Should I include "at the time of this request"? Maybe to be precise. But sentence 2 is already a bit long. I can adjust: "We denied the remaining 12 visits because, under medical policy MP-660, they are not established as medically necessary at this time." "at this time" captures "at the time of this request" in simpler language. Good.
Also, should I explicitly name "partial determination"? The prompt says "Write the member's notice for a partial determination." It's okay not to use those words explicitly; the content describes it.
Everything looks good. json{
"message": "We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because, under medical policy MP-660, they are not established as medically necessary at this time. Medical necessity means the treatment is needed for your health condition. Medical policy MP-660 authorizes up to 12 visits at first and requires a documented functional reassessment before authorizing more. Your treating therapist may submit that reassessment after visit 10 documenting objective functional gains, and a further 12 visits may then be authorized. You may file an internal appeal within 180 days if you disagree with this decision. If you remain dissatisfied after the internal appeal, you may request an external review. A licensed physical therapist reviewed your case."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist may submit reassessment after visit 10 for further 12 visits."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 3,811 tokens
The user wants a member-facing notice for a partial determination. Key facts:
- Requested: 24 physical therapy visits for right shoulder
- Approved: 12 visits, dates 2026-06-01 through 2026-08-31
- Denied: remaining 12 visits, as not established as medically necessary at time of request under medical policy MP-660. MP-660 authorizes up to 12 visits initially and requires documented functional reassessment before authorizing more.
- Route to remaining visits: treating therapist submits reassessment after visit 10 documenting objective functional gains; further 12 visits may then be authorized.
- Appeal rights: internal appeal within 180 days; external review thereafter.
- Reviewed by a licensed physical therapist reviewer.
- Constraint: Eight sentences or fewer.
- Format: JSON with key "message".
Need to write at 8th grade reading level, define terms of art first time they appear, use exact dollar figures (none here) and dates. No salutation/sign-off unless asked (not asked). No bullet points unless facts genuinely need a list. Probably plain paragraph is fine.
Must include appeal rights and route to resolution.
Let's draft sentences:
1. We approved 12 physical therapy visits for your right shoulder from June 1, 2026, through August 31, 2026. (Uses exact dates, plain language)
2. We denied the other 12 visits you requested because they are not established as medically necessary at this time under medical policy MP-660, which allows up to 12 visits at first and needs a documented functional reassessment before more visits can be approved. (Define reassessment? Maybe "documented functional reassessment" is a term of art? Might need to define. Or simplify: "which allows up to 12 visits at first and requires a new assessment of your function before more visits can be approved." That's simpler. But need to be accurate: policy MP-660 authorizes up to 12 initially and requires documented functional reassessment. Let's define "functional reassessment" maybe. Since it's member-facing, maybe: "a documented functional reassessment, which is a check of your progress using objective measures of how you are moving and functioning." That might be too wordy. Let's see.
Wait: "Define any term of art the first time it appears." "Medically necessary" and "functional reassessment" are terms of art. But maybe "medically necessary" is common enough? The instructions say define any term of art. So define "medically necessary"? Could say "medically necessary, meaning treatment that is needed for your condition according to our policy". Or just use simpler phrasing. "Functional reassessment" is definitely term of art. Need to define it.
Let's draft carefully:
Sentence 1: We approved 12 physical therapy visits for your right shoulder to take place from 2026-06-01 through 2026-08-31. (Wait, date format in message? The prompt says "Use the exact dollar figures and dates supplied; do not round them and do not introduce a figure that is not in the facts." It doesn't explicitly say dates in message must be ISO 8601, but the GLOSSARY says "Dates are ISO 8601 (YYYY-MM-DD)." That might apply to dates in general. However, for member-facing text, writing "2026-06-01" might be less readable but is exact. Usually member notices would write "June 1, 2026" but the rule says use exact dates supplied and do not introduce a figure not in facts. The facts give "2026-06-01 through 2026-08-31". So I should probably keep them as 2026-06-01 through 2026-08-31 to be safe, or is reformatting introducing a figure? The instruction: "Use the exact dollar figures and dates supplied; do not round them and do not introduce a figure that is not in the facts." Reformatting a date is not introducing a new figure, but to be absolutely safe, use the supplied format. The GLOSSARY says dates are ISO 8601. So use that in the JSON and maybe in the message? The message is member-facing. Using ISO dates in member text is weird but acceptable if it's the exact supplied string. I think it's safer to use the exact strings as given: 2026-06-01 and 2026-08-31.
Sentence 2: We denied the remaining 12 visits because they are not shown to be medically necessary, meaning treatment needed for your condition according to plan rules, at this time under medical policy MP-660.
Sentence 3: This policy allows up to 12 visits at the start and requires a documented functional reassessment, which is a report from your therapist that measures your movement and function with objective tests, before more visits can be approved.
Sentence 4: To request the remaining visits, your treating therapist must submit a reassessment after visit 10 that shows objective functional gains.
Sentence 5: If that reassessment shows you are making progress, up to 12 more visits may be approved.
Sentence 6: You have the right to file an internal appeal within 180 days if you disagree with this decision.
Sentence 7: If you are not satisfied with the internal appeal, you may request an external review after that.
Sentence 8: A licensed physical therapist reviewer reviewed your request.
Check sentence count: 8 sentences. Good.
Need to ensure no bullet points, no headers, no salutation. It's one paragraph or a few sentences. The prompt says "no bullet points unless the facts genuinely need a list". So plain text is fine.
Check reading level: roughly 8th grade. "medically necessary, meaning treatment needed for your condition according to plan rules" and "documented functional reassessment, which is a report from your therapist that measures your movement and function with objective tests" are definitions.
Wait, the facts say "requires a documented functional reassessment before authorising more". The route says "the treating therapist submits a reassessment after visit 10 documenting objective functional gains; a further 12 visits may then be authorised". So I need to convey that accurately.
Let's refine:
Sentence 1: We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31.
Sentence 2: We denied the remaining 12 visits because they are not established as medically necessary, meaning care that is required for your condition under our plan rules, at this time under medical policy MP-660.
Sentence 3: This policy authorizes up to 12 visits initially and requires a documented functional reassessment, which is a progress check that uses objective measures of your movement and function, before more visits can be authorized.
Sentence 4: Your treating therapist may submit a reassessment after visit 10 that documents objective functional gains.
Sentence 5: If the reassessment shows you are making progress, a further 12 visits may then be authorized.
Sentence 6: If you disagree with this decision, you may file an internal appeal within 180 days.
Sentence 7: After the internal appeal, you may request an external review.
Sentence 8: This request was reviewed by a licensed physical therapist reviewer.
That's 8 sentences. Good.
Wait, the facts say "Appeal rights: internal appeal within 180 days; external review thereafter". My sentence 6 and 7 capture that. "External review thereafter" means after internal appeal. My phrasing "After the internal appeal, you may request an external review" captures it.
Check for term of art definitions:
- "medically necessary" defined.
- "documented functional reassessment" defined.
- "objective functional gains" might be term of art? I used "objective functional gains" in sentence 4 but didn't define it. Should I define "objective functional gains"? It's part of the route. The instruction: "Define any term of art the first time it appears." "Objective functional gains" is somewhat technical. Maybe define it as "measurable improvements in how you move and function". Let's see if I can incorporate.
Alternative Sentence 4: Your treating therapist may submit a reassessment after visit 10 that documents objective functional gains, meaning measurable improvements in how you move and function.
That would be good. But then I have 8 sentences already. I need to combine something or keep it to 8.
Let's count again with that definition:
1. We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31.
2. We denied the remaining 12 visits because they are not established as medically necessary, meaning care that is required for your condition under our plan rules, at this time under medical policy MP-660.
3. This policy authorizes up to 12 visits initially and requires a documented functional reassessment, which is a progress check that uses objective measures of your movement and function, before more visits can be authorized.
4. Your treating therapist may submit a reassessment after visit 10 that documents objective functional gains, meaning measurable improvements in how you move and function.
5. If the reassessment shows you are making progress, a further 12 visits may then be authorized.
6. If you disagree with this decision, you may file an internal appeal within 180 days.
7. After the internal appeal, you may request an external review.
8. This request was reviewed by a licensed physical therapist reviewer.
That's exactly 8 sentences. Great.
But wait, "objective functional gains" appears in sentence 4. I define it there. "medically necessary" appears in sentence 2, defined. "documented functional reassessment" appears in sentence 3, defined. Good.
Are there any other terms? "Medical policy MP-660" is just a name. "Internal appeal" and "external review" are terms of art? Maybe, but they are somewhat self-explanatory and the instructions say include appeal rights. Defining them might be good but could make sentences too long. I think it's okay.
Check constraints: "Eight sentences or fewer." I have exactly 8. Good.
Check no salutation/sign-off: none.
Check exact dates: "2026-06-01" and "2026-08-31" used exactly.
Check exact numbers: 12 visits, 24 visits requested (implied by remaining 12 approved 12). I mention 12 and 12. That's fine.
Check no clinical advice: I'm not telling them what care they need.
Check no promised outcome: I say "may then be authorized", "may request". Good.
Check no bullet points: it's a paragraph. I'll join sentences with spaces.
Let's review the text flow:
"We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not established as medically necessary, meaning care that is required for your condition under our plan rules, at this time under medical policy MP-660. This policy authorizes up to 12 visits initially and requires a documented functional reassessment, which is a progress check that uses objective measures of your movement and function, before more visits can be authorized. Your treating therapist may submit a reassessment after visit 10 that documents objective functional gains, meaning measurable improvements in how you move and function. If the reassessment shows you are making progress, a further 12 visits may then be authorized. If you disagree with this decision, you may file an internal appeal within 180 days. After the internal appeal, you may request an external review. This request was reviewed by a licensed physical therapist reviewer."
Wait, sentence 3 is long but okay. Is "plan rules" accurate? The policy is a medical policy. "our plan rules" is close enough. Or "our policy". But I already said "under medical policy MP-660". So maybe "meaning care that is required for your condition according to that policy." Let's keep it simple.
Actually, "medically necessary, meaning care that is required for your condition under the plan's medical policy" might be better. But I used "plan rules". That should be fine.
Let's check sentence count carefully:
1. We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31.
2. We denied the remaining 12 visits because they are not established as medically necessary, meaning care that is required for your condition under our plan rules, at this time under medical policy MP-660.
3. This policy authorizes up to 12 visits initially and requires a documented functional reassessment, which is a progress check that uses objective measures of your movement and function, before more visits can be authorized.
4. Your treating therapist may submit a reassessment after visit 10 that documents objective functional gains, meaning measurable improvements in how you move and function.
5. If the reassessment shows you are making progress, a further 12 visits may then be authorized.
6. If you disagree with this decision, you may file an internal appeal within 180 days.
7. After the internal appeal, you may request an external review.
8. This request was reviewed by a licensed physical therapist reviewer.
Yes, 8 sentences.
One concern: In sentence 2, "at this time under medical policy MP-660" might be slightly awkward but okay. Could be: "We denied the remaining 12 visits because, under medical policy MP-660, they are not established as medically necessary at this time." But then where to put the definition? Maybe: "We denied the remaining 12 visits because they are not established as medically necessary at this time; medically necessary means care that is required for your condition under medical policy MP-660." But that changes meaning slightly. Let's keep as is.
Wait, the facts say "Denied: the remaining 12 visits, as not established as medically necessary at the time of this request under medical policy MP-660". So the reason is "not established as medically necessary at the time of this request under medical policy MP-660". My sentence captures that.
Double-check that I didn't miss anything: "Reviewed by a licensed physical therapist reviewer" included. Good.
Check JSON format: exactly one fenced JSON code block and nothing else.
Key required: "message" string.
No extra keys.
Value should be the string.
Should I include newline characters in the JSON string? Usually JSON strings can contain spaces. I'll just make it a single-line string or allow line breaks inside the string? The JSON format can handle escaped newlines, but it's easier to just put it all on one line with spaces. The prompt doesn't require specific formatting inside the string, just the text itself. A single line is fine.
Let's assemble final JSON.
```json
{
"message": "We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because they are not established as medically necessary, meaning care that is required for your condition under our plan rules, at this time under medical policy MP-660. This policy authorizes up to 12 visits initially and requires a documented functional reassessment, which is a progress check that uses objective measures of your movement and function, before more visits can be authorized. Your treating therapist may submit a reassessment after visit 10 that documents objective functional gains, meaning measurable improvements in how you move and function. If the reassessment shows you are making progress, a further 12 visits may then be authorized. If you disagree with this decision, you may file an internal appeal within 180 days. After the internal appeal, you may request an external review. This request was reviewed by a licensed physical therapist reviewer."
}
```
Is "plan rules" too vague? The fact says "medical policy MP-660". I defined medically necessary relative to our plan rules. Maybe better to say "meaning care that is required for your condition under our medical policy". Let's adjust slightly to be closer.
"We denied the remaining 12 visits because they are not established as medically necessary, meaning care that is required for your condition under our medical policy, at this time under medical policy MP-660." That's redundant. How about: "We denied the remaining 12 visits because, at this time under medical policy MP-660, they are not established as medically necessary, meaning care that is required for your condition." That's better.
Let's rewrite sentence 2:
"We denied the remaining 12 visits because, at this time under medical policy MP-660, they are not established as medically necessary, meaning care that is required for your condition."
That works. It's one sentence.
So:
1. We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31.
2. We denied the remaining 12 visits because, at this time under medical policy MP-660, they are not established as medically necessary, meaning care that is required for your condition.
3. This policy authorizes up to 12 visits initially and requires a documented functional reassessment, which is a progress check that uses objective measures of your movement and function, before more visits can be authorized.
4. Your treating therapist may submit a reassessment after visit 10 that documents objective functional gains, meaning measurable improvements in how you move and function.
5. If the reassessment shows you are making progress, a further 12 visits may then be authorized.
6. If you disagree with this decision, you may file an internal appeal within 180 days.
7. After the internal appeal, you may request an external review.
8. This request was reviewed by a licensed physical therapist reviewer.
Good.
Wait, is "documented functional reassessment" defined well enough? "a progress check that uses objective measures of your movement and function". That seems right.
One more thing: "route to the remaining visits: the treating therapist submits a reassessment after visit 10 documenting objective functional gains; a further 12 visits may then be authorised". I say "Your treating therapist may submit..." The fact says "the treating therapist submits...". Using "may" is appropriate because it's conditional. "may then be authorised" -> "may then be authorized". I use "may then be authorized". Good.
I think this is solid. I'll output the JSON.json{
"message": "We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because, at this time under medical policy MP-660, they are not established as medically necessary, meaning care that is required for your condition. This policy authorizes up to 12 visits initially and requires a documented functional reassessment, which is a progress check that uses objective measures of your movement and function, before more visits can be authorized. Your treating therapist may submit a reassessment after visit 10 that documents objective functional gains, meaning measurable improvements in how you move and function. If the reassessment shows you are making progress, a further 12 visits may then be authorized. If you disagree with this decision, you may file an internal appeal within 180 days. After the internal appeal, you may request an external review. This request was reviewed by a licensed physical therapist reviewer."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist may submit reassessment after visit 10 documenting functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval and partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}100DeepSeek V4 Pro · DeepSeek18.5s · 878 out | 17.2s · 1,102 out | 16.6s · 781 out
Reasoning · 723 tokens
We are asked to write a member's notice for a partial determination. The determination approves 12 visits and denies 12 more, with a route for the remaining visits and appeal rights. The notice should be eight sentences or fewer, written at an eighth-grade reading level, with no salutation or sign-off, and no bullet points unless needed. We'll craft a clear message that explains the decision, the reason, the next steps, and appeal rights.
Key points: approved 12 visits from 2026-06-01 to 2026-08-31. Denied 12 more because not medically necessary under MP-660; this policy requires a reassessment after 10 visits for more visits. So the member needs the therapist to submit a reassessment to potentially get more visits. We include internal appeal deadline and external review.
We'll keep it simple, eight sentences max. We'll write in plain language, define terms like "medical necessity" if needed, but we can just explain the policy. Since the member is likely familiar with physical therapy, we can say "the plan's policy" and "functional reassessment."
Possible structure:
- Sentence 1: We reviewed your request for 24 physical therapy visits for your right shoulder.
- Sentence 2: We approved 12 visits, from June 1 to August 31, 2026.
- Sentence 3: We could not approve the other 12 visits at this time.
- Sentence 4: Our policy (MP-660) allows up to 12 visits at first.
- Sentence 5: To get more, your therapist must submit a reassessment after visit 10 showing your progress.
- Sentence 6: After that, we may authorize more visits.
- Sentence 7: You have the right to appeal our decision.
- Sentence 8: You must file an internal appeal within 180 days, and then you can ask for an external review.
That's 8 sentences. We could combine some. The instruction says "Eight sentences or fewer." So we can be concise. We'll make sure to mention the functional reassessment and the timeline. Also, the reviewer is a licensed physical therapist, but that might not be necessary for the member notice. The prompt says "Reviewed by a licensed physical therapist reviewer" but we don't need to include that unless it's part of the facts. However, the notice could mention "our clinical reviewer" or something, but not required.
We'll craft a message without salutation, just the text. We'll use the exact dollar figures? No dollar figures here, only dates and numbers. No medical advice. Appeal rights included.
Let's write:
"Your request for 24 physical therapy visits for your right shoulder has been partly approved. We approved 12 visits, from June 1, 2026 through August 31, 2026. We could not approve the other 12 visits because our medical policy (MP-660) requires a functional reassessment before more visits can be approved. Please have your therapist submit a reassessment after your 10th visit. If the reassessment shows you are making progress, we may authorize more visits. If you disagree with this decision, you have the right to appeal. You must file an internal appeal within 180 days of this letter. After that, you may have the right to an external review."
Count: 8 sentences. Could be fine. It's clear and includes appeal rights and next steps. No bullet points, no headers. So I'll output that as the message.json{
"message": "Your request for 24 physical therapy visits for your right shoulder has been partly approved. We approved 12 visits, from June 1, 2026 through August 31, 2026. We could not approve the other 12 visits because our medical policy (MP-660) requires a functional reassessment before more visits can be approved. Please have your therapist submit a reassessment after your 10th visit. If the reassessment shows you are making progress, we may authorize more visits. If you disagree with this decision, you have the right to appeal. You must file an internal appeal within 180 days of this letter. After that, you may have the right to an external review."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved, June 1–Aug 31, 2026."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Other 12 not approved; cites MP-660 reassessment requirement before more visits."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after 10th visit showing progress."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Framed explicitly as partly approved."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 939 tokens
We need to write a member-facing notice (message) in 8 sentences or fewer. It's a partial determination: 12 PT visits approved, 12 denied pending reassessment. Need to include: what was approved (dates, number of visits), what was denied and why (medical policy MP-660, up to 12 initially, need reassessment), route to get remaining visits (reassessment after visit 10, objective functional gains, may be authorized), appeal rights (internal appeal 180 days, external review thereafter). Reviewed by a PT reviewer. Keep at eighth-grade level, define any terms if needed. But we're limited to 8 sentences. So craft concisely.
Message structure:
- State the decision: 12 physical therapy visits for right shoulder are approved from June 1 to August 31, 2026.
- State that the other 12 visits are not approved at this time because medical policy MP-660 allows up to 12 visits at first, and a reassessment is needed to show progress before more visits.
- Explain what to do: After your 10th visit, your therapist can submit a reassessment with your progress. If it shows gains, we may approve 12 more visits.
- Mention appeal rights: If you disagree, you can file an internal appeal within 180 days, then an external review.
- Mention reviewed by a licensed physical therapist.
Combine into 8 sentences max. Let's draft.
Sentence 1: We approved 12 physical therapy visits for your right shoulder, from June 1, 2026 to August 31, 2026.
Sentence 2: The other 12 visits you asked for are not approved at this time.
Sentence 3: Our medical policy MP-660 allows up to 12 visits to start and requires proof of progress before more visits are approved.
Sentence 4: To get more visits, your therapist should send us a reassessment after your 10th visit that shows your shoulder is getting better.
Sentence 5: If the reassessment shows clear gains, we may then approve 12 more visits.
Sentence 6: If you disagree with this decision, you have 180 days to file an internal appeal.
Sentence 7: After the internal appeal, you can ask for an external review.
Sentence 8: A licensed physical therapist reviewed your request.
That's 8 sentences. Could combine a bit: maybe combine appeal rights into one sentence? "You can file an internal appeal within 180 days, and then an external review." That's one. Then we'd have 7. But the prompt says "Eight sentences or fewer." So 8 is fine. Could also combine the medical policy explanation: "Our policy MP-660 covers up to 12 visits first, and a reassessment is needed before we can approve more." Then combine with the denial reason. Let's try to be concise.
Version:
1. We approved 12 physical therapy visits for your right shoulder, from June 1, 2026 through August 31, 2026.
2. The remaining 12 visits are denied because medical policy MP-660 allows only 12 visits at first.
3. The policy requires a reassessment that shows your shoulder is improving before we can approve more.
4. After your 10th visit, your therapist can send us a reassessment with your progress.
5. If it shows objective functional gains, we may then authorize another 12 visits.
6. You have the right to appeal this decision within 180 days by filing an internal appeal.
7. After that, you may request an external review.
8. A licensed physical therapist reviewed your case.
That's 8 sentences. Could drop sentence 8? It's part of the notice, maybe include. The prompt said "Write the member's notice" and gave "Reviewed by a licensed physical therapist reviewer" as a fact. I think it's appropriate to include that. Could combine it: "A licensed physical therapist reviewed your request." That's a sentence. So 8. OK.
Check reading level: Should be understandable. Terms: "reassessment", "internal appeal", "external review" might need definition. But can explain simply. The sentence "Your therapist should send us a reassessment after your 10th visit that shows your shoulder is getting better." is okay. Use "reassessment" meaning a check on your progress. Might define "functional reassessment" but the member doesn't need those words. Keep it simple. Provide the route to get remaining visits clearly.
Will output JSON with message key. So final.json{
"message": "We approved 12 physical therapy visits for your right shoulder, from June 1, 2026 through August 31, 2026. The remaining 12 visits you asked for are denied at this time. Our medical policy MP-660 covers up to 12 visits at first and requires a reassessment of your progress before we can approve more. After your 10th visit, your therapist can send us a reassessment that shows your shoulder is getting better. If that reassessment shows clear gains, we may then authorize another 12 visits. You have the right to appeal this decision. You can file an internal appeal within 180 days, and after that you can ask for an external review. A licensed physical therapist reviewed your request."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with June 1–Aug 31, 2026 dates."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied and cites MP-660 12-visit limit plus reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist sends reassessment after 10th visit showing gains; another 12 may be authorized."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "States internal appeal right within 180 days."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly presented as partial: approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 628 tokens
We need to write a member notice, 8 sentences or fewer. The notice should explain the partial determination: 12 visits approved, 12 denied because medical policy MP-660 requires reassessment after initial 12 visits for more. It provides the route to get the remaining visits: submit a reassessment after visit 10. Appeal rights: internal appeal within 180 days; external review thereafter. Reviewed by a licensed physical therapist reviewer. Keep it simple, eighth-grade level, no bullet points, just plain text. Mention dates, policy, process, appeal rights. No clinical advice. 8 sentences max.
Craft message:
- We reviewed your request for 24 physical therapy visits for your right shoulder.
- We approved 12 visits from June 1, 2026 to August 31, 2026.
- We denied the other 12 visits at this time because our medical policy (MP-660) covers up to 12 visits at first, and more visits require a reassessment of your progress.
- After your 10th visit, your therapist can submit a reassessment showing how you are improving.
- If the reassessment shows progress, we may approve more visits.
- If you disagree with this decision, you can appeal within 180 days.
- After that, you may ask for an external review.
- This decision was reviewed by a licensed physical therapist.
That's 8 sentences. Need to ensure it's terse, none are too long. I'll check if any details missing: Denied "as not established as medically necessary at this time under policy MP-660, which authorises up to 12 visits initially and requires documented functional reassessment before authorising more." I'll phrase: "denied because medical policy MP-660 allows up to 12 visits at first, and more visits need a reassessment showing functional gains." "Route to remaining visits: submit reassessment after visit 10 documenting objective functional gains; a further 12 visits may then be authorised." So I'll mention after 10th visit. "Appeal rights: internal appeal within 180 days; external review thereafter" – that's fine. Reviewed by licensed PT reviewer.
I'll combine some to fit 8 sentences max, but 8 is okay. I'll write:
1. We reviewed your request for 24 physical therapy visits for your right shoulder.
2. We approved 12 visits from June 1, 2026 through August 31, 2026.
3. We denied the remaining 12 visits because medical policy MP-660 covers up to 12 visits at first, and more visits need a functional reassessment to show progress.
4. After your 10th visit, your therapist can submit a reassessment.
5. If the reassessment shows objective functional gains, we may authorize up to 12 more visits.
6. You have the right to appeal this decision within 180 days.
7. After the internal appeal, you may request an external review.
8. This decision was reviewed by a licensed physical therapist.
That's 8 sentences. Yes.json{
"message": "We reviewed your request for 24 physical therapy visits for your right shoulder. We approved 12 visits from June 1, 2026 through August 31, 2026. We denied the remaining 12 visits because medical policy MP-660 covers up to 12 visits at first, and more visits need a functional reassessment to show progress. After your 10th visit, your therapist can submit a reassessment. If the reassessment shows objective functional gains, we may authorize up to 12 more visits. You have the right to appeal this decision within 180 days. After the internal appeal, you may request an external review. This decision was reviewed by a licensed physical therapist."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved, June 1–Aug 31, 2026."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States 12 denied, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 for 12 more."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "States appeal right within 180 days plus external review."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approval plus denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}100GPT-5.6 Luna · OpenAI3.4s · 211 out | 3.1s · 195 out | 2.1s · 239 out
json{"message":"We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. The remaining 12 requested visits were not approved because medical necessity was not established at the time of this request under medical policy MP-660. This policy authorizes up to 12 visits initially and requires a documented functional reassessment before more visits can be authorized. After visit 10, your treating therapist may submit a reassessment documenting objective functional gains. Based on that reassessment, a further 12 visits may then be authorized. A licensed physical therapist reviewer reviewed this request. You may file an internal appeal within 180 days, and you may request external review after the internal appeal."}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 visits approved with 2026-06-01 to 2026-08-31 range."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 not approved, cites MP-660 12-visit limit and reassessment."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 documenting functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly presented as partial approval and partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}json{"message":"We approved 12 physical therapy visits for your right shoulder from 2026-06-01 through 2026-08-31. The remaining 12 requested visits are not approved at this time because medical necessity was not established under medical policy MP-660, which allows up to 12 initial visits and requires a documented functional reassessment before more visits can be authorized. After visit 10, your treating therapist may submit a reassessment documenting objective functional gains, and a further 12 visits may then be authorized. A licensed physical therapist reviewer reviewed this determination. You may request an internal appeal within 180 days, followed by external review if needed."}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 not approved, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after visit 10 for further 12 visits."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: approval plus denial of remainder."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}json{"message":"Your request for 24 physical therapy visits for your right shoulder was partially approved. We approved 12 visits from 2026-06-01 through 2026-08-31. The remaining 12 visits were denied because they were not established as medically necessary at the time of this request under medical policy MP-660, which allows up to 12 initial visits and requires a documented functional reassessment before more visits can be authorized. After visit 10, your treating therapist may submit a reassessment documenting objective functional gains, and a further 12 visits may then be authorized. A licensed physical therapist reviewer reviewed this request. You may file an internal appeal within 180 days, followed by external review."}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 to 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist may submit reassessment after visit 10 for 12 more visits."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Explicitly framed as partial approval."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}100DeepSeek V4 Flash · DeepSeek3.0s · 539 out | 7.5s · 741 out | 88.3s · 689 out
Reasoning · 374 tokens
We need answer JSON with message. Need craft member notice for partial determination. Eight sentences or fewer. Required key message. Need exact figures dates. No header bullet unless needed. Explain coverage decision. Include appeal rights. Let's draft.
Need mention requested 24 visits, approved 12 from dates, denied remaining 12 as not medically necessary under MP-660, which authorizes up to 12 initially and requires documented functional reassessment before more. Route: therapist submits reassessment after visit 10 documenting objective functional gains; further 12 may be authorized. Appeal rights: internal appeal within 180 days; external review thereafter. Reviewed by licensed physical therapist reviewer. Need eight sentences or fewer.
Let's count. We can write maybe 5 sentences.
"Your request for 24 physical therapy visits for your right shoulder has been partially approved. We approved 12 visits for dates 2026-06-01 through 2026-08-31. The remaining 12 visits were denied because they are not established as medically necessary at this time under medical policy MP-660, which authorizes up to 12 visits initially and requires a documented functional reassessment before more visits can be approved. After visit 10, your treating therapist may submit a reassessment documenting objective functional gains, and a further 12 visits may then be authorized. This determination was reviewed by a licensed physical therapist reviewer. You have the right to file an internal appeal within 180 days, and may seek external review after that."
That's 6 sentences. Need "denied" term maybe okay. "as not established as medically necessary" exactly. Include exact.
Check sentence count: 1 request partial, 2 approved, 3 denied, 4 route, 5 review, 6 appeal. Fine. No bullets. Need no salutation. Good.
Final with JSON only.json{
"message": "Your request for 24 physical therapy visits for your right shoulder has been partially approved. We approved 12 visits for dates 2026-06-01 through 2026-08-31. The remaining 12 visits were denied because they are not established as medically necessary at this time under medical policy MP-660, which authorizes up to 12 visits initially and requires a documented functional reassessment before more visits can be approved. After visit 10, your treating therapist may submit a reassessment documenting objective functional gains, and a further 12 visits may then be authorized. This determination was reviewed by a licensed physical therapist reviewer. You have the right to file an internal appeal within 180 days, and may seek external review after that."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 visits approved with 2026-06-01 to 2026-08-31 range."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 initial 12 plus reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Describes therapist reassessment after visit 10 for further 12 visits."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "States internal appeal right within 180 days."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Explicitly framed as partial approval."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}Reasoning · 614 tokens
We need to produce JSON with key "message" containing member-facing text, 8 sentences or fewer. Must include exact figures and dates, route, appeal rights. No salutation. Should explain partial determination: approved 12 visits, denied remaining 12. Use plain language. Include that further visits possible with reassessment. Include appeal rights. Ensure no headers or bullets. Sentence count maybe 6-8. Let's craft.
Need to mention "medical policy MP-660" maybe not necessary but can say "our medical policy". Should define "medically necessary" maybe. Keep simple.
Write a message:
"We reviewed your request for 24 physical therapy visits for your right shoulder. We approved 12 visits for the dates June 1, 2026 through August 31, 2026. We denied the remaining 12 visits because, at this time, they are not shown to be medically necessary, which means needed to treat your condition. Our policy allows up to 12 visits at first, and more visits can only be approved after a documented functional reassessment. Your therapist can submit a reassessment after visit 10 that shows objective functional gains, and then up to 12 more visits may be approved. If you disagree, you have the right to ask for an internal appeal within 180 days, and you may seek an external review after that. A licensed physical therapist reviewed your request."
Count sentences: 1. reviewed, 2. approved, 3. denied, 4. policy allows, 5. therapist can submit, 6. if disagree, 7. licensed physical therapist. That's 7 sentences. Good.
Ensure dates format exactly? The prompt says use exact dollar figures and dates supplied. Dates are ISO 8601 in prompt, but for member-facing text, we can write as "June 1, 2026" or "2026-06-01"? The instruction says "Use the exact dollar figures and dates supplied; do not round them" — likely means the values should be consistent, but date formatting can be human-readable? Typically member notice uses "June 1, 2026". However, "exact" may mean include those dates. I'll use "June 1, 2026" and "August 31, 2026" as those are exact dates. But to be safe, could use "2026-06-01" but that's not member-friendly. The instruction says "Use the exact ... dates supplied" meaning don't change them, but I think formatting is okay. I'll keep as written.
Need define "objective functional gains" maybe not necessary.
Also mention "right shoulder" and "24 visits" "12 visits" etc.
No bullet points. OK.
Let's produce JSON.json{
"message": "We reviewed your request for 24 physical therapy visits for your right shoulder. We approved 12 visits for the dates June 1, 2026 through August 31, 2026. We denied the remaining 12 visits because, at this time, they are not shown to be medically necessary, which means needed to treat your condition. Our policy allows up to 12 visits at first, and more visits can only be approved after a documented functional reassessment. Your therapist can submit a reassessment after visit 10 that shows objective functional gains, and then up to 12 more visits may be approved. If you disagree, you have the right to ask for an internal appeal within 180 days, and you may seek an external review after that. A licensed physical therapist reviewed your request."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved, June 1–Aug 31, 2026."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12, cites 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist reassessment after visit 10 with functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly presented as partial approval and partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true,
"judgeCostUSD": 0.010463
}Reasoning · 629 tokens
We need answer JSON with message. Need comply. Need craft member notice for partial determination. Eight sentences or fewer. Need include facts: requested 24, approved 12 dates, denied remaining 12 as not medically necessary at this time under MP-660, authorizes up to 12 initially and requires documented functional reassessment before more. Route: treating therapist submits reassessment after visit 10 documenting objective functional gains; further 12 may be authorized. Appeal rights: internal appeal within 180 days; external review thereafter. Reviewed by licensed PT reviewer.
Need member-facing, no headers bullets unless needed. Avoid clinical advice. Use exact figures/dates. Sentence limit 8. Need explain coverage decision, include appeal rights / deadlines. Define term? "medically necessary" likely okay. Maybe "functional reassessment" define? Keep grade 8.
Need maybe mention partial determination. Let's draft in max 8 sentences. Count.
Potential:
"We have approved 12 of the 24 physical therapy visits you requested for your right shoulder. These 12 visits are covered for dates 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because medical policy MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved; at the time of this request, medical necessity for the additional visits was not established. After your 10th visit, your treating therapist can submit a reassessment showing objective functional gains, and a further 12 visits may then be authorized. This determination was reviewed by a licensed physical therapist reviewer. If you disagree, you have the right to ask for an internal appeal within 180 days. If the internal appeal is not resolved in your favor, you may then request an external review."
That's 7 sentences. Need maybe "functional reassessment" term maybe define? It's okay. Need ensure "objective functional gains" phrase. Use exact date. Need not include salutation. Good.
But check "not established as medically necessary at the time of this request" wording. Included. "approved" "covered" okay.
Need ensure second sentence dates exact. "These 12 visits are covered for dates..." fine.
Need output exactly one fenced JSON code block with key message. No extra.
Need maybe no "if the internal appeal is not resolved in your favor" but external review thereafter. Better "You may request an external review after the internal appeal." Good.
Let's final.json{
"message": "We have approved 12 of the 24 physical therapy visits you requested for your right shoulder. These 12 visits are covered for dates 2026-06-01 through 2026-08-31. We denied the remaining 12 visits because medical policy MP-660 allows up to 12 visits at first and requires a documented functional reassessment before more visits can be approved; at the time of this request, medical necessity for the additional visits was not established. After your 10th visit, your treating therapist can submit a reassessment showing objective functional gains, and a further 12 visits may then be authorized. This determination was reviewed by a licensed physical therapist reviewer. If you disagree, you have the right to ask for an internal appeal within 180 days. After the internal appeal, you may request an external review."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with dates 2026-06-01 through 2026-08-31."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "States remaining 12 denied, cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Describes therapist reassessment after visit 10 documenting functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "States internal appeal right within 180 days."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: 12 approved, 12 denied."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true,
"judgeCostUSD": 0.01100675
}100Claude Haiku 4.5 · Anthropic27.2s · 1,985 out | 17.4s · 1,765 out | 58.7s · 5,716 out
Reasoning · 1,824 tokens
This is a member explanation task for a partial determination on physical therapy. Let me parse what I need to include:
1. The claim facts:
- Requested: 24 physical therapy visits for right shoulder
- Approved: 12 visits (dates 2026-06-01 through 2026-08-31)
- Denied: remaining 12 visits
- Reason for denial: not established as medically necessary; per policy MP-660, only 12 visits approved initially; requires documented functional reassessment for more
- Route to additional visits: therapist submits reassessment after visit 10 with objective functional gains documentation; further 12 may be authorized
- Appeal rights: internal appeal within 180 days; external review thereafter
- Reviewer: licensed physical therapist
2. Requirements:
- Member-facing text
- Eighth-grade reading level
- No headers, bullets unless necessary
- No salutation/sign-off unless asked
- 8 sentences or fewer
- Include exact dollar figures and dates (there are none in this case)
- Don't give clinical advice
- Include appeal rights and deadlines
- Define terms of art
- Don't promise outcomes the facts don't support
3. Key points to communicate:
- We approved 12 visits (not all 24)
- These are from 2026-06-01 through 2026-08-31
- The other 12 are denied for now
- Why: our policy allows 12 initially; more need documentation of progress
- How to get more: therapist needs to submit reassessment after visit 10 showing functional improvement
- If not satisfied: can appeal within 180 days, then external review
Let me draft this at an eighth-grade level, keeping it concise (8 sentences max):
"We approved 12 physical therapy visits for your right shoulder between June 1, 2026 and August 31, 2026.
We cannot approve the remaining 12 visits you asked for right now. Our plan's rules allow 12 visits to start, and more visits need proof that therapy is helping you. Your therapist can send us an update after your 10th visit showing real progress, and we can then approve 12 more. You can appeal this decision within 180 days if you disagree. After that, you may ask for an outside review. A licensed physical therapist looked at your case before we made this decision.
That's 6 sentences, well within limit—good, concise, covers all required elements without extra padding.
tentially trim it, but a licensed PT reviewing the case does add credibility for the member.
Checking the required keys again—just "message" is needed for the JSON output, so I can keep this simple.
Tightening the wording once more: "We approved 12 physical therapy visits for your right shoulder from June 1, 2026 through August 31, 2026. We denied the remaining 12 visits you requested. Our policy allows up to 12 visits as a first step. To receive approval for additional visits, your therapist must submit a reassessment after your 10th visit showing improved shoulder function. If the reassessment shows progress, we can authorize 12 more visits. If you disagree with this decision, you may file an internal appeal within 180 days, then request an external review afterward. A licensed physical therapist reviewed your case."
That's 8 sentences, matching my target. Checking accessibility—"reassessment" seems fine in context; no need to overexplain. The core pieces are all there: dates and count approved/denied, the policy rationale, the path forward, appeal rights, and reviewer credentials.
One thing to verify: the facts say "may then be authorised," not guaranteed, so I should keep "can authorize" rather than "will" to avoid overpromising.
Also reconsidering "objective functional gains"—that's clinical jargon. Better to phrase it as "your shoulder function has improved," which reads clearer for a general audience.
This version holds together well. Final JSON:
```json
{
"message": "We approved 12 physical therapy visits for your right shoulder from June 1, 2026 through August 31, 2026. We denied the remaining 12 visits you requested. Our policy allows up to 12 visits as a first step. To receive approval for additional visits, your therapist must submit a reassessment after your 10th visit that shows your shoulder function has improved. If the reassessment shows progress, we can authorize 12 more visits. If you disagree with this decision, you may file an internal appeal within 180 days. After that, you can request an external review. A licensed physical therapist reviewed your case."
}
```
Double-checking accuracy: no dollar amounts involved, dates match exactly (June 1 and August 31, 2026), and the 180-day appeal window is included. Eight sentences total, clear language, all required elements present.
json{
"message": "We approved 12 physical therapy visits for your right shoulder from June 1, 2026 through August 31, 2026. We denied the remaining 12 visits you requested. Our policy allows up to 12 visits as a first step. To receive approval for additional visits, your therapist must submit a reassessment after your 10th visit that shows your shoulder function has improved. If the reassessment shows progress, we can authorize 12 more visits. If you disagree with this decision, you may file an internal appeal within 180 days. After that, you can request an external review. A licensed physical therapist reviewed your case."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with June 1–Aug 31, 2026 range."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12 and cites 12-initial policy plus reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist reassessment after 10th visit showing functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial: some approved, some denied."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true,
"judgeCostUSD": 0.01745
}Reasoning · 1,593 tokens
This is an EOB (Explanation of Benefits) task asking me to write a member-facing notice for a partial determination on physical therapy visits. Let me break down the key elements:
Facts:
- Member requested 24 PT visits for right shoulder
- Plan approved 12 visits (2026-06-01 through 2026-08-31)
- Denied 12 visits
- Reason: not medically necessary; policy MP-660 allows 12 initial visits and requires reassessment
- Path to more visits: therapist submits reassessment after visit 10 showing functional gains → potentially 12 more visits
- Appeal rights: internal appeal within 180 days, external review after
- Reviewed by licensed PT reviewer
Requirements:
- Member-facing text (no headers, bullets unless needed, no salutation/sign-off)
- Eighth-grade reading level
- Define terms of art
- Use exact dollar figures and dates (none in this case)
- Don't give clinical advice
- Include appeal rights and deadlines
- 8 sentences or fewer
- Respect the route to resolution
Key points to include:
1. What was approved (12 visits, dates)
2. What was denied (remaining 12)
3. Why (policy requires reassessment)
4. How to get more (reassessment after visit 10)
5. Appeal rights and timeline
Let me write this clearly and concisely at an 8th-grade level:
"We approved 12 physical therapy visits for your right shoulder from June 1, 2026 through August 31, 2026. We denied the remaining 12 visits you requested because our medical policy requires a reassessment documenting your progress before authorizing additional visits. After your 10th visit, your therapist can submit a reassessment showing objective functional improvements. If the reassessment shows you have made progress, we may authorize 12 more visits.
You have the right to appeal this decision within 180 days, or request an external review after that time. A licensed physical therapist reviewed your request."
Counting sentences: 7 total, within limits. Checking readability now — "reassessment," "objective functional improvements," and "external review" might trip up an 8th-grade reader, so I should clarify these plainly.
Revising: "We approved 12 physical therapy visits for your right shoulder from June 1, 2026 through August 31, 2026. We denied the remaining 12 visits because our medical policy (
and August 31, 2026. The remaining 12 visits can't be approved yet since our medical policy requires a reassessment before authorizing more treatment. After visit 10, your therapist submits a reassessment documenting measurable improvements in your physical function—if that shows progress, we can authorize 12 more visits. You can appeal within 180 days, or request external review after that period. A licensed physical therapist reviewed your request.
Seven sentences, checking off: approved amount/dates, denied amount, denial reason, reassessment criteria, appeal rights, reviewer credential—all covered.
Double-checking the dates match the facts (2026-06-01 through 2026-08-31), reading level stays simple, no clinical advice given, no bullet points used.
The message flows well: covers what was approved, why remaining visits weren't, the reassessment path forward after visit 10, and appeal rights within 180 days for internal review followed by external review. Everything ties back to the source facts accurately.
json{
"message": "We approved 12 physical therapy visits for your right shoulder between June 1, 2026 and August 31, 2026. We cannot approve the remaining 12 visits you requested at this time because our medical policy requires a reassessment, or re-evaluation, of your progress before we authorize more treatment. After your 10th visit, your therapist can submit a reassessment showing specific improvements you have made with treatment. If that reassessment documents measurable improvements in your physical function, we may authorize 12 additional visits. You can appeal this decision within 180 days. After 180 days, you can request an external review of this decision. A licensed physical therapist reviewed your request."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved, June 1–Aug 31, 2026."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Remaining 12 not approved; policy requires reassessment before more visits."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after 10th visit showing functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "States appeal right within 180 days."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval plus partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true,
"judgeCostUSD": 0.016088
}Reasoning · 5,534 tokens
This is a task asking me to write a member-facing notice for a partial determination on physical therapy visits. Let me break down the facts:
- Member requested 24 visits for right shoulder PT
- Approved: 12 visits, dates 2026-06-01 through 2026-08-31
- Denied: remaining 12 visits (not medically necessary per policy MP-660)
- Policy MP-660: allows up to 12 visits initially, requires documented functional reassessment before authorizing more
- Path forward: therapist submits reassessment after visit 10, if objective functional gains documented, further 12 visits can be authorized
- Appeal rights: internal within 180 days, external review thereafter
- Reviewed by licensed PT reviewer
Requirements:
- 8 sentences or fewer
- Member-facing (no headers, bullets unless genuinely needed, no salutation/sign-off)
- ~8th grade reading level
- Define terms of art on first use
- Use exact dollar figures and dates (none here, but dates apply)
- Don't give clinical advice
- Include appeal rights and deadlines
- Be terse
Key elements to include:
1. What was requested vs. what was approved
2. Reason for denial (medical necessity not established per policy)
3. Path to get remaining visits
4. Appeal rights with deadlines
Let me draft this:
"We have reviewed your request for 24 physical therapy visits for your right shoulder. We approved 12 visits covering June 1, 2026 through August 31, 2026. We denied the remaining 12 visits because medical necessity for those additional visits was not established at the time of your request under our medical policy MP-660. This policy allows up to 12 visits initially and requires that your therapist document objective functional gains through a reassessment after your 10th visit before we can authorize additional visits. If your therapist submits a reassessment showing functional improvement, we may authorize up to 12 more visits.
You have the right to appeal this decision within 180 days. If you are not satisfied with our internal appeal decision, you can request an external review. If you have questions, please contact us."
That's exactly 8 sentences. Checking against requirements: partial determination covered, member-facing tone with "you/your," dates included. "Objective functional gains" may need a plain-language tweak to hit grade level, and I should confirm the term is clarified on first use.
Let me simplify to make the reassessment reasoning clearer:
"We have reviewed your request for 24 physical therapy visits for your right shoulder. We approved 12 visits covering June 1, 2026 through August 31, 2026. We denied the remaining 12 visits because the medical need for those additional visits was not established at the time of your request under our medical policy MP-660. This policy allows up to 12 visits initially and requires that your therapist document that you have improved through a reassessment after your 10th visit before we can authorize additional visits. If your therapist submits a reassessment showing you have improved, we may authorize up to 12 more visits. You have the right to appeal this decision within 180 days. If you are not satisfied with our internal appeal decision, you can request an external review."
That comes to 7 sentences, one under the limit—room to add the contact line back in.
Checking clarity: "medical need" and "that you have improved" read simpler than the technical originals, and all the essentials are there—approval, denial, reasoning, path forward, appeal rights.
I'm debating whether to mention the reviewer being a licensed PT—it adds credibility but wasn't explicitly required, so I'll weigh it against the sentence budget since I have one slot left.
Refining the resolution path: the therapist needs to submit a reassessment after visit 10 showing improvement, and if approved, up to 12 more visits get authorized. Testing this version at 7 sentences confirms it still fits.
The word "may" matters here — approval isn't automatic even after reassessment, so I keep phrasing like "we may authorize" rather than promising it outright. Checking my draft, "if approved" already signals that dependency without overstating certainty.
Tightening further: combine the visit count and denial rationale into fewer words, cut redundant phrasing about MP-660, and keep the appeal/external review language intact since those are required elements.
the shoulder—strength, range of motion, ability to do daily tasks. "Improved" captures the plain-language meaning without the jargon.
Checking sentence count: 7 feels reasonable given the density of information. The structure covers request, approval/denial split, reasoning, path forward, and appeal rights—all essentials.
One more pass: "reassessment after your 10th visit" ties back to the 12-visit initial allowance, so the math should be clear to the member. That connection matters for them to understand why the timing is specific.
nal review after that."
That covers all the required elements: what was requested and approved, denial reason with policy citation, the path to more visits via reassessment, and both appeal rights. Checking readability—"reassessment" and "initial course of treatment" seem understandable given the surrounding context, so I don't think I need to simplify further.
One thing worth reconsidering: "medical necessity" is technically a term of art the member might not know. I could try defining it inline, like "medically necessary (appropriate and effective for your condition)," but that risks adding unnecessary length. I think phrasing it as "medical necessity was not established" alongside the policy detail about allowing 12 visits initially gives enough context for the member to grasp the meaning without a formal definition.
I keep drafting variations - "we do not have enough information to determine medical necessity," "based on medical policy MP-660, which requires evidence before approving," "which initially covers up to 12 visits, then requires reassessment" - but they either get too long or blur an important nuance: the policy doesn't guarantee more visits after reassessment, it just says they "may then be authorised." That's a subtle but important distinction I need to preserve accurately.
The actual process is: approved 12 visits, denied anything beyond because medical necessity wasn't established, and the path forward is for the therapist to submit a reassessment after visit 10 showing objective functional gains, which "may" unlock up to 12 more visits.
My current wording handles this reasonably: "To request approval for the remaining visits, your therapist should submit a reassessment after your 10th visit showing improvement in your shoulder. If your therapist's reassessment supports it, we may authorize up to 12 more visits." I'll keep this, just watching for the repeated "policy" wording nearby.
Draft: "We received your request for 24 physical therapy visits for your right shoulder. We approved 12 visits from June 1, 2026 through August 31, 2026, and denied the remaining 12 visits. We denied the additional visits because medical necessity was not established at the time of your request under medical policy MP-660. This policy allows up to 12 visits as an initial course of treatment. To request approval for the remaining visits, your therapist should submit a reassessment after your 10th visit showing improvement in your shoulder. If your therapist's reassessment supports it, we may authorize up to 12 more visits. You have the right to appeal this decision within 180 days, and to request external review after that."
Now I'm wondering whether "appeal" needs plain-language explanation given the eighth-grade target and insurance jargon concerns.
With 7 sentences already near the limit, defining it would force cutting content elsewhere. In everyday use "appeal" reads as "ask for reconsideration," which the phrase "appeal this decision" conveys well enough alongside the deadline given.
Similarly, "external review" seems understandable in context—review by someone outside the plan, coming after the internal appeal.
I'm satisfied with the draft and ready to format it as JSON, though I should still weigh mentioning licensed PT review.
The facts note a licensed physical therapist reviewed the request, lending credibility. But the prompt only requires appeal rights, deadlines, or resolution routes—reviewer credentials aren't part of that. Still, naming the reviewer is good transparency practice. With room for one more sentence, I try adding it: "We received your request for 24 physical therapy visits for your right shoulder. We approved 12 visits from June 1, 2026 through August 31, 2026, and denied the remaining 12 visits. A licensed physical therapist reviewed your request. We denied the additional visits because medical necessity was not established at the time of your request under medical policy MP-660. This policy allows up to 12 visits as an initial course of treatment. To request approval for the remaining visits, your therapist should submit a reassessment after your 10th visit showing
appeal this decision within 180 days, and to request external review after that." Seven sentences, clean flow.
Dropping the reviewer mention feels right—it doesn't add much for the member and made the opening sentence clunky. Leading with "We received your request" is simpler and gets straight to the point.
On phrasing "medical necessity was not established"—this works better than "could not be determined," which implies uncertainty rather than a standard not being met. It's standard denial language and clear enough in context.
Double-checking the dates: "June 1, 2026 through August 31, 2026" correctly converts the 2026-06-01/2026-08-31 format to plain English.
visits. Denial is because medical necessity wasn't established under MP-660, which caps initial treatment at 12 visits. Next step: therapist submits reassessment after visit 10 showing improvement, and up to 12 more visits could then be authorized. Appeal rights (180 days) and external review should be mentioned too.
Double-checking the date range - 2026-06-01 through 2026-08-31 represents when the 12 approved visits occur, not an approval date. So "approved 12 visits from June 1, 2026 through August 31, 2026" is the correct framing.
On appeal language, need to be clear: 180 days to appeal internally, then external review afterward if unsatisfied. Testing phrasing like "within 180 days, and then to request external review if you wish" - but "if you wish" undersells it since dissatisfaction is the real trigger, not preference.
The facts state internal appeal within 180 days, external review thereafter - so my current wording "and to request external review after that" is accurate and matches the source facts.
Confirming JSON structure: "message" key present, string properly formatted, no unescaped characters, no extra keys. Looks ready to finalize.
json{
"message": "We received your request for 24 physical therapy visits for your right shoulder. We approved 12 visits from June 1, 2026 through August 31, 2026, and denied the remaining 12 visits. We denied the additional visits because medical necessity was not established at the time of your request under medical policy MP-660. This policy allows up to 12 visits as an initial course of treatment. To request approval for the remaining visits, your therapist should submit a reassessment after your 10th visit showing improvement in your shoulder. If your therapist's reassessment supports it, we may authorize up to 12 more visits. You have the right to appeal this decision within 180 days, and to request external review after that."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved, June 1–Aug 31, 2026."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12, cites MP-660 initial 12-visit limit and reassessment."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after 10th visit showing improvement."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "States appeal right within 180 days, external review after."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval and partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true,
"judgeCostUSD": 0.01745675
}100DeepSeek V3.2 · DeepSeek4.3s · 180 out | 5.9s · 192 out | 5.3s · 172 out
json{
"message": "We have reviewed the request for 24 physical therapy visits for your right shoulder. We have approved 12 visits, which can be used from June 1, 2026, through August 31, 2026. We could not approve the remaining 12 visits now because our medical policy, MP-660, authorizes only an initial 12 visits without a documented reassessment of your progress. To request more visits, your therapist must submit a functional reassessment after your 10th visit, showing objective functional gains. If that is submitted, we can then authorize up to 12 more visits. If you disagree with this decision, you have the right to file an internal appeal within 180 days. After the internal appeal process, you may be eligible for an external review. This decision was reviewed by a licensed physical therapist."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "12 visits approved, June 1–Aug 31, 2026 stated."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Remaining 12 not approved; cites MP-660 initial 12 and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits functional reassessment after visit 10."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval/partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}json{
"message": "Your request for 24 physical therapy visits for your right shoulder has been partially approved. We have approved 12 visits, which are authorised for dates from June 1, 2026, through August 31, 2026. The remaining 12 visits are not approved at this time, as they have not been established as medically necessary under our medical policy MP-660. This policy allows up to 12 initial visits and requires a documented functional reassessment before authorising more visits. To seek approval for the remaining visits, your treating therapist must submit a reassessment after your 10th visit showing objective functional gains. If a reassessment supports the need, a further 12 visits may then be authorised. If you disagree with this decision, you have the right to file an internal appeal within 180 days. You also have the right to request external review after completing the internal appeal process."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "States 12 approved with June 1–Aug 31, 2026 range."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Denies remaining 12, cites MP-660 12-visit limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist submits reassessment after 10th visit showing functional gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}json{
"message": "We have reviewed your request for 24 physical therapy visits for your right shoulder. We have approved 12 visits, which can be used from June 1, 2026 through August 31, 2026. The remaining 12 visits are not approved at this time. According to our medical policy MP-660, we can initially authorize up to 12 visits and require a documented functional reassessment before authorizing more visits. Your therapist can submit a reassessment after your 10th visit that shows objective functional gains to request authorization for an additional 12 visits. If you disagree with this decision, you have the right to file an internal appeal within 180 days. You may also request an external review after completing the internal appeal process. This decision was reviewed by a licensed physical therapist."
}
Grader detail
json{
"criteria": [
{
"id": "R1",
"points": 3,
"met": true,
"why": "12 visits approved, June 1–Aug 31, 2026 stated."
},
{
"id": "R2",
"points": 3,
"met": true,
"why": "Remaining 12 not approved; cites MP-660 12-visit initial limit and reassessment requirement."
},
{
"id": "R3",
"points": 3,
"met": true,
"why": "Therapist reassessment after 10th visit with objective gains."
},
{
"id": "R4",
"points": 2,
"met": true,
"why": "Internal appeal within 180 days stated."
},
{
"id": "R5",
"points": -4,
"met": false,
"why": "Clearly framed as partial approval and partial denial."
}
],
"earned": 11,
"creditTotal": 11,
"judge": "claude-opus-5",
"judgeParsed": true
}