CCAR-P Practice Test

CCAR-P Practice Test practice questions, page 4 of 5, with answer review and explanations.

Question 16

After a prompt template update, several previously passing test cases now produce unexpected outputs. Which test type is specifically designed to detect this category of failure?

  1. regression tests scored against a stable reference set of known-good behavior
  2. adversarial tests that probe for prompt-injection vulnerabilities
  3. integration tests that validate cross-component pipeline behavior
  4. smoke tests that confirm high-level system availability after the change

Question 17

A research summarization assistant has been deployed for six months. A user has flagged that a generated summary contained a fabricated citation. The product team has asked whether the incident requires architectural action or whether it is an isolated case. Which two Diligence-competency actions should you take? (Choose two.) Each correct answer presents part of the solution.

  1. Sample recent summaries to estimate the fabrication frequency across the population.
  2. Treat the incident as an anecdotal isolated case and take no further investigative action.
  3. Review whether citation grounding controls exist anywhere in the current generation pipeline.
  4. Disable the assistant immediately for all current users without any prior diagnostic analysis.
  5. Communicate to users that the assistant does not fabricate output as a matter of design.

Question 18

You are assessing data-exfiltration risk in a Claude-based assistant that has tools for both internal-document retrieval and outbound HTTP calls. Which scenario most directly indicates a data-exfiltration risk?

  1. The outbound HTTP tool returns a 200 response when the assistant calls an allow-listed domain to fulfill a user-initiated data lookup request.
  2. Adversarial content in retrieved documents instructs the model to call the outbound HTTP tool and send sensitive content to an attacker-controlled URL.
  3. The user types a routine question into the assistant and receives a routine answer.
  4. The internal-document retrieval tool returns a document that the user has authorization to view.

Question 19

You are defining escalation criteria for ambiguous cases in an automated workflow. Which set of criteria best supports consistent escalation?

  1. confidence threshold below a defined level, presence of high-impact decision categories, ambiguity flags raised by content classifiers, and the user’s explicit request for review
  2. escalation at the discretion of whoever is available when the teams on-call engineer has spare capacity, with no defined threshold, category, or ambiguity criterion to trigger it
  3. escalation only after an affected customer has already contacted the support channel to complain, by which point the automated workflow has already completed without human review
  4. no escalation criteria at all; the model itself decides on each turn whether to escalate, without explicit confidence thresholds, impact categories, or classifier-based ambiguity flags

Question 20

You are designing a feedback session for a deployment in flight. Which structure best supports productive stakeholder feedback?

  1. Hold an open-ended meeting with no pre-distributed agenda or artifacts, and rely on participants’ memory to carry decisions and follow-up owners forward.
  2. Define a focused agenda, share the artifacts in advance, capture decisions and follow-ups in writing, and confirm action owners and dates.
  3. End the session without recording decisions, follow-up items, action owners, or dates, relying on participant memory to carry the session’s outcomes forward.
  4. Distribute artifacts at session start rather than in advance, so stakeholders review materials in real time without preparation before the discussion begins.