Frequently Asked Questions - Clinical Competency Portfolio Review and I-OCA

These Frequently Asked Questions relate to the Clinical Competency Portfolio Review and the Independent Observed Clinical Activity (I-OCA), which is a new component of this assessment.

Note: It is currently scheduled that trainees will be able to apply to sit an I-OCA starting in November 2024. This will give trainees an opportunity to complete at least one Stage 3 I-OCA before September 2025, making them eligible to apply for the CCPR in September 2025. However, there are discussions about potential changes to the proposed timelines for implementing I-OCAs and launching the CCPR. If there are any delays in the launch of CCPR and I-OCA implementation, the transition timelines will be adjusted accordingly and will be communicated as soon as they are finalised.

1. What are the assessments that will be considered for the CCPR?

• Stage 2 and Stage 3 end-of-rotation In-Training Assessments (ITAs)
• Observed Clinical Activity (OCAs)
• Independent Observed Clinical activity (I-OCAs)

Qualitative data such as supervisor feedback and narrative comments for the above assessments will also be considered.

2. What are the eligibility criteria for the CCPR?

The CCPR eligibility criteria, based on the current Clinical Competency Assessment – Modified Portfolio Review (CCA – MPR) eligibility, are as follows (transition time exemptions are listed in further questions below).

3. Will completion of a Stage 2 I-OCA be required for Trainees to progress to Stage 3, and will special consideration be given to the cohort starting Stage 3 training in February 2025?

With the implementation of the I-OCA, trainees will be required to complete a Stage 2 I-OCA before progressing to Stage 3.  

However, the requirement to complete a Stage 2 I-OCA will not apply for trainees commencing Stage 3 in February 2025 or are currently in Stage 3.

4. Will there be any changes to assessment requirements for the substantially comparable SIMGs?

No, these changes are only applicable for the partially comparable SIMGs. 

5. What provisions are there for trainees who complete their final Stage 2 rotation in August 2024 and take an approved Break In Training (BIT) in 2025?

Trainees who take an approved Break In Training (BIT) in 2025 after completing their final Stage 2 rotation in August 2024 will be exempted from the Stage 2 I-OCA requirement when applying for the CCPR later. They can progress to Stage 3 without fulfilling their Stage 2 I-OCA requirement.

6. How does an I-OCA differ from a standard OCA?

An I-OCA is consistent with the protocols and delivery of the standard OCAs but there are three specific differences for I-OCA: 

• it must be completed in a single session. 
• it is assessed by an external supervisor/independent assessor (who is not the candidate’s current Principal Supervisor or has not been the candidate’s supervisor in the previous 12 calendar months, has no personal or professional conflict of interest with the candidate they are assessing and has undertaken the I-OCA calibration training).
• written patient consent is required prior to the I-OCA assessment. 

7. What changes have been made to the Stage 2 I-OCA requirement for September 2025/April 2026 CCPR applicants?

The eligibility criteria for candidates applying for the September 2025/April 2026 CCPR will exclude the requirement of a Stage 2 I-OCA. The rest of the eligibility criteria will remain consistent with those outlined in Q2. This change aims to accommodate applicants in the initial cohort of the CCPR who may not have completed the Stage 2 I-OCA by that time.

For SIMGs applying for the CCPR in September 2025, completing one Stage 3 I-OCA and one Stage 3 OCA will be acceptable.

8. How will trainees be affected if there are any delays in the implementation of the I-OCA assessment?

Trainees will be informed in advance of any delays in the implementation of the I-OCA assessment. If a trainee misses the Stage 2 I-OCA deadlines due to such delays, it will not affect their progression to Stage 3 training.

9. Where will the I-OCAs be conducted?

The I-OCA will be conducted face-to-face at the candidate’s workplace if this is a feasible option with the availability of an external supervisor/independent assessor. The I-OCA must be completed in a single session.

If the external supervisor/independent assessor is not from the same jurisdiction, and the I-OCA is not able to be conducted face-to-face due to the availability/location of the external supervisor/independent assessor, the I-OCA will be conducted over Zoom/Microsoft Teams.  

10. When can candidates choose to schedule their I-OCA during their Stage 2 and Stage 3 rotations?

Candidates will complete one I-OCA during Stage 2 and one during Stage 3. Candidates are permitted to take their respective I-OCAs at any time, without the necessity of waiting for a specific time within Stage 2 and Stage 3. The I-OCAs can replace the mandatory OCA for that rotation.

11. Can the candidate re-sit the I-OCA if they do not perform well?

Candidates who do not meet the required standard for their I-OCAs are not required to re-sit the I-OCA at that time.  Those who do not perform well in Stage 2 I-OCA will need to be supported to improve their skills and address any identified deficits. A Stage 2 I-OCA could be viewed as a reference point for subsequent improvement and development over time.

12. How many I-OCAs are candidates required to complete for the CCPR?

Candidates are required to sit one I-OCA in Stage 2 and one in Stage 3. Candidates must complete a Stage 2 I-OCA before they can progress to Stage 3. The I-OCAs can replace the mandatory OCA for that rotation.

13. What are the criteria for being an external supervisor/independent assessor?

The external supervisor/independent assessor must meet the following criteria: 

• Has not been a supervisor of the candidate in the previous 12 months. 
• Has no personal or professional conflict of interest with the candidate. 
• Has undertaken the I-OCA training and calibration (while this may not be possible in the first six months of I-OCA implementation, it will become a mandatory requirement for all supervisors, as the same criteria will be applied for assessing OCAs as well).

14. Are supervisors expected to make pass/fail decisions for I-OCAs/OCAs and ITAs?

Supervisors are not expected to make any pass/fail decisions. Their main focus is to provide meaningful feedback on the candidate’s performance, knowledge, and competency. 

15. Who selects the external supervisor/independent assessor (IA) for the I-OCA, and how are they selected?

The Principal Supervisor is responsible for selecting an IA for conducting the I-OCA. The Principal Supervisor will have access to a list of accredited IA database (across jurisdictions) via the InTrain I-OCA form, which will automatically exclude any supervisors from the previous 12 months for the candidate who is applying to sit the I-OCA.

The Principal Supervisor will also have an option to submit the I-OCA form to the pool of accredited IA in the InTrain database. Individual IAs will be able to see the requests and select any of the I-OCAs where they are available to conduct the assessment. 

If, after a reasonable time, an IA has not been assigned, the Principal Supervisor will email the College at clinicals@ranzcp.org for assistance. 

16. What procedures are followed if the available supervisors in smaller jurisdictions do not meet the 12-month criteria for external supervisors/independent assessors?

If the supervisors within a smaller jurisdiction do not meet the 12-month criteria, the Principal Supervisor may email the College at clinicals@ranzcp.org for assistance. 

Please note the candidate will not have any knowledge of the identity of the external supervisor/independent assessor who will be conducting their I-OCA. 

17. How is conflict of interest managed for the I-OCA assessment?

External supervisors/independent assessors are required to declare any personal or professional conflict of interest with the candidate to the Principal Supervisor before the assessment. They will receive the candidate's details via InTrain to review and declare any conflict of interest prior to the assessment. 

External supervisors/independent assessors who identify conflict of interest are expected not to participate in the I-OCA assessment and must declare their conflict of interest via InTrain. 

Trainees will be able to submit an incident report up to 5 business days after completing an I-OCA if they encounter an incident that impacted their performance in the assessment or experienced conflict of interest issues. 

18. Who is responsible for identifying suitable patient for a trainee’s I-OCA?

Based on the feasibility, either the Principal Supervisor or the External Supervisor/Independent Assessor (or their delegate, such as the site coordinator) organizes the patient for the specified date and time and communicates with them about seeking their written consent before the assessment. 

They identify and arrange a suitable patient not well known to the trainee so that the trainee is able to do an initial clinical assessment, which is consistent with the existing OCA processes.

The candidate will not be informed about the identity of the specific patient who has been selected for their I-OCA assessment. 

19. Is patient consent required before participating in an I-OCA assessment?

Yes, patient consent is required before participating in an I-OCA assessment. The Principal Supervisor or their delegate must provide the patient with a consent form, which is available for download from the I-OCA webpage documentation. 

Patients should read the ‘Information to Patients’ document and sign the consent form prior to the assessment. The signed consent form will be kept by the health services and must be available for presentation to the College upon request.

20. Will the I-OCA forms be available in InTrain?

Yes, the I-OCA forms will be available in InTrain and completed forms will be included in their end-of-rotation ITAs. They will be clearly differentiated from the standard OCA forms.

21. I am currently employed in a setting that has difficulty holding online meetings and obtaining authorisation for external personnel to attend. How will I go about completing my I-OCA?

In the event that appropriate facilities are unavailable, alternative arrangements will need to be considered. Please contact the College by email at clinicals@ranzcp.org to discuss options. 

22. Will there be any pilot I-OCA assessment to scope out practical challenges with the I-OCA implementation?

There will not be a pilot for conducting the I-OCA assessment due to its complex nature. The Education Committee agreed that the I-OCA sessions would be implemented as a whole, with regular monitoring throughout. 

23.Will trainees completing an Advanced Certificate (such as Child and Adolescent Psychiatry) be able to see a patient under the age of 18 for the purposes of the I-OCA?

Generally, the College assessments are set at the standard expected of generalist psychiatrists, however any process that is currently followed for OCAs in sub-specialty areas may be applied to I-OCAs. The consent process will ensure that the consent from families or carers is incorporated where required.

24. Can I-OCAs be filmed in case there is an appeal at a later stage?

Currently there is no consideration being given to filming or recording I-OCAs. This is consistent with the process of conducting OCAs in the workplace.

25. What is the governance structure for I-OCA?

The I-OCA Oversight Panel has been set up to provide guidance and governance oversight for the delivery and implementation of I-OCAs including the calibration of supervisors and independent assessors. The Panel reports to the Committee for Training (CFT).

The Progression Competence Panel (PCP) oversees the holistic progression and determines overall competence and standards of candidates undertaking CCPR. The PCP reviews both qualitative and quantitative data from various assessments comprising the CCPR to determine whether the candidate has met the required standard.

26. Who will make the decision about the outcome of the CCPR?

The Progression Competence Panel (PCP) will comprise representatives from the relevant committees and independent Fellows will be responsible for making progression decisions based on the CCPR. The Panel will consider assessment elements of the CCPR covering assessments over a period of time from multiple sources in a holistic manner.

The assessment criteria, Terms of Reference and the business rules for the PCP are currently under development.