CIHR Peer Review Manual for Science to Business Award ApplicationsUpdated: March 2013
Table of Contents
- Purpose of the Manual
- Peer Review at CIHR
- Principles of Peer Review
- Policies Impacting Peer Review
- Science to Business Awards Peer Review Committee Members
- Science to Business Awards Application Review Process
- Rating of Science to Business Award Applications
1. Purpose of the Manual
The purpose of this manual is to provide information on CIHR's objectives, governance and policies; to outline the roles and responsibilities of peer review committee members evaluating Science to Business training award applications; and to define the policies and procedures for peer review of Science to Business training award applications.
This manual is addressed primarily to committee members, but is also of use to applicants in explaining the peer review process for Science to Business training award applications from submission to final judgment. Policies and Procedures regarding the assessment of grant applications can be found in the CIHR Peer Review Manual for Grant Applications. For detailed regulations concerning all aspects of CIHR funding programs, please see the Grants and Awards Guide.
2. Peer Review at CIHR
The mandate of the Canadian Institutes of Health Research (CIHR) is as follows:
"To excel, according to internationally accepted standards of scientific excellence, in the creation of new knowledge and its translation into improved health for Canadians, more effective health services and products and a strengthened health care system."
The purpose of peer review is to ensure excellence in the research funded by CIHR. The peer review system also ensures accountability, not only to the Government of Canada and the Canadian taxpayer - the source of CIHR funding - but to the research community at large. Peer review is carried out by committees of experts (peer review committees) that encompass all four pillars of health research (Biomedical, Clinical, Health Systems and Services, and Population and Public Health).
CIHR funds research through both open and strategic competitions. Open competitions accept proposals in any area of health research. Strategic competitions are sponsored by one or more of CIHR's Institutes or Branches and applications are solicited in specified areas of health research. In general, the same policies and procedures are followed for both types of competitions, unless otherwise specified in the funding opportunity. A list of current and archived CIHR funding opportunities can be found on the CIHR Funding Opportunities Database.
Peer review is overseen by CIHR's Scientific Council (SC), which governs all aspects of research-related decision making. SC develops, implements and reports on CIHR's research and knowledge translation strategies, in accordance with the CIHR Act and the overarching strategic directions set out by the Governing Council. The approval of funding for all research and knowledge translation initiatives is an integral part of SC's responsibilities.
3. Principles of Peer Review
Integrity of the peer review process depends on well established principles of confidentiality. All information contained in applications, reviewer reports, Scientific Officer notes and committee discussions is strictly confidential. The applications and any discussions thereof may not be used for any purpose beyond that for which they were originally intended. Committee members must not discuss with applicants or reviewers any information relating to the review of a specific application outside of the committee meeting. Applicants must not contact committee members, including the Chair and Scientific Officer, regarding the status of their applications (ratings, rank within committee, etc.). All requests for information on an application or a reviewer report should be referred to CIHR Program Delivery staff responsible for the committee in question. Please see the website for the Conflict of Interest and Confidentiality Policy of the Federal Research Funding Organizations (COIC).
By law, applicants have access to their own application files. Therefore, all written material used in evaluating an application is made available to the applicants when they are notified of CIHR's decision. The identity of the reviewers will not be revealed to the applicants under any circumstances. However, a list of peer review committee members will be published on the CIHR website 60 days after the Scientific Council approves funding for a competition cycle.
All materials related to the review process provided to peer review committee members must be stored in a secure manner to prevent unauthorized access. They must be transmitted using secure carriers and technologies. When they are no longer required, all material related to peer review must be destroyed using a secure method or returned to CIHR for destruction. Any loss or theft of materials related to peer review must be reported to your committee coordinator immediately.
3.2 Conflict of Interest
CIHR must make every effort to ensure not only that its decisions are fair and objective, but also that they are seen to be so. According to the Conflict of Interest and Confidentiality Policy of the Federal Research Funding Organizations (COIC), any otherwise eligible reviewer may be considered for membership on a review committee unless he/she:
- has disclosed a potential conflict of interest in regard to the competition to be reviewed, and has been determined to be in material conflict of interest in regard to the competition, by CIHR's Chief Financial Officer (CFO) or his/her delegate,
- has funding-decision authority for the competition, or
- is a Principal Applicant on an application to be reviewed by that committee.
A committee member is considered to have a conflict of interest with an application if he/she:
- is from the same immediate department, institution, organization or company as the applicant, and who interacts with the applicant in the course of his/her duties at the department, institution, organization or company;
- has collaborated, been a co-applicant or published with the applicant, within the last five years (exception will be made for CIHR funded networks designed to increase partnerships among disciplines, institutions and thematic research);
- has been a student or supervisor of the applicant within the last ten years;
- is a close personal friend or relative of the applicant;
- has had long-standing scientific or personal differences with the applicant;
- is in a position to gain or lose financially from the outcome of the application (e.g., holds stock in the company of an industry partner or a competitor); or
- for some other reason feels that he/she cannot provide an objective review of the application.
All committee members (Chair, Scientific Officer, reviewers, etc.) are subject to the same conflict of interest guidelines. CIHR staff and the Chair are responsible for resolving areas of uncertainty during the committee meeting.
All committee members must read and agree to abide by the COIC policy prior to viewing any application information. This task is performed electronically (on ResearchNet) or by using a form provided by CIHR.
Success of the peer review system is critically dependent upon the willingness and ability of all committee members to be fair and reasonable; to exercise rigorous scientific judgment; and to understand, and take into account in a balanced way, the particular context of each application. Reviews are provided to the applicant without prior editing by CIHR staff, and CIHR does not take responsibility for their content. An applicant will not accept that your review is fair if it contains comments that could be construed as sarcastic, flippant, arrogant, or inappropriate in any way. Conversely, a constructive review, which includes helping the applicant by pointing out deficiencies that could be repaired in a resubmission, will help to convince a disappointed applicant that you provided a fair assessment of the proposal.
4. Policies Impacting Peer Review
4.1 International Collaborations
As stated in the CIHR Act, one of the ways CIHR fulfills its mandate is by "pursuing opportunities and providing support for the participation of Canadian scientists in international collaborations and partnerships in health research." As a result, CIHR accepts applications for research to be carried out in, or in collaboration with applicants based in, other countries. The international nature of the research should not be a factor in the scientific assessment of the proposal, beyond how it relates to the feasibility of the proposed research and the quality of the research question. For detailed information on applying for funding with an international partnership component, please see the subsection titled "Global Health Research" in the Grants and Awards Guide.
4.2 Knowledge Translation
Knowledge translation is integral to CIHR's mandate and falls into two main categories, end of support KT and integrated KT. With both categories of knowledge translation CIHR expects researchers to disseminate their findings and facilitate their translation into improved health, more effective products or services, and/or a strengthened healthcare system. Note that the costs of dissemination are eligible expenditures in all CIHR grants.
For end of support KT, many means of dissemination exist and the onus is on the researcher to select the most appropriate vehicle for the intended knowledge-user audience to ensure maximum impact. When the primary knowledge users are researchers, dissemination of results through the publication of articles in high quality and accessible journals is appropriate, although other strategies that increase awareness of the results and facilitate their application may also be appropriate. When knowledge-user audiences outside the research community should be informed of specific research findings, dissemination plans with more ambitious goals and comprehensive strategies are expected. With integrated KT, stakeholders or potential research knowledge users are engaged in the entire research process and the research is directed at producing solutions to issues or problems the stakeholders/knowledge users have identified. Further information is available on the KT Portfolio website.
4.3 Open Access
Applicants and peer reviewers are reminded that the CIHR Open Access Policy applies to all funding awarded after January 1, 2008. Award recipients must ensure that all published peer-reviewed articles are freely available online within twelve months. Authors can adhere with the policy by archiving peer-reviewed manuscripts in an open access repository (e.g. institutional repository) or by publishing in an open access journal. Please consult the policy web site for more detail.
4.4 Gender, Sex and Health Research
Applicants are encouraged to demonstrate the use of gender and sex-based analysis in applications. Gender and sex-based analysis is an approach to research which systematically inquires about biological (sex-based) and sociocultural (gender-based) differences between women and men, boys and girls, without presuming that any such differences exist. The purpose of this line of inquiry is to promote rigorous health research which expands understanding of health determinants in both sexes and results in improvements in health and health care. For further information, please refer to Integrating Gender and Sex in Health Research: A Tool for CIHR Peer Reviewers.
4.5 Official Language Minority Communities
Federal agencies are required to take positive measures to ensure the support and recognition of minority language communities in Canada. For CIHR, this means an obligation to promote health research in these communities. For further information, please see the Official Language Minority Communities (OLMC) webpage. Research proposals in these areas should still be subject to the same rigorous peer review process as any other application. However, the justification for promoting health research in minority language communities should not be a factor in the assessment.
4.6 Publications and Productivity
An important evaluation criterion in all award programs is the excellence of the applicant(s). A key factor in assessing this criterion is the productivity of the applicant(s), as determined by the quality and impact of contributions to the field. When assessing the quality of publications, peer review committees should focus on the quality of a publication's content and not simply the number of publications nor the quality or impact factor of journals. In the case of multi-authored publications or other collaborative work, applicants are advised to describe their contribution and reviewers should assess the specific contribution of the applicant to the work.
CIHR funds researchers in many health-related areas, and the forms of research publications can vary greatly among disciplines. In addition to the more traditional peer-reviewed journals, health researchers also publish in books, monographs, memoirs or special papers, review articles, conference/symposia proceedings and abstracts, government publications, etc. Some fast-moving research fields, such as some areas of computing science, genetics or microelectronics, use special means to reach the target audience quickly. Communications, quick-print reports, letters and electronic distribution of pre-prints are important vehicles for disseminating research results. All such contributions should be treated equally when assessing quality and impact, and reviewers should not regard certain types as "second class" or "grey literature."
When assessing productivity, reviewers should also be sensitive to legitimate delays in research and dissemination of research results. Some circumstances make it impossible or undesirable for researchers to publish important results of their research prior to applying for CIHR support. For instance, the time required to complete a monograph may exceed the time available between consecutive applications, or the protection of intellectual property may require a delay in publication. Research productivity may also vary as a result of personal circumstances, such as pregnancy or early child care, administrative leave, disability, elder care, etc., whether or not a formal leave of absence is taken. Applicants are advised to clearly and fully describe any circumstances that affect the dissemination of research results in their application. Peer review committees must be sensitive to the impact of these circumstances on the level of productivity, while ensuring that the quality of the research remains competitive.
5. Science to Business Training Award Peer Review Committee Members
A typical CIHR award peer review committee consists of a Chair, Scientific Officer, peer reviewers and CIHR staff. Individual committee members are selected for their research excellence, as reflected by their ability to obtain continued extramural peer-reviewed grant support, and for their breadth of knowledge and maturity of judgment. Please see the website for peer review membership guidelines. Committees as a whole should also satisfy the need to cover the range of research areas for which the committee is responsible, to appropriately represent the Canadian health research community as a whole, to review in both official languages, and to allow for the logistics of conflict of interest and turnover of committee members. Please see the website for the procedure for selection of peer review committee members.
CIHR competitions can be held on a recurring or an ad hoc basis. For recurring competitions, standing peer review committees are formed, and committee members are recruited for a term of service (typically three years) in order to ensure consistency and continuity in the review process. Standing committee membership may be supplemented by additional members as required for a specific competition, based on the applications received and expertise needed for their review. For ad hoc competitions, committees are formed to review applications for that particular competition and then disbanded.
5.1 CIHR Staff
CIHR staff are typically represented by a Deputy Director and a Program Delivery Coordinator, who are responsible for ensuring the integrity and quality of the peer review process. CIHR staff:
- are involved in the assignment of applications to peer reviewers;
- provide advice and guidance to the committee on CIHR policies;
- keep notes on procedural aspects of the committee's functions;
- record the consensus rating for each application;
- record concerns raised by the committee on issues requiring later attention by staff, for example, ethics, eligibility, etc.
The committee Chair is directly responsible to CIHR for ensuring that the peer review committee functions smoothly, effectively and objectively, according to CIHR's policies. He/she establishes a positive, constructive, fair-minded environment in which the applications are to be evaluated. The Chair (and the Scientific Officer) fulfills an oversight role and does not rate applications before the committee. His/her responsibilities include:
- working with the Scientific Officer and CIHR staff during the assignment of applications to specific peer review committees and during the selection of reviewers for each application;
- working with CIHR staff to manage conflicts of interest;
- appointing a delegate as Chair or Scientific Officer when either leaves the committee room due to conflict of interest. Whenever possible, the same individual should not occupy both Chair and SO roles;
- ensuring the involvement of the entire committee with recommendations for each application;
- working with the Scientific Officer to summarize the discussion of each application before the rating;
- guiding the committee to a consensus rating;
- ensuring that specific concerns of ethics and other CIHR requirements are addressed.
5.3 Scientific Officer
In addition to the duties shared with the Chair, as described above, the Scientific Officer:
- supports the Chair in his/her role during the peer review committee meeting;
- takes notes of the discussion as it is proceeding ("SO notes"), which will be sent to applicants;
- ensures that issues of ethics, eligibility, and other concerns that have been flagged for the attention of CIHR are recorded for the applicant.
Under exceptional circumstances, CIHR staff may assume the role of Scientific Officer during the committee meeting.
5.4 Internal Reviewers
Internal reviewers are committee members who attend the peer review committee meeting, normally in person but occasionally by teleconference. Applications are assigned to a minimum of two internal reviewers for assessment, who review them in depth and submit a written review that is provided to the applicant after the committee meeting. Internal reviewers present their review at the peer review committee meeting and lead the review of applications assigned to them (see also Section 6.2.3). They also participate in the discussion and rating of all other applications before the committee for which they are not in conflict.
On occasion, a reviewer with a very specific expertise may be called on to review a small number of applications, typically by teleconference. These reviewers only take part in the discussion of the application(s) they have been assigned, and they rate the application(s) by e-mail to maintain confidentiality.
Occasionally, individuals are permitted to observe peer review committee meetings. Observers are typically CIHR Institute staff or representatives from partner organizations who have no funding decision-making authority for that competition. Observers must adhere to the same COIC policy as all committee members, and they do not contribute in any way to the review process or discussions surrounding the applications (including any discussions that arise during breaks). Observers may not remove any notes or other information related to the review of applications they observe from the meeting room.
6. Science to Business Training Award Application Review Process
6.1 Before the Meeting
6.1.1 Assigning Applications
All eligible applications received by the appropriate deadline date (posted in the Funding Opportunity) are entered into the competition. Applications must be complete at the time of submission, otherwise they are withdrawn from the competition. Specific exceptions to this rule can be found in the funding opportunity descriptions.
The Chairs and Scientific Officers of the peer review committees together with CIHR staff review the applications assigned to their committee. Together, they are responsible for ensuring their committees are equipped with the appropriate expertise and, upon accepting an application for review by their committee, accept responsibility for ensuring that the committee performs a fair review.
After the list of applications is compiled, committee members are given access to specific sections of the applications to declare any conflicts of interest and indicate their level of expertise on ResearchNet.
Chairs, Scientific Officers and/or CIHR staff then assign the applications to two internal reviewers and possibly a reader. All committee members are then given access to the full applications assigned to their committee four to six weeks before the peer review committee meeting.
6.1.2 Reviewing Applications
The internal reviewers' reports begin with a brief summary of the qualities of the candidate and their training objectives. However, it is still the responsibility of all peer review committee members to familiarize themselves in advance of the meeting with all applications to be assessed by their committee. Committee members responsible for written reviews submit them on ResearchNet, or as otherwise specified, according to the deadlines provided to each reviewer with the applications. See Section 7 (below) for the rating of applications.
In advance of the meeting, reviewers are required to complete the following tasks on ResearchNet (for programs using electronic review):
- upload reviews;
- provide an initial rating for each application (note that reviewers are not bound by this initial rating and can change it at the peer review committee meeting).
- divide the applications reviewed into a top and bottom group based on their overall quality. The top group should include the applications considered to be highly competitive and most deserving of being funded. This assessment is to be based on the reviewers' total experience with applications over the past five years and will be used during the streamlining phase of the review (Section 6.2.2). The proportion of applications in each group may vary depending on the overall quality of the pool of applications reviewed relative to the reviewers' experience.
6.2 During the Meeting
The prime responsibilities of a peer review committee are to evaluate applications submitted for a particular competition and to rate them so that they may be ranked in order of priority. It is important that committees follow defined procedures in order to function in a consistent manner. For a summary of the review procedure for Science to Business training award competition, please see Appendix I.
Any committee member who has a conflict of interest with an application (as defined in Section 3.2) must not take part in the discussion of that application. Committee members in conflict must leave the room before the application is discussed. The Chair and CIHR staff are responsible for monitoring conflicts and for resolving areas of uncertainty.
6.2.1 Attendance at the Committee Meeting
Committee meetings are held usually within six months of the application deadline date and last not more than three days. The effective and fair review of applications depends on all committee members participating for the full duration of the committee meeting. Therefore, if your meeting starts in the morning, please arrive the night before instead of traveling the morning of the meeting, to avoid travel delays. In addition, please avoid planning an early departure to return home at the end of the meeting, in case the meeting runs late on the last day. If the meeting ends early, CIHR will cover certain costs to change your travel plans if necessary. Your committee coordinator can provide further details and help you plan your itinerary accordingly.
In order to allow reviewers to devote more time to the consideration of applications that have the highest probability of being funded, "streamlining" may be applied to restrict discussion of non-competitive applications. Assessment of each application at peer review committee meetings begins with both internal reviewers announcing their initial ratings, to one decimal place.
An application is streamlined if it meets the following three conditions:
- both reviewers placed the application in their bottom group (Section 6.1.2);
- the average of the internal reviewers' initial ratings is <3.50;
- there is no objection from the other committee members that the application not be discussed.
If an application is not discussed, the applicant will receive a copy of all internal reviewers' reports but there will be no Scientific Officer notes. Committee members do not vote on the rating; it is calculated as the mean of the initial ratings of the two internal reviewers.
6.2.3 Rating of Applications
If an application is not streamlined, the discussion proceeds as follows:
- The primary reviewer presents his/her assessment, describing strengths and weaknesses of the application (see Section 7.2 for assessment criteria);
- The secondary reviewer follows, concentrating on points of agreement or disagreement and elaborating points not addressed by the first reviewer;
- The Chair leads the discussion of the application by all committee members;
- The Scientific Officer reads back the Scientific Officer notes, capturing the key elements of the discussion to be considered when rating the application;
- The Chair seeks a "consensus rating" from the two internal reviewers. The internal reviewers may revise their initial ratings as they see fit. If a consensus cannot be reached, the mean value of the ratings of the two internal reviewers is used (round up, if necessary, to obtain a single decimal point);
- All committee members, including the two internal reviewers but excluding the Chair and Scientific Officer, then cast individual confidential votes within ±0.5 of the consensus rating. The internal reviewers are not bound to the consensus rating. The rating assigned to the application is the average of these confidential votes. A vote is taken even if the consensus rating is <3.5 (i.e., not in the fundable range).
The appropriateness of the requested term of support is discussed, and recommendations are made.
6.2.5 Flagging of Applications
Any concerns in the following areas should be discussed and, if necessary, flagged for CIHR staff to address. These issues are not to be considered as criteria for evaluation, except as they may impact on the scientific quality of the application. For detailed regulations concerning these issues, please see the Grants and Awards Guide.
Eligibility: Reviewers should raise any concerns with respect to whether the Principal Applicant(s) and their affiliated institutions meet the criteria to receive CIHR funding.
6.2.6 End of Meeting Review
Once all applications have been reviewed, if the peer review committee feels that any application(s) has been treated inconsistently, re-review of one or a small number of applications is permitted. Any committee member with a conflict of interest must again leave the room. Following discussion, a consensus rating is determined by the two internal reviewers and voting proceeds as before. The committee does not review the overall rankings of all applications at the end of the meeting as individuals with conflicts of interest would inevitably be present.
An important component of any peer review committee meeting is the final review of the committee's effectiveness and functioning, and a discussion of policy issues that may have arisen in the course of its deliberations. This discussion provides an opportunity for CIHR staff to address any concerns of the committee members and for staff to record feedback on the peer review process as part of CIHR's ongoing efforts to maintain an effective and high quality peer review system.
6.3 After the Meeting
Applicants are informed of the results of the competition once the SC has approved the training awards to be funded. All applicants are sent a Notice of Decision, indicating whether or not their application was approved. The Notice of Decision will normally be released (either on ResearchNet or by mail) within three weeks following the SC meeting. A list of successful applicants is posted on the Funding Decisions Notifications webpage as soon as it is available.
Applications which have been flagged for Special Attention (see Section 6.2.5) are withheld as "pending". The applicant will be notified if further information is required. The additional information may be discussed by CIHR staff and peer review committee members if necessary prior to a final decision regarding funding.
7. Rating of Science to Business Training Award Applications
7.1 Types of Applications
Applications may be new applications or resubmissions of a previously unsuccessful application. All application types are evaluated together "on a level playing field" and the same criteria and funding cut-offs are applied to all, though peer review committee members are reminded to take the stage of career and previous progress made into account and to vary the emphasis placed on track record appropriately.
In some cases, the same peer review committee may review applications for more than one funding opportunity. At the conclusion of the committee meeting, these applications will be separated into their own overall ranking lists and funding decisions will be made based on the funding envelopes provided through their respective programs. Therefore, the presence of these applications will have no impact on the funding of other applications being reviewed by a committee.
7.2 Evaluation Criteria
The following general criteria for evaluating training award applications will be used:
Achievements and Activities of the Candidate:
- Assess the publication activity of the candidate relative to your expectations of someone with their academic experience. Consider: breadth of science covered, the frequency of publication and the scientific impact of the journals involved. In considering the candidate's input to the publications, take into account the number of co-authors for each paper and the prominence of the candidate's name on the list of authors.
- Assess other research activity of the candidate relative to your expectations of someone with their academic experience. Consider: breadth of science covered, size and importance of meetings involved, frequency of conference presentations and research honours or awards.
- Consider the type of program and courses pursued, the course load, the grades obtained, the relative standing (if available), the overall average, and the trend (give credit for a steadily improving or consistently good performance).
Characteristics and Abilities of the Candidate:
- Using the sponsor's assessments, in addition to your review of the application, provide a score based on your overall impression. Your assessment should be based on evidence in the letters of characteristics and abilities of the candidate such as critical thinking, independence, perseverance, originality, organizational skills, interest in discovery, research ability and leadership.
- Assess the candidate's entrepreneurial experience, as demonstrated within the application, relative to your expectations of someone at their career stage.
- Assess the candidate's demonstrated potential for advancing Science to Business objectives based on the alignment of the applicant's profile, the targeted MBA program and their career objectives
Summary of Evaluation Criteria and Weighting:
|Criterion||Weights for each criterion|
|Achievements and Activities of the Candidate|
|Other Research Activity|
|Characteristics and Abilities of the Candidate|
Interest in discovery
|Entrepreneurial Experience/ Capacity|
|Demonstrated Potential to advance S2B objectives|
Additional factors to be considered under each criterion may also be described in the funding opportunity details. Please contact your committee coordinator if you need further guidance on how to apply the individual criteria.
7.3 Format for the Internal Reviewer Report
The Internal Reviewer Report should include comments on the above mentioned criteria. The review should be clear and concise, using objective and non-inflammatory language, and include justification. Constructive advice to the applicant will allow him/her to improve the quality and efficiency of the proposed research. The applicant will receive the review as it is submitted by the reviewer. For this reason, please do not identify yourself in order to ensure the confidentiality of the review process.
7.4 The Rating
Criteria to assess the scientific merit of an application are as described above in Section 7.2. The relative weighting of these criteria depends on the program objectives as described in the funding opportunity description; if in doubt, please contact the Deputy Director responsible for the committee.
To ensure consistency, all reviewers must adhere to a common scale. It is particularly important that the full scale be used and the same conventions applied to assign ratings.
To facilitate this, the following scale and descriptors should be used:
|outstanding||4.5 - 4.9||May be Funded -
Will be Discussed by the Committee
|excellent||4.0 - 4.4|
|very good||3.5 - 3.9|
|good1||3.0 - 3.4||Not Fundable -
May or may not be Discussed by the Committee
|average||2.0 - 2.9|
|below average||1.0 - 1.9|
|not acceptable||0 - 0.9|
Appendix I: Sequence of Steps for Peer Review of a Science to Business Training Award Application
- Members in conflict leave the room. The two internal reviewers announce their initial rating.
Note: ratings can be different from those previously posted on ResearchNet
- Assessment of overall quality: Review is terminated if the following conditions are met:
- application is not considered competitive by both reviewers (placed into bottom group by both reviewers).
- the mean of the rating of the two internal reviewers is <3.50
- there is no objection from other committee members
Committee members will not vote. The rating is calculated as the mean of the rating of the two internal reviewers. No SO notes will be taken.
- Internal Reviewers:
The primary reviewer presents his/her assessment, describing strengths and weaknesses of the application followed by the secondary reviewer, who should concentrate on points of agreement or disagreement and elaborate on points not addressed by the first reviewer.
- Reader raises additional issues (if applicable)
- Discussion of application should focus on:
- factors important in rating
- differences of view between reviewers
- Scientific Officer reads SO notes to the committee:
- summary of discussions
- strength and weaknesses of application
- Consensus rating by internal reviewers:
- use full scale
- check consistency with previous applications
If a consensus cannot be reached, use mean of internal reviewers' ratings.
- Individual ratings:
- ± 0.5 of consensus rating
- confidential vote
- internal reviewers are not bound to consensus rating
- Term of Award
- Issues to be flagged:
- PhD was not in a health related field
- part-time vs. full-time status of the proposed MBA program
- Scientific Officer reads final notes for review / modifications / additions by committee