As part of the Stevens Initiative’s 2020 Virtual Exchange Grant Competition, the Initiative issued a call for applications from institutions proposing to conduct virtual exchange programs connecting young people in the United States and the Middle East and North Africa. The applications were reviewed by an independent review committee and, and a small number of the institutions that submitted full applications were awarded grants.
The Initiative reviewed rejected applications and is sharing a summary below of the feedback that were most commonly cited by the review committee. The guidelines and priorities of the next Stevens Initiative award competition – to be announced in 2022 – may differ from those of past competitions. We hope this information is helpful as you refine your virtual exchange programs and plans, and we encourage you to carefully review the guidelines and priorities of the next award competition rather than relying on the information below in shaping your proposal.
Reasons for Ineligibility
- Falling significantly outside the permissible range for total amount requested or cost per participant for the relevant grant type.
- Failing to answer required parts of the application or provide required documents.
- Requesting support for participants outside of the United States and the Middle East and North Africa (MENA) region.
- Requesting more money than would be allowed according to the Initiative’s rules for how much of the institution’s recent operating budget can be requested.
General Proposal Critiques and Errors
- Missing information or errors in proposal writing
- Common errors included inconsistency in the number of participants or incorrect cost per participant calculations in different parts of the application. Several proposals left prompts blank, including the Participant Perspective section. There were also instances of missing or corrupted attachments.
- Insufficient detail
- The explanation of the program was overly broad and the impact and outcomes were unclear.
- Some applications said they would address priority areas but did not explain or provide evidence for how these priorities would be met, such as proposing an open enrollment program without any details about how prospective participants would be reached, reviewed, and encouraged to complete the program.
Budget and Program Costs
- Insufficient justification for budgeted expenses
- Budgets included costs that did not appear to be necessary or reasonable. While there are inherent uncertainties in budgets, budgets should not include costs that are not clearly necessary for program implementation.
- Some proposals included high costs without sufficient justification and rationale. For example, if there are high travel costs, the proposal should clearly explain why the travel and related expenses are necessary for program implementation. Additionally, personnel roles should be clearly explained and justified, especially for full-time positions.
- One-sided budget
- Budgets did not reflect the amount of collaboration and effort required by partners, particularly by partners in the MENA region in the case of applications from U.S.-based institutions. For example, if nearly all the requested funds stay with the prime subrecipient, but partners will be doing significant work, the budget may not be considering the needs of partners.
- Level of effort (LOE) was not adequate to run a program in both the United States and MENA region.
- Insufficient detail
- Plans for facilitator recruitment and for training and facilitator roles were not specified or lacked sufficient detail. Plans for recruitment and training were inadequate.
- Unbalanced structure
- Some proposals had drastically imbalanced numbers of U.S. and MENA region facilitators.
- The proposal failed to address how language barriers or other key factors of international communication would be addressed.
- Insufficient number of facilitators or type of facilitation
- Not enough facilitators to adequately support the number of proposed participants.
- Some programs sought to be participant-driven or to replace human facilitation with automation. These issues raised concerns about whether participants would be safe and supported to have a consistently high-quality experience.
- Unclear recruitment plan
- The recruitment plans lacked necessary detail or were unrealistic. Some plans did not specify how participants would join the program, or which groups of young people would be invited to join the program.
- Several proposals did not provide enough detail for plans to recruit and meaningfully include young people from diverse backgrounds.
- U.S.-centric recruitment
- Several proposals failed to include a recruitment plan for MENA participants, which suggests the program may not be designed to be mutually beneficial to young people in the MENA region as well as to young people in the United States.
- Sustainability challenges
- Some proposals relied on one individual or a very small number of individuals, particularly in the MENA region, to recruit participants, prompting concern about what would happen if these individuals faced obstacles to their work.
- Lack of MENA partners
- Several proposals outlined work in the MENA region but failed to specify any partners in the region. In some cases, partners were mentioned but hadn’t been pursued or confirmed, or the proposal failed to provide sufficient detail about them.
- Unclear partnerships
- Proposals that did not include enough detail about partnerships raised concern about whether the program was viable in all countries or communities where implementation was proposed. For example, it may have been unclear what role the partners would have in design and implementation of the program.
- Unclear participant experience
- Some proposals left the Participant Perspective section blank or did not adequately portray the program from the participant perspective. It was unclear in some instances what the virtual exchange program would add to participants’ experience.
- The planned collaboration between participants and the resulting impact of the collaboration was not clear.
- Issues with subject matter and exchange activities
- The planned program seemed to miss an opportunity to include hands-on activities such as problem-solving or other forms of collaboration.
- The program topic was too simple and didn’t seem to provide a compelling incentive for participation for the intended participants. In some cases, proposals were stronger when they described the arc of activities each participant would engage in, building up to a fulfilling final activity or project.
Priority Populations and Inclusivity
- Inadequate plans for equity and access
- Proposals did not include clear plans to empower participants or address needs of participants from diverse backgrounds, leading to doubt over the ability to reach and meaningfully include young people from these populations. For example, proposals that stated an intention to reach women and underrepresented groups did not detail how they planned to overcome common barriers to participation, including language accessibility or internet costs.
- Inadequate plans to include priority participants
- Outlined plans for recruitment did not include reaching participants from priority populations. Some proposals failed to address whether there would be gender parity, issues of access and proposed solutions (i.e. internet access for those without), or geographic reach (i.e. reaching rural areas).
- Some institutions’ proposed participant selection processes raised concerns about fairness and inclusivity; highly competitive processes that rely on traditional measures of academic achievement or on a high level of written English proficiency could disadvantage participants from groups that have historically been excluded from international education and exchange.
- Lack of necessary details
- Some proposals lacked clear descriptions of curriculum, day to day activities of participants, contact hours, and planned participant collaboration. Some program plans did not detail the length of the program, what a typical program session would entail, the expected time commitment for participants, or whether there was a clear project or deliverable.
- Unclear value proposition or incentives for participant retention
- In some instances, the appeal or relevance of the program or the program topic for participants was not sufficiently clear or articulated. Programs that would have occurred outside credit-bearing academic courses often didn’t provide enough explanation of the incentives participants would have to complete the program.
- Some proposals did not outline how they would address attrition (participants dropping out) over the course of the program. In some cases, it was unclear what participants would gain or achieve from participation.
Sustainability and Scalability
- Unclear plans for scaling
- It was not clear how receiving a grant would help the program evolve and grow, rather than just maintaining current impact and reach. For programs that were looking to expand upon previous virtual experience, the value and plan for expansion should have been more clearly articulated, highlighting future scalability.
- Unclear sustainability
- Unclear whether the program would be sustainable beyond the Stevens Initiative grant. Long-term goals and plans following the period of performance were not articulated.
COVID – related
- Proposals did not include enough detail for how programs would adapt to mitigate the impact of the pandemic. They did not include contingencies, precautions, or back-up plans. For example, planned travel or in-person training did not have back-up plans in case gathering in person was not an option.
- Proposals that relied heavily on technology within a classroom left themselves vulnerable to the impact of the pandemic. Additionally, programs relying on one tech platform, with no backup plans mentioned, were also vulnerable to tech challenges.
- Virtual exchange seemed like a filler for pandemic circumstances without clear intention to sustain the program beyond that. Furthermore, some plans seemed to focus on translating an in-person experience to the virtual context without accounting for the differences in these settings.
Virtual Exchange Component
- Vague or unclear exchange activities
- The logistics and content of the exchange were not clear in critical areas, which left reviewers struggling to envision what the actual exchange activities would entail.
- Proposals lacked information about their virtual exchange experience or their plans to bring in necessary expertise.
- Unclear how the program would balance asynchronous activities with synchronous, especially considering time differences.
- Exchange aspect not substantive
- Not clear that substantive communication or collaboration between young people in different countries would take place. Some proposals emphasized a description of program content without providing a clear picture of what the exchange would involve.
- For programs intending to have small group work, group sizes of 20+ in a virtual setting did not contribute to intended design.
- Incentive structure
- Unequal value for participants in the U.S. and MENA region. For example, participants on one side proposed to be paid to serve as tutors to the participants on the other side. Paying participants is not a model the Initiative can support through its grants.
- Unclear credentials or benefit to participants upon completion of program
- Some proposals missed an opportunity to explain how they would meet the interests young people have in many contexts for credentials that demonstrate their employability.
- Disproportionate focus on U.S. or MENA
- In some proposals, the participant overview focused on U.S. youth or MENA youth rather than adequately describing participants in both places.
- Some programs had imbalanced descriptions of their benefits, for example by describing the benefits for youth in either the U.S. or MENA region without mentioning the benefits for youth in the other region.
- Imbalances in number of participants or facilitators
- Several proposals had vastly different numbers of participants or facilitators in the U.S. or MENA region without justifying the disparity.