| Evaluation issues and questions |
Potential indicators |
Potential data sources |
| RELEVANCE/RATIONALE |
- How closely does the Women's Program (WP) align with the current priorities and strategic objectives of the federal government and Status of Women Canada (SWC)?
|
- Comparison of program objectives with departmental and federal priorities and strategic objectives
- Key informant opinion
|
Document review
Key informant interviews |
- Is the WP still relevant to the advancement of women's equality in Canada?
|
- Key informant opinion
- Applicant opinion
- Case study results
- Number of applicants/funded projects per year
- Types of projects funded
- Types of groups funded
|
Key informant interviews
Survey of applicants
Case studies
Administrative data analysis/file review |
- What would be the consequence for the advancement of women's equality in Canada if the WP did not exist?
|
- Key informant opinion
- Applicant opinion
- Case study results
|
Key informant interviews
Survey of applicants
Case studies |
| IMPACT |
- To what extent has the WP succeeded in enhancing the organizational capacity of women's groups in order to address women's equality issues? What changed as a result of that increased organizational capacity?
|
- Key informant opinion
- Applicant opinion
- Number of groups funded for this purpose
- Types of projects funded
- Reported results
- Case study results
|
Key informant interviews
Survey of applicants
Administrative data analysis
File review
Case studies |
- To what extent has the WP succeeded in facilitating the mobilization of women in order to promote institutional change? What changed as a result of that mobilization?
|
- Key informant opinion
- Applicant opinion
- Number of groups funded for this purpose
- Types of projects funded
- Reported results
- Case study results
|
Key informant interviews
Survey of applicants
Administrative data analysis
File review
Case studies |
- To what extent has the WP succeeded in facilitating the mobilization of women in order to promote public awareness and understanding? What changed as a result of that mobilization?
|
- Key informant opinion
- Applicant opinion
- Number of groups funded for this purpose
- Types of projects funded
- Reported results
- Case study results
|
Key informant interviews
Survey of applicants
Administrative data analysis
File review
Case studies |
- To what extent has the WP succeeded in facilitating women's engagement in public policy processes? What changed as a result of women's engagement in public policy processes?
|
- Key informant opinion
- Applicant opinion
- Number of groups funded for this purpose
- Types of projects funded
- Reported results
- Case study results
|
Key informant interviews
Survey of applicants
Administrative data analysis
File review
Case studies |
- To what extent has AGE funding enabled the WP to:
- broaden the scope of groups receiving support?
- increase its ability to support action on new and emerging issues?
|
- Key informant opinion
- AGE case study results
- Number of new groups receiving AGE funding
- Number of new issues receiving AGE funding
- Types of new issues receiving AGE funding
- Reported results
|
Key informant interviews
Case studies (AGE only)
Administrative data analysis
File review |
- To what extent has the WP helped to achieve the strategic objectives of SWC?
|
- Key informant opinion
- Comparison of reported results against strategic objectives
|
Key informant interviews
Document review
File review |
- What unexpected impacts has the WP had, either positive or negative?
|
- Key informant opinion
- Applicant opinion
- Case study results
- Reported results
|
Key informant interviews
Survey of applicants
Case studies
File review |
- Are the expected outcomes of the WP clear enough to measure? Does the program need to clarify its expected results in order to improve performance measurement?
|
- Key informant opinion
- Ability of measures to support evaluation
- Evidence of comprehensive/clear interim and final reports submitted by funded projects
|
Key informant interviews
Document review (esp. review of RMAF)
File review |
- Is the current performance measurement strategy capturing adequate and useful information for assessing program impact? If not, how could the performance measurement strategy be improved?
|
- Key informant opinion
- Adequacy and usefulness of performance measurement strategy
|
Key informant interviews
Document review (esp. review of RMAF)
File review |
| DESIGN AND DELIVERY |
- Are there any fundamental weaknesses in the design or delivery of the Technical Assistance component of the WP? What are the strengths of this component?
|
- Key informant opinion
- Applicant opinion
|
Key informant interviews
Survey of applicants |
- Are there any fundamental weaknesses in the design or delivery of the Financial Assistance component of the WP? What are the strengths of this component?
|
- Key informant opinion
- Applicant opinion
|
Key informant interviews
Survey of applicants |
- Is the WP delivered efficiently? How could its efficiency be enhanced?
|
- Description of delivery mechanisms (e.g., complexity of application procedures, mechanisms for accessing WP staff, number of service centres, etc.)
- Potential efficiencies identified in documents
- Key informant opinion
- Applicant opinion
|
Document review
Key informant interviews
Survey of applicants
File review |
- What has been the impact of changes made to the Women's Program over the past few years (i.e., termination of program funding, introduction of initiative funding, availability of 18-month funding, availability of multi-year funding, introduction of outcome-based approach)? How have these changes affected women's groups and other equality-seeking organizations? How have they affected program staff?
|
- Key informant opinion
- Applicant opinion
- Evidence of changing funding levels
|
Key informant interviews
Survey of applicants
Administrative data |
- What, if any, changes to program design or delivery would make the WP more effective in achieving its stated objectives and the strategic outcomes of SWC?
|
- Changes identified in documents
- Key informant opinion
- Applicant opinion
|
Document review
Key informant interviews
Survey of applicants |
| COST-EFFECTIVENESS/ALTERNATIVES |
- Are there any alternatives to the WP that would be more effective in achieving its stated objectives and the strategic outcomes of SWC?
|
- Alternatives identified in documents
- Key informant opinion
- Applicant opinion
|
Document review
Key informant interviews
Survey of applicants |
- How does the cost of WP delivery compare to that of similar federal grants and contributions programs? Given the outcomes achieved by the WP, is the program delivery approach cost-effective?
|
- Comparison of WP administrative costs to those of other similar programs
|
Document review |
- Does the WP supplement/complement, duplicate/overlap with, or work at cross-purposes with any other federal programs or initiatives?
|
- Existence of other programs
- Key informant opinion
|
Document/literature review
Key informant interviews |
- Is SWC the most appropriate organization to deliver the WP, or could the program be transferred to another federal department, to the provinces, to the private sector, or to voluntary sector organizations?
|
- Other potential delivery agents identified in documents/literature
- Key informant opinion
- Applicant opinion
|
Document /literature review
Key informant interviews
Applicant survey |