Formative and Summative evaluations will result from data derived from both quantitative and qualitative research methods regarding programming, initiatives, research, and accountability. The multi-method approach for data collection proposed here will allow for both systematic and in-depth assessment of the process, strategies, and outcomes for sustainable change.
Our overall objective will be to “grow our own” women STEM faculty by enhanced recruitment, retention, and impact strategies designed to make UC a destination for women STEM faculty.
Key activities: (a) Bottom-Up: workshops at three career levels and grants program; (b) Top-Down: training workshops, best practices seminars.
Baseline data: One of our important planned activities is to construct in the provost’s office the infrastructure needed to compile all of these data and do retrospective analyses since 2002.
Formative evaluation activities: Throughout the course of the project we will work with the Office of Equal Opportunity and with Institutional Research to create and maintain a database on the recruitment, hiring, retention, and career trajectory of STEM scientists, male and female. This will be used to assess progress toward our quantitative goals. In addition, we will annually survey all STEM scientists (with identifying information) to track publications, awards, professional memberships, etc. Project staff will meet periodically to discuss progress and adjust the work plan accordingly. Intermediate (at least quarterly) progress reports will be discussed by the project team and with the advisory boards.
We will evaluate the workshop series by asking participants to complete pre- and post-series assessments as well as session evaluations. The assessments will focus on questions relevant to the workshop content and series as a whole (i.e., empowerment, engagement, and impact, respectively).
Periodically, interviews will be conducted with key informants (provostal staff, deans, heads, selected faculty members and selected advisory committee members) to assess the current status of the pipeline, identify success and continued challenges to identify ways in which our bottom-up and top-down strategies have had impact.
Summative evaluation activities: We will analyze hiring and retention data for the institution as whole and by STEM unit. The results will be presented as a flow chart from recruitment to hiring to retention to promotion, by year.
In addition, our external evaluator will conduct a web-based survey of all workshop participants in the 5th year of the project, which will provide an opportunity to assess how the succession of workshop series worked for those individuals who participated in more than one. Finally, our external evaluator will conduct key informant interviews in the 5th year of the project that will document key strengths and weaknesses of our efforts and results and summarize these in the form of lessons learned.
Transform the Climate
Key activities: (a) Bottom-Up: Learning communities and visiting scholars; (b) Top-Down: Mentoring of heads, site visits, shadowing at ADVANCE institutions, and logic models.