The opportunity for Broadband Equity, Access, and Deployment (BEAD) funding has communities wondering if they are well poised and doing the right things to maximize their opportunity to get funding. Colin Rhinesmith and Rafi Santo have come up with a tool (Digital Equity Ecosystems Measurement Framework) to help communities assess their preparedness. The tool looks at three things:
■ Coalition Health – The coalition health level speaks to the coalition’s structure and enactment: to what degree are members participating in coalition activities? Do they have strong relationships? Do they believe they can accomplish the goals they set out together? Is effective and equitable governance in place?
■ Member Strength – The member strength level speaks to the ability of coalition member organizations to carry out activities that promote community level outcomes: what issues are member organizations focused on? Where do they work, and with whom? How strong is their capacity in different areas?
■ Community Impact – Finally, the community impact level speaks to the on the ground issues that are of primary importance to the coalition: what is the nature of digital access issues in the community? Do community members have the digital skills they need to participate in society? Is the community collectively empowered in relation to the technological world?
The worker-be in me loves the worksheet-style information that includes aspects to measure and how to measure them. You can see a sample below:
There are recommendations for moving forward…
1. As coalitions move forward and aim to bring the ideas shared in this report into practice locally, there are several critical steps that we recommend: 1 Establish a collective process for determining why your coalition wants to engage in measurement, and what should be measured to achieve those ends. Questions of how and what data will be collected, how it will be analyzed and by whom, and many other important implementation issues around measurement in practice are downstream from these foundational questions. Establishing why a coalition wants to engage in measurement should serve to specify what kinds of indicators are important to collect data on, which can then help specify an overall approach to measurement. Critically, in coalitions, the process of answering these questions can be one that all stakeholders can be involved in in some way. While backbone organizations are often the natural stakeholder to lead such a process, as with other areas of governance, determining a high level measurement strategy is both more equitable and effective through the participation of members and other stakeholders. This is especially important if part of what will result from a new measurement strategy is members being asked to participate in things like surveys and coalition self-assessment activities, not to mention the creation and use of shared data collection mechanisms.
2 Articulate a coalition theory of change and associated logic model. As noted earlier in the report, if a coalition does not already have a developed theory of change and logic model, the process of developing a measurement strategy presents an important opportunity to do so. Articulating short term, medium term, and long term outcomes, as well as how specific coalition activities aim to “move the needle” on them, can provide an important localized model to guide measurement that can draw on the DEEM framework. With a logic model in hand, a coalition can then determine which areas of activity are most important to focus on within a data strategy based on the measurement uses it’s identified.
3 Develop data collection, analysis, and use plans. Having answered questions about why it wants to engage in measurement and what measurement should focus on, a coalition is then ready to begin determining how to go about measurement activities including data collection, analysis, and use. This includes matching indicators to potential data sources and measurement approaches such as tracking databases, surveys, publicly available data, etc. Plans around how these data will be analyzed, and then the contexts of data use and representation should be well envisioned as part of this stage of developing a coalition measurement strategy
4 Actively incorporate plans around data consent, privacy, harms, and security. As digital equity advocates know well, histories of harm are all too common when it comes to uses of data. A key element of a coalition measurement strategy should be a clear articulation of what data will be collected, how it will be stored securely, how it will (and will not) be used, how privacy will be protected, and how those providing data will have fully informed consent within data collection activities. Within this, questions of data de-identification, especially around data from vulnerable populations, should be paramount. 5 Engage in iterative development of measurement strategies. The process of developing and implementing a coalition measurement strategy is not a ‘one and done’ activity. As with all other work, measurement strategies require iteration in order to both improve existing approaches as well as to modify focus based on shifts in coalition activity. Creating mechanisms for reflection around a coalition data strategy can help articulate the utility and limitations of certain measurement approaches, as well as help identify new areas of need when it comes to measurement.