A national effort to elicit "grand" science and technology ideas has taught a nonprofit White House partner some lessons in crowdsourcing -- namely streamline the message.
"The prompts used to drive a crowdsourcing initiative are perhaps the most important part of the effort," an Expert Labs blog post read. "If there is an area for improvement in our efforts, this is clearly an important one to focus on."
The finding could prove useful to other government agencies that are thinking about crowdsourcing questions to the general population.
The White House Office of Science and Technology Policy (OSTP) and the National Economic Council released a request for information in February to collect public input regarding the "grand challenges" identified in President Barack Obama's innovation strategy, along with other ideas and potential partners. The mid-April deadline passed and thousands of replies were garnered.
The OSTP partnered with Expert Labs -- a nonprofit project of the American Association for the Advancement of Science -- to gather responses, which were mainly prompted by Twitter and Facebook messages. The ThinkTank app was used to capture and organize these responses, which are available in a Google document. It was the first big crowdsourcing experiment Expert Labs took on.
Some of those prompts included, "What's the next moon shot or the next human genome sequencing?" "What are the ambitious goals that are going to generate jobs, improve security, drive innovation or inspire students to learn?" and "How do we get our best minds to work on solving these challenges?"
That said, the White House prompted its social network connections to respond in several different ways, the blog post said. "Messages varied in tone, timing and in how much background expository information was provided," it said. "Clearly the Grand Challenges initiative itself was an ambitious one."
Specifically the prompts broadcast via Twitter and Facebook addressed a large population of users -- who aren't necessarily science and technology experts -- with a fairly complicated question. And even those in the science and tech communities, who may have had responses, had to adapt to the idea of sharing such ideas using what have become common social networking tools, according to the blog post.
Perhaps even more significant is the social network environment. "... The terse wording and distracted attention environment of social networks can amplify ambiguities in a prompt," the blog said.
An example of this issue related to the Grand Challenges project is the initial prompt from the White House's Twitter feed -- "The next Apollo program or Human Genome Project?" Because of this, a significant number of responses took the question very literally and answered with one of the programs prioritized over the other.
While the refining the message may be the greatest lesson learned, there are a few other key findings and highlights of the crowdsourcing effort:
- More than 2,000 replies to the request for information were received via Twitter and Facebook within the approximately 48 hours that those mediums were available (Expert Labs announced it would use those tools about two days before the April 15 deadline).
- The initial prompts from the White House's social network accounts (such as @whitehouse on Twitter) were forwarded by enough people to nearly double the number of people who saw the prompts.
- Off-topic and on-topic responses can coexist on the network. One of the biggest fears of large-scale crowdsourcing is that "noise" will crowd out