Successful digital resources have resulted from effective partnerships among content experts and tool builders, but such relationships are difficult to establish.Collaboratory testbeds were originally conceived as a response to that difficulty, but have been largely unsuccessful. We contend that effective testbed partnerships are as essential for knowledge-tool advancement as that advancement is to the support of effective partnerships, since knowledge tools must evolve to augment rather than merely to replicate human inference. We are building a game framework as a method for instituting testbed partnerships and an architecture for modular knowledge-tool integration, as essential steps in the co-evolution of knowledge tools and digital resource testbeds.
Collaboratory Testbeds ReconsideredMany promising knowledge tools are stranded at the end of their research and development cycles, waiting to be found by user communities. Meanwhile, digital resource developers struggle to find tools powerful enough and customizable enough to augment their development work and to support the evolution of research applications that rely on their resources. The collaboratory-testbed method of technology customization and transfer would be an appropriate solution, if it could be realized as originally conceived for evolving scientific resources. (see Lederberg & Uncapher, 1989 : 14).Testbeds were to support partnerships between users and technologists in exploring the utility of various technical approaches by which a scientist user-community could take advantage of emerging technology. In the virtual context of testbeds, scientist users could remotely collaborate to examine, calibrate, validate, and interpret some particular data content, while their technologist partners observed their work and introduced coordination technologies in experimental versions integrated for use in actual working contexts. The appropriate components of systems architecture and an array of tools for data access and communication would be designed and developed within a program of prototyping, testing, and evaluation that could support continuous improvement. Testbed participants were to be a sample group from the user community for whom collaboration support technology would be developed, and they were to be committed to work in partnerships with technologists who would be committed to work with them.Partners collaborating in testbeds were conceived to be geographically distributed, to represent a range of disciplines, and to be dedicated to a continuing study of what might improve the quality of both data content and testbed context. Testbed partners must be able to correlate and coordinate three basic realms of concern: the specific nature and uses of the content data, the computing context for collaboratively manipulating that content, and the continuing improvement of that collaborative context for that content manipulation. Based on game theoretical studies of how cooperation and coordination