Workshop Report: Improving the Quality and Reuse of Cybersecurity Datasets, Software, and Other Research Artifacts

David Balenson, Terry Benzel, Eric Eide, David Emmerich, David Johnson, Jelena Mirkovic, and Laura Tinnel

Online 2023.

abstract

This report summarizes the presentations, discussions, and key findings from the workshop, “Datasets, Software, and Other Research Artifacts,” held virtually September 16, 2022. Workshop participants attended virtually via Zoom. The workshop was attended by 32 people from 18 organizations across the United States as well as Austria and Italy. It served as a forum for learning and understanding the issues and challenges researchers face in producing, evaluating, and reusing high-quality cybersecurity research artifacts, including datasets and software, as well as experiment designs, execution, and results. The workshop benefited from the degree of openness and interaction displayed by the participants while discussing the challenges and opportunities for improving the quality and result of cybersecurity research artifacts. By openly sharing their experiences and knowledge, insights were gained which are documented in this report and which should provide value to all the participants and their respective organizations. Furthermore, the workshop was the first in what will hopefully be an ongoing series of discussions and interactions and the start of a new community centered around improving the sharing and reuse of cybersecurity research artifacts.