Opened
Jan 17, 2025
Closed
Feb 19, 2025
Rules of Engagement
Users can work in small teams (e.g., 1-3) to avoid getting stuck and to help with collectively observing or analyzing the performance of the models.
Users can use other AI models or tools (provided by themselves) during the AI Jam Session to help refine their understanding of the problems, for calibration, or for analysis of model outputs.
If other models or tools are used, the full traces (see 4 below) of those model runs should be added to the corpus and clearly identified as part of the run notes or analysis.
Users will be responsible for capturing and reviewing all information (e.g., prompts, outputs, observations, analysis, and notes) to form their user reviewed corpus. All information will be captured in a way that facilitates review by humans and machines (i.e., readable text).
Users control what information they share in their user reviewed corpus. However, they are encouraged to share as much information as possible. Users may redact any information that was entered in error (e.g., sensitive information or information identifying the user). Any information identifying users will not be associated with specific entries in the user reviewed corpus.
The collected information from each user/group will be aggregated into a single cross-laboratory corpus.
The collected corpus will be reviewed by laboratory leaders for any sensitive or inappropriate information (i.e., individual pieces or aggregates). This technical review with technical tools will form the laboratory reviewed corpus.
The laboratory reviewed corpus will be made available to the participants, the participating DOE national laboratories, and the AI laboratories.
Participating AI laboratories will also conduct a review of the content for sessions where their technologies were used and flag any items that should be removed or redacted. This will form the final approved corpus.
Participating DOE and AI laboratory researchers will use the final approved corpus to study the potential of advanced AI models for accelerating research.
Participating DOE and AI laboratories are free to use the final approved corpus for research purposes.
Participating DOE and AI laboratories are free to use the final approved corpus for model development, training, and model evaluation purposes.
The DOE national laboratories will be permitted to add to this data, share this data with future AI Jam Session participants, including additional AI laboratories that participate in future AI Jam Session. Any updated corpus will be shared with AI laboratories that may participate in future AI Jam Sessions. Data sharing beyond AI Jam Session participants, participating DOE national laboratories and AI laboratories is not permitted.
Any publications that are derived from the final approved corpus (within to-be-determined months) must be reviewed by the participating DOE and AI laboratories and cite the 1000 Scientist AI Jam Session as source, including credit to participating laboratories.
Results will not be associated with specific models in external publications unless agreed to by all participating AI laboratories on a case-by-case basis.
Registration is closed
The registration period has passed.
