Author-Judge's Commentary 319 Start with a simple model, follow it to completion, and then refine it Many teams built a model without air resistance and-before determin ing thenumber of boxes needed--they refined only that part of the model to include air resistance Computer Programs If computer programs are included, clearly define all parameters Always include an algorithm in the body of the paper for any code used If running a Monte Carlo simulation, be sure to run it enough times to have a statistically significant output . Validation Check your model against some known baseline, if possible, or explain how you would do this Check sensitivity of parameters to your results Check to see if your recommendations/ conclusions make common sense Use real data The model should represent human behavior and be plausible Resources All work needs to be original or else references must be cited-with specific page numbers-in the text of the paper; a reference list at the end is not sufficient. This particular problem lent itself to a good literature search Teams may use only inanimate resources. This does not include peop Surf the Web but document sites where you obtained information that you used Judging The judging is accomplished in two phases Phase I is"triage judging. These are generally only 10-min reads with a subjective scoring from 1(worst)to 7(best). Approximately the top 40% of papers are sent on to the final judging Phase Il, at a different site, is done with different judges and consists of a calibration round followed by another subjection round based on the 1 7 scoring system. Then the judges collaborate to develop an unique 100 point scale that will enable them to"bubble up"the better papers. Four or more longer rounds are accomplished using this scale, followed by a lengthy discussion of the last final group of papersAuthor-Judge’s Commentary 319 – Start with a simple model, follow it to completion, and then refine it. Many teams built a model without air resistance and—before determin￾ing the number of boxes needed—they refined only that part of the model to include air resistance. • Computer Programs – If computer programs are included, clearly define all parameters. – Always include an algorithm in the body of the paper for any code used. – If running a Monte Carlo simulation, be sure to run it enough times to have a statistically significant output. • Validation – Check your model against some known baseline, if possible, or explain how you would do this. – Check sensitivity of parameters to your results. – Check to see if your recommendations/conclusions make common sense. – Use real data. – The model should represent human behavior and be plausible. • Resources – All work needs to be original or else references must be cited—with specific page numbers—in the text of the paper; a reference list at the end is not sufficient. (This particular problem lent itself to a good literature search.) – Teams may use only inanimate resources. This does not include people. – Surf the Web, but document sites where you obtained information that you used. Judging The judging is accomplished in two phases. • Phase I is “triage judging.” These are generally only 10-min reads with a subjective scoring from 1 (worst) to 7 (best). Approximately the top 40% of papers are sent on to the final judging. • Phase II, at a different site, is done with different judges and consists of a calibration round followed by another subjection round based on the 1– 7 scoring system. Then the judges collaborate to develop an unique 100- point scale that will enable them to “bubble up” the better papers. Four or more longer rounds are accomplished using this scale, followed by a lengthy discussion of the last final group of papers