Judges'Commentary 163 Judges Commentary: The Outstanding Coral reef Papers Sheila Miller Dept of Mathematical Sciences U.S. Military Academy West Point, NY Melissa Garren Center for Marine Biodiversity and Conservation Scripps Institution of Oceanography University of California-San Diego La jolla, CA Rodney sturdivant Dept of Mathematical Sciences U.S. Military Academy West Point, ny Rodney Sturdivant@usma. edu Introduction The Interdisciplinary Contest in Modeling(ICM)e is an opportunity for teams of students to tackle challenging real-world problems that require a wide breadth of understanding in multiple academic subjects. This years problem required a particularly deep understanding of ecology to model a solution fectively. Due to the rapid growth of aquaculture facilities currently being installed in or adjacent to many sensitive coastal ecosystems, research into sustainable culturing methods is an active area of investigation. Seven judges gathered in late March to select the most successful entries of this challenging competition out of an impressive set of submissions The UMAP Joumal 30(2)(2009)163-168. @Copyright 2009 by CoMAP, Inc. Allrights reserved. Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice. Abstracting with credit is permitted, but copyrights for components of this work owned by others than COMAP must be honored. To copy otherwise, to republish, to post on servers, or to redistribute to lists requires prior permission from COMAP
Judges' Commentary 163 Judges' Commentary: The Outstanding Coral Reef Papers Sheila Miller Dept. of Mathematical Sciences U.S. Military Academy West Point, NY Melissa Garren Center for Marine Biodiversity and Conservation Scripps Institution of Oceanography University of California-San Diego La Jolla, CA Rodney Sturdivant Dept. of Mathematical Sciences U.S. Military Academy West Point, NY Rodney. Sturdivant@usma. edu Introduction The Interdisciplinary Contest in Modeling (ICM)® is an opportunity for teams of students to tac1de challenging real-world problems that require a wide breadth of understanding in multiple academic subjects. This year's problem required a particularly deep understanding of ecology to model a solution effectively. Due to the rapid growth of aquaculture facilities currently being installed in or adjacent to many sensitive coastal ecosystems, research into sustainable culturing methods is an active area of investigation. Seven judges gathered in late March to select the most successful entries of this challenging competition out of an impressive set of submissions. The UMAPJourna130 (2) (2009)163-168. @Copyright2009byCOMAP, Inc. All rights reserved. Permission to make digital or hard copies of part or all of this work for personal or dassroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice. Abstracting with credit is permitted, but copyrights for components of this work owned by others than COMAP must be honored. To copy otherwise, to republish, to post on servers, or to redistribute to lists requires prior permission from COMAR
164 The UMAP Journal 30.2(2009) The Proble The primary goal of this year's ICM was to develop an aquaculture scenario at incorporated species from multiple trophic levels to reduce the level of effluent leaving the fish pens for a specific case study in the Philippines. These fish farms are adjacent to coral reefs, thus the target was to improve water uality such that corals could thrive in the area while an economically viable aquaculture industry could also bemaintained. The main tasks expected ofthe eams were as follows: 1. Model the original Bolinao coral reef ecosystem before the introduction of 2. Model the current Bolinao milkfish monoculture. 3. Observe the remediation of bolinao via aquaculture 4. Maximize the value of the total harvest. 5. Call to action Overall, the judges were impressed by both the strength of many of the sub- missions of individual teams and the variety of approaches that teams used to address the questions posed by the ICM problem. Judges criteria In order to ensure that the individual judges assessed submissions on the same criteria, we developed rubric. The framework used to evaluate subm sions is described below. Executive Summary: It was important that teams succinctly and clearly explained the highlights of their submissions. These executive summaries needed toincludemodeling approach(es)used for both the currentmonocul ture and in remediation using polyculture. Further, the summary needed to answer themost pressing questions posed in the problemstatement, namely recommendations for remediation and the impact on water quality and op timizing the harvest. Truly Outstanding papers were those that communi cated their approach and recommendations in well-connected and concise Domain Knowledge and Science: The problem this year was particularly challenging for teams in terms of the science tseffectively, teams needed first to establish an ological frame of reference. Many teams were able to do this reasonably well; teams that excelled clearly did a great deal of research. Often, what distinguished the top teams was the ability not just to describe the
164 The UMAP Journal 30.2 (2009) The Problem The primary goal of this year's ICM was to develop an aquaculture scenario that incorporated species from multiple trophic levels to reduce the level of effluent leaving the fish pens for a specific case study in the Philippines. These fish farms are adjacent to coral reefs, thus the target was to improve water quality such that corals could thrive in the area while an economically viable aquaculture industry could also be maintained. The main tasks expected of the teams were as follows: 1. Model the original Bolinao coral reef ecosystem before the introduction of fish farms. 2. Model the current Bolinao milkfish monoculture. 3. Observe the remediation of Bolinao via aquaculture. 4. Maximize the value of the total harvest. 5. Call to action. Overall, the judges were impressed by both the strength of many of the submissions of individual teams and the variety of approaches that teams used to address the questions posed by the ICM problem. Judges' Criteria In order to ensure that the individual judges assessed submissions on the same criteria, we developed a rubric. The framework used to evaluate submissions is described below. "* Executive Summary: It was important that teams succinctly and dearly explained the highlights of their submissions. These executive summaries needed to include modeling approach(es) usedforboththe currentmonoculture and in remediation using polyculture. Further, the summary needed to answer the most pressing questions posedinthe problem statement, namely recommendations for remediation and the impact on water quality and optimizing the harvest. Truly Outstanding papers were those that communicated their approach and recommendations in well-connected and concise prose. "* Domain Knowledge and Science: The problem this year was particularly challenging for teams in terms of the science. - To address the requirements effectively, teams needed first to establish an ecologicalframe of reference. Many teams were able to do this reasonably well; teams that excelled dearly did a great deal of research. Often, what distinguished the top teams was the ability not just to describe the
Judges' Commentary 165 ecosystem in a single section of the paper, but to integrate this domain knowledge throughout the modeling process A second important facet of the problem was the ability to understand issues that impact water quality. Many teams created reasonable models of the species and their interactions but very few effectively modeled Modeling and Assumptions: The most popular models used were dif- ferential equations--usually linear for the simple cases and then expanding to include nonlinear terms. Simulation was also a popular approach to the problem. Often the models appeared appropriate but neglected any discussion of important assumptions. Additionally, many papers lacked a reasonable discussion of model development, instead presenting a series of equations and parameter values without support. Finally, the very best pa pers not only formulated the models well, but were able to use the models to produce meaningful results to address the problem and to make recom- mnenaatons Solution(Optimization): Perhaps the most distinct difference between the best papers and others was the ability to utilize their models to develop important portions of the problem in any substantive way--what should be done to remediate Bolinao and how to balance the water quality while he actual solution presented, in addition to the modeling approach asis on maximizing harvesting. As a result, the judges put additional empha Analysis/Reflection: Successful papers utilized the models developed in early sections of the paper to draw conclusions about the importantissues in addressing problems with the Bolinao ecosystem. For example, the impor- tant parameters were identified in terms of their impact on the water quality and the harvest available. In the best papers, trade-offs were discussed and, in truly exceptional cases, some sensitivity analysis conducted to identify potential issues with the solutions presented. Communication: The challenges of the modeling in this problem may have contributed to the difficulty many teams had in clearly explaining their so- lutions. Papers that were clearly exposited distinguished themselves signif icantly, emphasizing that it is not only good science that is important, but Iso the presentation of the ideas Discussion o of the Outstanding Papers Thetwo Outstanding papers eachhad features that distinguished themfrom the other submissions. Working under the time constraint, both teams were impressive in their ability to research the ecological issues, propose reasonable models, and to present their work in a clear and readable manner. This year, in
Judges' Commentary 165 ecosystem in a single section of the paper, but to integrate this domain knowledge throughout the modeling process. - A second important facet of the problem was the ability to understand issues that impact water quality. Many teams created reasonable models of the species and their interactions but very few effectively modeled the water quality. " Modeling and Assumptions: The most popular models used were differential equations-usually linear for the simple cases and then expanding to include nonlinear terms. Simulation was also a popular approach to the problem. Often the models appeared appropriate but neglected any discussion of important assumptions. Additionally, many papers lacked a reasonable discussion of model development, instead presenting a series of equations and parameter values without support. Finally, the very best papers not only formulated the models well, but were able to use the models to produce meaningful results to address the problem and to make recommendations. "* Solution (Optimization): Perhaps the most distinct difference between the best papers and others was the ability to utilize their models to develop an actual solution to the problems. Many teams failed to address the most important portions of the problem in any substantive way-what should be done to remediate Bolinao and how to balance the water quality while maximizing harvesting. As a result, the judges put additional emphasis on the actual solution presented, in addition to the modeling approach. "* Analysis/Reflection: Successful papers utilized the models developed in early sections of the paper to draw conclusions about the important issues in addressing problems with the Bolinao ecosystem. For example, the important parameters were identified in terms of their impact on the water quality and the harvest available. In the best papers, trade-offs were discussed and, in truly exceptional cases, some sensitivity analysis conducted to identify potential issues with the solutions presented. "* Communication: The challenges of the modeling in this problem may have contributed to the difficulty many teams had in clearly explaining their solutions. Papers that were clearly exposited distinguished themselves significantly, emphasizing that it is not only good science that is important, but also the presentation of the ideas. Discussion of the Outstanding Papers The two Outstanding papers each had features that distinguished them from the other submissions. Working under the time constraint, both teams were impressive in their ability to research the ecological issues, propose reasonable models, and to present their work in a clear and readable manner. This year, in
166 The UMAP Journal 30.2 (2009) particular, the judges felt that the Outstanding papers each demonstrated par- ticular strengths in one of the important dimensions discussed in the previot section. No submission was able to dominate every area, but these two teams were clearly superior in different ways China University of Mining and Technology The China University ofMining and Technology submission wasnotable for theimpressive array of modeling techniques utilizedin attacking the problem There were otherpaperswithasimilarlevelofmodeling, but this groupnotonly described the modeling process clearly but connected the models coherently to the problem at hand. As with many of the teams, the principal models used were differentialequations(Volterramodels). The teamalso used the analytical Hierarchy Process(AHP), as well as nonlinear optimization to improve their models and to address the later requirements of the problem. They propose strengthening the"middle strata of the foodweb"by introducing herbivorous species to the polyculture. They also propose a strategy for harvesting various species while still satisfying the constraint to maintain good water quality in Bolinao. while extremely strong on the modeling, the paper could have been further improved with more depth on the ecological issues and the overall quality of the writing U.S. Military Academy The paper from the U.S. Military Academy included perhaps the clearest understanding and presentation of the ecological problem and issues among all submissions. The paper was extremely well written and researched. Unlike many teams, the group chose discrete models(difference equations)as the primary tool for their analysis and then employed simulations to help with the optimization tasks. The team did an exceptional job of showing how their model outputsupportthemove from amono-to poly-culture-they addedblue mussel mollusks to the system to show the positive effects of such a cha They also proposed an optimal harvesting strategy involving multiple species. This paper could have been strengthened by adding detail about the models and modeling process Why Some Other Teams Weren't Outstanding In addition to the two Outstanding papers, the judges noted several other papers of equal merit in terms of the modeling effort but excluded from award due to issues with proper documentation. The issue wasnot the fact thatmate- rial from Websites or books was included-withinreason, quotations properly cited are appropriate. Rather, some teams used material taken directly from own ideas, failed to document a quoted passage as a quotation, or both their such sources(sometimes as much as one or more pages of text)in place
166 The UIMAP Journal 30.2 (2009) particular, the judges felt that the Outstanding papers each demonstrated particular strengths in one of the important dimensions discussed in the previous section. No submission was able to dominate every area, but these two teams were dearly superior in different ways. China University of Mining and Technology The China University of Mining and Technology submission was notable for the impressive array of modeling techniques utilized in attacking the problems. There were otherpaperswith a similar level of modeling, but this group not only described the modeling process dearly but connected the models coherently to the problem at hand. As with many of the teams, the principal models used were differential equations (Volterramodels). Theteam also usedthe Analytical Hierarchy Process (AHP), as well as nonlinear optimization to improve their models and to address the later requirements of the problem. They propose strengthening the "middle strata of the foodweb" by introducing herbivorous species to the polyculture. They also propose a strategy for harvesting various species while still satisfying the constraint to maintain good water quality in Bolinao. While extremely strong on the modeling, the paper could have been further improved with more depth on the ecological issues and the overall quality of the writing. U.S. Military Academy The paper from the U.S. Military Academy included perhaps the dearest understanding and presentation of the ecological problem and issues among all submissions. The paper was extremely well written and researched. Unlike many teams, the group chose discrete models (difference equations) as the primary tool for their analysis and then employed simulations to help with the optimization tasks. The team did an exceptional job of showing how their model output support the move from a mono- to poly-culture--they addedblue mussel mollusks to the system to show the positive effects of such a change. They also proposed an optimal harvesting strategy involving multiple species. This paper could have been strengthened by adding detail about the models and modeling process. Why Some Other Teams Weren't Outstanding In addition to the two Outstanding papers, the judges noted several other papers of equal merit in terms of the modeling effort but excluded from award due to issues with proper documentation. The issue was not the fact that material from Websites or books was included-within reason, quotations properly cited are appropriate. Rather, some teams used material taken directly from such sources (sometimes as much as one or more pages of text) in place of their own ideas, failed to document a quoted passage as a quotation, or both
Judges'Commentary 167 Conclusion The judges extend their congratulations to all who participated in the con- test. It is a pleasure to see the variety of approaches taken by the different teams; some of these were novel and interesting. The number of excellent pa pers made the judging both enjoyable and difficult. The problem this year was extremely challenging and the ability to both research and thenmodelin a short period of time was impressive Two facets of this years ICM are worth noting The importance of understanding the underlying science in formulating mathematical models. In the practice of modeling, assumptions should be carefully thought out and checked and, whenever possible, experts should How critical communication skills are to the analyst. a great mathematical model is not likely to be used if not clearly and concisely explained Recommendations for Future Participants Not even ingenious solutions are a substitute for clear exposition Ensure that the assumptions you make are clear to the reader, and address them in your conclusions and recommendations Address all aspects of the problem that are asked. Between two equally-clear explanations, the shorter one is better. Properly citing sources is critical. Judges notice plagiarized material and disqualify papers that contain it; cite as you go, not at the end The recommendations and sensitivity analysis are often as important as the model itself. Frequently, it is better to have a well-analyzed model that accounts for slightly less than a comprehensive but untested one Teammembers should work to integrate their final submissions. Your paper should read as though it has only one author
Judges' Commentary 167 Conclusion The judges extend their congratulations to all who participated in the contest. It is a pleasure to see the variety of approaches taken by the different teams; some of these were novel and interesting. The number of excellent papers made the judging both enjoyable and difficult. The problem this year was extremely challenging and the ability to both research and then model in a short period of time was impressive. Two facets of this year's ICM are worth noting: "* The importance of understanding the underlying science in formulating mathematical models. In the practice of modeling, assumptions should be carefully thought out and checked and, whenever possible, experts should be consulted. "* How critical communication skills are to the analyst. A great mathematical model is not likely to be used if not dearly and concisely explained. Recommendations for Future Participants "* Not even ingenious solutions are a substitute for clear exposition. "* Ensure that the assumptions you make are dear to the reader, and address them in your conclusions and recommendations. "* Address all aspects of the problem that are asked. "* Between two equally-clear explanations, the shorter one is better. "* Properly citing sources is critical. Judges notice plagiarized material and disqualify papers that contain it; cite as you go, not at the end. "* The recommendations and sensitivity analysis are often as important as the model itself. Frequently, it is better to have a well-analyzed model that accounts for slightly less than a comprehensive but untested one. "* Team members should work to integrate their final submissions. Your paper should read as though it has only one author
168 The UMAP Journal 30.2 (2009) about the authors Sheila miller is an assistant Professor and day allow at the U.S. Military Academy in West Point, NY. She holds a Ph. D in Mathematics from the University of Colorado, Boulder and does research in set theory, sea turtle population modeling, value of information, and change detection in social networks Melissa Garrenis currently a Ph. D can didatein marine biology at Scripps Institu tion of Oceanography in La Jolla, CA. She earned her B S in molecular biology from Yale University and her M.S. in marine bi- ology from Scripps Institution of Oceanog- raphy. Herresearch focuses on the ecologi- al response of microbes to organic coastal pollution, particularly in coral reef envi- conments, with the aim of understanding the effects on coral health and disease Rod Sturdivant is an associate Professor at the U.S. Mil itary Academy in West Point, NY. He earned aPh. D. in bio- statistics at the University of Massachusetts-Amherstand is currently program director for the probability and statistics course at West Point. He is also founder and director of the Center for Data Analysis and Statistics within the Dept Mathematical Sciences. His research interests are largely in applied statistics with an emphasis on hierarchical logistic
168 The UMAP Journal 30.2 (2009) About the Authors Sheila Miller is an Assistant Professor and Davies Fellow at the U.S. Military Academy in West Point, NY. She holds a Ph.D. in Mathematics from the University of Colorado, Boulder and does research in set theory, sea turtle population modeling, value of information, and change detection in social networks. Melissa Garrenis currently a Ph.D. candidate inmarine biology at Scripps Institution of Oceanography in La Jolla, CA. She earned her B.S. in molecular biology from Yale University and her M.S. in marine biology from Scripps Institution of Oceanography. Her research focuses on the ecological response of microbes to organic coastal pollution, particularly in coral reef environments, with the aim of understanding the effects on coral health and disease. Rod Sturdivant is an Associate Professor at the U.S. Military Academy in West Point, NY. He earned a Ph.D. in biostatistics at the University of Massachusetts-Amherst and is currently program director for the probability and statistics course at West Point. He is also founder and director of the Center for Data Analysis and Statistics within the Dept. of Mathematical Sciences. His research interests are largely in applied statistics with an emphasis on hierarchical logistic regression models
Wilson ep COPYRIGHT INFORMATION TITLE: Judges' Commentary: The Outstanding Coral Reef Papers SOURCE: UMAP J 30 no2 Summ 2009 The magazine publisher is the copyright holder of this article and it is reproduced with permission. Further reproduction of this article in lation of the copyright is prohibited. To contact the publishe Www. co com
COPYRIGHT INFORMATION TITLE: Judges’ Commentary: The Outstanding Coral Reef Papers SOURCE: UMAP J 30 no2 Summ 2009 The magazine publisher is the copyright holder of this article and it is reproduced with permission. Further reproduction of this article in violation of the copyright is prohibited. To contact the publisher: www.comap.com