Engineering Design Process Portfolio: Component and Element Titles
Component I: Presenting and Justifying a Problem and Solution
Requirements
Element A: Presentation and justification of the problem
Element B. Documentation and analysis of prior solution attempts
Element C. Presentation and justification of solution design requirements
Component II: Generating and Defending an Original Solution
Element D: Design concept generation, analysis, and selection
Element E: Application of STEM principles and practices
Element F: Consideration of design viability
Component III: Constructing and Testing a Prototype
Element G: Construction of a testable prototype
Element H: Prototype testing and data collection plan
Element I: Testing, data collection and analysis
Component IV: Evaluation, Reflection, and Recommendations
Element J: Documentation of external evaluation
Element K: Reflection on the design project
Element L: Presentation of designer's recommendations
RUBRIC FOR GUIDANCE AND REVIEW
Component I: Presenting and Justifying a Problem and Solution Requirements
Element A: Presentation and justification of the problem
5 The problem is clearly and objectively identified and defined with considerable depth, and it is well elaborated with specific detail; the justification of the problem highlights the concerns of many primary stakeholders and is based on comprehensive, timely, and consistently credible sources; it offers consistently objective detail from which multiple measurable design requirements can be determined.
4 The problem is clearly and objectively identified and defined with some depth, and it is generally elaborated with specific detail; the justification of the problem highlights the concerns of some primary stakeholders and is based on various timely and generally credible sources; it offers generally objective detail from which multiple measurable design requirements can be determined.
3 The problem is somewhat clearly and objectively identified and defined with adequate depth, and it is sometimes elaborated with specific detail, although some information intended as elaboration may be imprecise or general; the justification of the problem highlights the concerns of at least a few primary stakeholders and is based on at least a few sources which are timely and credible; although not all information included may be objective, the justification of the problem offers enough objective detail to allow at least a few measurable design requirements to be determined.
2 The problem is identified only somewhat clearly and/or objectively and defined in a manner that is somewhat superficial and/or minimally elaborated with specific detail; the justification of the problem highlights the concerns of only one or two primary stakeholders and/or may be based on insufficient sources or ones that are outdated or of dubious credibility; although little information included is objective, the justification of the problem offers enough objective detail to allow at least a few design requirements to be determined; however, these may not be ones that are measurable.
1 The identification and/or definition of the problem is unclear, is unelaborated, and/or is clearly subjective; any intended justification of the problem does not highlight the concerns of any primary stakeholders and/or is based on sources that are overly general, outdated, and/or of dubious credibility; information included is insufficient to allow for the determination any measurable design requirements.
0 The identification and/or definition of the problem are missing OR cannot be inferred from information included. A justification of the problem is missing, cannot be inferred from information included as evidence, OR is essentially only the opinion of the researcher.
Element B. Documentation and analysis of prior solution attempts
5 Documentation of plausible prior attempts to solve the problem and/or related problems is drawn from a wide array of clearly identified and consistently credible sources; the analysis of past and current attempts to solve the problem-including both strengths and shortcomings is consistently clear, detailed, and supported by relevant data.
4 Documentation of existing attempts to solve the problem and/or related problems is drawn from a variety of clearly identified and consistently credible sources; the analysis of past and current attempts to solve the problem-including both strengths and shortcomings-is clear and is generally detailed and supported by relevant data.
3 Documentation of existing attempts to solve the problem and/or related problems is drawn from several-but not necessarily varied-clearly identified and generally credible sources; the analysis of past and current attempts to solve the problem-including both strengths and shortcomings-is generally clear and contains some detail and relevant supporting data.
2 Documentation of existing attempts to solve the problem and/or related problems is drawn from a limited number of sources, some of which may not be clearly identified and/or credible; the analysis of past and current attempts to solve the problem-including strengths and/or shortcomings-is overly general and contains little detail and/or relevant supporting data.
1 Documentation of existing attempts to solve the problem and/or related problems is drawn from only one or two sources that may not be clearly identified and/or credible; the analysis of past and current attempts to solve the problem-including strengths and/or shortcomings-is vague and is missing any relevant details and/or relevant supporting data.
0 Documentation of existing attempts to solve the problem and/or related problems is missing or minimal (a single source that is not clearly identified and/or credible) OR cannot be inferred from information intended as analysis of past and/or current attempts to solve the problem.
Element C. Presentation and justification of solution design requirements
5 Design requirements are listed and prioritized, and they are consistently clear and detailed; these design requirements presented are consistently objective, measurable, and they would be highly likely to lead to a tangible and viable solution to the problem identified; there is evidence that requirements represent the needs of, and have been validated by, many if not all primary stakeholder groups.
4 Design requirements are listed and prioritized, and they are generally clear and detailed; these design requirements presented are nearly always objective and measurable, and they would be likely to lead to a tangible and viable solution to the problem 'identified; there is evidence that requirements represent the needs of, and have been validated by, several primary stakeholder groups.
3 Design requirements are listed and prioritized, and they are generally clear and somewhat detailed; these design requirements presented are generally objective and measurable, and they have the potential to lead to a tangible and viable solution to the problem identified; there is evidence that requirements represent the needs of, and have been validated by, at least a few primary stakeholder groups.
2 Design requirements are listed and prioritized, but some/all of these may be incomplete and/or lack specificity; these design requirements may be only sometimes objective and/or measurable, and it is not clear that they will lead to a tangible and viable solution to the problem identified; there is evidence that the requirements represent the needs, of/and or have been validated by, only one primary stakeholder group.
1 An attempt is made to list, format, and prioritize requirements, but these may be partial and/or overly general, making them insufficiently measurable to support a viable solution to the problem identified; there is no evidence that the requirements represent the needs of, or have been validated by, any primary stakeholder groups.
0 Design requirements are either not presented or are too vague to be used to outline the measurable attributes of a possible design solution to the problem identified.
Component II: Generating and Defending an Original Solution
Element D: Design concept generation, analysis, and selection
5 The process for generating and comparing possible design solutions was comprehensive, iterative, and consistently defensible, making a viable and well-justified design highly likely; the design solution ultimately chosen was well-justified and demonstrated attention to all design requirements; the plan of action has considerable merit and would easily support repetition and testing for effectiveness by others.
4 The process for generating and comparing possible design solutions was thorough, iterative, and generally defensible, making a viable design likely; the design solution chosen was justified and demonstrated attention to most if not all design requirements; the plan of action would support repetition and testing for effectiveness by others.
3 The process for generating and comparing possible design solutions was adequate and generally iterative and defensible, making a viable design possible; the choice of design solution was explained with reference to at least some design requirements; the plan of action might not clearly or fully support repetition and testing for effectiveness by others.
2 The process for generating a possible design solution was partial or overly general and only somewhat iterative and/or defensible, raising issues with the viability of the design solution chosen; that solution was not sufficiently explained with reference to design requirements; there is insufficient detail to allow for testing for replication of results.
1 The process for generating a possible design solution was incomplete and was only minimally iterative and/or defensible; any attempted explanation for the design solution chosen lacked support related to design requirements and cannot be tested.
0 There is no evidence an attempt to arrive at a design solution through an iterative process based on design requirements.
Element E: Application of Bioengineering principles* and practices
5 The proposed solution is well-substantiated with principles learned in Bioengineering curriculum and practices applicable to all or nearly all design requirements and functional claims; there is substantial evidence that the application of those principles and practices by the student or a suitable alternate has been reviewed by two or more experts (qualified consultants and/or project mentors) and that those reviews provide confirmation (verification) or detail necessary to inform a corrective response.
4 The proposed solution is generally substantiated with principles learned in Bioengineering curriculum and practices applicable to some design requirements and functional claims; there is some evidence that the application of those principles and practices by the student or a suitable alternate has been reviewed by at least two experts (qualified consultants and/or project mentors) and that those reviews provide confirmation (verification) or some detail necessary to inform a corrective response.
3 The proposed solution is partially substantiated with principles learned in Bioengineering curriculum and practices applicable to at least a few design requirements and functional claims; there is some evidence that the application of those principles and practices by the student or a suitable alternate has been reviewed by at least one expert (qualified consultant or project mentor) but this review may not provide clear confirmation (verification) or at least some detail to inform a corrective response.
2 The proposed solution is minimally substantiated with principles learned in Bioengineering curriculum and practices applicable to at least a few design requirements and functional claims; there is minimal evidence that the application of those principles and practices by the student or a suitable alternate has been reviewed by at least one expert (qualified consultant or project mentor) but there is no evidence of confirmation (verification) or any detail to inform a corrective response.
1 The proposed solution is minimally substantiated with principles learned in Bioengineering curriculum or practices applicable to at least a few design requirements and functional claims; however, there is no evidence that the application of those principles and practices by the student or a suitable alternate has been reviewed by an expert (qualified consultant or project mentor).
0 The proposed solution is not substantiated with principles learned in Bioengineering curriculum or practices applicable to any design requirements and/or functional claims.
*Bioengineering principles refers to concepts in the curriculum including basic science and math skills.
Element F: Consideration of design viability
5 The proposed design was carefully reviewed based on several relevant extra-functional considerations; a judgment about design viability based on those considerations-the capacity of the proposed solution to address the problem-is clearly realistic and well supported with credible evidence.
4 The proposed design was adequately reviewed based on several relevant extra-functional
considerations; a judgment about design viability based on those considerations-the capacity of the proposed solution to address the problem-is generally realistic and adequately supported with credible evidence.
3 The proposed design was partially reviewed based on one or two relevant extra-functional considerations; a judgment about design viability based on those considerations-the capacity of the proposed solution to address the problem-is only somewhat/sometimes realistic and is only partially supported with credible evidence.
2 The proposed design was superficially reviewed based on one or two relevant extra-functional considerations; a judgment about design viability based on those considerations-the capacity of the proposed solution to address the problem-may be generally although not completely unrealistic and/or may be inadequately supported with credible evidence.
1 The proposed design was superficially reviewed based on one or two extra-functional considerations of marginal relevance; a judgment about design viability based on those considerations-the capacity of the proposed solution to address the problem-may be unrealistic and/or not supported with any credible evidence.
0 There is no evidence provided that the proposed design was reviewed based on any extra functional considerations.
Component III: Constructing and Testing a Prototype
Element G: Construction of a testable prototype
5 The final prototype iteration is clearly and fully explained and is constructed with enough detail to assure that objective data on all or nearly all design requirements could be determined; all attributes (sub-systems) of the unique solution that can be tested or modeled mathematically are addressed and swell-supported justification is provided for those that cannot be tested or modeled mathematically and thus require expert review.
4 The final prototype iteration is clearly and adequately explained and is constructed with enough detail to assure that objective data on many design requirements could be determined; most attributes (sub-systems) of the unique solution that can be tested or modeled mathematically are addressed and a generally supported justification is provided for those that cannot be tested or modeled mathematically and thus require expert review.
3 The final prototype iteration is clearly and adequately explained and is constructed with enough detail to assure that objective data on some design requirements could be determined; some attributes (sub-systems) of the unique solution that can be tested or modeled mathematically are addressed and an adequately supported justification is provided for those that cannot be tested or modeled mathematically and thus require expert review.
2 The final prototype iteration is explained only somewhat clearly and/or completely and is constructed with enough detail to assure that objective data on at least a few design requirements could be determined; a few attributes (sub-systems) of the unique solution that can be tested or modeled mathematically are addressed but there may be insufficient justification for those that cannot be tested or modeled mathematically and thus require expert review.
1 The final prototype iteration is only minimally explained and/or is not constructed with enough detail to assure that objective data on at least one design requirements could be determined; no more than one attribute (sub-system) of the unique solution that can be tested or modeled mathematically is addressed and any attempt at justification for those that cannot be tested or modeled mathematically and thus require expert review is missing.
0 Any attempt to explain the final prototype iteration is unclear or is missing altogether; there is no evidence that the prototype would facilitate testing by suitable means for any of the design requirements.
Element H: Prototype testing and data collection plan
5 The testing plan addresses all or nearly all of the high priority design requirements by effectively describing the conduct (through physical and/or mathematical modeling) of those tests that are feasible based on the instructional context and providing for others a logical and well-developed explanation confirmed by one or more field experts of how testing would yield objective data regarding the effectiveness of the design.
4 The testing plan addresses many of the high priority design requirements by describing in a generally effective way the conduct (through physical and/or mathematical modeling) of those tests that are feasible based on the instructional context and providing for others a logical and generally developed explanation confirmed by one or more field experts of how testing would yield objective data regarding the effectiveness of the design
3 The testing plan addresses some of the high priority design requirements by adequately describing the conduct (through physical and/or mathematical modeling) of those tests that are feasible based on the instructional context and providing for others a generally logical and adequately developed explanation confirmed by one or more field experts of how testing would yield objective data regarding the effectiveness of the design.
2 The testing plan addresses a few of the high priority design requirements by at least partially describing the conduct (through physical and/or mathematical modeling) of those tests that are feasible based on the instructional context and providing for others an only somewhat logical and/or partially developed explanation confirmed by one or more field experts of how testing would yield objective data regarding the effectiveness of the design.
1 The testing plan addresses one of the high priority design requirements by describing at least minimally the conduct (through physical and/or mathematical modeling) of a test that is feasible based on the instructional context and/or providing for an at least generally logical and/or partially developed explanation of how testing would yield objective data regarding the effectiveness of the design; confirmation of that explanation by even one field expert may be
missing.
0 Any testing plan included fails to address at least one of the high priority design requirements by describing at least minimally the conduct (through physical and/or mathematical modeling) of a test that is feasible based on the instructional context and/or providing for an at least generally logical and/or partially developed explanation of how testing would yield objective data regarding the effectiveness of the design; OR a testing plan is missing altogether.
Element I: Testing, data collection and analysis
5 Through the conduct of several tests for high priority requirements that are reasonable based on instructional contexts, or through physical or mathematical modeling, the student demonstrates considerable understanding of testing procedure, including the gathering and analysis of resultant data; the analysis of the effectiveness with which the design met stated goals includes a consistently detailed explanation [and summary] of the data from each portion of the testing procedure and from expert reviews, generously supported by pictures, graphs, charts and other visuals; the analysis includes an overall summary of the implications of all data for proceeding with the design and solving the problem.
4 Through the conduct of several tests for high priority requirements that are reasonable based on instructional contexts, or through physical or mathematical modeling, the student demonstrates ample understanding of testing procedure, including the gathering and analysis of resultant data; the analysis of the effectiveness with which the design met stated goals includes a generally detailed explanation [and summary] of the data from each portion of the testing procedure and from expert reviews, generally supported by pictures, graphs, charts and other visuals; the analysis includes an overall summary of the implications of most if not all of the data for proceeding with the design and solving the problem.
3 Through the conduct of a few tests for high priority requirements that are reasonable based on instructional contexts, or through physical or mathematical modeling, the student demonstrates adequate understanding of testing procedure, including the gathering and analysis of resultant data; the analysis of the effectiveness with which the design met stated goals includes a somewhat detailed explanation [and summary] of the data from each portion of the testing procedure and from expert reviews, at least somewhat supported by pictures, graphs, charts and other visuals; the analysis includes a summary of the implications of at least some of the data for proceeding with the design and solving the problem.
2 Through the conduct of one or two tests for high priority requirements that are reasonable based on instructional contexts, or through physical or mathematical modeling, the student demonstrates partial or overly general understanding of testing procedure, including the gathering and analysis of resultant data; the analysis of the effectiveness with which the design met stated goals includes a partial explanation [and summary] of the data (partially complete and/or partially correct), at least minimally supported by pictures, graphs, charts and other visuals; the analysis includes a partial and/or overly-general summary of the implications of at least some of the data for proceeding with the design and solving the problem.
1 Through the conduct of one or two tests for requirements (which mayor may not be high priority) that are reasonable based on instructional contexts, or through physical or mathematical modeling, the student demonstrates minimal understanding of testing procedure, including the gathering and analysis of resultant data; the analysis of the effectiveness with which the design met stated goals includes an attempted explanation [and summary] of the data but may not be supported by any pictures, graphs, charts or other visuals; the analysis may be missing even a partial and/or overly-general summary of the implications of any of the data for proceeding with the design and solving the problem.
0 Any test(s) for requirement(s) or attempts at physical or mathematical modeling fail to demonstrate even minimal understanding of testing procedure, including the gathering and analysis of resultant data; OR there is no evidence of testing or physical or mathematical modeling to address any requirements.
Component IV: Evaluation, Reflection, and Recommendations
Element J: Documentation of external evaluation
5 Documentation of project evaluation by multiple, demonstrably qualified stakeholders and field experts is presented and is synthesized in a consistently specific, detailed, and thorough way; documentation is sufficient in two or more categories to yield meaningful analysis of that evaluation data; the synthesis of evaluations consistently addresses evaluators' specific questions, concerns, and opinions related to design requirements.
4 Documentation of project evaluation by two or more demonstrably qualified stakeholders and field experts is presented and is synthesized in a generally specific, detailed, and thorough way; documentation is sufficient in at least one category to yield a meaningful analysis of that evaluation data; the synthesis of evaluations generally addresses evaluators' specific questions, concerns, and opinions related to design requirements.
3 Documentation of project evaluation by three or four demonstrably qualified stakeholders and/or field experts is presented and is synthesized in a somewhat specific and detailed way, but may not be thorough; documentation may not be sufficient in any category to yield a meaningful analysis of that evaluation data; the synthesis of evaluations addresses at least some of evaluators' specific questions, concerns, and opinions related to design requirements.
2 Documentation of project evaluation by two or three representatives of stakeholders and/or field experts (some of whom may not be demonstrably qualified) is presented and is synthesized in a somewhat specific and/or detailed but incomplete or overly general way; the synthesis of evaluations addresses at least a few of evaluators' specific questions, concerns, and/or opinions related to design requirements:
1 Documentation of project evaluation by one or two representatives of stakeholders and/or field experts is presented but synthesis is sparse, with few specifics/details; the synthesis of evaluations addresses only one or two of an evaluators questions, concerns, and/or opinions related to design requirements.
0 Documentation of project evaluation by any representative stakeholder or 'field expert is nonexistent OR if included is minimal; synthesis is minimal or missing and if present, does not address any questions, concerns, or opinions of an evaluator related to design requirements.
Element K: Reflection on the design project
5 The project designer provides a consistently clear, insightful, and comprehensive reflection on, and value judgment of, each major step in the project; the reflection includes a substantive summary of lessons learned that would be clearly useful to others attempting the same or similar project.
4 The project designer provides a clear, insightful and well-developed reflection on, and value judgment of, each major step in the project; the reflection includes a summary of lessons learned that would be clearly useful to others attempting the same or similar project.
3 The project designer provides a generally clear and insightful, adequately-developed reflection on, and value judgment of, major steps in the project, although one or two steps may be addressed in a more cursory manner; the reflection includes a summary of lessons learned, at least most of which would be useful to others attempting the same or similar project.
2 The project designer provides a generally clear, at least somewhat insightful, and partially developed reflection on, and value judgment of, most if not all of the major steps in the project; the reflection includes some lessons learned which would be useful to others attempting the same or similar project.
1· The project designer provides a reflection on, and value judgment of, at least some of the major steps in the project, although the reflection may be partial, overly-general and/or superficial; the reflection includes a few lessons learned of which at least one would be useful to others attempting the same or similar project.
0 The project designer attempts a reflection on, and value judgment of, at least one or two of the major steps in the project, although the reflection may be minimal, unclear, and/or extremely superficial; any lessons learned are unclear and/or of no likely use to others attempting the same or similar project; OR there is no evidence of a reflection and/or lessons learned.
Element L: Presentation of designer's recommendations
5 The project designer includes consistently detailed and salient recommendations regarding the conduct of the same or similar project in the future; recommendations include caveats as warranted and specific ways the project could be improved with consistently detailed plans for the implementation of those improvements
4 The project designer includes generally detailed and salient recommendations regarding the conduct of the same or similar project in the future; recommendations include caveats as warranted and specific ways the project could be improved with generally detailed plans for the implementation of those improvements
3 The project designer includes a few detailed and salient recommendations regarding the conduct of the same or similar project in the future; recommendations include some specific ways the project could be improved along with what may be only minimally detailed plans for the implementation of those improvements and may also include one or two caveats for others
2 The project designer includes recommendations regarding the conduct of the same or similar project in the future; recommendations may include some specific ways the project could be improved but plans for the implementation of those improvements may be missing OR the recommendations (with or without plans) may be partial and/or overly general.
1 The project designer includes one or two overly general and/or questionably relevant recommendations regarding the conduct of the same or similar project in the future; any plans for implementation included are vague/unclear or minimally related to the recommendations provided
o The project designer includes one or two recommendations (with or without plans) that bear little/no relation to the conduct of the same or similar project in the future OR fails to offer any recommendations or plans regarding the conduct of the same or similar project in the future
(Adapted from InnovationPortal®)
Updated August 19, 2016 by Jennifer Amos. Credit to James Mitchell at Drexel University for portions of the text.