Abstract

The intersection between engineering design, manufacturing, and artificial intelligence offers countless opportunities for breakthrough improvements in how we develop new technology. However, achieving this synergy between the physical and the computational worlds involves overcoming a core challenge: few specialists educated today are trained in both engineering design and artificial intelligence. This fact, combined with the recency of both fields’ adoption and the antiquated state of many institutional data management systems, results in an industrial landscape that is relatively devoid of high-quality data and individuals who can rapidly use that data for machine learning and artificial intelligence development. In order to advance the fields of engineering design and manufacturing to the next level of preparedness for the development of effective artificially intelligent, data-driven analytical and generative tools, a new design for X principle must be established: design for artificial intelligence (DfAI). In this paper, a conceptual framework for DfAI is presented and discussed in the context of the contemporary field and the personas which drive it.

1 Introduction

Engineering design and manufacturing have been on an exciting trajectory in parallel with advancements in computation and internet connectivity. In only a few generations the world has transitioned from paper drawings stored in bulky file cabinets [1,2] to millions of computer-aided design (CAD) models accessible from anywhere in the world at the touch of a mouse click [35]. Entire professions, such as drafters, have largely declined [6], while new movements, such as that of the “maker” and rapid prototyping hobbyist have exploded in popularity [7].

The proliferation of 3D CAD applications has helped drive the adoption of advanced and robotic manufacturing [8]. What used to require careful manual attention can now be accomplished by computer-numeric controlled (CNC) machine tools, additive manufacturing (AM) machines, and many other automated solutions [9]. These advancements have fueled transformative progress in what types of geometries can be manufactured, how quickly they can be prototyped, and how much data can be mined to continuously improve the efficiency and profitability of manufacturing [10]. This emphasis on data monitoring and internet of things (IoT) has opened up new possibilities for “smart factories” using advanced, distributed, and automated data monitoring techniques [11,12].

These advancements in digitally driven design and manufacturing [13], although massively important, have led the design community into a false sense of security. Technology and the development of the digital thread are increasingly linking engineering design, engineering analysis, and manufacturing into interconnected processes. Thinking of these areas as separate, siloed fields limits the potential for high performance in all three. While technologies like computer-aided manufacturing (CAM) software can perform useful and impressive tasks, they are limited in their capability by the ability of software developers to translate complex expert manufacturing knowledge into automated tools.

Recognizing the challenges of manually designing algorithms for increasingly complex engineering processes, many have turned to AI, and particularly machine learning (ML), as a potential future of advancing engineering design software [1420]. ML has shown great success for text, image, sensor, and video analysis [2125]. Perhaps the two most exciting attributes of ML are its ability to reuse the same algorithms to solve a wide variety of problems and to automatically train these software algorithms to solve a problem [26,27]. These benefits, combined with recent advances in parallel processing hardware, mobile computing, and cloud-based computing, have led to a surge in ML research across industries [2831].

The generality of ML makes it easy to begin considering how large datasets might be useful for many potential problems that are adjacent to those in other fields. Examples may be found in a variety of problem types of varying levels of complexity. For instance, 3D object recognition [3236] is a natural extension of 2D image recognition [37,38]. Additionally, segmentation of image areas [37,39] can be similarly approached as the segmentation 3D volumes [4044], in such applications as identifying critical features or estimated defect zones [4550]. Even video can be seen as a specific case of time-series analysis [51], which is particularly relevant to manufacturing processes with transient heat flow and material deposition or removal phenomena [5257]. These time-series phenomena are a topic of particular interest in the rapidly maturing area of smart factories [11,12,58,59], in which sensor data are streamed to analytical and dashboard systems in real-time [6062]. Analogous time series could also be analyzed at the design stage [63]. Rather than harvesting sensor data from a physical machine to monitor activities in a factory, simulation data could be harvested and automatically analyzed at a larger scale to monitor and optimize an engineering team before manufacturing is even attempted.

As exciting as the advancements in ML are the prospect of applying ML to engineering design and manufacturing also reflects a false sense of security in the industry. ML and AI may finally be emerging from the “trough of disillusionment” in some industries [64]. However, the application of ML to engineering design fields is far from trivial, which may decrease business risk tolerance. One reason other fields may be more rapidly innovating ML technologies is that nonengineering data are often more common and relatable to a wider community. For instance, the internet is teeming with 2D graphics, images, text, and video which are consumed daily by billions of people. Contrastingly, 3D CAD models are only familiar to and interacted with perhaps a few hundred thousand individuals on a daily basis [65]. If advanced simulation technology data (such as data derived from finite element analysis (FEA), topology optimization, and implicit modeling) are taken into account, the number of existing examples and experts able to interpret them shrinks even further. Additionally, ML in “manufacturing” and “engineering design,” although linked through the digital thread and overall engineered product lifecycle, are often themselves markedly different in goals, difficulty, and implementation, adding to this complexity.

The consequence of general data and expert scarcity [66] has ripple effects in the field of engineering design and manufacturing AI. In addition to the obvious challenge of smaller datasets being more challenging to work with for ML, a deeper data quality issue is present as well. Whereas individuals in the general population can produce relatively accurate labels [6769] for something like 2D images or text, producing equivalently accurate labels for complex engineering design data may be challenging, time-consuming, or impossible for all but the most experienced engineering specialists [3,70,71]. Consider the case of trying to label an arbitrary 3D CAD model with the “best manufacturing method” to build it [72]. Such a question is a multi-objective optimization problem that may be highly susceptible to human bias, orientation-dependent, or require extensive physical and/or economic analysis. Answering such fundamental questions are very challenging without the context of the original design and function of the part. The labor required to create robust and useful datasets may actually prove prohibitive to medium and large-scale adoption of ML in industry.

For the near-term, engineering design software will largely continue to depend on the time-tested traditional modeling and analysis techniques that have transformed the manufacturing sector for the last decades. In order for the benefit from data-driven approaches like ML to be realized, the academic and industrial engineering community must work together to prepare for and support long-term innovation by strategically adjusting how engineering-design-practicing institutions operate on an ongoing basis. We propose design for artificial intelligence (DfAI) as a strategy for addressing these objectives. DfAI is a set of goals, principles, and heuristics that aim to improve the effectiveness, adoption, and innovation of engineering design and manufacturing AI. DfAI is not a rigid, fully mature construct, due to the rapidly evolving nature of AI; rather it is an evolving set of additional user requirements that strive to enhance how we architect design repositories, design engineered products, and conduct engineering software development. Like other design for X (DfX) principles, such as design for manufacturing (DfM), DfAI aims to improve design by explicitly focusing on specific goals and practices associated with the activities related to AI development. However, DfAI is differentiated from many DfX principles because it must have a broader impact on the long-term development of design-process-enhancing software, rather than being restricted to only the shorter-term impact of manufacturing a particular product. Creating useful engineering design or manufacturing AI based on learnings from past engineering design and manufacturing data requires guiding principles to address this breadth.

2 Short-Term Excellence Versus Long-Term View, A Challenge for the Future of Design

Engineering is ultimately economically and product-driven meaning that the unit of work for engineers is relatively short-term. The role of design and manufacturing engineers requires them to manage the creation, troubleshooting, continuous improvement, and sales of manufactured goods. From a software standpoint, CAD, CAM, Product Lifecycle Management (PLM), Product Data Management (PDM), Enterprise Resource Management (ERP), Material Requirements Planning (MRP), and other technologies have grown to support digitized end-to-end design and manufacturing.

Although beneficial for business, focusing solely on improvements and optimization of the products being designed and manufactured today could stifle the transformative potential of AI technologies. For an optimized business, driven by its bottom-line, discerning appropriate budget and allocation of resources for long-term research and development is certainly challenging. Thus, a great dilemma presents itself: How can institutions become motivated to make serious investments in engineering and design AI when they must still accomplish their challenging day-to-day missions? We propose that this immense challenge to advancing DfAI can be addressed through three foci (see Fig. 1).

Fig. 1
The three, overall foci that are driven by the adoption of DfAI principles
Fig. 1
The three, overall foci that are driven by the adoption of DfAI principles
Close modal

The three foci are (a) raising AI literacy in industry, (b) redesigning engineering systems to better integrate with AI, and (c) enhancing the engineering AI development process. These three foci are intentionally broad to help facilitate an inclusive, encompassing conversation. To address them practically, we propose the adoption and continuous improvement of DfAI as a guiding principle of engineering design and manufacturing. Each of these foci is explored in more detail in the following sections.

2.1 Raising Industrial Artificial Intelligence Literacy.

The first focus is to raise industrial literacy of the realities of AI for design and manufacturing. Simply defining AI, let alone developing it, can be a challenging task, and a greater understanding of the landscape of AI’s present and future could go a long way. Specifically, raising AI-literacy could be achieved by increasing the synergy between (a) academic and industrial engineering design and manufacturing experts and (b) engineering AI researchers and those of adjacent fields.

More collaborative projects between academic labs and industry could help make scientific studies more applicable to the real world. Major compromises are needed from both sides to make this easier-said-than-done goal a reality. Companies must be willing to invest in labor to contribute to these projects as well as intellectual property, which is often a barrier to increasing community knowledge. More strategic distinction of what can and cannot be shared by a company, although more expensive to determine than a completely defensive, conservative IP strategy, could end up paying off in the long run by helping create new community-driven technologies that could later enhance that organization’s capabilities. Academic labs also must compromise to better fit industrial needs. Some improvements could be made by increasing the scale and timeline of research projects, perhaps by combining the resources of labs or planning projects that transcend the normal schedules of the academic cycle. Increasing scale in this way could help alleviate the resource imbalance that often comes with relatively large companies and relatively low-staffed academic labs.

Increasing synergy between engineering AI researchers and those in adjacent fields, such as medical and general data science, could have numerous benefits. The demand for specialization in higher education creates powerful expertise in niche topics but might run the risk of losing sight of the larger community. One of the most powerful benefits of deep learning is its ability to be reused for many different problems, sometimes with only slight modifications. We must stop viewing advancements in individual fields as existing in their own spheres of influence. From a practical standpoint, this means providing greater support for interdisciplinary work and increasing industrial networks beyond their specific manufacturing or service sector.

2.2 Redesigning Engineering Systems to Meet Artificial Intelligence Growth Demands.

The second DfAI focus is to redesign the systems that power design and manufacturing to enable next-generation hierarchical data scalability and transformability. Hierarchical data scalability is the capacity to manage exponentially more design, simulation, and quality control data. As an example, imagine creating a quality control digital thread for a manufacturing company that measures their parts for simple length accuracy at key dimensions. Such measurements are simple numbers and binary pass/fail values, easily stored in a typical database. Achieving hierarchical data scalability would mean going above and beyond the current need of storing those quality control results by preparing for the development of future, more advanced data, such as a full 3D volumetric scan of each part that is suitable as input to a quality control AI construct. Failure to prepare for that possibility while the system is being developed might hinder the progress of implementing such an AI construct in the future, perhaps by years, due to the investment now required to completely redesign the system.

Like scalability, hierarchical data transformability also strives to prepare for an AI-driven future. It is the ability to efficiently operate on that data, transforming it through a series of automated operations. While the example of preparing for scalability relates closely to the use and adoption of specific AI, transformability addresses the need to develop that AI. Obtaining, cleaning, and validating data can be a substantial portion of the labor and cost of even attempting to create such technologies. Reducing the burden of these challenging, often miserable tasks, can only be done by compiling and understanding that data at the outset. Ensuring data is machine-readable, as accurate as possible, labeled with all possible knowledge, and populated with standardized, descriptive metadata could help motivate the development of AI by reducing the up-front investment to produce proof-of-concept and prototype technologies. Although some standards exist, digitally driven manufacturing is far from being fully standardized in practice. There exists a diverse landscape of file formats and institutionally specific knowledge. Thus, a combination of improved standards around engineering and design data management and organizational data storage enhancements are necessary to support hierarchical data transformability.

2.3 Enhancing the Artificial Intelligence Development Process.

The third focus is to improve the rate of adoption of design engineering and manufacturing AI by enhancing the techniques, tools, and expertise of the community developing that AI. Like manufacturing data management, this area could also stand to adopt greater standardization. However, standardization alone is not enough and may be misguided if attempted too early. Thus, the education of both generalist and specialist experts in the engineering and manufacturing AI space should be enhanced through specialized curricula, research programs, and knowledge-sharing venues that specifically advance this subfield of engineering and manufacturing.

Many general-purpose AI development tools are becoming increasingly accessible and performant. For instance, tools like TensorFlow [73] and scikit-learn [74] have decreased the barrier for entry to apply ML/AI to new problems. However, developing tools is only part of the solution. The specific ways in which the community approach problems, prioritize resources, build teams, and shares results are also important. Furthermore, understanding how to succeed in complex, team-driven design projects like AI development is not always trivial [75]. Achieving success in this third focus includes both developing enhanced community and institutional practices around AI-centric projects and enhancing existing engineering tools, such as CAD applications and PLM software, to integrate well with new ML and AI development and deployment platforms.

3. DfAI Principles and Applications

We propose several interconnected DfAI principles, with the acknowledgment that they are initial principles that should evolve with and be expanded by the engineering AI community in the future (see Fig. 2).

Fig. 2
Proposed DfAI principles
Fig. 2
Proposed DfAI principles
Close modal

The proposed principles primarily relate to the data surrounding engineering design and additional steps that improve that data for use in ML and AI development. The first DfAI principle, digitization, means striving to capture all engineering design data in a digital format and store that data in a reliable place. At some organizations, improving digitization could mean actions as simple as scanning paper drawings or replacing paper lab notebooks with software. At others, it could mean better capturing verbal, sketched, and whiteboard design collaboration. The next DfAI principle, data linkage integrity, relates to ensuring the many interconnected files and data points related to products are digitally linked. Ideally, all aspects of a project are hierarchically linked in some way and appropriately scalable. Examples of ensuring data are hierarchical could mean ensuring different parts of an assembly are related to each, different products are related to business initiatives, or different versions of designs are related to each other and their relative performances in reference to user requirements and specifications. This DfAI principle is closely related to the next, machine readability. Ensuring data linkage is more closely related to the abstract concept of linking different parts of the digital thread together, whereas ensuring machine readability relates more to an organization’s future ability to automatically slice and analyze those data. Another DfAI principle, metadata quality, could improve machine readability. By ensuring high-quality descriptive attributes accompany design data, programs that intend to consume that data are easier and less time-consuming to create. We propose data valuation as a DfAI principle. This principle relates less to practical engineering design activities and more toward fostering long-term motivation for engineering AI development. By improving the understanding of data value, both direct value and value toward future AI R&D opportunities, the return on investment (ROI) of infrastructure changes to support AI may be justified. Finally, the principles that define DfAI should evolve over time, expanding and redefining alongside changes to engineering design, manufacturing, and AI technology.

DfAI takes advantage of the extensible nature of the DfX family by applying the same meta-process of developing goals and heuristics as other DfX strategies. Unlike many other DfX strategies, the area of improvement is broader in DfAI. In typical DfX techniques, such as design for manufacturing (DfM), the area of application relevant to DfM is the design and manufacture of particular products. While DfAI also applies to the design and manufacture of particular products as a relevant area of improvement, it should also be applied to broader aspects of the engineering design process at a product portfolio, institutional practice, and design community levels. The areas to which DfAI, which are interdependent and not listed in priority order, is applied include (see Fig. 3):

  1. The design, manufacture, and testing of physical products and assemblies (“Products”)

  2. The design and use of design repositories and the digital threads which support them (“Design Repositories”)

  3. The design, manufacture, and use of manufacturing operational procedures, machines, lines, factories, and supply chains (“Practices & Infrastructure”)

  4. The design, development process, and use of analytical and artificially intelligent tools affect the cyber-physical manufacturing process (“AI Development”)

Fig. 3
Broad application areas that could benefit from DfAI principles
Fig. 3
Broad application areas that could benefit from DfAI principles
Close modal

3.1 Conceptual Case Study for Applying DfAI Principles.

Design and manufacture of engineered products do not occur in a vacuum, but rather in a complicated, financially driven landscape of industry. To help illustrate the motivation for applying DfAI principles to areas related to manufacturing, consider a hypothetical case study of a new company inventing small electric aircraft to be manufactured at a large scale for the shipping industry. At the outset of creating the company, proving technology through research and development, developing the business through market research and sales, and preparing to scale up operations through raising capital and preparing to build factories and hire works are expensive and risky activities. Relatively short-term factors such as speed-to-market and rapidly reaching profitability may eclipse all other needs. Suppose the company could take two general paths: path (a), a manual, data-devoid future, and path (b) a highly automatable and data-rich future. In path (a), the company pursues only the minimum viable product, does not spend excess resources on data collection, and does not consider how they may develop the end-to-end supply and manufacturing chain to be automatable in the future. In path (b), the company invests in an extensive data collection, validation, storage, and retrieval system to capture data through the lifecycle of design, manufacturing, and logistics into the future and creates dedicated roles to build, maintain, and link those systems to the growing organization. Path (a) is most likely to be less-cost-intensive during up-front development and requires fewer technical individuals. Now imagine 10 years later, and the company’s competitors begin introducing extensive data-driven design and manufacturing artificial intelligence that reduce their operating cost below the company’s capabilities. The difference in cost for path (a) versus path (b) companies to develop technology as-needed that competes after the companies are entrenched and mature may be staggering, perhaps threatening their feasibility.

3.2 Applying DfAI to Product Development.

We contend that DfAI principles can be applied to product development to improve the design, manufacture, and testing of physical products and assemblies in the long term. To consider how, one must envision the entire lifecycle of an engineered product from ideation to retirement and how each step is interconnected. Two examples of contemporary areas of development are manufacturing machine optimization and design process enhancement. Manufacturing machine optimization often involves intelligently determining machine settings, build orientations, and toolpath control strategies that will most cost-effectively manufacture the highest quality part. Design process enhancement typically involves automatically suggesting either big-picture heuristics, such as which manufacturing process is best suited for a design or other, smaller-scale tasks such as automatically generating a physical form that meets the design project’s problem statement or simulating and predicting the performance of a given form.

Although both of these engineering AI examples strive to better meet the ultimate goal of creating a product that addresses the user requirements and specifications of a problem within constraints, they do so at different stages of the design and manufacturing process. While early generation AI efforts may be able to address these stages individually with self-contained AI modules, later-generation, paradigm-shifting innovations likely require cohesive interconnection between all stages. For instance, optimizing a machine is often great for making incremental improvements for producing a single design, but won’t provide much insight in how to achieve step-change improvements with entirely new designs [76]. At the other end, design AI could help envision better products to meet user requirements in a theoretical sense, but might fail to account for the rapid advancements in the physical manufacturing and material science spaces. Harmony between these two areas, and the other areas of the design process, are necessary.

3.3 Applying DfAI to Design Repositories.

The designers of a new product should consider the entire cyber-physical pathway for a design both at the outset of the project and in parallel to each step. The cyber-physical pathway includes all of the digital and physical outputs of the design and manufacturing process. It is vital for engineers and product managers to understand it. However, practices of individuals are only part of the solution, and they must direct their data and knowledge to the second area of DfAI application: the design repository (see Fig. 4). A design repository is any dataset that contains information regarding multiple product designs. Design conceptual, product description, material composition, and quality control information should be generated, made machine-readable, linked to other data through traceability, stored in a design repository, and curated into metadata descriptions of that design repository. Practical implementations that achieve high-quality design repositories will vary depending on the nature of the organization and the volume of its data. Some example guidelines could include well-documented and fully automatable APIs for data entry and retrieval, budgeting for human data validation, budgeting for the development of automated data validation, and research and development budget and pipeline for continuous improvements to existing and new data acquisition and validation systems. Additionally, the creation of dedicated roles that may focus on management and execution of technical design repository issues could increase the capability of organizations to enhance them over time, rather than relying on fitting such responsibilities within nonspecialized personnel’s busy schedules.

Fig. 4
Data from each stage of the design process should be considered for DfAI principles before being added to a design repository
Fig. 4
Data from each stage of the design process should be considered for DfAI principles before being added to a design repository
Close modal

Producing multiple forms of linked, machine-readable data allows those developers to rapidly produce labeled datasets for supervised learning or validation tasks. To actually achieve worthwhile results from these activities, organizations must invest in both specialized individuals to oversee these activities and training for all contributing individuals to uphold this goal at each smaller task. Additionally, business stakeholders in these opportunities must be convinced of their value through ROI calculations that estimate the potential benefits of being able to more inexpensively develop future AI or even to sell the higher quality data outright. Although the specific ways in which data quality and continuity are achieved are highly dependent on the particular industry, manufacturing processes, and products being considered, the general, initial DfAI heuristic is simple: the entire cyber-physical pathway of each engineered product should be understood, and gaps in data quality and continuity should be documented. After that heuristic is complete, follow-up DfAI heuristics should be applied to consider the ROIs of investing in enhanced data management techniques at each stage of the product design and manufacturing process, prioritize those potential changes, and then execute them in priority order.

3.4 Applying DfAI to Institutional Practice and Infrastructure.

In addition to the design of physically engineered products, DfAI principles should also be applied to the practices, tools, and infrastructure that support the design and manufacturing overall. Human-in-the-loop AI can help operators and technicians with manual or semi-automatic manufacturing tasks. Thus, data surrounding the manufacturing tasks and the procedures that dictate them should be well-understood and then considered for DfAI-related issues. Similarly, the tools and machinery should also be considered for DfAI, ideally trending toward more complete and automated data-gathering through the adoption of IoT technologies. Furthermore, the largest scales of manufacturing infrastructure, factories, shipping, supply chain, distribution, and inventory, could also benefit from AI orchestration. How easily and effectively the data produced by these systems could be used for AI development should also be considered.

3.5 Applying DfAI to Artificial Intelligence Development Processes.

Finally, DfAI principles should also be applied to the development of analytical tools and broader AI constructs that seek to improve the engineering design and manufacturing process. Generally, making improvements in this area means standardizing and enhancing the design process for AI. The industry must shift by treating the AI development process more like an engineered product design process by adopting DfAI principles, similarly to how other DfX techniques seek to streamline design in other ways.

Specifically, this DfAI application could be achieved in several ways. First, the user requirements and specifications of engineering design and manufacturing AI should be clearly understood. Essentially, “market research” into the gaps and challenges in a specific engineering design process should be clearly quantified and considered when determining whether an AI development process should be done and how it should be approached. Second, enhanced standardized techniques for describing the inputs, outputs, algorithms, and performance of AI tools should be developed and applied. The minimal documentation required by academic journals and existing business practices will not be sufficient to achieve compounding progress in the modern software landscape, which is rife with enormous and poorly documented data and software artifacts. Third, the design repositories used for the development, training, and evaluation of AI tools should be completely documented and disseminated when possible. This means sharing much more than just CAD files, but also hierarchically complex, high-dimensional labels, such as simulation results. Today, replicating or improving upon an engineering design deep learning study often means manually producing ones’ own dataset. This laborious task must be improved through major collaboration efforts in the community and the development of next-generation design repository and interaction tools to support them. Finally, the results of the AI development process should be documented and fed back into the systems and tools associated with the other areas of DfAI application. We should not settle for simply using AI to enhance our current processes, but should use our growing knowledge to make those processes better suited for AI itself.

4 A Conceptual Breakdown of Personas in Design for Artificial Intelligence

Achieving long-term, future-state DfAI success requires the establishment of effective workflows both between and within specific business roles under the guidance of a supportive institution. Here, we refer to those business roles as personas. The three major personas of the DfAI process are (a) the engineering designers, (b) the design repository curator, and (c) the AI developer (see Fig. 5). Although some of these personas may be clearly identifiable roles at some institutions in the present day, others may be less clearly defined, less common, or entirely absent. Thus, we call for action to provide improved educational opportunities for individuals who may need to take on these roles.

Fig. 5
Personas in the DfAI process and their communication and interaction relationships with each other and their central institution
Fig. 5
Personas in the DfAI process and their communication and interaction relationships with each other and their central institution
Close modal

The first persona participating in DfAI principles, engineering designers, are likely the most intuitive personas involved in DfAI (see Fig. 6). Generally, an engineering designer could include any worker responsible for the development of user requirements and specifications necessary for manufacturing a new product. This role could be a single person with a generalized skillset or be collectively fulfilled by a large team of specialists, depending on the size of the organization and the complexity of the specific manufacturing task. Although engineering designers are not the only personnel involved with product design and manufacture, they are specifically identified as key stakeholders in the DfAI personas since the conception of a product at the design stage is the beginning of its technical lifecycle. From this perspective, engineering designers are not at the end of the DfAI-principle application, but rather at the beginning. Ideally, they should have a high degree of communication with and cascade DfAI-related responsibilities to peripheral or downstream personnel that are key to the manufacturing process, such as manufacturing engineers, quality engineers, process engineers, industrial engineers technologists, manufacturing operators, factory managers, planners, and technicians. The precise roles and number of personnel in each of these adjacent engineering and manufacturing roles are organization-dependent, and standardization of such roles may be a beneficial topic of future work.

Fig. 6
The engineering designer persona in terms of typical roles and actions that comprise key participation activities in applications replated to DfAI that may benefit from DfAI principles
Fig. 6
The engineering designer persona in terms of typical roles and actions that comprise key participation activities in applications replated to DfAI that may benefit from DfAI principles
Close modal

Engineering designers play many important roles in the broader DfAI. Some may be more obvious than others. For instance, engineering designers are the end-user of design AI applications. This role as the user situates them as an internal or external customer of design AI products. Even if effective design AI products are eventually produced and launched, their widespread use will depend on meeting the customer technical and user experience needs, which will be complex, varied, and continuously evolving with the ever-changing manufacturing technology landscape.

In line with this end-user role, engineering designers are the DfAI problem statement originators. This means that engineering designers must be able to clearly document, communicate, and justify the problems which are the highest priority to solve. AI developers may not understand the engineering problems as well as the actual designers completing day-to-day work.

Additionally, engineering designers are the originators of the engineering data which may benefit data-driven AI development. These data could take many forms, including product concepts, CAD files, quotes, test data, simulation data, prototype documentation, and countless other portions of the digital thread. Ensuring that engineering designers are trained, motivated, and supported to spend portions of their limited working time on documenting these data in a standardized and high-quality way is essential to the DfAI process. Generally, improving in this area means spending more time developing and executing procedures for engineering tasks and incrementally automating design tasks that are tedious or would otherwise cause the information to be lost.

The next DfAI persona, the design repository curator, is more abstract and perhaps less traditional than the engineering designer (see Fig. 7). Contemporary institutions are likely lacking a specialized individual or team responsible for maintaining design repositories that are intentionally designed for use as AI training datasets [13]. Broadly, the design repository curator is responsible for creating, maintaining, and extracting all data related to engineering design activities. Some near analogs exist. For instance, a database maintainer or system administrator resembles this role in terms of the technical data skillset required to generally interact with data. However, a design repository curator is differentiated from a generic database maintainer in that they must have greater engineering design and manufacturing knowledge to deliver design engineers with data management tools that will meet the current engineering design workflow demands and be extensible to future, AI-driven workflow demands [20]. Complete separation of data management and engineering design skillets creates a prohibitive wall to innovation and increases the expense of developing new systems.

Fig. 7
The design repository curator persona in terms of typical roles and actions that comprise key participation activities in applications replated to DfAI that may benefit from DfAI principles
Fig. 7
The design repository curator persona in terms of typical roles and actions that comprise key participation activities in applications replated to DfAI that may benefit from DfAI principles
Close modal

The design repository curator cannot operate effectively without the creation of infrastructure that supports convenient access to the data originators, the engineering designers. Today, many institutions are skilled at creating design repositories that are effective for non-AI development purposes. For example, quality systems at regulated industries, such as medical or aerospace companies, are typically highly effective at storing data to meet the minimum legal requirements for those products. Creating effective infrastructure from a DfAI lens, however, means continuing to fulfill the existing needs and priorities of a business or organization while adding in DfAI requirements for that infrastructure early in design repository creation. From a practical standpoint, doing so could mean ensuring that data storage mechanisms store data in a convertible format, preserve machine readability at scale, maintain links between potential training data and labels, and are efficiently processable and sliceable as batches.

The final DfAI persona, the AI developer, ties the other personas together (see Fig. 8). The AI developer must obtain data from the design repositories and use that data to create design-processing-enhancing AI software constructs.

Fig. 8
The design AI developer persona in terms of typical roles and actions that comprise key participation activities in applications replated to DfAI that may benefit from DfAI principles
Fig. 8
The design AI developer persona in terms of typical roles and actions that comprise key participation activities in applications replated to DfAI that may benefit from DfAI principles
Close modal

AI developers must be able to ideate, develop, market, and continuously improve AI software products that help design engineers. To do this, they must have interdisciplinary skills. These skills should overlap the fields of design and manufacturing engineering, computer science, data science, and AI development to some degree. This heterogeneity of knowledge would design AI developers both recognize areas in the engineering design space that work well and should not be substantially altered and also gaps in which transformative improvements may be made. The specific algorithms and technologies used to create design AI are the tools of the design AI developer and will vary depending on the application, resources, and development of future technology. The likelihood that numerous specific algorithms will be invented, become outdated, and be enhanced over time necessitates a combination of and a strong collaboration between generalist and specialist design AI developers.

In addition to understanding the problems and potential solutions in the design AI space, design AI developers must also interact skillfully and efficiently with design repositories and their curators [7779]. Doing so successfully means retaining a broad knowledge of both engineering design data that currently exists in non-AI-enhanced engineering workflows and that which might exist under a more advanced, AI-driven workflow. For example, consider the transition from paper engineering drawing-driven design to CAD-model-driven design [80]. This major shift in design technology produces exponential more machine-readable data, such as the 3D models themselves and simulation results. Future shifts will add even more data to the AI developer’s toolkit, perhaps including automatically harvested data on the human user interface usage behavior that could be used to detect the designers’ skill level and provide tailored feedback. Design AI developers being able to adapt and preempt future shifts in technology will help drive both the creation of that technology and the synergy with other personas, such as design repository curators that may need to store new forms of data.

Design AI developers also have a responsibility to a relatively new and growing community. Currently, the publication systems for presenting advancements in design AI rely on relatively old technology and lack standardization. Ideally, design AI developers will prioritize contribution to the standardization of terminology, methodology, results reporting, and quality of design AI. Further developing and publishing heuristics related to DfAI is an essential part of this process. In order to make faster progress as a community, design AI researchers must find ways to efficiently transfer knowledge through heuristics that are shared, extensible, and may be iteratively developed through collaborative and interdisciplinary research.

Finally, although not a single persona, the administration, management, and organization of the institutions and infrastructure under which the other personas work is also vitally important. Organizations are very capable of achieving ambitious and transformative goals when they are motivated to do so. This motivation is easier said than done. A portion of DfAI principles relates to building this motivation for business stakeholders, managers, departments, and institution administrators to fund and support advanced design repositories and design AI development projects. We propose that ideating and testing enhanced measures of return on investment of maintaining advanced design engineering data be increased. Understanding the timescales and benefits of applying DfAI principles economically will help them improve and proliferate. Creating design AI is not a short-term project, but rather a long-term collection of complex and interconnected projects and activities that extend well beyond the roles of most individuals or teams. DfAI should help clarify which efforts are likely to pay off in the long run.

5 Closing Remarks

DfAI stands to improve many areas of the holistic end-to-end design and manufacturing process, with stakeholders ranging from institutions who set procedures, designers who adhere to them, and future innovators who seek to use their learnings for the development of AI. To achieve optimal success in the challenging areas of data-driven design and AI development, design AI developers and design repository curators must not be an afterthought in the core operation of design and engineering institutions. A new specialty in DfAI must be grown with opportunities for the education of individuals, careers, and the growth of dedicated teams.

Like many fields, engineering design and manufacturing engineering are strongly geared toward short-term goals: launching the next project, getting the next grant, and publishing the next paper. Increasingly generalized manufacturing methods are enabling the manufacturing of increasingly optimized artifacts. Unless we augment our design engineers with a next-generation of CAD/CAM software based on more generalized AI and ML, our ability to design novel and useful artifacts will fall short of the potential of those new manufacturing techniques. The community must invest intellectual resources by advancing and applying the general principles of DfAI in the design repositories, design activities, and engineering software development activities that are conducted to efficiently and cost-effectively achieve the opportunities envisioned for AI-driven design.

Acknowledgment

This material is based upon work supported by the National Science Foundation under Grant No. CMMI-1825535. Any opinions, findings, conclusions, or recommendations expressed in this paper are those of the authors and do not necessarily reflect the views of the sponsors.

Conflict of Interest

There are no conflicts of interest.

Data Availability Statement

No data, models, or code were generated or used for this paper.

References

1.
Salzman
,
H.
,
1989
, “
Computer-Aided Design: Limitations in Automating Design and Drafting
,”
IEEE Trans. Eng. Manage.
,
36
(
4
), pp.
252
261
.
2.
Laxon
,
W. R.
,
1977
, “
Selecting and Evaluating CAD Systems
,”
Comput. Des.
,
9
(
4
), pp.
233
237
.
3.
Koch
,
S.
,
Matveev
,
A.
,
Jiang
,
Z.
,
Williams
,
F.
,
Artemov
,
A.
,
Burnaev
,
E.
,
Alexa
,
M.
,
Zorin
,
D.
, and
Panozzo
,
D.
,
2019
, “
ABC: A Big Cad Model Dataset for Geometric Deep Learning
,”
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
,
Long Beach, CA
,
June 16–20
, pp.
9593
9603
.
4.
Chang
,
A. X.
,
Funkhouser
,
T.
,
Guibas
,
L.
,
Hanrahan
,
P.
,
Huang
,
Q.
,
Li
,
Z.
,
Savarese
,
S.
, et al
,
2015
, “
ShapeNet: An Information-Rich 3D Model Repository
,” arXiv preprint arXiv:1512.03012.
5.
Zhirong Wu
,
S.
,
Khosla
,
S.
,
Fisher Yu
,
A.
,
Zhang
,
L.
,
Tang
,
X.
, and
Xiao
,
J.
,
2015
, “
3D ShapeNets: A Deep Representation for Volumetric Shapes
,”
2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
,
Boston, MA
,
June 7–12
, IEEE, pp.
1912
1920
.
6.
Fitzgerald
,
K.
,
1987
, “
Compressing the Design Cycle: CAD and CAE Are Crucial Competitive Tools, But Honing Them to Maximum Effectiveness Is Slow Work
,”
IEEE Spectr.
,
24
(
10
), pp.
39
42
.
7.
Halverson
,
E. R.
, and
Sheridan
,
K. M.
,
2014
, “
The Maker Movement in Education
,”
Harv. Educ. Rev.
,
84
(
4
), pp.
495
504
.
8.
Xiao
,
W.
,
Zheng
,
L.
,
Huan
,
J.
, and
Lei
,
P.
,
2015
, “
A Complete CAD/CAM/CNC Solution for STEP-Compliant Manufacturing
,”
Rob. Comput. Integr. Manuf.
,
31
(
1
), pp.
1
10
.
9.
Xu
,
X. W.
, and
He
,
Q.
,
2004
, “
Striving for a Total Integration of CAD, CAPP, CAM and CNC
,”
Rob. Comput. Integr. Manuf.
,
20
(
2
), pp.
101
109
.
10.
Mourtzis
,
D.
,
Fotia
,
S.
,
Boli
,
N.
, and
Vlachou
,
E.
,
2019
, “
Modelling and Quantification of Industry 4.0 Manufacturing Complexity Based on Information Theory: A Robotics Case Study
,”
Int. J. Prod. Res.
,
57
(
22
), pp.
6908
6921
.
11.
Chen
,
B.
,
Wan
,
J.
,
Shu
,
L.
,
Li
,
P.
,
Mukherjee
,
M.
, and
Yin
,
B.
,
2017
, “
Smart Factory of Industry 4.0: Key Technologies, Application Case, and Challenges
,”
IEEE Access
,
6
, pp.
6505
6519
.
12.
Osterrieder
,
P.
,
Budde
,
L.
, and
Friedli
,
T.
,
2020
, “
The Smart Factory As a Key Construct of Industry 4.0: A Systematic Literature Review
,”
Int. J. Prod. Econ.
,
221
, p.
107476
.
13.
Allison
,
J. T.
,
Cardin
,
M. A.
,
McComb
,
C.
,
Ren
,
M. Y.
,
Selva
,
D.
,
Tucker
,
C.
,
Witherell
,
P.
, and
Zhao
,
Y. F.
,
2022
, “
Special Issue: Artificial Intelligence and Engineering Design
,”
ASME J. Mech. Des.
,
144
(
2
), p.
020301
.
14.
Chan
,
S. L.
,
Lu
,
Y.
, and
Wang
,
Y.
,
2018
, “
Data-Driven Cost Estimation for Additive Manufacturing in Cybermanufacturing
,”
J. Manuf. Syst.
,
46
, pp.
115
126
.
15.
Razvi
,
S. S.
,
Feng
,
S.
,
Narayanan
,
A.
,
Lee
,
Y.-T. T.
, and
Witherell
,
P.
,
2019
, “
A Review of Machine Learning Applications in Additive Manufacturing
,”
39th Computers and Information in Engineering Conference Vol. 1.
,
Anaheim, CA
,
Aug. 18–21
.
16.
Heiden
,
B.
,
Alieksieiev
,
V.
,
Volk
,
M.
, and
Tonino-Heiden
,
B.
,
2021
, “
Framing Artificial Intelligence (AI) Additive Manufacturing (AM)
,”
Procedia Comput. Sci.
,
186
, pp.
387
394
.
17.
Jiang
,
J.
,
Xiong
,
Y.
,
Zhang
,
Z.
, and
Rosen
,
D. W.
,
2022
, “
Machine Learning Integrated Design for Additive Manufacturing
,”
J. Intell. Manuf.
,
33
(
4
), pp.
1073
1086
.
18.
Moosavi
,
S. M.
,
Jablonka
,
K. M.
, and
Smit
,
B.
,
2020
, “
The Role of Machine Learning in the Understanding and Design of Materials
,”
J. Am. Chem. Soc.
,
142
(
48
), pp.
20273
20287
.
19.
Fuge
,
M.
,
Peters
,
B.
, and
Agogino
,
A.
,
2014
, “
Machine Learning Algorithms for Recommending Design Methods
,”
ASME J. Mech. Des.
,
136
(
10
), p.
101103
.
20.
Wang
,
P.
,
Peng
,
D.
,
Li
,
L.
,
Chen
,
L.
,
Wu
,
C.
,
Wang
,
X.
,
Childs
,
P.
, and
Guo
,
Y.
,
2019
, “
Human-in-the-Loop Design With Machine Learning
,”
Proc. Des. Soc. Int. Conf. Eng. Des.
,
1
(
1
), pp.
2577
2586
.
21.
Deng
,
J.
,
Dong
,
W.
,
Socher
,
R.
,
Li
,
L.-J.
,
Li
,
K.
, and
Fei-Fei
,
L.
,
2010
, “
ImageNet: A Large-Scale Hierarchical Image Database
,”
2009 IEEE Conference on Computer Vision and Pattern Recognition
,
Miami, FL
,
June 20–25
, IEEE, pp.
248
255
.
22.
Amidi
,
A.
,
Amidi
,
S.
,
Vlachakis
,
D.
,
Megalooikonomou
,
V.
,
Paragios
,
N.
, and
Zacharaki
,
E. I.
,
2018
, “
EnzyNet: Enzyme Classification Using 3D Convolutional Neural Networks on Spatial Representation
,”
PeerJ
,
6
, p.
e4750
.
23.
Cho
,
J.
,
Lee
,
K.
,
Shin
,
E.
,
Choy
,
G.
, and
Do
,
S.
,
2015
, “
How Much Data Is Needed to Train a Medical Image Deep Learning System to Achieve Necessary High Accuracy?
arXiv
,
1
. https://arxiv.org/abs/1511.06348
24.
Kotsiantis
,
S. B.
,
Zaharakis
,
I.D.
, and
Pintelas
,
P.E.
,
2006
, “
Machine Learning: a Review of Classification and Combining Techniques
,”
Artif Intell Rev
,
26
, pp.
159
190
.
25.
Pan
,
S. J.
, and
Yang
,
Q.
,
2010
, “
A Survey on Transfer Learning
,”
IEEE Trans. Knowl. Data Eng.
,
22
(
10
), pp.
1345
1359
.
26.
Schmidhuber
,
J.
,
2015
, “
Deep Learning in Neural Networks: An Overview
,”
Neural Networks
,
61
, pp.
85
117
.
27.
Jain
,
A. K.
,
Mao
,
J.
, and
Mohiuddin
,
K. M.
,
1996
, “
Artificial Neural Networks: A Tutorial
,”
Computer
,
29
(
3
), pp.
31
44
.
28.
Lee
,
C.
, and
Lim
,
C.
,
2021
, “
From Technological Development to Social Advance: A Review of Industry 4.0 Through Machine Learning
,”
Technol. Forecast. Soc. Change
,
167
, p.
120653
.
29.
Ansari
,
F.
,
Erol
,
S.
, and
Sihn
,
W.
,
2018
, “
Rethinking Human-Machine Learning in Industry 4.0: How Does the Paradigm Shift Treat the Role of Human Learning?
Procedia Manuf.
,
23
, pp.
117
122
.
30.
Angelopoulos
,
A.
,
Michailidis
,
E. T.
,
Nomikos
,
N.
,
Trakadas
,
P.
,
Hatziefremidis
,
A.
,
Voliotis
,
S.
, and
Zahariadis
,
T.
,
2020
, “
Tackling Faults in the Industry 4.0 Era—A Survey of Machine-Learning Solutions and Key Aspects
,”
Sensors
,
20
(
1
), pp.
1
34
.
31.
Brik
,
B.
,
Bettayeb
,
B.
,
Sahnoun
,
M.
, and
Duval
,
F.
,
2019
, “
Towards Predicting System Disruption in Industry 4.0: Machine Learning-Based Approach
,”
Procedia Comput. Sci.
,
151
, pp.
667
674
.
32.
Qi
,
C. R.
,
Su
,
H.
,
Mo
,
K.
, and
Guibas
,
L. J.
,
2017
, “
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
,”
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
, pp.
652
660
.
33.
Muzahid
,
A. A. M.
,
Wan
,
W.
,
Sohel
,
F.
,
Khan
,
N. U.
,
Villagomez
,
O. D. C.
, and
Ullah
,
H.
,
2020
, “
3D Object Classification Using a Volumetric Deep Neural Network: An Efficient Octree Guided Auxiliary Learning Approach
,”
IEEE Access
,
XX
(
3
), pp.
1
1
.
34.
Sedaghat
,
N.
,
Zolfaghari
,
M.
,
Amiri
,
E.
, and
Brox
,
T.
,
2016
, “
Orientation-Boosted Voxel Nets for 3D Object Recognition
,”
arXiv
,
1
, pp.
1
18
. https://arxiv.org/abs/1604.03351
35.
Ahmed
,
J.
,
Vesal
,
S.
,
Durlak
,
F.
,
Kaergel
,
R.
,
Ravikumar
,
N.
,
Rémy-Jardin
,
M.
, and
Maier
,
A.
,
2020
, “
COPD Classification in CT Images Using a 3D Convolutional Neural Network
,”
Bildverarbeitung für die Medizin
,
1
, pp.
39
45
.
36.
Assfalg
,
J.
,
Borgwardt
,
K. M.
, and
Kriegel
,
H.-P.
,
2006
, “
3DString: A Feature String Kernel for 3D Object Classification on Voxelized Data
,”
Proceedings of the 15th ACM International Conference on Information and Knowledge Management
,
Arlington, VA
,
Nov. 11
, pp.
198
207
.
37.
Pal
,
N. R.
, and
Pal
,
S. K.
,
1993
, “
A Review on Image Segmentation Techniques
,”
Pattern Recognit.
,
26
(
9
), pp.
1277
1294
.
38.
Egmont-Petersen
,
M.
,
de Ridder
,
D.
, and
Handels
,
H.
,
2002
, “
Image Processing With Neural Networks—A Review
,”
Pattern Recognit.
,
35
(
10
), pp.
2279
2301
.
39.
Xie
,
W.
,
Noble
,
J. A.
, and
Zisserman
,
A.
,
2018
, “
Microscopy Cell Counting and Detection With Fully Convolutional Regression Networks
,”
Comput. Methods Biomech. Biomed. Eng. Imaging Vis.
,
6
(
3
), pp.
283
292
.
40.
Vosselman
,
G.
,
Gorte
,
B. G. H.
,
Sithole
,
G.
, and
Rabbani
,
T.
,
2004
, “
Recognising Structure in Laser Scanner Point Clouds
,”
Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci.
,
46
(
8
), pp.
33
38
.
41.
Aldoj
,
N.
,
Lukas
,
S.
,
Dewey
,
M.
, and
Penzkofer
,
T.
,
2020
, “
Semi-automatic Classification of Prostate Cancer on Multi-parametric MR Imaging Using a Multi-channel 3D Convolutional Neural Network
,”
Eur. Radiol.
,
30
(
2
), pp.
1243
1253
.
42.
Bae
,
H. J.
,
Hyun
,
H.
,
Byeon
,
Y.
,
Shin
,
K.
,
Cho
,
Y.
,
Song
,
Y. J.
,
Yi
,
S.
,
Kuh
,
S. U.
,
Yeom
,
J. S.
, and
Kim
,
N.
,
2020
, “
Fully Automated 3D Segmentation and Separation of Multiple Cervical Vertebrae in CT Images Using a 2D Convolutional Neural Network
,”
Comput. Methods Programs Biomed.
,
184
, p.
184
.
43.
Kleesiek
,
J.
,
Urban
,
G.
,
Hubert
,
A.
,
Schwarz
,
D.
,
Maier-Hein
,
K.
,
Bendszus
,
M.
, and
Biller
,
A.
,
2016
, “
Deep MRI Brain Extraction: A 3D Convolutional Neural Network for Skull Stripping
,”
Neuroimage
,
129
, pp.
460
469
.
44.
Guay
,
M.
,
Emam
,
Z.
,
Anderson
,
A.
, and
Aronova
,
M.
,
2021
, “
Dense cellular segmentation for EM using 2D–3D neural network ensembles
,”
Scientific Reports
,
11
.
45.
Du Plessis
,
A.
,
Le Roux
,
S. G.
,
Els
,
J.
,
Booysen
,
G.
, and
Blaine
,
D. C.
,
2015
, “
Application of MicroCT to the Non-destructive Testing of an Additive Manufactured Titanium Component
,”
Case Stud. Nondestruct. Test. Eval.
,
4
, pp.
1
7
.
46.
Everton
,
S. K.
,
Hirsch
,
M.
,
Stavroulakis
,
P. I.
,
Leach
,
R. K.
, and
Clare
,
A. T.
,
2016
, “
Review of In-Situ Process Monitoring and In-Situ Metrology for Metal Additive Manufacturing
,”
Mater. Des.
,
95
, pp.
431
445
.
47.
Yang
,
J.
,
Chen
,
Y.
,
Huang
,
W.
, and
Li
,
Y.
,
2017
, “
Survey on Artificial Intelligence for Additive Manufacturing
,”
ICAC 2017—2017 23rd IEEE International Conference on Autonomic Computing Addressing Global Challenges Through Automation and Computing
,
Columbus, OH
,
July 17–21
, pp.
7
8
.
48.
Cui
,
W.
,
Zhang
,
Y.
,
Zhang
,
X.
,
Li
,
L.
, and
Liou
,
F.
,
2020
, “
Metal Additive Manufacturing Parts Inspection Using Convolutional Neural Network
,”
Appl. Sci.
,
10
(
2
), p.
545
.
49.
Rao
,
P. K.
,
Liu
,
J.
,
Roberson
,
D.
,
Kong
,
Z.
, and
Williams
,
C.
,
2015
, “
Online Real-Time Quality Monitoring in Additive Manufacturing Processes Using Heterogeneous Sensors
,”
ASME J. Manuf. Sci. Eng.
,
137
(
6
), p.
061007
.
50.
Rao
,
P. K.
, and
Roberson
,
D.
,
2016
, “
Sensor-Based Online Process Fault Detection in Additive Manufacturing
,”
International Manufacturing Science and Engineering Conference
,
Blacksburg, VA
,
June 27–July 1
, pp.
1
13
.
51.
Prakash
,
A.
,
Mahan
,
S. K.
,
Williams
,
T.
,
McComb
,
G.
,
Menold
,
C.
,
and Tucker
,
J.
, and
S
,
C.
,
2020
, “
Detection of System Compromise in Additive Manufacturing Using Video Motion Magnification
,”
ASME J. Mech. Des.
,
142
(
3
), p.
031109
.
52.
Pierce
,
J.
,
Williams
,
G.
,
Simpson
,
T.
,
Meisel
,
N.
, and
McComb
,
C.
,
2021
, “
Stochastically-Trained Physics-Informed Neural Networks: Application to Thermal Analysis in Metal Laser Powder Bed Fusion
,”
International Design Engineering Technical Conferences.
,
Online, Virtual
,
Aug. 17–19
.
53.
Shamsaei
,
N.
,
Yadollahi
,
A.
,
Bian
,
L.
, and
Thompson
,
S. M.
,
2015
, “
An Overview of Direct Laser Deposition for Additive Manufacturing; Part II: Mechanical Behavior, Process Parameter Optimization and Control
,”
Addit. Manuf.
,
8
, pp.
12
35
.
54.
Ding
,
D.
,
Pan
,
Z.
,
Cuiuri
,
D.
, and
Li
,
H.
,
2015
, “
Wire-Feed Additive Manufacturing of Metal Components: Technologies, Developments and Future Interests
,”
Int. J. Adv. Manuf. Technol.
,
81
(
1–4
), pp.
465
481
.
55.
Zhang
,
P. F.
,
Churi
,
N. J.
,
Pei
,
Z. J.
, and
Treadwell
,
C.
,
2008
, “
Mechanical Drilling Processes for Titanium Alloys: A Literature Review
,”
Mach. Sci. Technol.
,
12
(
4
), pp.
417
444
.
56.
Che
,
D.
,
Saxena
,
I.
,
Han
,
P.
,
Guo
,
P.
, and
Ehmann
,
K. F.
,
2014
, “
Machining of Carbon Fiber Reinforced Plastics/Polymers: A Literature Review
,”
ASME J. Manuf. Sci. Eng.
,
136
(
3
), p.
034001
.
57.
Chatham
,
C. A.
,
Long
,
T. E.
, and
Williams
,
C. B.
,
2019
, “
A Review of the Process Physics and Material Screening Methods for Polymer Powder Bed Fusion Additive Manufacturing
,”
Prog. Polym. Sci.
,
93
, pp.
68
95
.
58.
Wang
,
S.
,
Wan
,
J.
,
Li
,
D.
, and
Zhang
,
C.
,
2016
, “
Implementing Smart Factory of Industrie 4.0: An Outlook
,”
Int. J. Distrib. Sens. Netw.
,
12
(
1
), p.
3159805
.
59.
Shi
,
Z.
,
Xie
,
Y.
,
Xue
,
W.
,
Chen
,
Y.
,
Fu
,
L.
, and
Xu
,
X.
,
2020
, “
Smart Factory in Industry 4.0
,”
Syst. Res. Behav. Sci.
,
37
(
4
), pp.
607
617
.
60.
Park
,
S. T.
,
Li
,
G.
, and
Hong
,
J. C.
,
2020
, “
A Study on Smart Factory-Based Ambient Intelligence Context-Aware Intrusion Detection System Using Machine Learning
,”
J. Ambient Intell. Humaniz. Comput.
,
11
(
4
), pp.
1405
1412
.
61.
Shiue
,
Y. R.
,
Lee
,
K. C.
, and
Su
,
C. T.
,
2018
, “
Real-Time Scheduling for a Smart Factory Using a Reinforcement Learning Approach
,”
Comput. Ind. Eng.
,
125
(
101
), pp.
604
614
.
62.
Horick
,
C.
,
2020
, “
Industry 4.0 Production Networks: Cyber–Physical System-Based Smart Factories, Real-Time Big Data Analytics, and Sustainable Product Lifecycle Management
,”
J. Self-Governance Manage. Econ.
,
8
(
1
), pp.
107
113
.
63.
Tribelsky
,
E.
, and
Sacks
,
R.
,
2010
, “
Measuring Information Flow in the Detailed Design of Construction Projects
,”
Res. Eng. Des.
,
21
(
3
), pp.
189
206
.
64.
Van Lente
,
H.
,
Spitters
,
C.
, and
Peine
,
A.
,
2013
, “
Comparing Technological Hype Cycles: Towards a Theory
,”
Technol. Forecast. Soc. Change
,
80
(
8
), pp.
1615
1628
.
65.
Torpay
,
E.
,
2022
, “
Engineers: Employment, Pay, and Outlook
,” U.S. Bureau of Labor Statistics.
66.
Coff
,
R. W.
,
Coff
,
D. C.
, and
Eastvold
,
R.
,
2006
, “
The Knowledge-Leveraging Paradox: How to Achieve Scale Without Making Knowledge Imitable
,”
Acad. Manag. Rev.
,
31
(
2
), pp.
452
465
.
67.
Wazny
,
K.
,
2017
, “
‘Crowdsourcing’ Ten Years in: A Review
,”
J. Glob. Health
,
7
(
2
), pp.
1
13
.
68.
Xintong
,
G.
,
Hongzhi
,
W.
,
Song
,
Y.
, and
Hong
,
G.
,
2014
, “
Brief Survey of Crowdsourcing for Data Mining
,”
Expert Syst. Appl.
,
41
(
17
), pp.
7987
7994
.
69.
Chai
,
C.
,
Fan
,
J.
,
Li
,
G.
,
Wang
,
J.
, and
Zheng
,
Y.
,
2019
, “
Crowdsourcing Database Systems: Overview and Challenges
,”
IEEE 35th International Conference on Data Engineering
,
April
, pp.
2052
2055
.
70.
Valerdi
,
R.
, and
Davidz
,
H. L.
,
2009
, “
Empirical Research in Systems Engineering: Challenges and Opportunities of a New Frontier
,”
Syst. Eng.
,
12
(
2
), pp.
169
181
.
71.
Wu
,
X.
,
Chen
,
H.
,
Wu
,
G.
,
Liu
,
J.
,
Zheng
,
Q.
,
He
,
X.
,
Zhou
,
A.
, et al
,
2015
, “
Knowledge Engineering With Big Data
,”
IEEE Intell. Syst.
,
30
(
5
), pp.
46
55
.
72.
Pereira
,
T.
,
Kennedy
,
J. V.
, and
Potgieter
,
J.
,
2019
, “
A Comparison of Traditional Manufacturing Vs Additive Manufacturing, the Best Method for the Job
,”
Procedia Manuf.
,
30
, pp.
11
18
.
73.
Abadi
,
M.
,
Paul
,
B.
,
Chen
,
J.
,
Chen
,
Z.
,
Davis
,
A.
,
Dean
,
J.
,
Devin
,
M.
, et al
,
2016
, “
TensorFlow: A System for Large-Scale Machine Learning
,”
12th USENIX Symposium on Operating. Systems Design and Implementation (OSDI ‘16)
,
Savannah, GA
,
Nov. 2–4
, pp.
265
283
.
74.
Pedregosa
,
F.
,
Varoquaux
,
G.
,
Gramfort
,
A.
,
Michel
,
V.
,
Thirion
,
B.
,
Grisel
,
O.
,
Blondel
,
M.
, et al
,
2011
, “
Scikit-Learn: Machine Learning in Python
,”
J. Mach. Learn. Res.
,
12
, pp.
2825
2830
.
75.
Maier
,
T.
,
DeFranco
,
J.
, and
Mccomb
,
C.
,
2019
, “
An Analysis of Design Process and Performance in Distributed Data Science Teams
,”
Team Perform. Manage. An Int. J.
,
25
(
7/8
), pp.
419
439
.
76.
Valle
,
S.
, and
Vázquez-Bustelo
,
D.
,
2009
, “
Concurrent Engineering Performance: Incremental Versus Radical Innovation
,”
Int. J. Prod. Econ.
,
119
(
1
), pp.
136
148
.
77.
Bohm
,
M. R.
, and
Stone
,
R. B.
,
2004
, “
Product Design Support: Exploring a Design Repository System
,”
ASME International Mechanical Engineering Congress and Exposition
,
Anaheim, CA
,
Nov. 13–19
, pp.
55
65
.
78.
Bespalov
,
D.
,
Ip
,
C. Y.
,
Regli
,
W. C.
, and
Shaffer
,
J.
,
2005
, “
Benchmarking CAD Search Techniques
,”
Proceedings of the 2005 ACM Symposium on Solid and Physical Modeling
,
Cambridge, MA
,
June 13–15
, Vol. 1, No. 212, pp.
275
286
.
79.
Bohm
,
M. R.
,
Vucovich
,
J. P.
, and
Stone
,
R. B.
,
2008
, “
Using a Design Repository to Drive Concept Generation
,”
ASME J. Comput. Inf. Sci. Eng.
,
8
(
1
), p.
014502
.
80.
Robertson
,
B. F.
, and
Radcliffe
,
D. F.
,
2009
, “
Impact of CAD Tools on Creative Problem Solving in Engineering Design
,”
CAD Comput. Aided Des.
,
41
(
3
), pp.
136
146
.