Artificial Neural Networks
Artificial neural networks are by now the most widely used approach for black box modeling of various technical, chemical and biological systems. The advantages of neural networks are essentially its complex nonlinear behavior. Complex processes can be reproduced in their input/output behavior arbitrarily accurately without detailed knowledge of the prevailing physical relationships and situations. Further advantages are its ability to adapt to any input / output data, its fault tolerance and the processing of inaccurate or contradictory information.
Artificial Neural Networks
Artificial neural networks are by now the most widely used approach for black box modeling of various technical, chemical and biological systems. The advantages of neural networks are essentially its complex nonlinear behavior. Complex processes can be reproduced in their input/output behavior arbitrarily accurately without detailed knowledge of the prevailing physical relationships and situations. Further advantages are its ability to adapt to any input / output data, its fault tolerance and the processing of inaccurate or contradictory information.
Structure of Neural Networks
The architecture of a neural network is inspired by the structure of the biological nervous system. In contrast to traditional technical systems with a powerful central processing unit a neural network is composed of a complex linkage of a large number of simple processing units, the so-called neurons. Neural networks differ in terms of the transmission behavior of a neuron or network node (the so-called activation function), as well as the arrangement and linking of the various network nodes. The most common neural networks for function approximation are the multi-layer Perzeptron (MLP) and the radial basis functions network (RBF). Both are strictly forward networks, that means the flow of information is arranged through the layers of the network from the inputs to the outputs without processing any information of following or the same layer. As activation functions, different approaches are used, see table.
Typically these are for the RBF networks radialsymmetric functions with a single extremum and monotonous sloping outer flanks. Often Gaussian functions are used as activation functions for RBF networks, which are then overlaid for representing the corresponding target function. The most important parameters are the location of the nodes, the validity radius and the weights of the transitions between the layers, which are optimized in the training of the network such that the function is approximated as well as possible.
An MLP network consists of an input, one or more hidden and an output layer. That means, the input values are distributed by the input layer to the hidden layer, processed there and hand over to the following layer parties. The output layer combines the values of the last hidden layer and processes them to the outputs of the network. The activation function in the neurons is often linear in the input and output layer, while the functions of the hidden layers may vary. Often, these are hyperbolic tangent functions. The neurons of the individual layers are fully linked. There is just forward linkages (feed forward net). There are no layers skipped.

- Activation functions of MLP (above) and RBF networks (below)
Structure of Neural Networks
The architecture of a neural network is inspired by the structure of the biological nervous system. In contrast to traditional technical systems with a powerful central processing unit a neural network is composed of a complex linkage of a large number of simple processing units, the so-called neurons. Neural networks differ in terms of the transmission behavior of a neuron or network node (the so-called activation function), as well as the arrangement and linking of the various network nodes. The most common neural networks for function approximation are the multi-layer Perzeptron (MLP) and the radial basis functions network (RBF). Both are strictly forward networks, that means the flow of information is arranged through the layers of the network from the inputs to the outputs without processing any information of following or the same layer. As activation functions, different approaches are used, see table.
Typically these are for the RBF networks radialsymmetric functions with a single extremum and monotonous sloping outer flanks. Often Gaussian functions are used as activation functions for RBF networks, which are then overlaid for representing the corresponding target function. The most important parameters are the location of the nodes, the validity radius and the weights of the transitions between the layers, which are optimized in the training of the network such that the function is approximated as well as possible.
An MLP network consists of an input, one or more hidden and an output layer. That means, the input values are distributed by the input layer to the hidden layer, processed there and hand over to the following layer parties. The output layer combines the values of the last hidden layer and processes them to the outputs of the network. The activation function in the neurons is often linear in the input and output layer, while the functions of the hidden layers may vary. Often, these are hyperbolic tangent functions. The neurons of the individual layers are fully linked. There is just forward linkages (feed forward net). There are no layers skipped.

- Activation functions of MLP (above) and RBF networks (below)
Neural Networks at IRT
The modelling and identification with the aid of artificial neural networks was used successfully at IRT as part of the process control of the laser beam welding. For this purpose, an MLP network was implemented, which additionally is extended by analytical process knowledge linked.
The identified process model served as a basis for a Model based Predictive Controller.

- Process model of the laser beam welding with integrated analytical part model M
Neural Networks at IRT
The modelling and identification with the aid of artificial neural networks was used successfully at IRT as part of the process control of the laser beam welding. For this purpose, an MLP network was implemented, which additionally is extended by analytical process knowledge linked.
The identified process model served as a basis for a Model based Predictive Controller.

- Process model of the laser beam welding with integrated analytical part model M
As part of the SFB 686 "Model based Control of the Low-Temperature Combustion" Neural networks are used. Especially the CAI combustion is modelled at first with a neural network, as long as physical models still are developed in the participating sub-projects. Here networks of the form NNSSIF are used. These have the advantage that they come along already with properties of a state space representation.
If this form of MLP network is linearized, it leads automatically to discrete time state space with feedback of the modeling error ε(t), see picture.
This feature can be used beneficially if this network is extended to an extended Kalman filter. This was implemented in the SFB 686 in conjunction with a nonlinear Model based Predivctive Controller.

- Neural Network StateSpace Innovations Form (NNSSIF)
As part of the SFB 686 "Model based Control of the Low-Temperature Combustion" Neural networks are used. Especially the CAI combustion is modelled at first with a neural network, as long as physical models still are developed in the participating sub-projects. Here networks of the form NNSSIF are used. These have the advantage that they come along already with properties of a state space representation.
If this form of MLP network is linearized, it leads automatically to discrete time state space with feedback of the modeling error ε(t), see picture.
This feature can be used beneficially if this network is extended to an extended Kalman filter. This was implemented in the SFB 686 in conjunction with a nonlinear Model based Predivctive Controller.

- Neural Network StateSpace Innovations Form (NNSSIF)
Literature
| [1] | Bollig, A.: Prädiktive Prozessregelung beim Schweißen mit Laserstrahlung, Fortschritt-Berichte VDI, Reihe 8, Nr. 1020, VDI-Verlag, Düsseldorf 2004 |
| [2] | Bollig, A.: Prädiktive Regelung mit Neuronalen Netzen. at - Automatisierungstechnik 51 (2003), Heft 2, S. 69-77, Oldenbourg Verlag |
| [3] | Bollig, A.; Rake, H.; Kratzsch, Ch.; Kaierle, S.: Application of Neuro-Predictive control to laser beam welding. 15th IFAC world congress, 21.-26.7.2002, Barcelona |
| [4] | Hoffmann, K.; Seebach, D.; Pischinger, S.; Abel, D.: Neural Networks for Controlling future low Temperature Combustion Technologies, 3rd IFAC Advanced Fuzzy and Neural Network Workshop, 29-30.10.2007, Proceedings, Valenciennes, France |
| [5] | Isermann, R.: Identifikation Dynamischer systeme, Band I+II. Springer-Verlag, Berlin, 1988 |
| [6] | Nelles, O.; Ernst, S.;Isermann, R.: Neuronale Netze zur Identifikation nichtlinearer dynamischer Systeme: Ein Überblick. at - Automatisierungstechnik 45 (1997), Heft 6, S. 251-262, Oldenbourg-Verlag |
Literature
| [1] | Bollig, A.: Prädiktive Prozessregelung beim Schweißen mit Laserstrahlung, Fortschritt-Berichte VDI, Reihe 8, Nr. 1020, VDI-Verlag, Düsseldorf 2004 |
| [2] | Bollig, A.: Prädiktive Regelung mit Neuronalen Netzen. at - Automatisierungstechnik 51 (2003), Heft 2, S. 69-77, Oldenbourg Verlag |
| [3] | Bollig, A.; Rake, H.; Kratzsch, Ch.; Kaierle, S.: Application of Neuro-Predictive control to laser beam welding. 15th IFAC world congress, 21.-26.7.2002, Barcelona |
| [4] | Hoffmann, K.; Seebach, D.; Pischinger, S.; Abel, D.: Neural Networks for Controlling future low Temperature Combustion Technologies, 3rd IFAC Advanced Fuzzy and Neural Network Workshop, 29-30.10.2007, Proceedings, Valenciennes, France |
| [5] | Isermann, R.: Identifikation Dynamischer systeme, Band I+II. Springer-Verlag, Berlin, 1988 |
| [6] | Nelles, O.; Ernst, S.;Isermann, R.: Neuronale Netze zur Identifikation nichtlinearer dynamischer Systeme: Ein Überblick. at - Automatisierungstechnik 45 (1997), Heft 6, S. 251-262, Oldenbourg-Verlag |


Webmaster des IRT
Nach Oben