Next: Computer Education Laboratory Up: Department of Computer Previous: Computer Communications Laboratory

Multimedia Devices Laboratory


/ Qiangfu Zhao / Professor
/ Yong Liu / Associate Professor
/ Jie Huang / Assistant Professor

The main stream in our lab is related to computational intelligence. The final goal is to design a system that can think, and decide what to do and how to grow-up based on its own thinking. For this purpose, many approaches have been studied --- e.g., neuro-computation and evolutionary computation. Of course, results proposed in conventional symbol based artificial intelligence are also included.

  1. Neuro-computation and evolutionary computation:

    The goal of this research is to develop a neural network model that is flexible enough to adapt changing environment, and also simple enough to be realized and used for practical applications. Of course, we cannot use a model if we do not study the learning algorithms corresponding to this model. Possible models include:

    As for learning, we have proposed the following algorithms:

    To verify and improve the models and learning algorithms proposed by us, we are also studying automatic design of decision rules and decision trees, pattern recognition, robot control, and data mining.

  2. Supporting Researches

    To apply our methods to pattern recognition and robot control, it is also necessary to get support from many other researches, such as signal and image processing, development of virtual environment, learning and evolution of agents living in it, and so on. Specifically, we are studying localization and recognition of sounds in natural environments, and trying to apply our result to automatic acquisition of robot control strategies.


Refereed Journal Papers

  1. Liu, Y. and Yao, X. and Higuchi, T., Evolutionary Ensembles with Negative Correlation Learning. IEEE Transactions on Evolutionary Computation, vol. 4, No. 4, pp. 380--387, 2000.

    This paper presents evolutionary ensembles with negative correlation learning (EENCL) to address the issues of automatic determination of the number of individual neural networks (NNs) in an ensemble and the exploitation of the interaction between individual NN design and combination. Experiments on two real-world problems demonstrate that EENCL can produce NN ensembles with good generalization ability.

  2. Liu, Y. and Higuchi, T. and Iwata, M., Design of Evolvable Hardware for Robotic Navigation. Wuhan University Journal of Natural Science, vol. 6, No. 1--2, pp. 547--554, 2001.

    In robot learning, many of papers are concerned with neural networks as controllers. In this paper, an evolvable hardware (EHW) is designed as a robot controller. EHW is based on the idea of combining reconfigurable hardware devices, such as programmable logic array (PLA) and field-programmable gate array (FPGA), with evolutionary algorithms to execute reconfiguration autonomously.

  3. Asai, Y. and Nakashima, H. and Yamamura, T. and Huang, J. and Ohnishi, N., Acquiring the Ability of Object Localization by Vision and Audition Through Motion. IEICE Trans. D-II, vol. J83-D-II, No. 7, pp. 1676--1684, 2000.

Refereed Proceeding Papers

  1. Zhao, Q. F., Hammami, O., Kuroda, K. and Saito, K., Cooperative co-evolutionary algorithm - how to evaluate a module? The first IEEE Symposium on Combinations of Evolutionary Computation and Neural Networks, pp. 150-157, IEEE, May 2000.

    When we talk about co-evolution, we often consider it as competitive co-evolution (CompCE). Examples include co-evolution of training data and neural networks, co-evolution of game players, and so on. Recently, several researchers have studied another kind of co-evolution --- cooperative co-evolution (CoopCE). While CompCE tries to get more competitive individuals through evolution, the goal of CoopCE is to find individuals from which better systems can be constructed. The basic idea of CoopCE is to {\bf divide-and-conquer}: divide a large system into many modules, evolve the modules separately, and then combine them together again to form the whole system. Depending on how to divide-and-conquer, different cooperative co-evolutionary algorithms (CoopCEAs) have been proposed in the literature. Results obtained so far strongly support the usefulness of CoopCEAs. To study the CoopCEAs systematically, we proposed a society model, which is a common framework of most existing CoopCEAs. From this model, we can see that there are still many open problems related to CoopCEAs. To make CoopCEAs generally useful, it is necessary to study and solve these problems. In this paper, we focus the discussion on evaluation of the modules - which is one of the key point in using CoopCEAs. To be concrete, we will apply the model to evolutionary learning of RBF-neural networks, and show the effectiveness of different evaluation methods through experiments.

  2. Tanigawa, T. and Zhao, Q. F., A study on efficient generation of decision trees using genetic programming. 2000 Genetic and Evolutionary Computation Conference, pp. 1047-1052, GP Society, Morgan Kaufmann Publishers, July 2000.

    For pattern recognition, the decision trees (DTs) are more efficient than neural networks (NNs) for two reasons. First, the computations in making decisions are simpler. Second, important features can be selected automatically during the design process. On the other hand, NNs are adaptable, and thus have the ability to learn in changing environment. Noting that there is a simple mapping from DT to NN, we can design a DT first, and then map it to an NN. By so doing, we can integrate the symbolic (DT) and the sub-symbolic (NN) approaches, and have advantages of both. For this purpose, we should design DTs which are as small as possible. In this paper, we continue our study on the evolutionary design of the decision trees based on genetic programming, and propose two new methods to reduce the tree sizes. The effectiveness of the new methods are tested through experiments with a character recognition problem.

  3. Oka, S. and Zhao, Q. F., Design of decision trees through integration of C4.5 and GP. The 4-th Japan-Australia Joint Workshop on Intelligent and Evolutionary Systems, pp. 122-127, National Defence Academy, Japan. Oct. 2000.

    C4.5 is one of the tools for designing decision trees (DTs) from training examples. In most cases, C4.5 can generate near optimal DTs when the training data are given all together. However, if the training data are given incrementally, C4.5 cannot be used. In this case, genetic programming (GP) might be a better choice. Actually, GP can be considered as a DT-breeder in which good DTs can be generated automatically through evolution. In GP based DT design, the training examples can be given all together or incrementally, provided that the fitness of the tree is properly defined. This of course does NOT mean that the GP based approach is BETTER than C4.5 because DTs obtained by GP are usually very large and complex. In this paper, we try to integrate C4.5 and GP in such a way that each individual is initialized by C4.5 using part of the training examples. By so doing, we can have relatively good DTs from the very beginning, and use them while waiting for better DTs to emerge. To show the effectiveness of this kind of integration, we conducted some experiments with a digit recognition problem. Experimental results show that smaller DTs with higher recognition rates can always be obtained through integration of C4.5 and GP. However, as the evolution continues, DTs obtained by GP (with random initialization) tend to have almost the same recognition ability as those obtained by C4.5+GP.

  4. Endou, T. and Zhao, Q. F., Some consideration for improving the efficiency of GA based concept learning. The 4-th Japan-Australia Joint Workshop on Intelligent and Evolutionary Systems, pp. 209-214, National Defence Academy, Japan. Oct. 2001.

    GABIL is a genetic algorithm (GA) based concept learner. It is a batch (off-line) learner because all training data are given all together. However, it is not exactly the traditional batch learner because the training data are provided to GA incrementally. In GABIL, the same data set is used both for training and test. When the number of training data is large, GABIL would be more efficient than traditional batch learner in the sense that a good rule set could be obtained in a more stable way. GABIL can also be easily extended to on-line learning. In this paper, we point out some problems in using GABIL, and then propose some solutions to these problems. Experimental results show that the improved GABIL is much better than the original one for multi-class and unbalanced concept learning.

  5. Zhao, Q. F., Modeling and evolutionary learning of modular neural networks. The 6-th International Symposium on Artificial Life and Robotics, pp. 508-511, AROB, Jan. 2000.

    In the last decade, a number of neural network models have been proposed in the literature. Some of them have been successfully incorporated in different intelligent information processing systems. Among these models, a group of most successful ones are the modular neural networks (MNNs). This paper introduces a general model of MNNs, and proposes a neural network tree (NNTree) model. An evolutionary algorithm is also given for designing the NNTrees. The usefulness of the NNTrees and the effectiveness of the learning algorithm are verified through experiments with a digit recognition problem.

  6. Liu, Y. and Iwata, M. and Higuchi, T. and Keymeulen, D., An integrated on-line learning system for evolving programmable logic array controllers. Parallel Problem Solving from Nature -- PPSN VI: Proc. of the Sixth International Conference on Parallel Problem Solving from Nature, Lecture Notes in Computer Science, Vol. 1917, pp. 589--598, Springer-Verlag, Berlin, 2000.

    This paper presents an integrated on-line learning system to evolve programmable logic array controllers for navigating an autonomous robot in a two-dimensional environment. The integrated on-line learning system consists of two learning modules: one is the module of reinforcement learning based on temporal-difference learning methods, and the other is the module of evolutionary learning based on genetic algorithms. The control rules extracted from the module of reinforcement learning can be used as input to the module of evolutionary learning, and quickly implemented by the PLA through on-line evolution.

  7. Liu, Y. and Yao, X. and Higuchi, T., Designing Neural Network Ensembles by Minimizing Mutual Information. Proceedings of the 2001 International Conference on Computational Intelligence for Modelling, Control and Automation (CIMCA'2001), July 2001.

    This paper presents a new ensemble learning with minimization of mutual information (ELMMI) for designing neural network ensembles. By minimizing the mutual information between variables extracted by two neural networks, they are forced to convey different information about some features of their input.

  8. Liu, Y. and Yao, X. and Higuchi, T., Ensemble Learning by Minimizing Mutual Information. Proceedings of the second International Conference on Software Engineering, Artificial Intelligence, Networking & Parallel/Distributed Computing (SNPD'01), August 2001.

    This paper has analyzed negative correlation learning in terms of mutual information on a regression task in the different noise conditions. Unlike independent training which creates larger mutual information among the ensemble, negative correlation learning can produce smaller mutual information among the ensemble.

  9. Liu, Y. and Yao, X., Evolving Neural Networks for Chlorophyll-a Prediction. Proceedings of the 4th International Conference on Computational Intelligence and Multimedia Applications, IEEE Computer Society Press, October 2001.

    This paper studies the application of evolutionary artificial neural networks to chlorophyll-a prediction in Lake Kasumigaura. Our experimental results have shown that evolved artificial neural networks are very compact and generalize well. Accurate prediction of chlorophyll-a and other blue-green algae is very useful in protecting the fresh-water environment.

  10. Iwata, M. and Kajitani, I. and Liu, Y. and Kajihara, N. and Higuchi, T., Implementation of a Gate-level Evolvable Hardware Chip. Proceedings of the 4th International Conference on Evolvable Systems: From Biology To Hardware, Springer-Verlag, October 2001.

    In this paper, we describe how to design a gate-level evolvable hardware chip. The chip consists of genetic algorithm hardware, reconfigurable hardware logic, and the control logic. With this chip, we have successfully executed genetic learning and hardware reconfiguration. The paper describes the architecture, functions, and a performance evaluation of the chip. We show that its learning speed is considerably faster than with software.

  11. Huang, J., Spatial Sound Processing for a Hearing Robot. Proc. Int. Conf. Information Society in the 21st Century: Emerging Technologies and New Challenges in Information Society, Aizu-Wakamatsu, IS2000, pp. 281--287, Nov. 2000.

Chapters in Books

  1. Yao, X. and Liu, Y., From Evolving a Single Neural Networks to Evolving Neural Network Ensembles. Advances in the Evolutionary Synthesis of Intelligent Agents, pp. 383--427, The MIT Press, 2001.

    Evolutionary artificial neural networks (EANNs) refer to a special class of artificial neural networks (ANNs) in which evolution is another fundamental form for adaptation and learning. This chapter describes an evolutionary programming-based EANNs which learn both their weights and architectures simultaneously using a hybrid algorithm. We have tested our evolutionary programming-based EANNs on a wide range of problems, including parity problems of various size, the two-spiral problem, four different medical diagnosis problems, the Australian credit card problem, and a couple of time-series prediction problems. Very good results have been achieved.

Academic Activities

  1. Yong Liu., ICES'01 Organising Committee. 2001.

    Program co-chair of the program committee of the 4th International Conference on Evolvable Systems: From Biology To Hardware, October, 2001 in Tokyo.

  2. Jie Huang., Organizing Committee Member of IS2000, 2000.

Others

  1. Taichirou Endou., Graduation Thesis: Some consideration for improving the efficiency of GA based concept learning. Univ. of Aizu, 2000, Thesis Advisor: Q. F. Zhao.

  2. Shinichi Oka., Graduation Thesis: Design of decision trees through integration of C4.5 and GA. Univ. of Aizu, 2000, Thesis Advisor: Q. F. Zhao.

  3. Yuuki Takemura., Graduation Thesis: The simulation of robot with two wheels. Univ. of Aizu, 2000, Thesis Advisor: Q. F. Zhao.

  4. Masamitsu Ikarashi., Graduation Thesis: Co-evolution of competition robots in virtual space. Univ. of Aizu, 2000, Thesis Advisor: Q. F. Zhao.

  5. Keisuke Ura., Graduation Thesis: A study on robust evolution of robots. Univ. of Aizu, 2000, Thesis Advisor: Q. F. Zhao.

  6. Tsuyoshi Ito., Graduate School Thesis: Parallel implementation of genetic algorithms and its application to neural network design. Graduate School, Univ. of Aizu, 2000, Thesis Advisor: Q. F. Zhao.

  7. Fumihito Matsuno., Graduate School Thesis: A study on finite automaton based character recognition. Graduate School, Univ. of Aizu, 2000, Thesis Advisor: Q. F. Zhao.

  8. Takayuki Yanagiya., Graduate School Thesis: Parallel implementation of co-evolutionary algorithms and its application to generation of cellular automata. Graduate School, Univ. of Aizu, 2000, Thesis Advisor: Q. F. Zhao.

  9. Toyoda, Y., Graduation Thesis: Environmental Sound Recognition by Time-delay Neural Network. Univ. of Aizu, 2000, Thesis Advisor: Jie Huang.

  10. Nishihashi, M., Graduation Thesis: HTRF Measurement and Analysis for a Sphere Microphone Head. Univ. of Aizu, 2000, Thesis Advisor: Jie Huang.

  11. Hanami, T., Graduation Thesis: Sound Integration and Segregation Based on Spatial Cues. Univ. of Aizu, 2000, Thesis Advisor: Jie Huang.

  12. Yoshida, K., Graduation Thesis: Interaction Between Different Primary Cues for Sound Integration and Segregation. Univ. of Aizu, 2000, Thesis Advisor: Jie Huang.

  13. Watanabe, S., Graduation Thesis: First-step Implementation for a Multi-navigation Mode Agent Robot. Univ. of Aizu, 2000, Thesis Advisor: Jie Huang.



Next: Computer Education Laboratory Up: Department of Computer Previous: Computer Communications Laboratory


www@u-aizu.ac.jp
July 2001