January 1995 Report No. STAN-CS-TR-95- 1542 John R. Koza and David Andre (2004)
David Andre, John R. Koza, Margaret Jacks Hall
this report describes our search for a practical option that provides computing power that is intermediate between that of workstations and supercomputers at a price (in terms of both money and...
Parallel Genetic Programming on a Network of Transputers (2004)
This paper describes the parallel implementation of genetic programming in the C programming language using a PC 486 type computer running Windows acting as a host and a network of transputers acting...
A Parallel Implementation Of (2004)
This paper describes the successful parallel implementation of genetic programming on a network of processing nodes using the transputer architecture. With this approach, researchers of genetic...
r ELSEVIER Robotics and Autonomous Systems 22 (1997) 151-158 (2003)
Illah R. Nourbakhsh, David Andre, Carlo Tomasi, Michael R. Genesereth
A critical challenge in the creation of autonomous mobile robots is the reliable detection of moving and static obstacles.In this paper, we present a passive vision system that recovers coarse depth...
John R. Koza, Forrest H Bennett Iii, David Andre, Martin A
The design (synthesis) of analog electrical circuits starts with a highlevel statement of the circuit's desired behavior and requires creating a circuit that satisfies the specified design goals....
Use of Architecture-Altering Operations to Dynamically (2003)
John R. Koza, Forrest H Bennett Iii, Jason Lohn, Frank Dunlap, Martin A. Keane, David Andre
The problem of source identification involves correctly classifying an incoming signal into a category that identifies the signal's source.
State Abstraction for Programmable Reinforcement Learning Agents (2002)
David Andre, Stuart J. Russell
Safe state abstraction in reinforcement learning allows an agent to ignore aspects of its current state that are irrelevant to its current decision, and therefore speeds up dynamic programming and...
Representations for Learning Control Policies (2002)
Representing the expected reward or cost for taking an action in a stochastic control problem, such as automated driving, is not trivial when the state and action spaces are continuous.
State Abstraction for Programmable Reinforcement Learning Agents (2002)
David Andre, Stuart J. Russell
Safe state abstraction in reinforcement learning allows an agent to ignore aspects of its current state that are irrelevant to its current decision, and therefore speeds up dynamic programming and...
Use of Architecture-Altering Operations to Dynamically (2002)
John R. Koza, Forrest H Bennett Iii, Jason Lohn, Frank Dunlap, Martin A. Keane, David Andre
The problem of source identification involves correctly classifying an incoming signal into a category that identifies the signal's source.
Staff Scheduling for Inbound Call Centers and Customer Contact Centers (2002)
Alex Fukunaga, Jason Fama, David Andre, Ofer Matan, Illah Nourbakhsh
The staff scheduling problem is a critical problem in the call center (or more generally, customer contact center) industry.
Staff Scheduling for Inbound Call Centers and Customer Contact Centers (2002)
Alex Fukunaga, Jason Fama, David Andre, Ofer Matan, Illah Nourbakhsh
The staff scheduling problem is a critical problem in the call center (or more generally, customer contact center) industry. This paper describes Director, a staff scheduling system for contact...
State Abstraction for Programmable Reinforcement Learning Agents (2001)
David Andre, Stuart J. Russell
Safe state abstraction in reinforcement learning allows an agent to ignore aspects of its current state that are irrelevant to its current decision, and therefore speeds up dynamic programming and...
Programmable Reinforcement Learning Agents (2001)
David Andre, Stuart J. Russell
We present an expressive agent design language for reinforcement learning that allows the user to constrain the policies considered by the learning process.The language includes standard features...
State Abstraction for Programmable Reinforcement Learning Agents (2001)
David Andre, Stuart J. Russell
Safe state abstraction in reinforcement learning allows an agent to ignore aspects of its current state that are irrelevant to its current decision, and therefore speeds up dynamic programming and...
Programmable Reinforcement Learning Agents (2001)
David Andre, Stuart J. Russell
We present an expressive agent design language for reinforcement learning that allows the user to constrain the policies considered by the learning process.The language includes standard features...
John R. Koza, Forrest H. Bennett Iii, David Andre, Martin A. Keane
This paper describes a biologically inspired domain-independent technique, called genetic programming, that automatically creates computer programs to solve problems. Starting with a primordial ooze...
Practical Reinforcement Learning in Continuous Domains (2000)
Many real-world domains have continuous features and actions, whereas the majority of results in the reinforcement learning community are for nite Markov decision processes. Much of the work that...
Real-Time Reinforcement Learning in Continuous Domains (2000)
this paper is the standard Markov Decision Process (MDP) setup for reinforcement learning (Kaelbling & Moore 1996). We assume that at each point in time the environment is in some state s. At each...
Programmable Reinforcement Learning Agents (2000)
David Andre, Stuart J. Russell
We present an expressive agent design language for reinforcement learning that allows the user to constrain the policies considered by the learning process by partially specifying a program for the...
Real-Time Reinforcement Learning in Continuous Domains (2000)
this paper is the standard Markov Decision Process (MDP) setup for reinforcement learning (Kaelbling & Moore 1996). We assume that at each point in time the environment is in some state s. At each...
Generalized Prioritized Sweeping (2000)
David Andre, Nir Friedman, Ronald Parr
Prioritized sweeping is a model-based reinforcement learning method that attempts to focus an agent's limited computational resources to achieve a good estimate of the value of environment states. To...
Evolving Team Darwin United (1999)
. The RoboCup simulator competition is one of the most challenging international proving grounds for contemporary AI research. Exactly because of the high level of complexity and a lack of reliable...
Darwinian Programming and Engineering Design Using Genetic Programming (1999)
Forrest H Bennett Iii, John R. Koza, Martin A. Keane, David Andre
One of the central challenges of computer science is to build a system that can automatically create computer programs that are competitive with those produced by humans. This paper presents a...
Forrest H Bennett Iii, John R. Koza, Martin A. Keane, David Andre
This paper describes a biologically inspired domain-independent technique, called genetic programming, that automatically creates computer programs to solve problems. We argue that the field of...
Model based Bayesian Exploration (1999)
Richard Dearden, Nir Friedman, David Andre
Reinforcement learning systems are often concerned with balancing exploration of untested actions against exploitation of actions that are known to be good. The benefit of exploration can be...
Model based Bayesian Exploration (1999)
Richard Dearden, Nir Friedman, David Andre
Reinforcement learning systems are often concerned with balancing exploration of untested actions against exploitation of actions that are known to be good. The benefit of exploration can be...
Model based Bayesian Exploration (1999)
Richard Dearden, Nir Friedman, David Andre
Reinforcement learning systems are often concerned with balancing exploration of untested actions against exploitation of actions that are known to be good. The benefit of exploration can be...
Model based Bayesian Exploration (1999)
Richard Dearden, Nir Friedman, David Andre
Reinforcement learning systems are often concerned with balancing exploration of untested actions against exploitation of actions that are known to be good. The benefit of exploration can be...
Generalized Prioritized Sweeping (1999)
David Andre, Nir Friedman, Ronald Parr
Prioritized sweeping is a model-based reinforcement learning method that attempts to focus an agent's limited computational resources to achieve a good estimate of the value of environment states. To...
Generalized Prioritized Sweeping (1999)
David Andre, Nir Friedman, Ronald Parr
Prioritized sweeping is a model-based reinforcement learning method that attempts to focus an agent's limited computational resources to achieve a good estimate of the value of environment states. To...
Practical Reinforcement Learning in Continuous Domains (1999)
this paper, we propose a practical architecture for model-based reinforcement learning in continuous state and action spaces that avoids the above difficulties by using an instance-based modeling...
: In the last few years, many researchers have begun to study how to introduce hierarchy into reinforcement learning methods. Generally, this work has pushed the envelope in one of several important...
John R. Koza, David Andre, Forrest H Bennett Iii, Martin A. Keane
: This paper demonstrates that a design for a low-distortion highgain 96 decibel (64,860-to-1) operational amplifier (including both circuit topology and component sizing) can be evolved using...
The goal of automatic programming is to create, in an automated way, a computer program that enables a computer to solve a problem. Ideally, an automatic programming system should require that the...
John R. Koza, Forrest H Bennett Iii, David Andre, Martin A. Keane
: This paper describes an automated process for designing analog electrical circuits based on the principles of natural selection, sexual recombination, and developmental biology. The design process...
Introduction Amenability to parallelization is an appealing feature of genetic algorithms, evolutionary programming, evolution strategies, classifier systems, and genetic programming [Holland 1975;...
Automated methods of machine learning may be useful in discovering biologically meaningful patterns that are hidden in the rapidly growing databases of genomic and protein sequences. However, almost...
Automated methods of machine learning may prove to be useful in discovering biologically meaningful information hidden in the rapidly growing databases of DNA sequences and protein sequences. Genetic...
Parallel Genetic Programming on a Network of Transputers (1998)
This paper describes the parallel implementation of genetic programming in the C programming language using a PC 486 type computer running Windows acting as a host and a network of transputers acting...
John R. Koza, Forrest H Bennett Iii, Jeffrey L. Hutchings, Stephen L. Bade, Martin A. Keane, David Andre
This paper describes how the massive parallelism of the rapidly reconfigurable Xilinx XC6216 FPGA (in conjunction with Virtual Computing Corporation's H.O.T. Works board) can be exploited to...
John R. Koza, Forrest H Bennett Iii, Jeffrey L. Hutchings, Stephen L. Bade, Martin A. Keane, David Andre
This paper describes ongoing work involving the use of the Xilinx XC6216 rapidly reconfigurable field-programmable gate array to evolve sorting networks using genetic programming. We successfully...
Automatic Discovery of Protein Motifs Using Genetic Programming (1998)
Automated methods of machine learning may prove to be useful in discovering biologically meaningful information hidden in the rapidly growing databases of DNA sequences and protein sequences. Genetic...
John R. Koza, Forrest H Bennett Iii, Jeffrey L. Hutchings, Stephen L. Bade, Martin A. Keane, David Andre
This paper describes how the massive parallelism of the rapidly reconfigurable Xilinx XC6216 FPGA (in conjunction with Virtual Computing's H.O.T. Works board) can be exploited to accelerate the...
Classifying Proteins as Extracellular using Programmatic Motifs and Genetic Programming (1998)
John R. Koza, Forrest H Bennett Iii, David Andre
As newly sequenced proteins are deposited into the world's ever-growing archive of protein sequences, they are typically immediately tested by various computerized algorithms for clues as to their...
John R. Koza, Forrest H Bennett Iii, David Andre
As newly sequenced proteins are deposited into the world's ever-growing archives, they are typically immediately tested by various algorithms for clues as to their biological structure and function....
Learning Hierarchical Behaviors (1998)
: In the last few years, many researchers have begun to study how to introduce hierarchy into reinforcement learning methods. Generally, this work has pushed the envelope in one of several important...
: Many of the various proposals for tomorrow's supercomputers have included clusters of multiprocessors as an essential component. However, when designing the systems of the future, it is important...
Learning and Upgrading Rules for an OCR System Using Genetic Programming (1998)
: Rule-based systems used for Optical Character Recognition (OCR) are notoriously difficult to write, maintain, and upgrade. This paper describes a method for using Genetic Programming (GP) to evolve...
Introduction and Overview The problem of determining which feature set to use has always been somewhat of a dilemma in the pattern recognition field. Not only must a feature set have features that...
For many problems to which genetic programming has been applied, choosing the number of fitness cases with which to evaluate the individuals is a crucial decision. If too few fitness cases are used,...
Generalized Prioritized Sweeping (1998)
David Andre, Nir Friedman, Ronald Parr
Prioritized sweeping is a model-based reinforcement learning method that attempt to focus the agent's limited computational resources to achieve a good estimate of the value of environment states....
Evolution of Mapmaking: Learning, planning, and memory using Genetic Programming (1998)
: An essential component of an intelligent agent is the ability to observe, encode, and use information about its environment. Traditional approaches to Genetic Programming have focused on evolving...
: An essential component of an intelligent agent is the ability to notice, encode, store, and utilize information about its environment. Traditional approaches to program induction have focused on...
Generalized Prioritized Sweeping (1998)
David Andre, Nir Friedman, Ronald Parr
Prioritized sweeping is a model-based reinforcement learning method that attempts to focus an agent's limited computational resources to achieve a good estimate of the value of environment states. To...
John R. Koza, Forrest H Bennett Iii, Jason Lohn, Frank Dunlap, Martin A. Keane, David Andre
Automated synthesis of analog electronic circuits is recognized as a difficult problem. Genetic programming was used to evolve both the topology and the sizing (numerical values) for each component...
John R. Koza, Forrest H Bennett Iii, Jason Lohn, Frank Dunlap, Martin A. Keane, David Andre
The problem of source identification involves correctly classifying an incoming signal into a category that identifies the signal's source. The problem is difficult because information is not...
Generalized Prioritized Sweeping (1997)
David Andre, Nir Friedman, Ronald Parr
Prioritized sweeping is a model-based reinforcement learning method that attempt to focus the agent's limited computational resources to achieve a good estimate of the value of environment states....
Generalized Prioritized Sweeping (1997)
David Andre, Nir Friedman, Ronald Parr
Prioritized sweeping is a model-based reinforcement learning method that attempt to focus the agent's limited computational resources to achieve a good estimate of the value of environment states....
Generalized Prioritized Sweeping (1997)
David Andre, Nir Friedman, Ronald Parr
Prioritized sweeping is a model-based reinforcement learning method that attempt to focus the agent's limited computational resources to achieve a good estimate of the value of environment states....
Generalized Prioritized Sweeping (1997)
David Andre, Nir Friedman, Ronald Parr
Prioritized sweeping is a model-based reinforcement learning method that attempt to focus the agent's limited computational resources to achieve a good estimate of the value of environment states....
Generalized Prioritized Sweeping (1997)
David Andre, Nir Friedman, Ronald Parr
Prioritized sweeping is a model-based reinforcement learning method that attempt to focus the agent's limited computational resources to achieve a good estimate of the value of environment states....
Generalized Prioritized Sweeping (1997)
David Andre, Nir Friedman, Ronald Parr
Prioritized sweeping is a model-based reinforcement learning method that attempt to focus the agent's limited computational resources to achieve a good estimate of the value of environment states....
Generalized Prioritized Sweeping (1997)
David Andre, Nir Friedman, Ronald Parr
Prioritized sweeping is a model-based reinforcement learning method that attempt to focus the agent's limited computational resources to achieve a good estimate of the value of environment states....
Generalized Prioritized Sweeping (1997)
David Andre, Nir Friedman, Ronald Parr
Prioritized sweeping is a model-based reinforcement learning method that attempt to focus the agent's limited computational resources to achieve a good estimate of the value of environment states....
John R. Koza, Forrest H Bennett Iii, Jeffrey L. Hutchings, Stephen L. Bade, Martin A. Keane, David Andre
The dominant component of the computational burden of solving non-trivial problems with evolutionary algorithms is the task of measuring the fitness of each individual in each generation of the...
Visiting Scholar, John R. Koza, David Andre
Introduction and Overview The goal of automatic programming is to create, in an automated way, a computer program that enables a computer to solve a problem. Ideally, an automatic programming system...
John R. Koza, Forrest H Bennett, Visiting Scholar, Martin A. Keane, David Andre
Genetic programming is an automatic programming technique that evolves computer programs to solve, or approximately solve, problems. This paper presents two examples in which genetic programming...
Evolution of a Time-Optimal Fly-To Controller Circuit using Genetic Programming (1997)
John R. Koza, Forrest H Bennett, Visiting Scholar, Martin A. Keane, David Andre
Most problem-solving techniques used by engineers involve the introduction of analytical and mathematical representations and techniques that are entirely foreign to the problem at hand. Genetic...
Evolution of Iteration in Genetic Programming (1997)
The solution to many problems requires, or is facilitated by, the use of iteration. Moreover, because iterative steps are repeatedly executed, they must have some degree of generality. An automatic...
John R. Koza, David Andre, Forrest H Bennett Iii, Martin A. Keane
: This paper demonstrates that a design for a low-distortion highgain 96 decibel (64,860-to-1) operational amplifier (including both circuit topology and component sizing) can be evolved using...
Automated Synthesis of Computational Circuits Using Genetic Programming (1997)
John R. Koza, Forrest H Bennett Iii, Jason Lohn, Frank Dunlap, Martin A. Keane, David Andre
: Analog electrical circuits that perform mathematical functions (e.g., cube root, square) are called computational circuits. Computational circuits are of special practical importance when the small...
Evolution Using Genetic Programming Of A Lowdistortion 96 Decibel Operational Amplifier (1997)
John R. Koza, Forrest H Bennett, David Andre, Martin A. Keane
There is no known general technique for automatically designing an analog electrical circuit that satisfies design specifications. Genetic programming was used to evolve both the topology and the...
Automatically Choosing the Number of Fitness Cases: The Rational Allocation of Trials (1997)
For many problems to which genetic programming has been applied, choosing the number of fitness cases with which to evaluate the individuals is a crucial decision. If too few fitness cases are used,...
Evolution of a 60 Decibel Op Amp Using Genetic Programming (1996)
Forrest H Bennett Iii, John R. Koza, David Andre, Martin A. Keane
: Genetic programming was used to evolve both the topology and sizing (numerical values) for each component of a low-distortion, lowbias 60 decibel (1000-to-1) amplifier with good frequency...
John R. Koza, Forrest H Bennett Iii, David Andre, Martin A. Keane
: Most practical electrical circuits contain modular substructures that are repeatedly used to create the overall circuit. Genetic programming with automatically defined functions and...
John R. Koza, David Andre, Forrest H Bennett Iii, Martin A. Keane
It would be desirable if computers could solve problems without the need for a human to write the detailed programmatic steps. That is, it would be desirable to have a domain-independent automatic...
David Andre, Visiting Scholar, Forrest H Bennett Iii, John R. Koza
It is difficult to program cellular automata. This is especially true when the desired computation requires global communication and global integration of information across great distances in the...
John R. Koza, David Andre, Forrest H Bennett Iii, Martin A. Keane
Genetic programming was used to evolve both the topology and the sizing (numerical values) for each component of a low-distortion, lowbias 60 decibel (1000-to-1) amplifier circuit with good frequency...
John R. Koza, David Andre, Forrest H Bennett Iii, Martin A. Keane
This paper demonstrates the usefulness of automatically defined functions and architecture-altering operations in designing analog electrical circuits using genetic programming. A design for a...