A simulated annealing technique for generating artificial data to assess concept learning algorithms

Article type: Research Article

Authors: Hunniford, Thomas J.C.^{; 1} | Hickey, Ray J.^{; *}

Affiliations: ISE, Faculty of Informatics, University of Ulster, Cromore Road, Coleraine BT52 1SA, Northern Ireland, UK

Correspondence: [*] Corresponding author. Tel.: +44-1265-44141; fax: +44-1265-324916; e-mail: [email protected]

Note: [1] E-mail: [email protected]

Abstract: Artificial data can be used instead of real world data to derive rigorous results for the average case performance of concept learning algorithms. Empirical testing with artificial data can be used to calculate the average case performance with arbitrary precision. This paper presents an artificial data-generating program, called ADG. The program makes use of simulated annealing to generate its data sets. ADG is distinctive because users can define as few or as many data characteristics as they wish. In most other artificial data generating systems the user must specify a complete distribution of the examples, which can be difficult and tedious.

Keywords: Artificial data generation, Concept learning algoritlnn evaluation, Simulated annealing, Empirical testing

DOI: 10.3233/IDA-1999-3303

Journal: Intelligent Data Analysis, vol. 3, no. 3, pp. 177-189, 1999