Software

aiParts
C++ classes for multi-decision problems implimenying the High-Hope technique with sample programs. [MIT]
http://www.agt.net/public/bmarshal/aiparts/index.htm

AliceBOT
The famous free software BOT developed in promotion of AIML (Artificial Intelligence Markup Language). [FREE]
http://alicebot.blogspot.com/

ArrayMiner - ClassMarker
Programmatically isolate similarities between scattered classes of genes. Expression driven. Utilizes a voting method along with a k-Nearest-Neighbors classification. Very rich graphical interface. Samples of an unknown class are possible given enough data. Fully functional demo. [Commercial]
http://www.optimaldesign.com/ArrayMiner/ClassMarker.htm

The AutoClass Project
A database of cases described by a combination of real and discrete valued attributes, and automatically finds the natural classes in that data. It can be seen as a Naive Bayes classifier where the class node is hidden. [Free]
http://ic-www.arc.nasa.gov/ic/projects/bayes-group/autoclass/

Bayes Net Toolbox for Matlab
Supports several inference algorithms and learning algorithms. Allows simulation of static and dynamic networks, including HMMs, IOHMMs, and Kalman filters. [GPL]
http://bnt.sourceforge.net/

Bayes++: Open Source Bayesian Filtering Classes
A library of C++ classes for Bayesian Filtering of discrete systems. [MIT]
http://bayesclasses.sourceforge.net/Bayes++.html

BETSY: A Bayesian Essay Test Scoring System
A windows-based program that classifies text based on trained material. Designed for automated essay scoring, BETSY can be applied to any text classification task. [GPL]
http://edres.org/betsy

BNet EngineKit
A developer toolkit for researchers and engineers to embed belief networks in software applications. Nice online demo. [Commercial]
http://www.cra.com/commercial-products-services/bnet-engine-kit.asp

Bow: A Toolkit for Statistical Language Modeling, Text Retrieval, Classification and Clustering
A library of C code useful for writing statistical text analysis, language modeling, and information retrieval programs. The current distribution includes the library, as well as front-ends for document classification (rainbow), document retrieval (arrow) and document clustering (crossbow). [LGPL]
http://www.cs.cmu.edu/~mccallum/bow/

C4.5 and FOIL
The home page of R. Quinlan with FTP links to FOIL (inductive logic programming) and C4.5 (learning decision trees). [LGPL]
http://www.rulequest.com/Personal/

CHILL: Constructive Heuristics Induction for Language Learning
A general approach to the problem of inducing natural language parsers. It uses an annotated corpus, and produces a parser by using ILP for inducing the rules that control the actions of a shift-reduce parser. [Free]
http://www.cs.utexas.edu/users/ml/chill.html

Classification Toolbox for MATLAB
A complete set of algorithms for classification, clustering, feature selection and reduction for Matlab. [Free]
http://www.yom-tov.info/toolbox.html

Data Access Tools from the US Census Bureau
General purpose data display and extraction tools that works with Census Bureau data. Census data available for pickup through census bureau employees only. [Free]
http://www.census.gov/main/www/access.html

ELIE: An Adaptive Information Extraction System
A tool for adaptive information extraction from text. Also included are a number of other text processing tools for POS tagging, chunking, gazetteer, and stemming. [GPL]
http://www.aidanf.net/software/elie_an_adaptive_information_extraction_system

Experience-based Language Acquisition
Computational model of human language acquisition written in Java; currently acquires a protolanguage of nouns and verbs language based on visual perception. [BSD]
http://sourceforge.net/projects/ebla

FastMix
Generates Gaussian mixture models for large datasets using efficient KD-clustering algorithms. [Free]
http://www.cs.cmu.edu/~psand/

FTP Repository Site List for Cognitive and Machine Learning
Anonymous sites from popular colleges and universities. To access other pages just replace the 6 in URL with numbers 1-23. [Free]
http://hoohoo.ncsa.uiuc.edu/ftp/part6.html

Fully Complex Machine Learning Algorithm: ELM
Treatise on a newly discovered algorithm for feedforward neural network, ELM. Complete performance evaluation along with discussions in PDF format. [Free] [PDF]
http://www.ntu.edu.sg/home/egbhuang/C-ELM.pdf

GAlib: Matthew's Genetic Algorithms Library
A toolset of genetic algorithm objects for C++ to perform optimization. Uses any representation and genetic operators. The documentation contains implementation and examples. Nice screenshots. PVM for distributed, parallel implementations. Includes graphic examples that use the Athena, Motif widget sets, or MFC. [BSD]
http://lancet.mit.edu/ga/

General Hidden Markov Model Library
Hidden Markov Models software library from the Center of Applied Informatics, Cologne. Includes algorithms such as Viterbi, Baum-Welch, and Forward-Backward. [GPL]
http://sourceforge.net/projects/ghmm

Genetic Algorithm Projects at SourceForge.net
A large collection of algorithm projects with complete sourcecode. [GPL]
http://sourceforge.net/softwaremap/trove_list.php?form_cat=621

GRIDLOCK: A Scalable Approach to Unifying Computer and Communications Security
A globally specified and locally interpreted policy language based software for specification of network access control policy. [GPL]
http://nsl.cs.columbia.edu/projects/gridlock/

(H)HMM Library and Designer
This library allows probabilistic sequence models to be constructed through use of Hidden Markov models (HMMs) and Hierarchical Markov models HMMs (HHMMs) in Ocaml programming language. [GPL]
http://connex.lip6.fr/%7ebinsztok/hhld.html

HMM: Pattern search and discovery
A collection of tools for creating and using HMMs for biological sequences. [AFL]
http://bioweb.pasteur.fr/seqanal/motif/sam-uk.html

HMMER: Biosequence Analysis
A tool used to build HMMs from multiple alignments and calculate e-scores. [GPL]
http://hmmer.janelia.org/

HRE API: A Portable Handwriting Recognition Engine
This engine is a functionally complete interface for handwriting recognition. API was written in ANSI C and has minimal reliance on the Windows system. There is a version ported to Linux. [GPL]
http://playground.sun.com/pub/multimedia/handwriting/hre.html

Intelligent Software Agent Projects at Sourceforge.net
A large collection of Intelligent Agent projects complete with sourcecode. [GPL]
http://sourceforge.net/softwaremap/trove_list.php?form_cat=591

ITI: Incremental Tree Inducer
An algorithm that incrementally constructs decision trees from labeled examples. [AFL]
http://www.cs.umass.edu/~lrn/iti/index.html

JProGraM -- PRObabilistic GRAphical Models in Java
JProGraM is a machine learning library which supports learning and inference algorithms for Bayesian networks, Markov random fields, hybrid random fields, probabilistic decision trees, dependency networks, and Parzen windows. [GPL]
http://www.dii.unisi.it/%7efreno/JProGraM.html

KEEL: Knowledge Extraction based on Evolutionary Learning
The aim of this project is to develop a Computational Environment for integrating the design and use of knowledge extraction models from data using evolutionary algorithms. Genetic learning may also be applied to the model. [GPL]
http://sci2s.ugr.es/keel/

The Leibniz Software System
A formal system for constructing artificial intelligent software agents from the book, 'Design of Logic-based Intelligent Systems' covering such topics as production rules, neural nets, support vector machines, fuzzy logic, and Bayesian networks. License is given through purchase of the book alone. [COMM]
http://www.utdallas.edu/~klaus/Leibnizprogram/leibnizmain.html

Lemga: Learning Models and Generic Algorithms
A library of classes for optimizing (training) the generic models. Written in C++. [GPL]
http://www.work.caltech.edu/ling/lemga/

libbpfl - A Bayesian Probability Filtering Library
A general purpose library for Bayesian filtering written in C++. [LGPL]
http://libbpfl.sourceforge.net

LibML
A machine learning library. New implementations of various machine learning algorithms. [GPL]
http://savannah.nongnu.org/projects/libml/

LingPipe: Natural Language Processor (NLP)
A suite of Java libraries for the linguistic analysis of human language which can link entity mentions to database entries, uncover relations, cluster documents, and discover significant trends. [GPL]
http://www.alias-i.com/lingpipe/

The Lisa Project
A production rule based system implemented in a Common Lisp Object System (CLOS) for the development of Lisp based intelligent software agents. [LGPL]
http://lisa.sourceforge.net/

Machine Learning and Data Mining Software
Index of software links for computer learning software. Scroll down. [FREE]
http://www.sciencemag.org/feature/data/compsci/machine_learning.dtl

Machine Learning and Inference Laboratory
Downloadable group of programs comprising the EMERALD machine learning system, (Experimental Machine Example-based Reasoning and Learning Disciple) integrates five modules (e.g. or 'robots'), each displaying a capability for machine learning, visualization, and interence. [LGPL]
http://www.mli.gmu.edu/msoftware.html

Machine Learning Programs by Peter Clark
A collection of downloadable packages including: KM - The Knowledge Machine, Guiding Inductive Learning with a Qualitative Model, LPE - Lazy Partial Evaluation, and CN2 - Rule induction from examples. [GPL]
http://www.cs.utexas.edu/users/pclark/software/

Machine Learning Repository
Machine language tools including inductive systems (i.e. ILP and others), and other ML related links.
http://scalab.uc3m.es/~dborrajo/ml-systems/

Machine Learning Research Software in LISP
FTP repository of common list algorithms and datasets for research. [GPL]
http://www.cs.utexas.edu/~ml/ml-progs.html

Machine Learning Software Packages
Various classes, packages, macros and other software systems related to machine learning. [GPL]
http://www.cs.cmu.edu/afs/cs/project/ai-repository/ai/areas/learning/systems/0.html

MALLET: Advanced Machine Learning for Language
An integrated collection of Java code useful for statistical natural language processing, document classification, clustering, information extraction, and other machine learning applications to text. [GPL]
http://mallet.cs.umass.edu/index.php/Main_Page

Markov TheBeast
A Markov Logic Interpreter that focusses on efficient MAP inference and Online Learning featuring MAP inference using Cutting Planes combined with Max-Walk-Sat programming, parametrized weights, a shell interpreter, and cardinality constraints. [GPL]
http://thebeast.googlecode.com

Maximum Entropy Modeling Toolkit
A library of tools for constructing maximum entropy (maxent) model in either python or C++. Some program features are L-BFGS and GIS parameter estimation, and gaussian prior smoothing. [GPL]
http://homepages.inf.ed.ac.uk/s0450736/maxent_toolkit.html

MEME/MAST: Motif Discovery and Search
A software package to discover motifs (highly conserved regions) in groups of related DNA or protein sequences and, search sequence databases using motifs. [Commercial]
http://meme.sdsc.edu/meme/intro.html

Meta-MEME: Motif-based Hidden markov Modeling of Biological Sequences
Software toolkit for building and using motif-based hidden Markov models of DNA and proteins. There is an online interactive version. Source written in C. [GPL]
http://metameme.sdsc.edu/

MIX: Software for Mixture Distributions
Software for learning mixture distributions. Examples and two case studies are included. [Commercial]
http://icarus.math.mcmaster.ca/peter/mix/mix.html

NEITHER: A Propositional Theory Refinement
A system to modify an incomplete or incorrect rule base to make it consistent with a set of input training examples. Written in C++ [Free]
http://www.cs.utexas.edu/users/ml/neither.html

New Scientific Brainstorming Software for Inventors -- Windows, Mac and Linux
A software developed to help your team brainstorm. Words are replaced programmatically in user's idea sentence with new words from program categories perhaps creating ideas not formerly thought of. Includes word categories. [Commercial]
http://www.paramind.net/pmscientificversion.html

Nieme: Classification, Regression, Ranking and Reinforcement Learning
A machine learning library for classification, regression, ranking and reinforcement learning. It implements several well-known algorithms and is specially designed for large-scale applications. [GPL]
http://nieme.lip6.fr/

Nonparametric Classification with Polynomial MPMC Cascades
Scalable non-parametric classification with Polynomial MPMC Cascades for use in Matlab. [GPL]
http://cervisia.org/machine_learning_code.php

NSP: N-gram Statistics Package
Software for counting and analyzing word n-grams in text. This package provides standard tests of association for identifying word n-grams in large corpora and allows users to implement other tests with minimal scripting knowledge. Written in Perl. [GPL]
http://www.d.umn.edu/~tpederse/nsp.html

The Observable Operator Modeling Kit
Machine learning library for 'observable operator models' (OOMs) suitable for time-series and sequence data classification and prediction. OOMs are similar but more powerful than HMMs. Written in C++ [BSD]
http://omk.sourceforge.net

Open Source Computer Vision Library
Open source computer learning system making use of the Bayesian inferencing engine. [GPL]
http://www.intel.com/technology/computing/opencv/index.htm

OpenCyc
Open source version of the Cyc technology, the world's largest and most complete general knowledge base and commonsense reasoning engine. Can be used as the basis of a wide variety of intelligent applications including; rapid development of an ontology in a vertical area, email prioritizing, routing, summarization, and annotating, expert systems, game engine development. [GPL]
http://www.opencyc.org/

ORANGE: Inter-active Machine Learning Data Mining components
A component based framework for data input/output, preprocessing, predictive modelling, ensemble methods, and modelling validation. [GPL]
http://www.ailab.si/orange

Pattern Matching Pointers
Using algorithms to address issues of searching and matching strings and more complicated patterns such as trees, regular expressions, graphs, point sets, and arrays. [GPL]
http://www.cs.ucr.edu/~stelo/pattern.html

Pfam: Database of Protein Families and HMMs
A large collection of multiple sequence alignments and trained hidden Markov models covering many common protein domains. Alignments are included as well as models for 8296 protein families, based on the Swissprot 48.9 and SP-TrEMBL 31.9 protein sequence databases. [GPL]
http://pfam.janelia.org/

The PNC2 Rule Induction System
Windows software tool that induces rules from your data using the PNC2 cluster algorithm. An integrated parameter-tuning component allows easy adjustment of the algorithms behavior to the given problem without requiring any further knowledge. [GPL]
http://www.newty.de/pnc2/index.html

PRAPI: Pattern Recognition Application Programmer's Interface
A library for many pattern recognition tasks. The main focus of this package is on image analysis but utilizes a general architecture and XML-based data interchange format. Written in C++ [GPL]
http://www.ee.oulu.fi/~topiolli/cppdocs/

Probabilistic Networks Library (PNL), and Open Source Machine Learning Library (OpenML) by Intel
Open source library of tools for building machine learning software based on Bayesian mathematical principles. Links on lower left of page article. [GPL]
http://deviceforge.com/news/NS5332804106.html

PRODIGY: An Architecture for Planning and Learning
A system of research planning and learning utilizing explanation-based learning, partial evaluation, experimentation, graphical knowledge acquisition, automatic abstraction, mixed-initiative planning, and case-based reasoning. [Free]
http://www.cs.cmu.edu/afs/cs.cmu.edu/project/prodigy/Web/prodigy-home.html

Rapid Miner
The Rapid Miner toolset is an environment for machine learning through use of nested operators. Multiple experiments can be arbitrarily nested together through use of a graphical XML based user interface. (Formerly YALE) [GPL]
http://rapid-i.com/

SenseClusters
Programs to cluster similar contexts together using unsupervised knowledge-lean methods for word sense discrimination, email categorization, and name discrimination. Written in Perl. [GNU]
http://senseclusters.sourceforge.net/

SNoW: Sparse Network of Winnows
A learning architecture specifically tailored for learning in very high-dimensional feature spaces. The current release uses sparse variations of Winnow, Perceptron, and Naive Bayes. [AFL]
http://l2r.cs.uiuc.edu/~danr/snow.html

Software Packages for Graphical Models/Bayesian Networks
Tools for modeling graphs and Bayesian networks. Scroll down. [AFL], [Commercial]
http://www.ai.mit.edu/~murphyk/Software/bnsoft.html

Sorting Algorithms for Machine Learning
Various sorting algorithms including insertion, quick, merge, heap, Dutch National Flag, and radix with on-line demos. [Free]
http://www.csse.monash.edu.au/%7Elloyd/tildeAlgDS/Sort/

Spider: General Purpose Machine Learning Toolbox in Matlab
An object orientated environment for machine learning in Matlab. Algorithms can be plugged together and can be compared with (e.g. model selection, statistical tests and visual plots). Algorithms may be downloaded separately. [GPL]
http://www.kyb.tuebingen.mpg.de/bs/people/spider/index.html

SUBDUE: Graph Based Knowledge Discovery
A program which discovers interesting and repetitive subgraphs in labeled graph representations using the minimum description length principle. Includes applications to molecular biology. [Free]
http://ailab.wsu.edu/subdue/

SUrrogate MOdeling (SUMO) Toolbox
A Matlab toolbox that automatically builds surrogate models of a given data source within the accuracy and time constraints set by the user. Some key features are the inclusion of scalable regression models, knowledge discovery, best-in-class modelling techniques, and logging and profiling tools. [COMM]
http://www.sumo.intec.ugent.be/?q=SUMO_toolbox

TIMBL: Tilburg Memory Based Learner
A program implementing several memory-based learning techniques. These learners store representation of the training set explicitly, and classifies new cases by extrapolation from the most similar stored cases. [AFL]
http://ilk.uvt.nl/software.html

The Torch Machine Learning Library
This package forms a complete gradient descent machine learning library. Modules support vector machines in classification and regression, ensemble models such as bagging or adaboost, non-parametric models such as K-nearest neighbors, Parzen regression, and Parzen density estimation. Includes speech recognition tools. Written in C++ [BSD]
http://www.torch.ch

Tree Visualizer
Software which allows one to navigate (fly) through the data tree, zoom in on interesting nodes, click on bars to get counts, and mark interesting places in the tree. Includes datasets for automobiles, voting, produce, and medical research. Uses LEDA, ([AFL] licensed only). [GPL]
http://www.sgi.com/tech/mlc/trees.html

UCI Machine Learning
A repository of databases, domain theories and data generators that are used by the machine learning community for the empirical analysis of machine learning algorithms at the University of California at Irvine. [Free]
http://www.ics.uci.edu/~mlearn/MLRepository.html

UMDHMM and other statistical programs
This tool implements Hidden Markov Models and application to part-of-speech tagging. Also available; a multivariate hypothesis testing software for gaussian data, and a groundtruth/metadata editing and visualizing toolkit for OCR. [GPL]
http://www.kanungo.com/software/software.html

VIBES: Variational Inference for Bayesian Networks
A software package which allows variance-modeled posterior inference to be performed automatically on a Bayesian network. [GPL]
http://vibes.sourceforge.net/

WebMO
Web-based interface to computational chemistry. Has support for Gaussian 94/98/03, GAMESS, MolPro 2002, MOPAC 7/93/200x, NWChem 4.6+, QChem 2.1+, and Tinker 4.2+. Unix or Linux based. [Free]
http://www.webmo.net/

Weka 3: Data Mining Software
A collection of tools that implement decision trees and tables, rule learners, Naive Bayes, support vector machines, voted perceptrons, multi-layer perceptron. Meta schemes include bagging, stacking, and boosting. Written in Java. [GPL]
http://www.cs.waikato.ac.nz/~ml/weka/index.html

What If: Web-based Scientific Discovery
An algorithm engine which will calculate everything from symmetry, torsion angles, polar fraction through protein analysis and bond angles. Online version only. [Free]
http://swift.cmbi.kun.nl/WIWWWI/

WinBUGS: The BUGS Project
A stand-alone program to allow practical MCMC methods available to applied statisticians. Either a point and click interface can be used to control the analysis or a graphical interface can be constructed. The BUGs project also includes links to GeoBUGS for spatial analysis, PKBUGS for pharmacokinetic modelling, and OpenBUGS for latest developments. [GPL]
http://www.mrc-bsu.cam.ac.uk/bugs/winbugs/contents.shtml

WinMine Toolkit
A set of tools for Windows 2000/NT/XP that allow you to build statistical models from data. [Free]
http://research.microsoft.com/~dmax/WinMine/tooldoc.htm

Self-Taught: Software That Learns By Doing
Short article on self-modifying software touching on co-training, partial-programming, and genetic programming (GP) methods of problem solving. [FREE] <small>(February 6, 2006)</small>
http://www.computerworld.com/softwaretopics/software/story/0,10801,108320,00.html