EVOLUTION-MANAGER

Edit File: fclustIndex.html

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>R: Fuzzy Cluster Indexes (Validity/Performance Measures)</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<link rel="stylesheet" type="text/css" href="R.css" />
</head><body>

<table width="100%" summary="page for fclustIndex {e1071}"><tr><td>fclustIndex {e1071}</td><td style="text-align: right;">R Documentation</td></tr></table>

<h2>Fuzzy Cluster Indexes (Validity/Performance Measures)</h2>

<h3>Description</h3>

Calculates the values of several fuzzy validity measures. The values
of the indexes can be independently used in order to evaluate and compare
clustering partitions or even to determine the number of clusters
existing in a data set.

<h3>Usage</h3>

<pre>fclustIndex(y, x, index = "all")</pre>

<h3>Arguments</h3>

<table summary="R argblock">
<tr valign="top"><td><code>y</code></td>
<td>
An object of a fuzzy clustering result of class <code>"fclust"</code>
</td></tr>
<tr valign="top"><td><code>x</code></td>
<td>
Data matrix
</td></tr>
<tr valign="top"><td><code>index</code></td>
<td>
The validity measures used: <code>"gath.geva"</code>, <code>"xie.beni"</code>,
<code>"fukuyama.sugeno"</code>, <code>"partition.coefficient"</code>,
<code>"partition.entropy"</code>, <code>"proportion.exponent"</code>,
<code>"separation.index"</code> and <code>"all"</code> for all the indexes.
</td></tr></table>

<h3>Details</h3>

The validity measures and a short description of them follows, where
N is the number of data points, u_{ij} the values of the
membership matrix, v_j the centers of the clusters and k
te number of clusters.

<dl>
<dt>gath.geva:</dt><dd>
Gath and Geva introduced 2 main criteria for comparing and finding
optimal partitions based on the heuristics that a better clustering
assumes clear separation between the clusters, minimal volume of the
clusters and maximal number of data points concentrated in the
vicinity of the cluster centroids. These indexes are only for the
cmeans clustering algorithm valid.
For the first, the &ldquo;fuzzy hypervolume&rdquo; we have:
F_{HV}=&sum;_{j=1}^{c}{[\det(F_j)]}^{1/2}, where
F_j=\frac{&sum;_{i=1}^N
	 u_{ij}(x_i-v_j)(x_i-v_j)^T}{&sum;_{i=1}^{N}u_{ij}}, for the
case when the defuzzification parameter is 2.
For the second, the &ldquo;average partition density&rdquo;:
D_{PA}=\frac{1}{k}&sum;_{j=1}^k\frac{S_j}{{[\det(F_j)]}^{1/2}},
where S_j=&sum;_{i=1}^N u_{ij}.
Moreover, the &ldquo;partition density&rdquo; which expresses the general
partition density according to the physical definition of density
is calculated by:
P_D=\frac{S}{F_{HV}}, where S=&sum;_{j=1}^k&sum;_{i=1}^N
	u_{ij}.

</dd>
<dt>xie.beni:</dt><dd>
This index is a function of the data set and the centroids of the
clusters. Xie and Beni explained this index by writing it as a ratio
of the total variation of the partition and the centroids $(U,V)$
and the separation of the centroids vectors. The minimum values of
this index under comparison support the best partitions.
u_{XB}(U,V;X)=\frac{&sum;_{j=1}^k&sum;_{i=1}^Nu_{ij}^2{||x_i-v_j||}^2}{N(\min_{j\neq l}\{{||v_j-v_l||}^2\})}

</dd>
<dt>fukuyama.sugeno:</dt><dd>
This index consists of the difference of two terms, the first
combining the fuzziness in the membership matrix with the
geometrical compactness of the representation of the data set via
the prototypes, and the second the fuzziness in its row of the
partition matrix with the distance from the $i$th prototype to the
grand mean of the data. The minimum values of this index also
propose a good partition.
u_{FS}(U,V;X)=&sum;_{i=1}^{N}&sum;_{j=1}^k
	(u_{ij}^2)^q(||x_i-v_j||^2-||v_j-\bar v||^2)

</dd>
<dt>partition.coefficient:</dt><dd>
An index which measures the fuzziness of the partition but without
considering the data set itself. It is a heuristic measure since it
has no connection to any property of the data. The maximum values of
it imply a good partition in the meaning of a least fuzzy
clustering.
F(U;k)=\frac{tr (UU^T)}{N}=\frac{&lt;U,U&gt;}{N}=\frac{||U||^2}{N}

<ul>
<li> F(U;k) shows the fuzziness or the overlap of the partition
and depends on kN elements. 

</li>
<li> 1/k&le;q F(U;k)&le;q 1, where if F(U;k)=1 then U is a hard
partition and if F(U;k)=1/k then U=[1/k] is the centroid of
the fuzzy partion space P_{fk}. The converse is also valid.

</li></ul>

</dd>
<dt>partition.entropy:</dt><dd>
It is a measure that provides information about the membership
matrix without also considering the data itself. The minimum values
imply a good partition in the meaning of a more crisp partition.
H(U;k)=&sum;_{i=1}^{N} h(u_i)/N, where
h(u)=-&sum;_{j=1}^{k} u_j\,\log _a (u_j) the Shannon's entropy.

<ul>
<li> H(U;k) shows the uncertainty of a fuzzy partition and
depends also on kN elements. Specifically, h(u_i) is
interpreted as the amount of fuzzy information about the
membership of x_i in k classes that is retained by column
u_j. Thus, at U=[1/k] the most information is withheld since
the membership is the fuzziest possible.

</li>
<li> 0&le;q H(U;k)&le;q \log_a(k), where for H(U;k)=0 U is a
hard partition and for H(U;k)=\log_a(k) U=[1/k].

</li></ul>

</dd>
<dt>proportion.exponent:</dt><dd>
It is a measure P(U;k) of fuzziness adept to detect structural variations
in the partition matrix as it becomes more fuzzier. A crisp cluster
in the partition matrix can drive it to infinity when the partition
coefficient and the partition entropy are more sensitive to small
changes when approaching a hard partition. Its evaluation does not also
involve the data or the algorithm used to partition them and
its maximum implies the optimal partition but without knowing what
maximum is a statistically significant maximum.

<ul>
<li> 0&le;q P(U;k)&lt;&infin;, since the [0,1] values explode to
[0,&infin;) due to the natural logarithm. Specifically, P=0
when and only when U=[1/k], while P\rightarrow&infin; when
any column of U is crisp. 

</li>
<li> P(U;k) can easily explode and it is good for partitions
with large column maximums and at detecting structural
variations.

</li></ul>

</dd>
<dt>separation.index (known as CS Index):</dt><dd>
This index identifies unique cluster structure with well-defined
properties that depend on the data and a measure of distance. It
answers the question if the clusters are compact and separated, but
it rather seems computationally infeasible for big data sets since a
distance matrix between all the data membership values has to be
calculated. It also presupposes that a hard partition is derived
from the fuzzy one. 
D_1(U;k;X,d)=\min_{i+1\,&le;q\,l\,&le;q\,k-1}&le;ft\{\min_{1\,&le;q\,j\,&le;q\,k}&le;ft\{\frac{dis(u_j,u_l)}{\max_{1&le;q m&le;q k}\{dia(u_m)\}}\right\}\right\}, where dia is the diameter of the subset, dis the distance of
two subsets, and d a metric.
U is a CS partition of X \Leftrightarrow D_1&gt;1. When this
holds then U is unique.

</dd>
</dl>

<h3>Value</h3>

Returns a vector with the validity measures values.

<h3>Author(s)</h3>

Evgenia Dimitriadou

<h3>References</h3>

James C. Bezdek, Pattern Recognition with Fuzzy Objective
Function Algorithms, Plenum Press, 1981, NY. 
L. X. Xie and G. Beni, Validity measure for fuzzy
clustering, IEEE Transactions on Pattern Analysis and Machine
Intelligence, vol. 3, n. 8, p. 841-847, 1991. 
I. Gath and A. B. Geva, Unsupervised Optimal Fuzzy
Clustering, IEEE Transactions on Pattern Analysis and Machine
Intelligence, vol. 11, n. 7, p. 773-781, 1989. 
Y. Fukuyama and M. Sugeno, A new method of choosing the
number of clusters for the fuzzy $c$-means method, Proc. 5th Fuzzy
Syst. Symp., p. 247-250, 1989 (in japanese).

<code><a href="cmeans.html">cmeans</a></code>

<h3>Examples</h3>

<pre>
# a 2-dimensional example
x&lt;-rbind(matrix(rnorm(100,sd=0.3),ncol=2),
 matrix(rnorm(100,mean=1,sd=0.3),ncol=2))
cl&lt;-cmeans(x,2,20,verbose=TRUE,method="cmeans")
resultindexes &lt;- fclustIndex(cl,x, index="all")
resultindexes 
</pre>

<hr /><div style="text-align: center;">[Package e1071 version 1.7-3 <a href="00Index.html">Index</a>]</div>
</body></html>