Skip to content

Commit 42c59fe

Browse files
committed
Updated formatting
1 parent ebd4687 commit 42c59fe

File tree

1 file changed

+30
-34
lines changed

1 file changed

+30
-34
lines changed

experiment/theory.md

Lines changed: 30 additions & 34 deletions
Original file line numberDiff line numberDiff line change
@@ -37,13 +37,11 @@ A constraint satisfaction model can be displayed by means of a Hinton diagram as
3737

3838

3939
<img src="images/figA2.jpg" width="500px;" height = "500px">
40-
41-
42-
43-
40+
\
41+
\
4442
**Figure 2**: *Hinton diagram for the 'rooms' example.*
45-
46-
43+
\
44+
\
4745
The model is allowed to relax by computing the next state for each unit selected at random, computing sum of its weighted inputs and thresholding the weighted sum using a hard-limiting output function. For a given external evidence, say like 'oven' and 'ceiling' in the following figure, the state of the network after each cycle is shown in the figure. After 17 cycles the model settles down to an equilibrium state closest to the given external evidence, and the state description gives a description of the concept of the room satisfying the external evidence, namely 'kitchen', in this case. Thus the PDP model clearly demonstrates the concepts of rooms captured by the weak constraints derived from the data given by the subjects. The model captures the concepts of the five room types at the equilibrium states corresponding to the description that best fits each room type. A goodness-of-fit function (g) is defined for each state (\(x_1,x_2, ...,x_N)\) , where \(x_i\) = 1 or 0, as $$ g = \sum\limits_{i,j=1}^{N}w_{ij} x_i x_j + \sum\limits_{i=1}^{N} e_i x_i + \sum\limits_{i=1}^{N} b_i x_i \qquad(3)$$
4846

4947
where \(e_i\) is the external input given as output of the \(i^{th}\) unit and \(b_i\) is the bias of the unit \(i\). At each of the equilibrium states the goodness-of-fit function is maximum. The model not only captures the concepts of the room types, but it also gives an idea of their relative separation in the 40 dimensional space.
@@ -62,48 +60,46 @@ For further information, refer the references given in the references section fo
6260

6361

6462
<img src="images/clamping.png">
65-
66-
67-
63+
\
64+
\
6865
**Figure 3**: *The state of the CS model after each cycle, starting with an initial state where the units 'ceiling' and 'oven' are clamped.*
69-
66+
\
67+
\
7068
### Illustration of Constraint Satisfaction Model
7169

7270
In this experiment, we use the PDP model called the Constraint Satisfaction Model, to illustrate how we as humans, attempt building of concepts as well as to arrive at conclusions given weak evidences. We start with a set of 40 descriptors used to characterize different room types. These descriptors can also be referred as hypotheses . Also present with the model is the relationship between these descriptors, acting as constraints, which can either be weak or strong. So eventually given a set of such hypotheses and weak or strong constraints between these, we arrive at some knowledge towards a particular room type in this example. The experiment first shows all the 40 descriptors involved in capturing knowledge for a given room type.
73-
71+
\
72+
\
7473
<img src="images/CSNN_1.png">
75-
76-
77-
74+
\
75+
\
7876
**Figure 1**: *Experiment window showing descriptors and other buttons.*
79-
77+
\
78+
\
8079
The constraint satisfaction model which is illustrated in this experiment is already trained. We can view the model using Hinton Diagram by clicking on the "CLICK" button on top. A new panel showing the Hinton Diagram for all the descriptors appears where 40 hypotheses have their corresponding squares with constraints between them and other hypotheses being displayed within the larger square. Moving the mouse over the squares presents their zoomed picture at the bottom of the page.
81-
80+
\
81+
\
8282
<img src="images/CSNN_2.png">
83-
84-
85-
83+
\
84+
\
8685
**Figure 2**: *Experiment panel showing the Hinton diagram for the descriptors.*
87-
86+
\
87+
\
8888
In the above diagram we notice that each large square represents a unit. There are 40 units corresponding to 40 descriptors. Within the square of each unit a replica of all the 40 units are displayed as smaller squares or dots, each dot representing the unit in its relative position in the diagram. Around each dot, weak constraints are depicted by smaller squares in lighter gray shade. Similarly strong constraints is represented by darker gray or black color with a square of larger size. There are many units which have no connections at all.
8989

9090
The constraint satisfaction model is used to illustrate the ability of human beings to build concepts or arrive at conclusion based on partial and sometime erroneous knowledge. The key idea of the model is that a large number of weak constraints when put together, evolve into a definitive conclusion. To test the model, some units can be clamped or say provided a constant external bias. As shown in the figure below, we can click on the units and have these clamped.
91-
92-
93-
91+
\
92+
\
9493
<img src="images/CSNN_3.png">
95-
96-
97-
98-
94+
\
95+
\
9996
**Figure 3**: *Testing of the model by clamping some units.*
100-
97+
\
98+
\
10199
After clamping the model is allowed to relax by computing the next state for each unit selected at random. The state computation is done by computing sum of the weighted inputs and thresholding the weighted sum using hard-limiting output function. After we click the test network button, we find that after running through some iterations the network settles to a state where no further change in the state of descriptors is visible. And then the state description gives the description of the concept of the room satisfying the external evidence or clamping
102-
103-
104-
100+
\
101+
\
105102
<img src="images/CSNN_4.png">
106-
107-
108-
103+
\
104+
\
109105
Figure 4: Figure showing the states of descriptors after reaching equilibrium.

0 commit comments

Comments
 (0)