Exponentiated Gradient; list etiquette
Apr. 16th, 2009 01:41 amI feel like posting a question to the UAI list, but the list seems to be for announcements (except for one thread in February).
So I'm pasting it here instead:
Exponentiated Gradient
This would compromise the consistency of EG in cases where any coefficient is negative. Where am I going wrong?
It would be nice to have a list explicitly for discussion... like in the old days of the Internet, with newsgroups.
So I'm pasting it here instead:
Exponentiated Gradient
If we're trying to learn a set of weights {w_i} via EG updates, then
what we're doing is updating the log(w_i) additively. Suppose the true
w_i is negative. Then log(w_i) is a complex number, and we can only
get there if the update terms are complex, which can't happen under
ordinary loss functions.
This would compromise the consistency of EG in cases where any coefficient is negative. Where am I going wrong?
It would be nice to have a list explicitly for discussion... like in the old days of the Internet, with newsgroups.