Blog

2012 NRAC Allocationsbengio

bengio


bengio.jpg

However, in high dimension, the neighborhood becomes exponentially large, and one requires an exponential number of training examples to cover it. To cover and discriminate among N regions in input space, one would need O(N) examples with a local learning algorithm, but N can grow to the power fo the space dimension.