Post #3195792

@neuralreckoning@neuromatch.social @GabrielBena@neuromatch.social Prediction: With all other capacities fixed, imposing a restriction on the network structure (modularization) will decrease generalization performance because it forces SGD to learn n extra bits (one bit for each neuron indicating which module it is in). Please, prove me wrong!