soc-efficiency
The efficiency of separation of concerns: the hypothesis that in general, efficient designs will often result in the responsibillities and goals of distinct 'actors' or 'components' being disjoint, separate, or orthogonal in a suitable sense.
Evidence
-
"Notice the specialization exhibited by the two GPUs, a result of the restricted connectivity described in Section 3.5. The kernels on GPU 1 are largely color-agnostic, while the kernels on on GPU 2 are largely color-specific. This kind of specialization occurs during every run and is independent of any particular random weight initialization (modulo a renumbering of the GPUs)."
