Within the earlier put up I mentioned the “neuroeconomics of motion”, which is an method to the research of motor management that assumes the nervous system chooses motor patterns by computing their estimated prices and advantages. One side of this computation that I did not point out, however which was talked about by my good friend Eric Kruger in a remark, is the trade-off between exploration and exploitation. I’ve been that means to speak about this trade-off for a very long time, and Eric’s remark prompted me to put in writing about it, because it has numerous relevance for some subjects I talk about steadily, such because the position of play in motor studying.
The idea of the exploration-exploitation tradeoff originated in laptop science, and was later utilized in lots of different fields looking for to grasp complicated decision-making by clever methods, comparable to organisms and companies.
The fundamental dilemma posed by the trade-off is that this: in attempting to resolve an issue, must you depend on a well known methodology that delivers first rate outcomes with excessive confidence (exploitation), or attempt an untested methodology which may work significantly better, or result in the invention of helpful info (exploration)? By exploiting a identified useful resource you’re assured a sure degree of efficiency, however you’re additionally denied the potential for enchancment which may come from exploring totally different choices. Alternatively, exploration brings danger and uncertainty, but in addition the potential for studying one thing new and helpful which may be exploited sooner or later.
Within the context of motor management, exploitation refers to reliance on acquainted, recurring motion patterns. These are the methods the nervous system has beforehand decided to be environment friendly for a given activity. Exploitation is about perfecting and using these identified patterns to make sure constant, dependable outcomes. It is following a well-trodden path or staying in a groove.
Exploration includes getting off the trail and into uncharted territory. It is about various actions, attempting new methods, and experimenting with totally different methods. Whereas this would possibly introduce non permanent inefficiency or awkwardness, it’s required for locating higher motion patterns which may finally be exploited as new habits.
We will add some nuance to those distinctions by imagining that the seek for higher options to motion issues is like exploring an enormous panorama of various choices. Options are represented by peaks within the panorama, and non-solutions are represented by valleys. The very best peak is the optimum resolution.
Exploitation means discovering a peak after which merely shifting upward to the highest. This technique will finally convey you to the highest of the native space, however there could also be far larger peaks on extra distant elements of the panorama. To seek out them, it is advisable discover by descending out of your native peak, and perhaps even strolling via just a few valleys earlier than discovering the bottom of the very best mountain.
The desire for exploration or exploitation ought to rely in your degree of talent and schooling. On the whole, early learners ought to interact in a number of exploration, so they do not lock themselves into suboptimal habits. However as they get higher at what they’re doing and change into moderately assured that their problem-solving strategies are practically optimized, they need to spend much less time exploring and extra time exploiting what they know.
We will use this metaphor to grasp how a golfer makes swing adjustments. A newbie might want to interact in vital exploration to discover a good method, as a result of the primary swing makes an attempt will most likely be fairly awkward. For instance, a novice could discover it simpler to make stable contact by taking a brief backswing and