Histories are complex, although we do generally know oysters (and also lobsters) were once so common that they were considered "prison food".
In fact, in the 19th century there were prison riots because prisoners were tired of eating oysters and lobsters.