- “Are there still potential problems with using AI to maximize cockroach production? Yes. Since AIs lack context about what they’re actually trying to accomplish and why, they often solve problems in unexpected ways. Suppose the cockroach AI found that by turning both the heat and water up to “max” in one particular room, it can significantly increase the number of cockroaches that room can produce. It would have no way of knowing (or caring) that what it had actually done was short out the door that prevents the cockroaches from accessing the employee kitchen. **Technically, shorting out the door was the AI being good at its job. Its job was to maximize cockroach production, not guard against their escape.** To work with AI effectively, and to anticipate trouble before it happens, we need to understand what machine learning is best at.” --- **Tags** — [[quotes]], [[artificial-intelligence]], [[ai-problems]], **Source** — [[202307171347 — B — You Look Like a Thing and I Love You]]