I feared much the same thing so I put a magnetic tool holder strip (picked up at Lowes) on the front edge of my table. It’s location is so convenient I don’t even lay tools down on the waste board during bit changes.
The strip also allows me to store an LED pen light there for utility.
Whiskey glasses on the other hand…