Hoyle was a writer who was an expert on the rules of card games. And the idiom means doing something strictly by the rules, doing something the usual and correct way.
“According to Hoyle, we should not use this room but probably nobody will complain if we do use it.”