The Rook's Gambit is the only tavern on Smuggler's Rest. You can only access it during times when the Treasure of Crystal Cove event is running. However, if your spirit is still bound there, releasing from death will still respawn you inside the Gambit. This won't do any good because no monsters spawn in Smuggler's Rest, Crystal Cove won't open, and Euphonia's Barter Box and Euphonia's Hat Box are gone unless the event is running. There is no PVP pit.