Have you ever tried this? Just turn and walk away, trust it's hard at first, but you do this 3 times and no one will lock you into small talk again. They'll just do a little shrug and walk away as well