help with Cabaret quest (The Witcher 3: Wild Hunt)

I pick up the sword, go to a meeting with Buttercup and wait for him, two game hours pass and nothing happens, he is not there.
help, what am i doing wrong?