Shadow of Steel can't finish due to a bug (Fallout 4)

People help me in trouble! During the quest "Shadow of Steel", I refused Danse to accompany me, now the quest hangs at the moment where I have to talk to him, but when I want to talk to him well, he tells me to talk to the elder, and he himself will be waiting for me at dining room. Tell me what to do plz!
= (