The prisoners in the prisons (Mount & Blade 2: Bannerlord)

Why bother to leave the prison? I am over 20 hours of play have not noticed that with them that something happened.
It's just the way suspend prisoners? In case then suddenly need them again to carry in the hope that they will decide to join you?
Or maybe there is some chips why do we need prison?