The problem with mods in multiplayer (Terraria)

Hello. My friend and I decided to play with the mod. Downloaded mods (Tremor, Calamity, Spirit, Thorium), a friend started the server (by invitation). When entering the fashion again begin to download at a certain place always stay. What's the problem?
PS Game - license
UPD Problem solved. In the settings knocked out to download mods from the server
UPD we HAVE different versions of mods