Do you just stand in one sqm while dwarves come to you? How fast do they come?

Because if you move, you get kicked right?