This work proposes a new method for the fatigue damage evaluation of vibrational loads, based on preceding investigations on the relationship between stresses and modal velocities. As a first step, the influence of the geometry on the particular relationship is studied. Therefore, an analytic expression for Euler Bernoulli beams with a non-constant cross section is derived. Afterward, a general method for obtaining geometric factors from finite element (FE) models is proposed. In order to ensure a fast fatigue damage evaluation, strongly simplified FE-models are used for the determination of both factors and measurement locations. The entire method is demonstrated on three mechanical structures and indicates a better compromise between effort and accuracy than existing methods. For all examples, the usage of velocities and geometric factors obtained from simplified FE models enables a sufficient fatigue damage calculation.