Figured that one out... seems like something with the interrupts is getting messed up if you set the jumpers wrong on the Pivot card and that is why the mouse won't move.
Now I got the card working together with the Asante and also modified the Asante panel:
View attachment 14738
And another picture because colour
View attachment 14739