Fabulous idea, I hope it works out. Is 19mm the trackball spec or did you use a caliper on the original?
I don't have a Duo open ATM so I couldn't check. I don't think the ball would touch the brass, check if the rollerball is supported by the mechanism's rollers? If the copper/brass ring is the bottoming out support it's a no go. If so the weight of the ball bearing may stress the support structure? Dunno, I've got one colored ball so I haven't looked for them, but if marbles are available in 19mm they'd make some crazy trackballs.
Smoothness might be a concern in terms of frictional interface differential with the roller material?
On a side note, the mass of a bearing would have made tweaking Bezier control points a lot more accurate given the inertial upgrade when I was doing that in the field.