I've seen those green and white batteries before, circa mid-90s? Unless it's a modern Saft, which will have the date printed.
Easiest way to get the drive out is to just pull the whole caddy, FDD and all. Disconnect all cables, then there are four screws that hold the caddy in place, two on the...