I dont' think you'll have any luck crossing the river without heading to West Point.
I haven't been up that way before, but from looking at my GMCO charts, I think the railroad bridge is a swing bridge & the markers indicate the channel for when the bridge is open.
Williams Landing is on the same side of the river from you.