Here's a hypothetical for you. . .

[goinsfishin]

The wrong thing to do would be to create another ghost pot.
The right thing to do would be to swing back into the general area and drop it where it came from.....even if it means pulling your boat rods to get it over.
The crabber gets his pot (and hopefully his crabs in it), no ghost pot is created and you can sleep knowing you did the right thing.