Fisherman fears oysters could be hit in fish kills