Is Ascophyllum nodosum harmful to my garden or the environment?

No. Residual product excreted by animals is not harmful to gardens, nor is the seaweed damaging to the environment if introduced into waterways.