Usually clay deposits spawn near bodies of water like a pond.
Mostly near the shore but it can also be found on the bottom of the lake.
In apperance they look like red rocks form a far. (see pictures below)
To harvest clay you will need a shovel.