ocean fishing along the shores of North Eastern Coast

I am hoping to do some shore fishing along the north-eastern coast of
the US, I guess that would mean RhodeIsland, Maine, etc. But not
being from there I am wondering what the rules and regulations are?
What kind of licensing you must have. Are there public beaches along
this area that you can just drive along/into and fish? Or are all
beaches privately owned?

By the way how far is the drive from Rochester, New York to the East
coast fishing grounds in terms of mileage? Lets say to the nearest
ocean fishing-able location? be it Rhode Island or Maine or?? whatever
is closer.

I don't really want to jump on those fishing tourboats. Just want to
drive with my car and stop here and there to fish.