a dab off goop on the inside part of the rivet would be fine.
when drilling holes or installing stuff on the kayak put a dab of goop down then put the rivet in.
I get a little water from hatch seel and rivet holes. but its never more than a cups worth for a long days fishing. doesnt bug me much.