Being an element doesnt exclude it from poisoning/pollution. Lead is an element and it'll happily poison people. Quick google suggests gold will kill at dosages 2g/kg, so probably dont want to ingest too much.

Gold isnt very strong on its own, so in order to use it for foil food packaging, it would require being attached to something else, which brings back the plastics part :(