Technically, they're made of fossil oil, part of the Big Oil sector. Plastics are their fallback.
More technically, plastics sinking to the bottom of oceans or buried underground are actually a carbon sink. Plastics will emit GHGs like carbon dioxide and methane if they degrade. So we really need to stop using straws entirely.