You don't understand what gold is being used for, it's insurance against government printing and is impossible to forge and hard to steal if your not stupid and actually pay for security, unlike things like bitcoin. Its used as the currency for century's for a reason and is often fallen back upon as a last resort for a reason. Silver isn't because it's not as fininite but is good as a more ubiquidous self backed currency for the same reason, just more for the common man.
The reason golds value is so high is because it is the price of combine debts that verious fiat deal could cover over all these years, that's why it's so high. When a debt can't be covered in cash, gold is often sold to make up the diffrence, over time that has caused its price to rise due to it being represented against these assets, it seems people can't get enough of the shiny metal.