The majority of Internet infrastructure runs on either something Linux based or something FreeBSD based.

A lot of the tools used are also various flavours of open or semi open source.

I'd say open source already has success. Just not in places where you see consumers using it. Except... Wait a minute, Android is a fork of Linux, and Android is open source too.