Machine energy, definitely not programmer energy ;)
post
This doesn't account for all the comfort food the programmer will have to consume in order to keep themselves sane
For those who don't want to open threads, it's a link to a paper on energy efficiency of programming languages.
Also the difference between TS and JS doesn't make sense at first glance. 🤷♂️ I guess I need to read the research.
It does, the "compiler" adds a bunch of extra garbage for extra safety that really does have an impact.
I thought the idea of TS is that it strongly types everything so that the JS interpreter doesn't waste all of its time trying to figure out the best way to store a variable in RAM.
The code is ultimately ran in a JS interpreter. AFAIK TS transpiles into JS, there's no TS specific interpreter. But such a huge difference is unexpected to me.
Its really not, have you noticed how an enum is transpiled? you end up with a function... a lot of other things follow the same pattern.
Nope, have not noticed because I hate JavaScript with a passion. Thanks for educating me.
fair enough :D but it does happen and there are reasons for that: https://stackoverflow.com/questions/47363996/why-does-an-enum-transpile-into-a-function
No they don't. Enums are actually unique in being the only Typescript feature that requires code gen, and they consider that to have been a mistake.
In any case that's not the cause of the difference here.
This isn't true, there are other features that "emit code", that includes: namespaces, decorators and some cases even async / await (when targeting ES5 or ES6).
Ah yeah I forgot about namespaces. I don't think they're a popular feature.
The other two only generate code for backwards compatibility. When targeting the latest JavaScript versions they don't generate anything.
Ok decorators are technically still only a proposal so they're slightly jumping the gun there, but the point remains.
Here's a good example: https://stackoverflow.com/questions/47363996/why-does-an-enum-transpile-into-a-function
I guess we can take the overhead of rust considering all the advantages. Go however... can't even.
Even Haskell is higher on the list than Go, which surprises me a lot
For Lua I think it's just for the interpreted version, I've heard that LuaJIT is amazingly fast (comparable to C++ code), and that's what for example Löve (game engine) uses, and probably many other projects as well.
WASM would be interesting as well, because lots of stuff can be compiled to it to run on the web
Indeed, here's an example - my climate-system model web-app, written in scala running (mainly) in wasm
(note: that was compiled with scala-js 1.17, they say latest 1.19 does wasm faster, I didn't yet compare).
[ Edit: note wasm variant only works with most recent browsers, maybe with experimental options set - if not try without ?wasm ]
I have no clue what I am looking at but it is absolutely mesmerizing.

I would be interested in how things like MATLAB and octave compare to R and python. But I guess it doesn't matter as much because the relative time of those being run in a data analysis or research context is probably relatively low compared to production code.
Is there a lot of computation-intensive code being written in pure Python? My impression was that the numpy/pandas/polars etc kind of stuff was powered by languages like fortran, rust and c++.
Looking at the Energy/Time ratios (lower is better) on page 15 is also interesting, it gives an idea of how "power hungry per CPU cycle" each language might be. Python's very high
Every time I get surprised by the efficiency of Lisp! I guess they mean Common Lisp there, not Clojure or any modern dialect.
Yeah every time I see this chart I think "unless it's performance critical, realtime, or embedded, why would I use anything else?" It's very flexible, a joy to use, amazing interactive shell(s). Paren navigation is awesome. The build/tooling is not the best, but it is manageable.
That said, OCaml is nice too.
For Haskell to land that low on the list tells me they either couldn't find a good Haskell programmer and/or weren't using GHC.
Wonder what they used for the JS state since it's dependent on the runtime.
I have a hard time believing Java is that high up. I'd place it around c#.
Why?
(A super slimmed down flavour of) Java runs on fucking simcards.
And it powers a lot of phones. People generally don't like it when their phone needs to charge all the freaking time.
I ran Linux with KDE on my phone for a while and it for sure needed EVEN MORE charging all the time even though most of the system is C, with a sprinkle of C++ and QT.
But that is probably due to other inefficiencies and lack of optimization (which is fine, make it work first, optimize later)
Yeah, and Android has had some 16 years of "optimize later". I have some very very limited experience with writing mobile apps and while I found it to be a PITA, there is clearly a lot of thought given to how to not eat all the battery and die in the ecosystem there. I would expect that kind of work to also be done at the JVM level.
If Windows Mobile had succeeded, C# likely would've been lower as well, just because there'd be more incentive to make a battery charge last longer.
I'm using the fattest of java (Kotlin) on the fattest of frameworks (Spring boot) and it is still decently fast on a 5 year old raspberry pi. I can hit precise 50 μs timings with it.
Imagine doing it in fat python (as opposed to micropython) like all the hip kids.
Love the "I reject your empirical data and substitute my emotions" energy.
etalon
/ˈɛtəlɒn/
noun Physics
noun: etalon; plural noun: etalonsa device consisting of two reflecting glass plates, employed for measuring small differences in the wavelength of light using the interference it produces.
I don't see how that word makes sense in that phrase
Does the paper take into account the energy required to compile the code, the complexity of debugging and thus the required re-compilations after making small changes? Because IMHO that should all be part of the equation.
They compile each benchmark solution as needed, following the CLBG guidelines, but they do not measure or report the energy consumed during the compilation step.
Time to write our own paper with regex and compiler flags.
It's a good question, but I think the amount of time spent compiling a language is going to be pretty tiny compared to the amount of time the application is running.
Still - "energy efficiency" may be the worst metric to use when choosing a language.
Energy efficiency strongly correlates to datacentre costs.
and in most cases that's not good enough to justify choosing c
I just learned about Zig, an effort to make a better C compatible language. It's been really good so far, I definitely recommend checking it out! It's early stages for the community, but the core language is pretty developed and is a breath of fresh air compared to C.
Your link links to facebook that links to https://haslab.github.io/SAFER/scp21.pdf
Written in 2021 and not including julia is weird imo. I'm not saying it's faster but one should include it in a comparison.
For raw computation, yes. Most programs aren't raw computation. They run in and out of memory a lot, or are tapping their feet while waiting 2ms for the SSD to get back to them. When we do have raw computation, it tends to be passed off to a C library, anyway, or else something that runs on a GPU.
We're not going to significantly reduce datacenter energy use just by rewriting everything in C.
Ah this ancient nonsense. Typescript and JavaScript get different results!
It's all based on
https://en.wikipedia.org/wiki/The_Computer_Language_Benchmarks_Game
Microbenchmarks which are heavily gamed. Though in fairness the overall results are fairly reasonable.
Still I don't think this "energy efficiency" result is worth talking about. Faster languages are more energy efficient. Who new?
Edit: this also has some hilarious visualisation WTFs - using dendograms for performance figures (figures 4-6)! Why on earth do figures 7-12 include line graphs?
Microbenchmarks which are heavily gamed
Which benchmarks aren't?
Private or obscure ones I guess.
Real-world (macro) benchmarks are at least harder to game, e.g. how long does it take to launch chrome and open Gmail? That's actually a useful task so if you speed it up, great!
Also these benchmarks are particularly easy to game because it's the actual benchmark itself that gets gamed (i.e. the code for each language); not the thing you are trying to measure with the benchmark (the compilers). Usually the benchmark is fixed and it's the targets that contort themselves to it, which is at least a little harder.
For example some of the benchmarks for language X literally just call into C libraries to do the work.
Private or obscure ones I guess.
Private and obscure benchmarks are very often gamed by the benchmarkers. It's very difficult to design a fair benchmark (e.g chrome can be optimized to load Gmail for obvious reasons. maybe we should choose a more fair website when comparing browsers? but which? how can we know that neither browser has optimizations specific for page X?). Obscure benchmarks are useless because we don't know if they measure the same thing. Private benchmarks are definitely fun but only useful to the author.
If a benchmark is well established you can be sure everyone is trying to game it.
Typescript and JavaScript get different results!
It does make sense, if you skim through the research paper (page 11). They aren't using performance.now() or whatever the state-of-the-art in JS currently is. Their measurements include invocation of the interpreter. And parsing TS involves bigger overhead than parsing JS.
I assume (didn't read the whole paper, honestly DGAF) they don't do that with compiled languages, because there's no way the gap between compiling C and Rust or C++ is that small.
Their measurements include invocation of the interpreter. And parsing TS involves bigger overhead than parsing JS.
But TS is compiled to JS so it's the same interpreter in both cases. If they're including the time for tsc in their benchmark then that's an even bigger WTF.


top 81 comments