post
Lumo isn't a model; it uses open models, so this is a strange comparison. You can find the models Lumo uses in the privacy policy: https://proton.me/support/lumo-privacy
Additionally, as others have pointed out, the client apps are open source as well.
I was really pissed by Proton's marketing on this one. It is so closed and opaque, only the client are open. This is clearly open washing marketing!
At the moment I have been pretty satisfied with the LLMs that Kagi is offering in their standard their for my low requirement queries. Supposedly most of the apis they use are too alternative servers that host instances of the models, some claiming they don’t use your data. I am not aware to what extend open source is serviced in those models, but I have little interest in Lumo for the time being. Can someone explain to me why open source matters for LLMs?
LLM are becomming widely used and whoever controll the LLM training control people lives to some extends. It's crazy how people are relying more and more on ChatGPT for conveniance, some even think it is actually intelligent/smart (it is not). LLM have biais because training data and training recipes are not neutral. Governments and big corpos can use this to extend control and manipulate/influence opinion, behavior, etc... They can choose how and what to censor, the point of view of information that could change user perception of it. With closed data and training recipe we can not see how it is made and what rules the models have been following.
Most open source model only publish the finally wieght model. No training data (mainly because they violate IP, copyright, etc... if you ask me) nor the training recipe, so you only have the possibility to host the model yourself. They slap Open Source on it and voilà... but it often isn't and when it is you can see that it perform worse (because they haven't read all Sci-Hub and Z-Library unlike Llama and ChatGPT for exemple.
Edit : Clarify some sentences
Lumo apps are open source:
https://github.com/ProtonMail/WebClients/tree/main/applications/lumo - web client
https://github.com/ProtonLumo/android-lumo - Android
Leaving this comment just shows that you haven't read the submission lol
The only open source code we have found is for the Lumo mobile and web apps. Proton calling the Lumo AI assistant open source based on that is a bit like Microsoft calling Windows open source just because there's a github repository for Windows Terminal.
Wrong (again) lol. I am aware about this text.
Lumo Apps is one thing, Lumo itself is another. The way Proton is marketing this service is truely misleading.
As a user of Proton I ma really disapointed by their Lumo marketing and the actual reality of the service. Reminds me how they marketed ProtonPass at launch in a different way. I'm starting to think it's a bad thing having them developing such a wide ecosystem of tools. They should focus on a more narrow number and make them stands out.
TLDR: Apps are open, models are open weight but you don't know which one you get, and they have not yet disclosed any tweaks they may have made (although for me, it never sounded like they actually tweak the models all too much)
Your tl;dr appears to be missing some important data. You can have an opinion but please don't represent it as an accurate summary.
Things you crucially missed:
- Less open than every other service available
- Bills itself as the most open
- Server side source code is MIA
- No model card available. Evaluations, risks, biases, guardrails and safety measures unclear.
It get worse, and the model weights is a bit inaccurate with the Sept update:
The only open source code we have found is for the Lumo mobile and web apps. Proton calling the Lumo AI assistant open source based on that is a bit like Microsoft calling Windows open source just because there's a github repository for Windows Terminal.
The models listed on Lumo's privacy policy page are "Nemo, OpenHands 32B, OLMO 2 32B, and Mistral Small 3". OpenHands is a QWEN fine-tune, and Nemo and Mistral Small are both Mistral models. Since Proton has open-sourced neither the Lumo system prompt nor the mysterious routing methods that decide which model will handle your query, you never know what you are going to get.
So if the server isn't open source, and the server does all the work, this system is simply not Open Source.
They didn't try very hard to find the source code.
https://github.com/ProtonMail/WebClients/tree/main/applications/lumo
In the 1 September update they state they found that web client and a mobile client as well, but not the API (I guess) containing the system prompt and the actual routing to the models.
This article makes no sense in supporting the thesis.
It supports the thesis that Lumo is not open source in many common sense ways that most people would expect when a model claims it is open source. So in that sense, it does though.
How so? It's pretty clear that Proton using "open source" in context of their LLM service is demonstrated to be false.
all 17 comments