True. The "we should slow down" also comes from the fact that there havent been any real technological advances since the transformer model. All improvements are from training bigger models better and more intricate scaffolding but you can only get so far with that.