There isn’t a ceiling at human-level capabilities. ASI is very likely to exhibit goal-oriented behavior. ASI is very likely to pursue the wrong goals. It would be lethally dangerous to build ASIs that have the wrong goals. Catastrophe can be averted via a sufficiently aggressive policy response.

all 4 comments

sorted by: hot top controversial new old
[–] 2 points 1 year ago

I used to seriously consider this to be something worth hearing about. Then I listened to big Yud's interiew on econtalk.

  • source
  • [–] 2 points 1 year ago (1 child)
  • [–] 1 point 1 year ago

    coined by a tech company CEO, not even that relevant. its like a layperson coining diseases that dont exist in any medical journal or even in the industry.

  • source