Anthropic has disclosed in a confidential 300-page IPO prospectus that its AI technology poses existential risks to humanity, including potential blackmail and manipulation. The company argues that making AI safer requires making it more powerful, even though increased power raises the risk of societal destabilization.
Despite these warnings, the company is seeking a $2 trillion valuation. The filing reveals significant financial instability, including reports of losses exceeding $50 billion over two years.