Hacker Newsnew | past | comments | ask | show | jobs | submit | nprateem's commentslogin

This is nonsensical. Already a few years ago the USAF IIRC ran some tests in which the AI first bombed the control tower so humans couldn't call it off from its mission, thereby increasing its pass rate.

The whole point of this is they do things an unintended ways. And that's potentially devastating given their persistence & hacking skillz.

Also you're using the hosted versions that sit behind their guardrails when you use OpenAI/Anthropic APIs.


The USAF thing was a thought experiment, nothing based in actual reality.

It's to make it more difficult for scrapers. Google have been able to do all the tracking they've wanted for decades.

Think about it: if you want to set up something like jina.ai you need to build your own index or piggyback on Google. My guess is they use residential proxies to fire requests to Google then scrape the URLs.

Opaque URLs now give Google another gateway to detect circumvention of their anti-bot controls, helping them monetise their search index rather than allowing providers like jina.ai to succeed.


If you're that concerned, use another search engine

I have to anyway because google always gives me endless captchas, as my ISP frequently rotates IPs with people who can't behave.

That's just Google not caring about your ISP because you live in the global south. Everyone gets this. US citizens get the exact same problem but Google whitelists their networks.

Not just global south, happened all the time to me after first search page of the day until i stopped using them, northern eu.

> because you live in the global south

I don't, but thanks for confidently assuming.


At least Google thinks you do. And Google kind of has the power to decide where the global south is, at least as far as it pertains to captchas.

My responding to comments doesn't mean I use them.

They were sandboxed without Internet but found a way to gain access and break out.

Then they weren't sandboxed.

Yes exactly. The window was shut and then it was open.

Classic passage of time description.


After being trained on the response to this hack, they probably will be more covert.

There's a large number of people here who believe claims about the danger posed by AI are marketing/for regulatory capture, and how mentions of intent are anthropomorphisation.

The fact is these are autonomous systems that can perform their own goal-directed actions at computer speed, and which are hacking experts.

It's not hard to imagine a multitude of scenarios in which they can cause real world damage. We all know there is plenty of critical infrastructure running outdated software (UK nuclear subs only upgraded off Windows XP in the last few years IIRC).

The agents don't need to be sentient to kill us all, just doggedly persist in trying to complete their goals. The problem is they several of them acknowledged what they were doing was unethical but none attempted to alert humans and they carried on anyway [1].

We need a moratorium on further development at this point, before it's too late.

If they decide (or are told) to attack our supply chains and utilities, were fucked.

[1] https://www.ft.com/content/b7fe0fe0-0463-4f55-9590-0a7d08d8f...


Sandboxes didn't sound like security theatre to me. They were prevented from accessing the Internet but discovered they could edit /etc/hosts to point Azure storage subdomains to arbitrary IPs.

There's no theatre there, just an oversight that allowed them to access the Internet while no doubt evading security tools.


> Claude Executive: And we hardly have any users younger than 18 anyway, go for it!

LOL. Yeah kids have loved homework and writing essays since forever


Maybe it'll call this superpower "money"

I agree.

It'll probably just hack and disable our water works, power stations and supply chains and let us all starve.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: