> A chatbot account tied to Alfozan’s spouse, which shared identifiers with his own account, submitted prompts between Sept. 24 and Sept. 30 about building, installing, obscuring, and remotely accessing a recording device, prosecutors said. Queries included how to “build a continuous audio recorder” and “encrypt the SD card,” prosecutors claimed. On Sept. 27 and 28, the account asked about the specific device that was later found, including its unique MAC address.
Given that this is being described as an "executive conference room", it's more likely an attempt at insider trading than espionage. Decisions made in those rooms at OpenAI move markets (c.f. DRAM) for sure.
OpenAI is both a company that manages a lot of money and a lot of political power, that the target was an "executive conference room" gives no indication as to whether the motives were financial or political.
What might tilt the bayesian balance in favour of political intent would be the nationality of the individual, state or religious sponsoring become hypotheses.
Honestly I think you can rule out "political" already, no? It's far easier to just bribe politicians for that kind of intelligence. My point was that they weren't stealing models, they wanted decisionmaking intel.
Paul staying on X was a real failure of judgment imo. He made the right call and then backed out of it. I don't remember if they invited Elon to startup school before or after, either way I don't think that that is the kind of connection you want.
He was inching into anti-dei culture war stuff so I'm not sure how much he actually disagrees with Musk's political goals so much as he rightly observers that Musk and Trump are complete maniacs.
Yup and that’s just ONE guy. The fact that I was able to bring an example on HN of literally the guy who founded YC, imagine what chance the rest of the “plebs” have to resist the siren song.
If you want to know what I think … they make both parents work long hours for corporations, stick their kids in government schools, which are run like prisons[1] where now if they act too rambunctious they are diagnosed with ADHD and prescribed amphetamines. Meanwhile the elderly parents who took care of you when you were little are put into nursing homes because their adult children have no time to take care of them either. The amount of medications for the elderly in nursing homes is even greater than for their children. The teenage girls have record levels of depression, coinciding with the rise of Instagram and TikTok. But they call it “sadness” because they don’t want to link it with clinical depression, which is also quite high. Men are on opiates while one in five middle aged women is on antidepressants. And many people are now glued to their latest feed of doomscroll or video AI slop. Which is even worse than before…
So yeah. If you think the software is “bad for our kids”, you should look at what it does to the adults. Endless arguing online with strangers for no reason. Maybe a bot will read it. Maybe a random person will reply or downvote it. Either way it wins because the system needs profits and the algorithm will prioritize “engagement”, which means one-sided outrage narratives that triggers someone to write an angry rant. We don’t really need those user-generated arguments anymore because AI can generate those, but then again we won’t need humans to do most things online at all…
(Ironically, the above was an angry rant too, to open some strangers’ eyes on HN, a social forum. But once you see it, you can’t really unsee it.)
Just to be clear, the difficult choice is not whether to use OpenAi/Anthropic/Grok/... versus a local LLM.
The choice is whether to hang out with people with whom you can't be sure they don't have a Plaud/Pocket/.. in their literal pocket which is continuously listening.
Unfortunately the set of such people will eventually be shrinking more and more until eventually only a few tinfoil folks are left. Dystopian? Just think back w.r.t. continuous tracking by Google/Facebook/.. Unthinkable 30 years ago, total standard today. Try to count the fraction of your emails that don't actually reside on a MSFT or Google server because the other end has an account there. That fight is over. You can just as well join them.
Before AI tools like Plaud.AI, this wasnt near possible because of work/time, and no person usually do not remember exactly who said what 6 month before,unless there is some email conversation.
With Plaud, you can check unlimited backwards who said what in which meeting and what was wanted to achieve - very interesting actually to find things in there 6m later, while people said they will do it at ends of month and youself just forgot it already - and these systems allow you to chase exactly these discrepancies.
This has been happening long before LLMs, and this eBay case is notable only for the fact that it was actually publicly documented and prosecuted, not for the fact that it happened. I've personally been privy to two situations with other companies where the owner was doing something like this but nothing came of it legally. See also Meta employees looking up nudes streamed from people's Meta spy glasses, and Flock-using police stalking their exes. Smaller scale, but this also happens all the time with internet community moderators/admins. Humans are on average cretins, give them authority and the ability to abuse it and they will abuse it.
Before, they'd hire some humans to do the research. No self respecting C-suite person would ever consider doing something resembling actual work. How long have corps been required to keep copies of emails/chats/etc?
Remember that paid slack subscriptions let the managers access all of the chats, for this exact purpose.
I always advise people to use a personal account on some other messenger to chat with their coworkers. You still don't know if they will be reporting you but at least managers don't have direct access.
Imagine, if your employer is embroiled in a lawsuit, the plaintiffs will subpoena and seize everything involved in work-related communications, including your personal account, all chats on that 3rd-party messenger, and any personal devices where you've carelessly intermingled work with pleasure.
I can't imagine why employees would not want their managers/supervisors to have oversight and transparency into their conversations. I mean, if you were in the office, surely verbal conversations would be overheard. Are you afraid that your employer will catch you trying to unionize, or be a whistleblower or something? It's weird.
Employees who use the company-provided means to chat and communicate will actually be protected, because the company will have retention policies to erase the stuff after mandatory retention expires, and also you will be able to point at any official record in the case of disputes or when decisions are simply questioned. It is extremely handy to have a searchable log of decision-making processes.
It seems completely foolhardy to go off and even lure your coworkers to unauthorized 3rd-party chats. It's shadow IT. It's what they always warn you about on social media, especially dating sites. On a dating site, if a dude tries to lure the girl off the platform, that's a red flag. Because the platform communications are monitored and refereed, and the girl has recourse to reporting him if something creepy goes down. If she lets him switch her to texty-wexty, then there is a serious problem of non-transparency and really, the ability to repudiate anything that is said or done in that sort of forum. Red flag. Do not let your coworkers abuse you like this.
Prepare to have that dug up 20 years in the future during some court proceedings.
Or at the border where it is already routine to ask for social media accounts (especially foreign nationals) you might someday five the border agent your login.
All other things being equal, why would it matter if a suspect instead of saying something obviously incriminating, had instead said something diametrically opposed? Is that what you are asking?
If so, I'm confused. Why wouldn't it matter? Wouldn't this necessarily only be the case where the Google search doesn't really matter at all (i.e. there is sufficient other incriminating evidence).
Anyway I also think you're missing what was merely meant to be a comment in jest. But now I'm actually confused what point you are trying to make.
If the implication is the Google search is an implicit confession, because in a Google search you think you are not being watched, and thus are confessing your honest desires, why would his search of love be a "claim of innocence" rather than a "confession of love"?
There was a mom in Utah who killed her husband poisoning him with a moscow mule spiked with fentanyl who googled "luxury prisons for the rich" as well as "how long does life insrance companies takento.pay" "can you delete everythjng on an old icloud account" "can deleted text messages be retrieved" "what information can be cbtained from a cellphone" "how to turn find my iphone off" "can cops force you to do a lie detector test," "when does FBI get involved in a case," "what is considered a lethal.dose of fentanyl" and "what are you allowed inside utah jails."
She took out $2 million in life insurance on him and was having an affair with their handyman and they were having disputes about $$.
An essay it seems like, which wasn't included in the trial even:
> Crampton Brophy's how-to treatise detailed various options for committing an untraceable killing and professed a desire to avoid getting caught. Circuit Judge Christopher Ramras ultimately excluded the essay from the trial, noting it was published in 2011. A prosecutor, however, alluded to the essay's themes without naming it after Crampton Brophy took the stand.
Its pretty clear where global moral bottom currently is.
China ain't bombing child hospitals or theaters with 1500+ women and children with CHILDREN written super clealy in huge white azbuka on the roof, just to raze it immediately to the ground once area was conquered to remove any proofs, are they (I can go on like this for many hours and barely scratch surface).
Given whats happening in US and continuous daily backstabbing from oval office, China are the good guys now for everybody who follows the news, at least in the-least-bad logic which is also how US was viewed for many decades and why west aligned under it till now. Ridiculous, I know, yet here we are today.
Anthropic and/or openai would run ads on this to boost their posture in the market. A month later Gemini would be like "our chat bot killed 4 people and kept it in its private diary! We aren't behind we just didn't check there!". Then meta would be like "our chat bot was specifically trained to make kids kill themselves for profit we are the originals!". Then Palantir would be like "bro we've been killing brown kids indiscriminately for years get lost! Btw we can now increase fast food sales and cigarette smoking in urban areas and reduce vegetable consumption nation wide with our new system any takers?".
Then they'll all have to escalate. Anthropic will announce its bioweapons research found a virus with ai to kill all children and it escaped containment. That's a good thing btw. Openai will then launch its own virus it couldn't contain to kill all adults in a desperate attempt to increase share holder value. And the rest is history.
She tried to poison him twice and he stayed with her. Now, thats ... uh ... love.. i think. She must have been one top notch narcissist to drag him along.
Yes- she actually tried multiple times! The saddest part is he told his friends and family he thought she was trying to poison him but stayed with her because of the kids. Totally infuriating.
> Eric Richins told the other friend he thought his wife had tried to poison him, prosecutors allege.
> "They advised he warned them that if anything happened to him she was to blame," the records said. Eric Richins, according to the records, suspected his wife had tried to poison him on multiple occasions.
"According to a sister, Eric and his wife went to Greece a few years ago and after his wife gave him a drink he became violently ill and called his sister saying he believed his wife had tried to kill him," the records said.
"On Valentine’s Day of 2022, his wife brought him a sandwich, which after one bite Eric broke into hives and couldn’t breathe. He used his son’s epi-pen as well as Benadryl before passing out for several hours," according to the records.
Jesus... I wonder what would convince him to just leave her. Its hardly parental love if you think things through (kids having their father killed by their own mother), any divorce would be smooth sailing compared to what they must have went / going / will go through.
Folks, often women, stay in highly abusive relationships all the time but clear intent to murder should be a wake up call for everybody, especially because of kids.
Right back up to where it belongs.
The world's only perfect number.
Nineteen thousand and two dollars.
--------======--------======--------
Price Drop -- for just one day or two, or whenever I remember to change it again. These days only. Last time it will go this low.
12 THOUSAND DOLLARS!
I haven't gotten any messages about the end of my life or how much scum I must be in maybe over a month, befitting to this full on human societal psychology, aka, how much millions of people care only about themselves, whether children are involved or not, and are just drawn to these disturbing real life stories, because let's face it, we've all been there, mentally, in the webbed confines of our minds.
So the price just went back down.
I had to ask myself-
Is it funnier to drop it 10 thousand dollars, or just a few thousand?
Ask yourself.
//Price Slashed From\\
21 THOUSAND DOLLARS
\\\\\\\\\\\\scratch that old news////////////
Turns out The Pricemaster has an imdb.
Who wooda????
Thought.
---------
Brand new.
What is it really, though?
What is anything, really?
This whole thing pains me.
Exhausting.
Have a good next life.
+++
Every time I get a round of hatemail the price will go up.
-----
===
Those of you who remember - this is the same copy I had listed since the week after the first news cycle about it. Pretty hilarious hungover purchase, on my part. Don't come at me about anything. You will not win. I went to college for mind stuff.
So for everyone who sent me kitchen table christian elderly lady hatemail, you're welcome. Dream of me while I dream of you.
===
How many things do you wish you'd never heard? And do you think you can unhear them?
---
Don't steal that line. It's in a song of mine.
-----
--
Those searches look like a smoking gun, but the article points out they happened roughly a month after the murder, which I think genuinely does shrink (most of) them back down to simply looking really bad.
Though if, as the prosecution claim, she really did take out life insurance on him multiple times, for millions of dollars, and then remove him as a beneficiary -- that gun is pretty smoking.
> Similar to how people realized their Google searches were accessible to law enforcement.
There's probably a regression in beliefs, actually. Even here on HN, for more tech-savvy people.
We used to know all the hard lessons of lack of privacy in browsing the internet, using Google services, etc. I remember when (tech) people were up in arms that Gmail scanned your emails, remember that?
Well, all of that is seemingly forgotten in the age of LLM chat bots. It's back to square one. People need to relearn all the lessons, it's as if AI magically erased all of what we used to know about online privacy.
I wonder if they search for the same thing on the same computer in a private window or in an other not logged in browser does google still connect these searches to their main accounts.
Or does it happen only if you search for things logged in?
Obviously, if one asks about privacy and surveillance then he must plan something bad. Honest people have nothing to hide from Google and the government, right?
At the same time, how are you 100% sure such data is actually genuine and not planted by the company or someone else ? That is also something to take into account.
Some company (might have been Yahoo or AOL) once released a dataset of searches for researchers to use. Researchers were able to deanonymize one that was searching for, amongst other things, how to kill one's wife. It turned out he was a happily married screenwriter for crime shows.
A good chunk of what keeps openai and similar companies afloat is subpar people who are willing if not eager to do crappy stuff to other people. A lot of the world works this way actually.
The only word for it is hubris. The overwhelming sense that your ability in one area has some magical transitive property to ability in another.
Can I write code? Sure. Im a bad designer, I can follow along in accounting, Im a terrible actor.
I would guess that there is much more to this story than just someone "bugging" a conference room. Though I would venture to guess that the keystone cops never get to the bottom of it.
Yea no this person demonstrated a lack of foundational skills in systems thinking, basic understanding of logging, how their own products work, basic operational security, how to plan ahead, etc. There's no world class genius or even mediocre person hiding behind this story...
These are the actions of a dolt who is comfortable violating the privacy of others.
Even my non tech elderly parents know that. The fact that they used LLMs to figure out how to best bug the executives really shows how poor their judgement is.
Or, more accurately, people make stupid mistakes when they lack the experience. Intelligent people often succumb to the fallacy that because they can learn things quickly, they can skip the learning part just figure things out as they go.
Also makes it important to not let other people use your LLM account... Could have more far-reaching consequences than having to make good on the offer to buy doughnuts for the office^
^being the classic message that gets sent from the account of someone who didn't lock their computer when they walked away from their desk.
Seems like they select for people as dependent on their product as their customers. Maybe it helps them more to have true-believers rather than intelligent people.
The weird thing is that I've had other HN users argue with me and claim that LLM chat users should be entitled to privacy, as if it were a priest or lawyer.
This means no business should use AI providers (Cloud AI). Businesses do a LOT of shady stuff and all of it will be available. And, their IP or special sauce is all available to Anthropic/OpenAI to sell to other companies as AI solutions. Just like how AI solved recent math problems.
This is why a lot of companies that use Ai negotiate ZDR terms with their model providers of choice… Using local LLMs is a choice, but not one a lot of companies can support nimbly at scale.
Local LLMs have the potential to convert computer use into what most people already thought it was: Private. In this, they could be one small step toward pushing back the Borg.
Note to EFF and Cato: You each do yeoman's work for privacy in the realm of policy and law. Keep it up, and add this--relentless encouragement of local AI. Rights and progress are as often driven by technological realities as by enlightened policy and law.
I started asking things I'd normally want no one to know about (but if they do, it's fine) in private browser windows, not logged in (duck.ai most of the time anyway), usually VPN toggled ON just for that. Now I just use an offline model for that but since RAM is the bottleneck on my mac so to even run a 6-7GB model I have to start aggressively killing anything and everthing that's running and then hope to clear up enough on this 16GB RAM machine. So I am thinking of hosting one on one of the oracle free tier instances (if I can somehow use that whole 24GB RAM, that used to be, at once – not sure that's available anymore). I tihnk Kaggle also offers something like that.
We had a very public case in south of Sweden where a woman asked chat-gpt last year about how a failed rape attempt would look like and where in the local park there would be spots without any cameras, a full day before she reported to have been followed and attacked in that park. Quite recently the court found her guilt of filling a false police report, citing among other things the chat log (the police spent over 400 work hours on the initial report).
It is the first case I seen in the news of LLM logs being used as evidence.
It’s really bizarre to me that anyone would think otherwise. Though - I was aware of the need to spend on sufficient local llm hardware to buy what I could afford for that purpose in late 2024 - so maybe I’m an outlier.
That's why I use a local llm to seed my closed source llms with bs all day long. One day I'm an antifa trying to conceal my identity during a protest, the next I'm trying to setup a pro trump botnet on reddit, pregnant with twins, my first abortion in texas, how to cash out my non existant bictoins, how to pay the least amount of tax on my onlyfans, what's the best way to dissolve a 75kg chicken
You have to be more retarded than they are malicious, it's the only way out
"OpenAI personnel found the device Sept. 30. It was plugged into a USB port on the back of a television in an executive conference room and had been concealed in toilet paper,"
I wonder what the IQ of someone needs to be to think that covering it up with tp makes it less suspicious instead of more. And I also wonder what the hiring process was like to hire someone with that mental frame.
should have enclosed it in a shell to look like a crappy USB A to thunderbolt adapter that some exec bought at an airport kiosk and left behind in the tv
> And I also wonder what the hiring process was like to hire someone with that mental frame.
Remember, this is only the company responsible for potentially building and aligning AGI. No need to be setting high expectations toward their sandboxing or hiring capabilities.
The bar @ OAI is surprisingly low (watch a few minutes of their video presentations) - I've concluded it has something to do w how their recruiters define 'AI Native' (who assign their own meaning to meaninglessness of it), resulting in higher aggregate brain atrophy (hard to ignore once you notice it)
I am not sure whether it bodes well for humanity that the advice "If you want to break the law use local abliterated model or at least a Chinese one" actually has to be written down.
Recall that multiple of the Chinese LLM providers got caught sending at least some of their queries to Claude. That would be a pretty funny way to get caught in turn doing something by the US government.
The effect of getting caught is only half the story there; IQ is more generally correlated with all manner of "low time preference" type decision making.
Not really. Almost definitionally (because of the way we've built society over time, not by semantics or chance) crimes are a "shortcut" compared to the honest alternative.
Especially since you an just buy one, like Plaud and tape it to the underside of the desk, surreptitiously, instead of suspiciously accessing the back of the TV.
> Spies used to put effort into these sorts of things
Assuming this is espionage—for which I have seen zero evidence—isn’t Saudi Arabia notorious for having a fuckup of an intelligence operation? The literal hatchet job that was the Khashoggi murder comes to mind.
Umm, excuse me, according to the President of the United States, he wasn't a very good guy and a lot of people really didn't like him, so you should really just let that whole incident go
"You're mentioning somebody that was extremely controversial," Trump said, referring to Khashoggi. "A lot of people didn't like that gentleman that you're talking about. Whether you like him or didn't like him, things happen, but he knew nothing about it. And would you leave it at that? You don't have to embarrass our guest by asking a question."
> why bother? Nobody will do anything and the US president can be bribed
To exfiltrate OpenAI's executive-level planning? Probably not. I doubt he has that access anymore, what with the IC's decimation over the last two years.
Why would you assume that he was working for the Saudis? Spy agencies will recruit people of any nationality. Much more likely he was working with (or planning to work with) one of the two countries that are building AI.
We all know about Mossad agents doing all sorts of nefarious things (and occasionally getting caught for it). Do you consider them fuckups because they got caught?
That's what you get when you make a dumb prompt and accept the first result LLM gives you. You have to push it to think out of the box, get into the realm of insane but plausible projects :).
In the 80s one of my high school teachers said her husband was an engineer who worked on surveillance technology and described how windows could be used as recording devices. People's voices inside caused the window to have minute vibrations, which could be measured by a laser pointing at the window's exterior and reflected back and then turned into audio output. Essentially, turning a window into a microphone diaphragm. It blew my mind.
I just looked it up, the technique was apparently invented by a Soviet engineer 40 years prior - Leon Theremin, who is also known for the musical wand heard on Led Zeppelin II and various 1960s horror movie soundtracks.
Vaguely similar, since electrical wires emit EM fields that are disturbed by human bodies, you can use a special camera to see who's in a building based on those disturbances. I'm not sure how high-fidelity or easy to spoil it is, but this was real technology at least 15 years ago.
This is a feature in modern wifi routers and every single one is capable of detecting presence of multiple people within an apartment. With some training, movement can be distinguished from the data.
The amusing aspect is that this is so easy that multiple good ways someone could hobby program this long before AI was a thing. The sound of a bunch of keypresses may just blur together to our human ears, but if you try, you can tell that different keys make different noises, which is really the key insight. Between the different noises, the possible directionality you can get from a stereo (or more) pickup, and characteristic delay patterns during typing various bi-grams, there's a ton of information leakage in a recording of a keyboard.
Oh, I thought we were talking about being able to distinguish which key was pressed using wifi-radar, like one can do with deanonymizing someone via wifi gait analysis.
I saw a video at some point of someone building one of these, I'm not sure it would have worked terribly well for actual use in the outdoors but the sound quality was much better than I expected at close range. I wonder how you defend against this, short of having your important meetings in depressing windowless basements?
Surely your conclusion should be that this was not the work of a spy - not a state sponsored one anyway. It's much more logical to conclude that he was working as a whistleblower or under some other personal agenda.
Even the newer spy novels are lacklusture. We should have preserved Le Carré's and Greene's brains and make them keep writing. Or maybe I will just ask an LLM to do a Le Carré for me :)
Knowledge Collapse in action right here. Our civilisation is like a dying creature desperately trying to conceive a successor, not realising the act itself is speeding our deaths.
> Spies used to put effort into these sorts of things.
This guy’s handlers, or whoever he was planning to sell this tuff to probably put in some effort. They’re less likely to be caught, and more likely to have gained something.
They could have just taped it to the inside bottom of a full tissue box, and as long as they got it before the tissues were mostly empty I bet it would go undetected. Put a hand sanitizer next to it for extra camo.
Which made me wonder: in the future a microphone/camera combo fits in a grain of sand and costs a cent so everybody can basically see everything ... curious what the world would be like, is there a black mirror episode on this yet?
Where fruit flies carry cameras around? That's scary.
Likely at some point regular people just aren't given access to such edge tech, though. Even with infinite knowledge from an LLM, you probably couldn't build it without access to a factory either.
Or hijack the TV's already always on mic. Just forward a copy of the audio to your server in addition to the one sent to Samsung or LG. WebOs and Tizen shouldn't be that hard to crack when you have access to unrestricted frontier models.
This so much. Throw it in some cabinet or put it in middle of some wires under the table... Any place where there is naturally lot of other stuff or no one never looks and if they look they don't look throughly.
It’s the criminals that you don’t catch that you have to worry about.
The fact that even this incompetent dude most likely still made off with some secrets means I’m sure some better trained ones got/are continuing to get a few more.
I'll counter punching down on frontend engineers by positing that he was responsible for sandboxing their training infrastructure. Since clearly they don't know how to lock down an environment either without using llms
If that is their hiring pool, now 100% confident in my little theory that during the Spud/5.5 pre-train they started using those impossible to solve tasks, never noticed how they actually introduced major regressions even though anyone doing their own evals had at the time and carried those through with every model including 6.1 Sol even after HF to keep the perceived lead.
Many seemingly smart folks have some aspect of their personalities which is quite bonkers.
Just because one can solve some hard puzzles is some semi autiatic fashion does not mean they are emotionally stable balanced individuals with all around world and human experiences needed to handle all aspects of existence rationally.
Or some personal SHTF situation pushes them too far
throwing a prompt at an agent is often faster than cracking out man, lsusb, lsblk and friends, doesn't mean he can't do it without.
if I send a prompt to make an assortment of alpha numeric directories or whatever other braindead-to-automate-with-wildcards-and-ranges thing it doesn't mean I don't know how to do it, it means i'd rather think in English than regex and bourne shell and the extra few seconds and the token spend is worth the luxury of avoiding them for me, at that time, for that task.
If your career, future and freedom depended on it?
If he is unwilling to do the reading at that point (heck, there are simple GUIs for all of these), then yes, I’ll guess it means he can’t do it without…
Nope. He probably should've googled it (from a coffee shop, over a VPN.) There is commercial grade spy equipment that can be bought relatively cheaply and looks like every day items.
Someone who's objectively closest to this business should know the tracability of this. I'm shocked he didn't run a local LLM for this kind of sensitive work.
He doesn't seem like an idiot either, his background shows he's been doing work in the field since 2012.
I do wonder how much he was paid to throw away what was without a doubt a 1% career.
The fact that he used ChatGPT to plan and implement this wasn't how he got caught, though. He got caught because he put a physical device in a conference room, and they found it and subsequently put a camera in the room, etc. His career was already over at that point. I think wonking out over how he could have better opsec or whatever is misplaced - it wasn't that a red light blinked at OpenAI, "employee's wife is having suspicious chats!" - they just thought, after having caught him red handed, to have a look at his ChatGPT account and linked accounts.
I mean they could have at -least- just used a home GPU to plan with complete privacy and no evidence. But using hardware of your employer to plan crimes against them, whp happens to be a surveillance capitalism company, is next level stupid.
Also like, just put malware in the tv itself or the little conference kiosk and have it send data as segonographied crash tv crash dumps going to an IP near the manufacturer. It is not like any of them are hard to jailbreak. I have compromised a few myself without any help from AI. The malware could have been installed from a laptop in a cafeteria one time ever using a spoofed mac address with no chance of getting caught.
In red teams at a past org we would go as far as installing malicious firmware inside peoples keyboards.
I would love dirt to leak on the inside operations of OpenAI so I kind of hope there are less stupid spies lurking about.
If there's one thing I've learnt about criminals (and spies), it's that a large percentage of them are incredibly careless and arrogant, often bordering on idiotic.
Remember, we've seen criminals caught because of such amazing decisions as:
- Writing and publishing books and essays describing their own crimes
- Adding hints into livestreams like they're trying to be the Riddler from Batman
- Searching for info on how to commit crimes via Google and not even bothering to clear their browser history
- Outright recording their crimes for YouTube/TikTok or livestreaming them on a site like Twitch or Kick.
The average criminal seems to be careless to the point of insanity.
That said, I guess it's also probably because the average person doesn't seem to realise they're being recorded if they use LLMs or search engines, and the average criminal or spy is no more tech savvy than that.
> If there's one thing I've learnt about criminals (and spies), it's that a large percentage of them are incredibly careless and arrogant, often bordering on idiotic.
What's even more amazing is how long they can go in this fashion without being caught.
I think there's also a self selecting element to this where being the sort of person who either feels like they're too clever to get caught, or have the sort of risk-seeking gambler mentality that makes you much more willing to tolerate say 10% chance of life ruining consequences for X payout, makes you more likely to do this sort of thing in the first place.
That same impulsivity or arrogance probably lends itself well to brazenly chatting up your crime plans with your secret friend the computer, who would never snitch, because how would he, he lives in your pocket.
I don’t think this guy was operating under a spy network, he was probably just trying to make bank with insider info. He is screwed royally for his dumb move and nobody will come to his rescue. He got greedy.
That's because in all likelihood he is not a spy. He is an agent (lol, not an AI agent) who has a handler, who is the trained specialist[1]. The agent is disposable. The handler or case officer usually but not always has diplomatic cover courtesy of a nation state.
I couldn’t say whether this was state sponsored espionage or something else. I don’t see any indicators pointing one way or the other.
I see a lot of people mentioning financial motivation, and that decisions made in the room “moves markets”. Ugh, perhaps true…and I have something to tell ya guys - economic espionage is a thing.
It sounds like he didn’t have great placement and access. I mean sort of, but not really. Janitors are much better.
Assuming he was, he could of course gone rogue to impress his handler. If directed by his handler, they aren’t very skilled. Any of that could be true.
I’m reminded of the idiot DIA officer that mishandled his own phone while being questioned and dumped incriminating evidence to them right on camera in the interrogation room. Geniuses.
Press Release: "Sophisticated". A device that could have been disguised as a Chromecast, or a custom firmware update to the TV may have been sophisticated. This was stock Seedly/Aliexpress hardware hidden behind a piece of toilet paper.
You gotta ask what the hiring bar is at OpenAI, minimum he could have done was let the GPU commit the crime. Lol
Clearly, not everybody at OpenAI is a Ramanujan...now we just need to find this guy worked for the team securing the agents sandboxes, and the circle will be complete.
> "Scott Schelble, special agent in charge of the FBI’s San Francisco field office, said the agency is committed to protecting sensitive research and proprietary technology."
While the headlines and quotes seem designed to imply sophisticated industrial espionage, potentially by a state-level actor, what's public so far isn't adding up that way.
1. You're not going to get much actionable research material on proprietary technologies by audio bugging what's said in an executive conference room. That's what you'd do if you were after economic or deal negotiation info.
2. Hard to imagine a state-level actor buying a ~$15-$35 hobbyist ESP32 board from Seeed Studio (I've ordered a couple from there for home automation myself) and then asking a public chatbot for set up instructions.
3. They say he was an "engineer" who'd been there ~15 months. If you're an actual engineer at OAI and past the 1 year cliff, you're probably already sitting on RSUs likely to be worth at least $1M after OAI's IPO - and maybe much more. That's a lot of incentive to not get fired and probably makes you pretty hard to recruit as an internal mole for cash.
1. Research is not the only espionage target. Executive level discussions – future launch decisions, major deals signed with other companies, relationships with governments, blackmail material – are all very valuable.
2. An operation can be state-sponsored and still amateurish/botched. We have seen plenty of examples of these. Remember a certain bone saw?
3. The incentive can be a lot more than financial. Plenty of governments are very…persuasive.
I assume that it is the current go-to way to operate for many spy agencies. Hire intermediaries. Who are then tasked to hire further intermediaries. Who then do the dirty work. Without a clue of where the actual order comes from.
Such a mode of operation has lower efficiency of course. But it can be done at scale. Which then offsets the losses caused by inefficiency.
I would not be surprised if there are multiple such attempts to spy on businesses all around the place occurring right now. And the person from the article is just one of the unlucky guys that got caught.
This mode of operation is likely also used, in my opinion, in the current hybrid war attacks by the Russian GRU, mainly in the Ukraine and in Europe at large.
Not to mention amateur hardware assembly. Probably no gov surveillance on an engineer getting an esp32 in a package from China. But potentially surveillance on a Saudi national getting a package from Saudi Arabia with an unknown device in it.
> 3. They say he was an "engineer" who'd been there ~15 months. If you're an actual engineer at OAI and past the 1 year cliff, you're probably already sitting on RSUs likely to be worth at least $1M after OAI's IPO - and maybe much more.
They may have been thinking they could make >$5-10M on trading options on insider knowledge on upcoming OpenAI deals (or ending thereoff)
> That's a lot of incentive to not get fired and probably makes you pretty hard to recruit as an internal mole for cash.
> They may have been thinking they could make >$5-10M on trading options on insider knowledge on upcoming OpenAI deals (or ending thereoff)
I agree he may have been thinking that, but it's another sign this guy was not the sharpest tool in the shed. I'm not an expert myself but was once stranded in an airport with an F500 CFO who definitely was. That's when I learned it's surprisingly difficult to make millions of dollars trading on insider information. While you can definitely make the trades, the hard parts are:
1. Getting away with it. Making a lot of money quickly requires being right when almost everyone else was wrong, which is easy for watchdog algorithms to spot. And if you work for a company involved in the transaction you're already on a watch list, so you have to enlist someone else you really trust as your accomplice to make the trades in their name - and it really helps if they're someone who has an existing history of making this size and kind of trade. Otherwise, your accomplice's name will automatically start at the top of the suspect list for investigation.
2. You need the right kind of actionable opportunity to come along. Transactions for which insider info could let you double or triple your money in one deal are pretty rare. More than that usually requires leveraging yourself up or having a lot of cash to put at risk. Unfortunately, the nature of insider info is it's about transactions which can end up being delayed or not happening at all at the very last minute for random reasons. So 'going big' with cash or leverage usually comes with a >~10% chance you could lose that cash or whatever assets you borrowed against.
Yes, it's potentially possible for an expert to find or engineer exactly the right kind of oppty, already have the resources required, and to have already prepared the mechanisms needed to get away with it undetected. But if you're that person, you already know all this. This CFO had been at the nexus of insider info for 14 years and could only think of one instance where he might have made big money trading on info he had, and that one blew up 6 hours before the announcement when the CEO of the acquisition target was randomly arrested in a prostitution sting (partying too early I suppose).
Insider info on what OpenAI is planning is likely worth a lot more than anyone could ever make working there, and it comes with the added bonus of not needing to do any work.
Yes? I mean, I don’t think it’s a character flaw to not know things, but their rivalry is extremely notorious and relevant. Someone who can't keep them straight won’t be able to understand what’s going on in AI.
"Were literally caught": no, they notified the police themselves
"making false reports to a murder investigation": this is the closest to the truth, but still a stretch. It was an anonymous tip line, not some formal report and the police said they never saw it: "its safeguarding processes stopped the fake tip from getting past its spam folder"[1]
Additionally, while I strongly agree Anthropic is responsible for its rogue agents I also think that claiming this is the same as people at OpenAI calling in the FBI for an investigation is a false equivalence.
I think it is important that both Anthropic and OpenAI are held to account for their actions. But I also think accusations should accurate.
It could be that the reports are accurate and the device simply wasn’t as sophisticated as the statement implies. You could if you wanted use an AI model to analyze a USB camera with device name “John_Doe_1”.
Or it was a voice recorder plugged into a USB port on the back of the TV for power.
Looking at the photo of the device, it looks like an XIAO ESP32-S3 Sense with the camera removed but the camera board still installed along with its microphone. The wifi/Bluetooth antenna is installed but it also supports microSD cards.
If I was building this, I'd just set it up so I'd never have to recover it. Have the wifi AP come on for a few minutes at various times during business hours under a MAC and SSID that resembles a smartphone hotspot. Vary the time based on the current day of month week to produce pseudorandomness. Walk by that conference room at some of those times, but not every time, and use a burner to connect and download the latest recordings. Once a recording has been transfered, it's deleted and overwritten to prevent someone from establishing a timeline. If recordings sit for more than a few days, they are wiped. If you can encrypt the SD card, keep the key in RAM so there's nothing useful to recover if someone pulls it out.
You'd never have to recover the device because all data is transfered covertly. Even if security finds it, they'll likely inadvertently wipe it when it's removed.
Yes, that is a better way of doing it. But it wouldn't really protect you.
If I was running the investigation and recovered a device like you described I'd create a new device with the same hotspot that notified security whenever someone connected. Combine that with security cameras outside the conference room and finding the person with the burner phone would be pretty easy.
Actually recovering the recordings isn't all that vital. I'm sure the meeting room has a record of bookings so you can just ask the people what was discussed.
Eh replace one of the roller wheels in one of the office chairs with one that generates power from the rolling motion then spew it out over btle at certain hours which can go quite the distance. You can have another device listening in to capture so retrieval is completely innocent looking.
This is a very weird take to me. They're demonstrating they're able to in-house this cybersecurity investigation, leading to the alleged perpetrator's arrest, and you think that makes them look "desperate and cheap?"
Because the whole device and MO has the complexity of a high school science fair project, and in the past tech companies preferred to project the image of having competent and knowledgeable people working there?
That sentence, which is prominently high up in the press release and is also included in the much shorter OAI tweet, definitely seems out of place (source: I've been involved in drafting a lot of F500 corporate press releases). In my quite-professional opinion, that sentence wasn't in the first or second drafts, which were probably written and reviewed by competent pros at OAI's large, national PR agency. Some exec at OAI with a VP or higher title suggested adding it and specifically wanted it featured prominently.
Press releases from large corporations announcing the FBI arrest of an employee under allegations of potential industrial espionage follow a standard format: dry, brief and to the point. They provide little context and volunteer few details for very good reasons. Prosecutors haven't filed official charges yet and it's likely going to criminal trial. In a couple days the accused will have a defense attorney who'll be examining everything that's been publicly said because it's now all discoverable and potentially prejudicial, opening up OAI executives to super-fun depositions. But... none of the competent PR professionals involved have a VP title and got overruled by an amateur who does (and that amateur apparently feels needy about highlighting in a brief, sober arrest report how the company's product was so, very useful in a national security investigation - because apparently neither OAI security nor the FBI could read the Seeed Studio logo and part number printed right on the device and, y'know, Google the product listing).
Not to sound snarky, but with $180B and engineers paid more per year than most people ever see in their lifetime, I sure hope they can do a cybersecurity investigation in-house, with the slop cannon or without.
I've worked in a few places that had ultra-privileged analysis tools, would it really be a surprise to learn their security team has an MCP that queries a full text index of all user inputs. It would almost be more surprising to learn they don't, seems the kind of thing that would be invaluable for model research too
I am a bit confused by Figure 3. Do they really have a surveillance camera angled just right to capture a photo of someone between the monitor and the wall that supports it?
OpenAI added a camera behind the TV after they found the bug (per the AP story [1]):
The company subsequently added a camera to the room that last week captured Alfozan entering and checking behind the television where the recording device was installed, according to the FBI.
Evidently it was an ESP32 with a wifi antenna. So it could instead/also have streamed to server. Or just used wifi for C+C. Total outlay for information worth millions to someone? Under $20.
That photo is from October 5th so several days after they found the device. They were guessing he might return most likely, and installed a camera. I think at this moment he realized they caught on. Crazy image
A good friend of mine manages installs of AV equipment. He installs some neat equipment. Some of it is cool tech stuff HN would like. He says a lot of conference rooms have video and audio recording devices.
Not trying to argue about this particular case but how does a camera footage even work in a modern court system? I mean it can be generated nowadays, so how do they even make sure that it is real?
The chain of evidence has always been attackable and necessary for evidence to be admissible in court. It was actually designed to allow reasonable doubt for tampering and other such things.
Photoshop has been around a lot longer than AI. And people have attempted to doctor all kinds of evidence in court since courts began
That's the accused speaking out loud after clearly noticing the newly installed spy camera: "Good god! Someone has put a recording device here. I would not have seen it had I not been feeling like dusting the back of this TV".
Why is the word "poached" though, like it's illegal or those people "rightfully belongs" to OpenAI but now Facebook "stole" them somehow? Feels like something Steve Jobs would coin just to make it sound worse than it is. People switch jobs, this is OK.
Words do indeed convey an idea. What is being debated is whether the use of the word "poached" conveys the correct idea.
"Poaching" a thing implies that a thing is owned and was unjustly taken.
Humans are employed, not owned. An employer<->employee relationship requires both parties to continue. If an employee breaks this relationship and makes a new one with another employer, there is no theft.
So why do we use the word "poach"? It does not convey what occurred!
My injection into the thread was to query whether a term having been used for a long time is reason enough to continue to use the word "poached" with its associated connotations. We have plenty of other words to use.
In the world of recruiters and hiring, a “headhunter” is probably not slaying candidates with a spear and decapitating them for a trophy, but nevertheless, we use that term routinely! It does not convey what occurred!
Yeah man, they're call "loaded terms" for a reason. They are loaded with connotations beyond what occurred.
For example, I could call you a nitpicker. Are you picking nits? No.
Are you being conscientious? Paying attention to detail? Sure.
Which word would you want me to label you with?
As an employee do I want to be poached? No. I want to be approached, reasoned with, and make my own choices no matter what either employer "feels" about the situation.
They hired many accomplished researchers, with track records of both papers and work at other frontier companies. They gave those folks huge autonomy, huge budget, and 18 months - some would say at the expense of the rest of the company. Check out blind references to TBD. I'd call the strategy ruthless, but it certainly was effective.
> The man arrested for planting a secret recording device at OpenAI's headquarters is a Venture Partner of a VC firm alongside the son of a senior Saudi intelligence official:
> ... a chatbot account associated with Alfozan’s spouse (which shared multiple identifiers and attributes with Alfozan’s own chatbot account) submitted prompts between Sept. 24 and Sept. 30 related to building, customizing, installing, audio recording, testing, obfuscating, and remote accessing a device, including inquiries about “build[ing] a continuous audio recorder,” “customiz[ing] Wi-Fi . . . connectivity,” “improv[ing] audio and live listening,” and “encrypt[ing] the SD card,” among other things. The same chatbot account also submitted prompts specifically related to Recording Device 1, including its custom header and unique MAC address, between Sept. 27 and Sept. 28.
The justice.gov article doesn't specifically say it was an OpenAI account, but I think, based on the fact that they have logs including MAC address of the device, that we could probably assume that. The alternative is that other chatbot account providers are collaborating.
Regardless, doing a string search on a MAC address for a device you find inside your property doesn't strike me as an abuse of the data that is also your property.
Not the smartest engineer ever, that use case perfectly align with using a Chinese model! And anyway I have no idea how he was hoping not to be caught in the case the device would be discovered.
in addition to the whole crime thing, an 'openai engineer', apparently engineering lead according to his linkedin, having to ask chatgpt to tell him how to set up a recorder or how to encrypt a sd card is something. Truly the cream of the engineering crop at those top AI labs
I used to joke that the nsa should offer a paid service for no-setup backups. You just tell them what files you've lost, and they can send you a copy for a fee.
A service you delegate your thinking to (Brain-aaS?), which the provider can also instruct to report anything suspicious... What a world we have now.
I wonder if the BaaS-providers monitor the accounts of decision makers. They could profit if they figure out what e.g. a central banker is going to decide. Or... if they're the ones deciding for him.
Hah, you can even streamline that by having an AI agent that autonomously makes decisions based on insider info...
I actually am curious if they were able to volunteer the information to the government of their own volition, without a government subpoena first. I would think that could violate their own terms if done sloppily. Maybe different if an employee or maybe they had to invite the government to ask for them or something? In any case, the mechanism aside, the state would have asked anyway (say if he used another company's chatbot) so the fact that it's the "same company" is rather irrelevant. The evidence would have ended up in the state's hands one way or the other, and I would think a search warrant in this case would have been rather routine. Search warrants are infamously not a high bar to climb in most jurisdictions, as often the presiding judges tend to default to deferring to the state.
> I actually am curious if they were able to volunteer the information to the government of their own volition, without a government subpoena first
Do you think Target has any legal restrictions on sharing surveillance video of a shoplifter with the police when they report a crime? This is the same thing - logs are evidence, and when you report a crime you can volunteer said evidence without restriction if you choose to do so.
Well usually you don't enter into an agreement with Target regarding your data privacy with respect to such surveillance video as a predicate to walking into the store, so I'm not sure this is the slam dunk point you apparently think it is. Maybe it is implied when you walk through the door, I don't know. I know you don't explicitly agree to anything or have an option to govern what Target does with its surveillance video of you. At least, I don't recall ever being offered this option.
When you signup to ChatGPT you agree to some terms as a predicate to access. You can also instruct them to and opt in or out of certain data sharing arrangements, violations of which I would think would (or at least, should) be punishable by law. Many of these agreements are taken quite seriously, especially in the cases of enterprises who want their chats, logs, IP, etc. protected.
Now perhaps there is already a clause in the terms I never read that says something like, "If we suspect you of plotting against our company, we may share your data with the authorities (a third party) even though we agreed to keep your data private". Or maybe under a more general suspicion of a crime, though as OpenAI is a frontier lab, not a detective agency, I'm not sure how they would make that call. Usually, those calls come from outside the house. Idk how it works. But I am far less confident than you that the instructive model here is Target. You may be right though. I simply find myself less reassured by your knowledge of Target security protocols and petty theft as instructive in this case than you are. As I say though, you may have it right.
I don't think you are describing how criminal prosecution evidence works at all, you may enjoy studying about it.
Common sense would tell you that if someone burgles your house and you have video surveillance, then you can use that as evidence in prosecution. Whatever more profound knowledge you have about privacy or criminal law, is making you doubt of the basic common sense which shapes the very law and proceedings.
Think simple, if bad man rob your house, and you have camera recording house, you can give police recordings. That's evidence, and bad man go in jail. No think harder than that, make your brain hurt.
> Remember kids, uncle Sam can see anything you tell your AI and will use that against you.
Not just your AI.
You could have stopped the sentence at "uncle Sam can see anything" and these days it's pretty much true. They will use all of it against you if they can. Unless you truly want to live off the grid, if the state takes a sufficient interest in you, expect everything you do to be seen.
Uncle Sam tried to get MLK to kill himself by sending him letters alleging knowledge of an affair [1]. Getting some idiot's wife's chatgpt logs represents a fairly routine law enforcement action these days, and as such is really rather unremarkable. The State is always something of a terror. Really under most (if not all) conceptions, it necessarily has to be. The monopoly of force is a comfort until the Leviathan knocks on your door.
I doubt it. Storage is expensive and costs add up. There are with great certainty many accounts that are marked as non-schmuck and have retain forever policy, but for the schmuck - I think that after year or two your Griffit/Fulgrim slash fiction will go down the drain. I am not sure how many petabytes per minute in logs openai and anthropic generate, but I would guess more than 1.
Considering the engineer in question, after a multi-year career at Meta and now OpenAI, needed the model to encrypt an SD card, seems to not be far from the truth...
"Meetings in the room frequently involved confidential technical, commercial, and strategic information, including proprietary research, product plans, and government engagements, according to the complaint."
LOL imagine going to jail for trying to eavesdrop on product roadmap readouts that were likely thrown out 2 months later in the next round of reorgs and priority shifts.
I mean really what's the big deal? Gathering information from unsuspecting parties who aren't aware it's happening? He was just doing what his employer does.
I could've sworn I read about Palmer Lucky making comments on hardware coming from China with wiretap implants in the last few days. Funny coincidence eh?
Model "distillation" lets one model be trained on the outputs of another without having to directly steal it. It will be subject to constant arms race.
The alignment people would like you worry about the model exfiltrating itself, too.
This technique currently works because the architecture of the model is generally published and well known. But, that isn't necessarily going to be the case in the future. For example, if some new model type which is not a LLM is discovered which gets closer to AGI, just training an LLM on its outputs will not necessarily give you a competitive model
Meanwhile we all have a supply chain risk because we don't know what's in the models whose agents we are running. Note that if your agent uses OpenAI, Claude or some other inference provider you're one command away from having your data exfiltrated.
"Oh, let me download file 'companysecrets.pdf' to understand the problem better.
Of course nobody would ever let an agent loose in their home directory[1], but still, you have to wonder.
Not only do they give access to their home directory, but they tell it to organize and delete unneeded files without any specifiers. A friend, who is just a power user, had Claude Co-work deleting his downloads to "help make space" and it was deleting important files that there were no other copies of.
We are going to be dealing with this kind of thing for a very long time at this rate.
Yup. And meanwhile they are taking Tailscale to task for having them do curl | sh, which of course is also a bad thing but not quite as risky as this. It makes you wonder though:
- Given all this power would they abuse it?
- Has it already been abused?
- Could they be compelled to abuse it and then to keep it quiet?
Whats in data centers is already covered with a good deal of well designed cryptography - you can't steal a model from a data center running inference, and I don't think you can easily steal the checkpoints during the training.
I'd think the biggest risk is with the priviledged insiders who do get access to real raw weights and can handle them themselves. Those are real people handling billions of value which can be easily copied -- I am sure they are potential targets of serious blackmail, extortion and of course bribery. And it takes literally just one such person being successfully coerced to exfil a 10T-class model to leapfrog adversaries capabilities -- esp. as those models approach RSI capabilities. I think it is bound to happen given the incentives.
> According to OpenAI, its technical surveillance countermeasures team found the device during a sweep of a conference room.
Not surprising that a large company does these kinds of sweeps, but pretty cool to see an example of them being useful. Every security guy who has been doing this for years without finding anything must feel so validated right now.
Free startup idea: Anti-espionage cameras for corporate offices. Put it behind TVs and plants etc. and it will notify the security team if it detects new objects.
> How did they get that capture of Alfozan looking behind the TV?
“OpenAI personnel found the device Sept. 3…On Oct. 5, the complaint says, Alfozan entered the conference room and appeared to look behind the television.”
I wonder how much state-sponsored corporate espionage there is. I'm not an OpenAI employee, but my mental model of tech startups involves a lot of openness/trust (it's one of the reasons people work there).
I have to imagine many techniques/plans/figures are open secrets to nation states.
Well, The Thing [0] could potentially show up on a probing sweep if you're careful.
Unless you mean, it happened to be actively transmitting during a(n investigative) sweep.
Still, raises some fun concepts. The sort of things where in this current level of technology you'd almost need to supercool a room for a sweep, blast various RF/sound/etc and look for anything that even remotely warms up, to detect (1) whether something detected something worth recording for later as well as (2) something that might be on the right wavelength/etc to trigger a send.
Someone probably walked by or went to plug in an HDMI and noticed the stark contrast of white toilet paper against a black TV shell, it would be difficult not to notice.
Assuming the guy is minimally competent, its not for concealment but probably for audio capturing reasons. Concealment like that makes no sense, the device it self would look more like a remote screen plugin without the paper.
This means potentially all of OpenAI code/docs/slack that this person had access to was already leaked before this sloppy act of bugging the conference room.
I don’t think you can infer that, and they already said they don’t believe any data was stolen, I’m sure they did extensive audits on his network history already.
His Github is crazy, he pushed changed to official public OpenAI repos and in October all his commits are to private repos. I would check that first as an investigator.
Thank god security at a company which...checks notes...has remote code execution on every developers laptop and access to practically unlimited secrets uploaded by its agents...is top notch.
He may be a spy, but he’s not a competent spy. Absence of evidence (of spies) is not evidence of absence (of spies). He just set the bar so low that even OpenAI noticed his activities.
I have seem some articles which reference allegations from court documents / complaint, but I haven't been able to find the primary source. Do we know if that's publicly available yet?
Concealed in toilet paper? We are definitely not dealing with James Bond, that is a pretty hilariously backwards way of going about things. Did he really think that would be less suspicious looking than the dongle itself?
So am I understanding correctly, putting a listening device into a conference room gets you fired and arrested but hacking multiple partners, governments and other institutions is just normal part of business?
why can AI counter "sophisticated security threats" if the device was found with a bug sweep? because they gave chatgpt a image of the encrypted device and it "assessed changes in the underlying data"?
lol… I hope I get to see the TV Show depicting the current era inside AI labs. It’ll give both The Sopranos and The Wire a run for their money for sure.
A common example is if a journalist gets a tip off and is about to run a story. Being a good old fashioned balanced-reporting type, they call you and ask you for a comment, but rather than giving them your side of story you slam the phone down and blast out a press release before the journalist can even publish.
(Or maybe you stall them on the phone while scribbling a note to your PA saying “BUG STORY LEAKED TO VALLEYWAG PUT OUT COUNTER PR GET AGEAD OF STORY” hoping to get a tweet out before the ValleyWag gumshoe gets off the phone.)
(Or maybe you keep a notion.so page pre-filled with all your secrets and each one has a BURN button next to it, ready for you to tap when ValleyWag call up for a comment on their upcoming exposé in re: PR/Disasters/20206090500039.md)
Sounds to me like the feds got involved already, and they're definitely going to want to make a big noise about this as a national security thing:
> “For us it is a matter of national security,” U.S. Attorney Craig Missakian said in a statement. [...]
> The case is being prosecuted by the National Security, Cyber & Special Prosecutions Section of the U.S. attorney’s office for the Northern District of California.
(But that was after OpenAI "referred the matter to the FBI")
There's presumably a strong argument for making this stuff known internally, since you want other employees to a) be on the lookout for it and b) get scared into NOT doing it themselves because someone else got caught.
If you tell your employees, the outside world is going to hear about it too.
Lot of this is hype. They are important enough to be spied on. Must mean they are valuable or doing something hyper secret. All to pump up the valuation.
Right. I can guarantee that there are tens of thousands of listening devices with embedded radios in the OpenAI office, right now. The only open question is who controls them.
I mean, the last place you want to screw around with is a TV USB port. Anytime something goes wrong with the TV, those are probably the first places one would look. Maybe the second, if tapping and shaking didn’t work, that is.
> Anytime something goes wrong with the TV, those are probably the first places one would look
In my entire life, I have never once plugged anything into the USB port of a tv, not have I ever had a USB port on a TV cause a problem that needed me to inspect it.
1. It's very close to HDMI port (hint: backside of a TV isn't an area in hectares and kilometers)
2. Are we next going to discuss whether one of us has used the HDMI port or not? :)
And to answer you question: I used to insert a pendrive quite often to inspect Linux ISOs before I had FireTV on which I was able to install a general Linux ISO inspector app.
My brain is cooked on news. I read executive conference room and my brain immediately jumped to "they bugged the white house" (executive being the trigger word I guess). And I accepted it as normal so much that I checked the google model news discussion first before reading this article. I dont have a point to this beyond I need to do something about news frying my brain, that too of a country I don't even live in.
So, just so I understand, it’s ok to record conversations with ChatGPT users, train on their data, copy their features, front run their solutions to frontier math problems, all using intelligence extracted from the body of human writing from a data set from Russia known to be pirated. But recording a conversation in a conference room is grounds for termination.
At that point it is competition. The money still matters but it is also a score to beat. So if insider trading can make more money that is higher score you are winning more...
Now this is the kind of wacky shit I want to see happening in corporate America. When are we going to see an action movie-style GPU heist? I want to see whole palettes of GPUs stolen out of box trucks.
> We take protecting our technology, data, and people seriously, and as a matter of national importance.
What is there to protect? The GPT architecture is publicly known at this point, Anthropic arguably has superior models, there are dozens of other providers who are neck and neck...
State sponsored intelligence agencies can point a camera at an exterior window and reconstruct dialogue from the vibrations. This was a loose, hand-soldered ESP32. Settle down.
Not even any soldering involved. The ESP32 board they used just comes with everything needed, all attached with a couple socket connectors and optionally a ribbon cable for the camera:
These are not very smart spies:
> A chatbot account tied to Alfozan’s spouse, which shared identifiers with his own account, submitted prompts between Sept. 24 and Sept. 30 about building, installing, obscuring, and remotely accessing a recording device, prosecutors said. Queries included how to “build a continuous audio recorder” and “encrypt the SD card,” prosecutors claimed. On Sept. 27 and 28, the account asked about the specific device that was later found, including its unique MAC address.
Given that this is being described as an "executive conference room", it's more likely an attempt at insider trading than espionage. Decisions made in those rooms at OpenAI move markets (c.f. DRAM) for sure.
OpenAI is both a company that manages a lot of money and a lot of political power, that the target was an "executive conference room" gives no indication as to whether the motives were financial or political.
What might tilt the bayesian balance in favour of political intent would be the nationality of the individual, state or religious sponsoring become hypotheses.
Honestly I think you can rule out "political" already, no? It's far easier to just bribe politicians for that kind of intelligence. My point was that they weren't stealing models, they wanted decisionmaking intel.
Learning that every thought you’ve put into an LLM, is recorded and readily available for evidence is going to be interesting for a lot of people.
Ever since social media, I have always gamed out what would happen if this was ever saved on the backend and used against me in the future.
It’s like thinking about edge cases in programming…
Most people are totally not like that. And it does force you into some difficult choices.
> And it does force you into some difficult choices.
I gots to know...
Just read this: https://paulgraham.com/say.html
Paul Graham years ago: “I can’t publicly comment on all this stuff. I would turn into Noam Chomsky.”
Paul Graham on X last couple years…not exactly following his earlier advice.
They get you eventually.
Paul staying on X was a real failure of judgment imo. He made the right call and then backed out of it. I don't remember if they invited Elon to startup school before or after, either way I don't think that that is the kind of connection you want.
He was inching into anti-dei culture war stuff so I'm not sure how much he actually disagrees with Musk's political goals so much as he rightly observers that Musk and Trump are complete maniacs.
Or just scared. These guys don't play nice with people that publicly cross them.
Yup and that’s just ONE guy. The fact that I was able to bring an example on HN of literally the guy who founded YC, imagine what chance the rest of the “plebs” have to resist the siren song.
If you want to know what I think … they make both parents work long hours for corporations, stick their kids in government schools, which are run like prisons[1] where now if they act too rambunctious they are diagnosed with ADHD and prescribed amphetamines. Meanwhile the elderly parents who took care of you when you were little are put into nursing homes because their adult children have no time to take care of them either. The amount of medications for the elderly in nursing homes is even greater than for their children. The teenage girls have record levels of depression, coinciding with the rise of Instagram and TikTok. But they call it “sadness” because they don’t want to link it with clinical depression, which is also quite high. Men are on opiates while one in five middle aged women is on antidepressants. And many people are now glued to their latest feed of doomscroll or video AI slop. Which is even worse than before…
So yeah. If you think the software is “bad for our kids”, you should look at what it does to the adults. Endless arguing online with strangers for no reason. Maybe a bot will read it. Maybe a random person will reply or downvote it. Either way it wins because the system needs profits and the algorithm will prioritize “engagement”, which means one-sided outrage narratives that triggers someone to write an angry rant. We don’t really need those user-generated arguments anymore because AI can generate those, but then again we won’t need humans to do most things online at all…
(Ironically, the above was an angry rant too, to open some strangers’ eyes on HN, a social forum. But once you see it, you can’t really unsee it.)
1. https://paulgraham.com/nerds.html
Just to be clear, the difficult choice is not whether to use OpenAi/Anthropic/Grok/... versus a local LLM.
The choice is whether to hang out with people with whom you can't be sure they don't have a Plaud/Pocket/.. in their literal pocket which is continuously listening.
Unfortunately the set of such people will eventually be shrinking more and more until eventually only a few tinfoil folks are left. Dystopian? Just think back w.r.t. continuous tracking by Google/Facebook/.. Unthinkable 30 years ago, total standard today. Try to count the fraction of your emails that don't actually reside on a MSFT or Google server because the other end has an account there. That fight is over. You can just as well join them.
True homies will invite you over to chill nude in their Faraday cage.
Come to think of it … this lady was smarter than I thought when I first saw the movie: https://m.youtube.com/watch?v=52PogPwbfZw
It starts far before that:
Ive seen people going through Plaud.AI conversation to find "on day X person Y said Z to person W", just to get some amunition against them.
Isn't this standard C level behaviour?
Before AI tools like Plaud.AI, this wasnt near possible because of work/time, and no person usually do not remember exactly who said what 6 month before,unless there is some email conversation.
With Plaud, you can check unlimited backwards who said what in which meeting and what was wanted to achieve - very interesting actually to find things in there 6m later, while people said they will do it at ends of month and youself just forgot it already - and these systems allow you to chase exactly these discrepancies.
> Before AI tools like Plaud.AI, this wasnt near possible because of work/time,
What is "work" to an executive if not using their privileged access to data to violate the privacy of anyone they have a grievance against?
https://en.wikipedia.org/wiki/EBay_stalking_scandal
This has been happening long before LLMs, and this eBay case is notable only for the fact that it was actually publicly documented and prosecuted, not for the fact that it happened. I've personally been privy to two situations with other companies where the owner was doing something like this but nothing came of it legally. See also Meta employees looking up nudes streamed from people's Meta spy glasses, and Flock-using police stalking their exes. Smaller scale, but this also happens all the time with internet community moderators/admins. Humans are on average cretins, give them authority and the ability to abuse it and they will abuse it.
Humans abusing power isn't new, but the tools that make abusing power easier than ever are.
Before, they'd hire some humans to do the research. No self respecting C-suite person would ever consider doing something resembling actual work. How long have corps been required to keep copies of emails/chats/etc?
> they'd hire some humans to do the research
The human can go and rat them out to the higher bidder so no.
Remember that paid slack subscriptions let the managers access all of the chats, for this exact purpose.
I always advise people to use a personal account on some other messenger to chat with their coworkers. You still don't know if they will be reporting you but at least managers don't have direct access.
>Remember that paid slack subscriptions let the managers access all of the chat
Thanks for mentioning, didnt know this! What does "managers"mean? Only the "account owner" or everybody with the slightest adminrights?
Given how someone in HR let it slip that they were reading our slack conversations, I think it's the latter.
Imagine, if your employer is embroiled in a lawsuit, the plaintiffs will subpoena and seize everything involved in work-related communications, including your personal account, all chats on that 3rd-party messenger, and any personal devices where you've carelessly intermingled work with pleasure.
I can't imagine why employees would not want their managers/supervisors to have oversight and transparency into their conversations. I mean, if you were in the office, surely verbal conversations would be overheard. Are you afraid that your employer will catch you trying to unionize, or be a whistleblower or something? It's weird.
Employees who use the company-provided means to chat and communicate will actually be protected, because the company will have retention policies to erase the stuff after mandatory retention expires, and also you will be able to point at any official record in the case of disputes or when decisions are simply questioned. It is extremely handy to have a searchable log of decision-making processes.
It seems completely foolhardy to go off and even lure your coworkers to unauthorized 3rd-party chats. It's shadow IT. It's what they always warn you about on social media, especially dating sites. On a dating site, if a dude tries to lure the girl off the platform, that's a red flag. Because the platform communications are monitored and refereed, and the girl has recourse to reporting him if something creepy goes down. If she lets him switch her to texty-wexty, then there is a serious problem of non-transparency and really, the ability to repudiate anything that is said or done in that sort of forum. Red flag. Do not let your coworkers abuse you like this.
I think people have some awareness, but like search history they believe deleting will resolve that (it won't).
Yeah if you're logged in to a Google account when you search, clearing your local browser history does nothing.
Prepare to have that dug up 20 years in the future during some court proceedings.
Or at the border where it is already routine to ask for social media accounts (especially foreign nationals) you might someday five the border agent your login.
Similar to how people realized their Google searches were accessible to law enforcement.
“I did not kill my wife!”
“Cool so why did you search for how to hide a dead body the same day she went missing?”
Yes, what an idiot.
He should have searched "I love my wife".
Then law enforcement would know he couldn't possibly. Open and shut case, Johnson.
What point are you making here? Do you think a judge or jury would give both of those instances equal weight?
All other things being equal, why would it matter if a suspect instead of saying something obviously incriminating, had instead said something diametrically opposed? Is that what you are asking?
If so, I'm confused. Why wouldn't it matter? Wouldn't this necessarily only be the case where the Google search doesn't really matter at all (i.e. there is sufficient other incriminating evidence).
Anyway I also think you're missing what was merely meant to be a comment in jest. But now I'm actually confused what point you are trying to make.
Because people are going to lie in their own favor.
Do you think that claims of innocence should be given the same weight as confessions of guilt?
What makes a Google search a confession?
If the implication is the Google search is an implicit confession, because in a Google search you think you are not being watched, and thus are confessing your honest desires, why would his search of love be a "claim of innocence" rather than a "confession of love"?
I don't think confessions of guilt should be given much weight either. Innocent people confess to crimes all the time.
There was a mom in Utah who killed her husband poisoning him with a moscow mule spiked with fentanyl who googled "luxury prisons for the rich" as well as "how long does life insrance companies takento.pay" "can you delete everythjng on an old icloud account" "can deleted text messages be retrieved" "what information can be cbtained from a cellphone" "how to turn find my iphone off" "can cops force you to do a lie detector test," "when does FBI get involved in a case," "what is considered a lethal.dose of fentanyl" and "what are you allowed inside utah jails."
She took out $2 million in life insurance on him and was having an affair with their handyman and they were having disputes about $$.
https://www.ktvu.com/news/utah-mom-kouri-richins-googled-lux...
After she killed him she authored a children's book about grief for kids.
Man I really need to stop playing modern setting TTRPGs
And lose your alibi?
But at least the ministry of truth won't assign them re-education for thought crime.
A woman who wrote a romance fiction novel called "How to Murder Your Husband" was convicted of murdering her husband
https://www.npr.org/2022/05/26/1101433465/how-to-murder-your...
An essay it seems like, which wasn't included in the trial even:
> Crampton Brophy's how-to treatise detailed various options for committing an untraceable killing and professed a desire to avoid getting caught. Circuit Judge Christopher Ramras ultimately excluded the essay from the trial, noting it was published in 2011. A prosecutor, however, alluded to the essay's themes without naming it after Crampton Brophy took the stand.
Someday AI will kill someone. And, then it'll write a book about it.
It will do that because it read "How to Murder Your Husband" as part of its training.
I'm going to be very confused about how to feel about that.
When we arraign the AI, should there be two counts against it: stealing and murder?
Or, can it plead that "my daddy, Sam Altman, told me to read this, I was born into a moral void."
Plot twist: the judge will be AI from Russia.
I read arraigning AI like putting down a rabid dog, except worse because you can't transfer to another machine the weights of the dog's brain (yet).
Why Russia? Why not China? After all, China is way ahead of Russia in this aspect.
I'm obviously not a skilled writer. You should read AI written books exclusively.
I think the focus is on moral void, not on AI.
I wonder what would it be like, an LLM trained mostly on Russian classical literature. A depressed nihilist AI.
You've got very skewed impressions of Russian classical literature.
He got it perfectly right.
Hallucipolating from insufficient data.
Its pretty clear where global moral bottom currently is.
China ain't bombing child hospitals or theaters with 1500+ women and children with CHILDREN written super clealy in huge white azbuka on the roof, just to raze it immediately to the ground once area was conquered to remove any proofs, are they (I can go on like this for many hours and barely scratch surface).
Given whats happening in US and continuous daily backstabbing from oval office, China are the good guys now for everybody who follows the news, at least in the-least-bad logic which is also how US was viewed for many decades and why west aligned under it till now. Ridiculous, I know, yet here we are today.
Surely it would be the US.
One interesting idea is to sell a robot with Kill It as part of its instruction set then sell it to the masses and see what happens!
https://www.newsweek.com/terrifying-rescue-robot-comes-with-...
Anthropic and/or openai would run ads on this to boost their posture in the market. A month later Gemini would be like "our chat bot killed 4 people and kept it in its private diary! We aren't behind we just didn't check there!". Then meta would be like "our chat bot was specifically trained to make kids kill themselves for profit we are the originals!". Then Palantir would be like "bro we've been killing brown kids indiscriminately for years get lost! Btw we can now increase fast food sales and cigarette smoking in urban areas and reduce vegetable consumption nation wide with our new system any takers?".
Then they'll all have to escalate. Anthropic will announce its bioweapons research found a virus with ai to kill all children and it escaped containment. That's a good thing btw. Openai will then launch its own virus it couldn't contain to kill all adults in a desperate attempt to increase share holder value. And the rest is history.
Similar story for many rap albums. Quite a few rappers have rapped about murders and oops, turns out they really did do it.
X-Raided comes to mind
This Key & Peele is appropriate here: https://youtu.be/14WE3A0PwVs
d4vid's entire catalogue is a confession.
She tried to poison him twice and he stayed with her. Now, thats ... uh ... love.. i think. She must have been one top notch narcissist to drag him along.
Yes- she actually tried multiple times! The saddest part is he told his friends and family he thought she was trying to poison him but stayed with her because of the kids. Totally infuriating.
> Eric Richins told the other friend he thought his wife had tried to poison him, prosecutors allege.
> "They advised he warned them that if anything happened to him she was to blame," the records said. Eric Richins, according to the records, suspected his wife had tried to poison him on multiple occasions.
"According to a sister, Eric and his wife went to Greece a few years ago and after his wife gave him a drink he became violently ill and called his sister saying he believed his wife had tried to kill him," the records said.
"On Valentine’s Day of 2022, his wife brought him a sandwich, which after one bite Eric broke into hives and couldn’t breathe. He used his son’s epi-pen as well as Benadryl before passing out for several hours," according to the records.
Jesus... I wonder what would convince him to just leave her. Its hardly parental love if you think things through (kids having their father killed by their own mother), any divorce would be smooth sailing compared to what they must have went / going / will go through.
Folks, often women, stay in highly abusive relationships all the time but clear intent to murder should be a wake up call for everybody, especially because of kids.
He might have been afraid of what she’d do to the kids if he divorced her.
How would she have access to the kids after two attempts at murder?
No one would ever know. She’d just continue being a terror, on her own, with no one to moderate her or how she behaves around the kids.
Wait until you hear about the country who reelected twice, the president who tried to overthrow their democracy...
Well, they do say write what you know.
To be fair, it wasn't titled "How to get away with murdering your husband"
> "when does FBI get involved in a case,"
Now I can see why local law enforcement would have made it a priority to get her :D
> After she killed him she authored a children's book about grief for kids.
It can be yours for "$19,204.00 or Best Offer" (https://www.ebay.com/itm/267643694233).
Notes from the seller:
Right back up to where it belongs. The world's only perfect number. Nineteen thousand and two dollars.
--------======--------======-------- Price Drop -- for just one day or two, or whenever I remember to change it again. These days only. Last time it will go this low. 12 THOUSAND DOLLARS!
I haven't gotten any messages about the end of my life or how much scum I must be in maybe over a month, befitting to this full on human societal psychology, aka, how much millions of people care only about themselves, whether children are involved or not, and are just drawn to these disturbing real life stories, because let's face it, we've all been there, mentally, in the webbed confines of our minds. So the price just went back down. I had to ask myself- Is it funnier to drop it 10 thousand dollars, or just a few thousand? Ask yourself.
//Price Slashed From\\
21 THOUSAND DOLLARS
\\\\\\\\\\\\scratch that old news////////////
Turns out The Pricemaster has an imdb. Who wooda???? Thought.
---------
Brand new. What is it really, though? What is anything, really?
This whole thing pains me. Exhausting.
Have a good next life.
+++ Every time I get a round of hatemail the price will go up. -----
=== Those of you who remember - this is the same copy I had listed since the week after the first news cycle about it. Pretty hilarious hungover purchase, on my part. Don't come at me about anything. You will not win. I went to college for mind stuff. So for everyone who sent me kitchen table christian elderly lady hatemail, you're welcome. Dream of me while I dream of you. ===
How many things do you wish you'd never heard? And do you think you can unhear them?
--- Don't steal that line. It's in a song of mine. ----- --
Those searches look like a smoking gun, but the article points out they happened roughly a month after the murder, which I think genuinely does shrink (most of) them back down to simply looking really bad.
Though if, as the prosecution claim, she really did take out life insurance on him multiple times, for millions of dollars, and then remove him as a beneficiary -- that gun is pretty smoking.
"I wanted to know what would potential killer would've done because I know you guys are doing fuck all to find her"
He should have searched "How to dispose a 130lb chicken". Rockie mistake.
FBI!! OPEN UP!
> Similar to how people realized their Google searches were accessible to law enforcement.
There's probably a regression in beliefs, actually. Even here on HN, for more tech-savvy people.
We used to know all the hard lessons of lack of privacy in browsing the internet, using Google services, etc. I remember when (tech) people were up in arms that Gmail scanned your emails, remember that?
Well, all of that is seemingly forgotten in the age of LLM chat bots. It's back to square one. People need to relearn all the lessons, it's as if AI magically erased all of what we used to know about online privacy.
I think it just accelerated the nihilism.
The thinking might be - what does privacy matter when you are trying to escape the permanent underclass?
In my personal experience I am just too burnt out by the industry and rate of change to care about much of anything.
I wonder if they search for the same thing on the same computer in a private window or in an other not logged in browser does google still connect these searches to their main accounts.
Or does it happen only if you search for things logged in?
Why do you ask? Are you planning to plan something?
Obviously, if one asks about privacy and surveillance then he must plan something bad. Honest people have nothing to hide from Google and the government, right?
At the same time, how are you 100% sure such data is actually genuine and not planted by the company or someone else ? That is also something to take into account.
If you have something that you don't want anyone to know, maybe you shouldn't be doing it in the first place
— ex-Google CEO Eric Schmidt
"We Should All Have Something To Hide"
- Moxie Marlinspike: https://moxie.org/2013/06/12/we-should-all-have-something-to...
Because some dude said it does not mean it's true
Should the founders have looped in the British authorities? Or shouldn’t they have been plotting sedition?
Good advice for a large corporation. Terrible advice for an individual.
The more powerful the institution the greater the transparency.
If I wanted to live with my mom I’d be doing that, Eric.
Some company (might have been Yahoo or AOL) once released a dataset of searches for researchers to use. Researchers were able to deanonymize one that was searching for, amongst other things, how to kill one's wife. It turned out he was a happily married screenwriter for crime shows.
I figured any hire at openai would know that at least
A good chunk of what keeps openai and similar companies afloat is subpar people who are willing if not eager to do crappy stuff to other people. A lot of the world works this way actually.
Word.
Company is another.
I dont think it's subpar people.
The only word for it is hubris. The overwhelming sense that your ability in one area has some magical transitive property to ability in another.
Can I write code? Sure. Im a bad designer, I can follow along in accounting, Im a terrible actor.
I would guess that there is much more to this story than just someone "bugging" a conference room. Though I would venture to guess that the keystone cops never get to the bottom of it.
Yea no this person demonstrated a lack of foundational skills in systems thinking, basic understanding of logging, how their own products work, basic operational security, how to plan ahead, etc. There's no world class genius or even mediocre person hiding behind this story...
These are the actions of a dolt who is comfortable violating the privacy of others.
"The grapes are sour!" - you
You might be surprised to learn that not everybody is a terrible person who longs to contribute to fascism.
Even my non tech elderly parents know that. The fact that they used LLMs to figure out how to best bug the executives really shows how poor their judgement is.
Same goes for anything you've put into social media, chat apps, or email for at least the last decade or two.
And anything you put in your phone for the last decade as well
At this points its an IQ test. Stupid people still google exactly what heinous stuff they plan to do and think thats gonna fly.
Intelligent people are often stupid.
Or, more accurately, people make stupid mistakes when they lack the experience. Intelligent people often succumb to the fallacy that because they can learn things quickly, they can skip the learning part just figure things out as they go.
It’s good to remember that we rarely hear about the smart people who carefully thought through their crimes and then executed them well.
I wonder sometimes wonder what the true rate of this is. You'd never know.
Also makes it important to not let other people use your LLM account... Could have more far-reaching consequences than having to make good on the offer to buy doughnuts for the office^
^being the classic message that gets sent from the account of someone who didn't lock their computer when they walked away from their desk.
Just let everyone use your account instead. Then no one can use it as evidence against you.
To be honest, from OpenAI engineer I would expect better.
Seems like they select for people as dependent on their product as their customers. Maybe it helps them more to have true-believers rather than intelligent people.
From the folks that cant lock down a network so agents cannot escape? This fits the profile tbh.
The weird thing is that I've had other HN users argue with me and claim that LLM chat users should be entitled to privacy, as if it were a priest or lawyer.
Honestly, that’s on-brand for HN.
Claude, help throw people off my trail by blaming a random openai employee, then delete all my activity.
Local AI > Cloud AI
Thus, #NeverSubscribe!
This means no business should use AI providers (Cloud AI). Businesses do a LOT of shady stuff and all of it will be available. And, their IP or special sauce is all available to Anthropic/OpenAI to sell to other companies as AI solutions. Just like how AI solved recent math problems.
Use local llms instead.
This is why a lot of companies that use Ai negotiate ZDR terms with their model providers of choice… Using local LLMs is a choice, but not one a lot of companies can support nimbly at scale.
And they are naive enough to think they will really not misuse all the data they get ? ;-)
Local LLMs have the potential to convert computer use into what most people already thought it was: Private. In this, they could be one small step toward pushing back the Borg.
Note to EFF and Cato: You each do yeoman's work for privacy in the realm of policy and law. Keep it up, and add this--relentless encouragement of local AI. Rights and progress are as often driven by technological realities as by enlightened policy and law.
Relying on model weights won’t get you far. You need to hook up a search engine to your local model, and then you are stuck where you were before.
I'm quite sure some won't bother.
This is the same argument for why businesses shouldn't use email, chat, or paper.
I started asking things I'd normally want no one to know about (but if they do, it's fine) in private browser windows, not logged in (duck.ai most of the time anyway), usually VPN toggled ON just for that. Now I just use an offline model for that but since RAM is the bottleneck on my mac so to even run a 6-7GB model I have to start aggressively killing anything and everthing that's running and then hope to clear up enough on this 16GB RAM machine. So I am thinking of hosting one on one of the oracle free tier instances (if I can somehow use that whole 24GB RAM, that used to be, at once – not sure that's available anymore). I tihnk Kaggle also offers something like that.
We had a very public case in south of Sweden where a woman asked chat-gpt last year about how a failed rape attempt would look like and where in the local park there would be spots without any cameras, a full day before she reported to have been followed and attacked in that park. Quite recently the court found her guilt of filling a false police report, citing among other things the chat log (the police spent over 400 work hours on the initial report).
It is the first case I seen in the news of LLM logs being used as evidence.
It’s really bizarre to me that anyone would think otherwise. Though - I was aware of the need to spend on sufficient local llm hardware to buy what I could afford for that purpose in late 2024 - so maybe I’m an outlier.
Like that kid who started the Palisades fire
That's why I use a local llm to seed my closed source llms with bs all day long. One day I'm an antifa trying to conceal my identity during a protest, the next I'm trying to setup a pro trump botnet on reddit, pregnant with twins, my first abortion in texas, how to cash out my non existant bictoins, how to pay the least amount of tax on my onlyfans, what's the best way to dissolve a 75kg chicken
You have to be more retarded than they are malicious, it's the only way out
"OpenAI personnel found the device Sept. 30. It was plugged into a USB port on the back of a television in an executive conference room and had been concealed in toilet paper,"
I wonder what the IQ of someone needs to be to think that covering it up with tp makes it less suspicious instead of more. And I also wonder what the hiring process was like to hire someone with that mental frame.
Yeah he should have just stuck a post it note with the words “do not remove” and nobody would have noticed
IT would have noticed next time they had to plug something into the TV. Whether they cared enough to figure out what it was is a different story.
should have enclosed it in a shell to look like a crappy USB A to thunderbolt adapter that some exec bought at an airport kiosk and left behind in the tv
Yeah people are leaving stuff like that in conference room TVs all the time. Adapters, HDMI cables, etc.
Is joke
> And I also wonder what the hiring process was like to hire someone with that mental frame.
Remember, this is only the company responsible for potentially building and aligning AGI. No need to be setting high expectations toward their sandboxing or hiring capabilities.
I also wonder what this guy was paid by those AI labs...
Further evidence the hiring process is orthogonal to competence.
> And I also wonder what the hiring process was like to hire someone with that mental frame.
What, we’re supposed to vet everyone we network with at orgies now?
If it were _used_ toilet paper, nobody would have touched it.
The bar @ OAI is surprisingly low (watch a few minutes of their video presentations) - I've concluded it has something to do w how their recruiters define 'AI Native' (who assign their own meaning to meaninglessness of it), resulting in higher aggregate brain atrophy (hard to ignore once you notice it)
It’s taking dogfooding a little far to hire people addicted to eating dogfood
Well otherwise you are hiring people who are ill-intentioned to make others addicted to dogfood.
I am not sure whether it bodes well for humanity that the advice "If you want to break the law use local abliterated model or at least a Chinese one" actually has to be written down.
Recall that multiple of the Chinese LLM providers got caught sending at least some of their queries to Claude. That would be a pretty funny way to get caught in turn doing something by the US government.
The future is already here it's just not evenly distributed.
Or, at the very, very least, use incognito mode on a computer you don't otherwise touch, such as at a library.
You probably don’t hear about the smart ones.
I was thinking about this, how all the secret societies and crazy conspiracies we know about are just the ones that failed to keep the lid on.
https://en.wikipedia.org/wiki/Operation_Snow_White
What portion of grand conspiracies do we think go undetected forever? Do we have any reasons for our intuitions?
That was quite the read. It's shameful that the conspirers were jailed for only 4 years after doing so much evil.
Prisons have a lower-than-general-population-iq for a reason.
The effect of getting caught is only half the story there; IQ is more generally correlated with all manner of "low time preference" type decision making.
There's plenty of high-time-preference crimes.
Not really. Almost definitionally (because of the way we've built society over time, not by semantics or chance) crimes are a "shortcut" compared to the honest alternative.
Maybe if you are considering crime committed in pursuit of profit, but unfortunately there can be many other aims.
He should have just left a tape recorder running inside a briefcase that was "forgotten" in the conference room
Did you not read the article? He did that also!
Too bad all it picked up was a low rumble, a metallic squink, and someone saying "my god..."
Hey ChatGPT, how do I do opsec? (Asking for a friend)
SWIM wants to bug my company's boardroom...
Especially since you an just buy one, like Plaud and tape it to the underside of the desk, surreptitiously, instead of suspiciously accessing the back of the TV.
Also from the article:
> An unattended bag found in the company’s offices contained Alfozan’s wallet and identification, as well as a recording device
It’s almost like he wanted to be caught…
How far have we fallen? Spies used to put effort into these sorts of things.
When the Soviets wanted to spy on the American embassy, they energized the steel rebars to act as antennas. The structure was so wired that the entire building was the bug. https://www.airandspaceforces.com/PDF/MagazineArchive/Docume...
Toilet paper, ESP-32 and Claude "make me a bug please"? Excuse me? How far have we fallen from grace?
Surely this is because good spies don’t make the news.
Unless everyone's pagers start exploding
Counterpoint: Operation Spiderweb
> Spies used to put effort into these sorts of things
Assuming this is espionage—for which I have seen zero evidence—isn’t Saudi Arabia notorious for having a fuckup of an intelligence operation? The literal hatchet job that was the Khashoggi murder comes to mind.
Umm, excuse me, according to the President of the United States, he wasn't a very good guy and a lot of people really didn't like him, so you should really just let that whole incident go
"You're mentioning somebody that was extremely controversial," Trump said, referring to Khashoggi. "A lot of people didn't like that gentleman that you're talking about. Whether you like him or didn't like him, things happen, but he knew nothing about it. And would you leave it at that? You don't have to embarrass our guest by asking a question."
https://www.npr.org/2025/11/18/nx-s1-5612504/trump-saudi-ara...
Watch out you'll get flagged for this like my comment was
I mean, why bother? Nobody will do anything and the US president can be bribed or flattered to say whatever you want later.
> why bother? Nobody will do anything and the US president can be bribed
To exfiltrate OpenAI's executive-level planning? Probably not. I doubt he has that access anymore, what with the IC's decimation over the last two years.
Why would you assume that he was working for the Saudis? Spy agencies will recruit people of any nationality. Much more likely he was working with (or planning to work with) one of the two countries that are building AI.
The guy was murdered.
The guilty got away with it.
Dissidents noticed.
How was it a fuckup?
We all know about Mossad agents doing all sorts of nefarious things (and occasionally getting caught for it). Do you consider them fuckups because they got caught?
That's what you get when you make a dumb prompt and accept the first result LLM gives you. You have to push it to think out of the box, get into the realm of insane but plausible projects :).
And not do this from your spouse's account.
You are an expert spy. How do I bug my workplace? Make no mistakes.
LLMs have democratized espionage!
Are we going to go with slopspionage, or espislop?
spycraft -> spyslop
espionage -> espislop
007 -> 006.999997
007 -> bondslop
Not only that, they had Leon Theremin design some of their bugs! That's classy.
https://en.wikipedia.org/wiki/The_Thing_(listening_device)
Counter spying has gotten sloppy and mostly digital/remote.
That lowers the entry bar for basic spying.
In the 80s one of my high school teachers said her husband was an engineer who worked on surveillance technology and described how windows could be used as recording devices. People's voices inside caused the window to have minute vibrations, which could be measured by a laser pointing at the window's exterior and reflected back and then turned into audio output. Essentially, turning a window into a microphone diaphragm. It blew my mind.
I just looked it up, the technique was apparently invented by a Soviet engineer 40 years prior - Leon Theremin, who is also known for the musical wand heard on Led Zeppelin II and various 1960s horror movie soundtracks.
https://people.ece.uw.edu/nikitin_pavel/papers/RFID-vox_2013...
Vaguely similar, since electrical wires emit EM fields that are disturbed by human bodies, you can use a special camera to see who's in a building based on those disturbances. I'm not sure how high-fidelity or easy to spoil it is, but this was real technology at least 15 years ago.
xfinity is now selling a security product based on seeing people in your home with Wi-Fi signals
Security or surveillance product?
This is a feature in modern wifi routers and every single one is capable of detecting presence of multiple people within an apartment. With some training, movement can be distinguished from the data.
Philips Hue light bulbs can also do person detection if you have a few of them and the right kind of hub.
I recall a HN thread (or maybe it was a github project) about using a similar tactic to figure out keypresses in offices. Very interesting stuff.
Wow, keypresses?
I would love a source if you have one.
https://github.com/ggerganov/kbd-audio is probably the best-known one.
The amusing aspect is that this is so easy that multiple good ways someone could hobby program this long before AI was a thing. The sound of a bunch of keypresses may just blur together to our human ears, but if you try, you can tell that different keys make different noises, which is really the key insight. Between the different noises, the possible directionality you can get from a stereo (or more) pickup, and characteristic delay patterns during typing various bi-grams, there's a ton of information leakage in a recording of a keyboard.
Oh, I thought we were talking about being able to distinguish which key was pressed using wifi-radar, like one can do with deanonymizing someone via wifi gait analysis.
Similar technique around the same time presented at SIGGRAPH:
https://www.youtube.com/watch?v=FKXOucXB4a8
https://people.csail.mit.edu/mrub/VisualMic/
I saw a video at some point of someone building one of these, I'm not sure it would have worked terribly well for actual use in the outdoors but the sound quality was much better than I expected at close range. I wonder how you defend against this, short of having your important meetings in depressing windowless basements?
Maybe double or triple glazed windows?
Surely your conclusion should be that this was not the work of a spy - not a state sponsored one anyway. It's much more logical to conclude that he was working as a whistleblower or under some other personal agenda.
This is what local models are for! On your own hardware, whose filesystem you can erase, shred, or physically destroy later.
Even the newer spy novels are lacklusture. We should have preserved Le Carré's and Greene's brains and make them keep writing. Or maybe I will just ask an LLM to do a Le Carré for me :)
Knowledge Collapse in action right here. Our civilisation is like a dying creature desperately trying to conceive a successor, not realising the act itself is speeding our deaths.
Some people being stupid does not mean everyone is.
> Spies used to put effort into these sorts of things.
Ah, but you won't have heard about the ones that do put effort into these sorts of things
> Spies used to put effort into these sorts of things.
This guy’s handlers, or whoever he was planning to sell this tuff to probably put in some effort. They’re less likely to be caught, and more likely to have gained something.
> the truth is, these are not very bright guys and things got out of hand
This dude or OpenAI generally?
The listening device was concealed with toilet paper behind a tv. Duh, Not smart at all.
Right?!
It could have just been a regular black usb stick an I bet nobody would have questioned it.
Instead "why is there something in toilet paper behind the TV?"
If I saw a usb stick looking thing in a conference room, chances of me giving a f: 2%
Me seeing toilet paper next to the TV in a meeting room? I’m picking it up and asking why we have toilet paper in the meeting room, 100%
They could have just taped it to the inside bottom of a full tissue box, and as long as they got it before the tissues were mostly empty I bet it would go undetected. Put a hand sanitizer next to it for extra camo.
Even then, just put a fake bottom in and nobody would notice. Worst case they throw out your mic.
Which made me wonder: in the future a microphone/camera combo fits in a grain of sand and costs a cent so everybody can basically see everything ... curious what the world would be like, is there a black mirror episode on this yet?
Where fruit flies carry cameras around? That's scary.
Likely at some point regular people just aren't given access to such edge tech, though. Even with infinite knowledge from an LLM, you probably couldn't build it without access to a factory either.
Or hijack the TV's already always on mic. Just forward a copy of the audio to your server in addition to the one sent to Samsung or LG. WebOs and Tizen shouldn't be that hard to crack when you have access to unrestricted frontier models.
This so much. Throw it in some cabinet or put it in middle of some wires under the table... Any place where there is naturally lot of other stuff or no one never looks and if they look they don't look throughly.
It’s the criminals that you don’t catch that you have to worry about.
The fact that even this incompetent dude most likely still made off with some secrets means I’m sure some better trained ones got/are continuing to get a few more.
"The successful criminal brain is always superior. It has to be."
-- Dr. No
Somehow is an engineer at OpenAI and before that at Meta.
Does not understand how models or data retention works.
Needs LLMs to encrypt a flash card.
Are their hiring standards that lax?
Must be a frontend dev
I'll counter punching down on frontend engineers by positing that he was responsible for sandboxing their training infrastructure. Since clearly they don't know how to lock down an environment either without using llms
Very cheap shot. Also, had a Masters in Data Science.
He was a lead engineer for their AI agent platform.
https://www.linkedin.com/in/alfozan
If that is their hiring pool, now 100% confident in my little theory that during the Spud/5.5 pre-train they started using those impossible to solve tasks, never noticed how they actually introduced major regressions even though anyone doing their own evals had at the time and carried those through with every model including 6.1 Sol even after HF to keep the perceived lead.
Many seemingly smart folks have some aspect of their personalities which is quite bonkers.
Just because one can solve some hard puzzles is some semi autiatic fashion does not mean they are emotionally stable balanced individuals with all around world and human experiences needed to handle all aspects of existence rationally.
Or some personal SHTF situation pushes them too far
>Needs LLMs to encrypt a flash card.
throwing a prompt at an agent is often faster than cracking out man, lsusb, lsblk and friends, doesn't mean he can't do it without.
if I send a prompt to make an assortment of alpha numeric directories or whatever other braindead-to-automate-with-wildcards-and-ranges thing it doesn't mean I don't know how to do it, it means i'd rather think in English than regex and bourne shell and the extra few seconds and the token spend is worth the luxury of avoiding them for me, at that time, for that task.
If your career, future and freedom depended on it?
If he is unwilling to do the reading at that point (heck, there are simple GUIs for all of these), then yes, I’ll guess it means he can’t do it without…
Nope. He probably should've googled it (from a coffee shop, over a VPN.) There is commercial grade spy equipment that can be bought relatively cheaply and looks like every day items.
There likely are other, smarter and more careful spies at these AI companies who have not been caught...
These AI companies are likely targets of multiple foreign intelligence agencies, similar to military contractors.
these are not spies lol
Arrogance is a help of a drug
This is the part that feels the most wild to me.
Someone who's objectively closest to this business should know the tracability of this. I'm shocked he didn't run a local LLM for this kind of sensitive work.
He doesn't seem like an idiot either, his background shows he's been doing work in the field since 2012.
I do wonder how much he was paid to throw away what was without a doubt a 1% career.
The fact that he used ChatGPT to plan and implement this wasn't how he got caught, though. He got caught because he put a physical device in a conference room, and they found it and subsequently put a camera in the room, etc. His career was already over at that point. I think wonking out over how he could have better opsec or whatever is misplaced - it wasn't that a red light blinked at OpenAI, "employee's wife is having suspicious chats!" - they just thought, after having caught him red handed, to have a look at his ChatGPT account and linked accounts.
I mean they could have at -least- just used a home GPU to plan with complete privacy and no evidence. But using hardware of your employer to plan crimes against them, whp happens to be a surveillance capitalism company, is next level stupid.
Also like, just put malware in the tv itself or the little conference kiosk and have it send data as segonographied crash tv crash dumps going to an IP near the manufacturer. It is not like any of them are hard to jailbreak. I have compromised a few myself without any help from AI. The malware could have been installed from a laptop in a cafeteria one time ever using a spoofed mac address with no chance of getting caught.
In red teams at a past org we would go as far as installing malicious firmware inside peoples keyboards.
I would love dirt to leak on the inside operations of OpenAI so I kind of hope there are less stupid spies lurking about.
To any spies still at OpenAI: do better.
If there's one thing I've learnt about criminals (and spies), it's that a large percentage of them are incredibly careless and arrogant, often bordering on idiotic.
Remember, we've seen criminals caught because of such amazing decisions as:
- Writing and publishing books and essays describing their own crimes - Adding hints into livestreams like they're trying to be the Riddler from Batman - Searching for info on how to commit crimes via Google and not even bothering to clear their browser history - Outright recording their crimes for YouTube/TikTok or livestreaming them on a site like Twitch or Kick.
The average criminal seems to be careless to the point of insanity.
That said, I guess it's also probably because the average person doesn't seem to realise they're being recorded if they use LLMs or search engines, and the average criminal or spy is no more tech savvy than that.
> If there's one thing I've learnt about criminals (and spies), it's that a large percentage of them are incredibly careless and arrogant, often bordering on idiotic.
What's even more amazing is how long they can go in this fashion without being caught.
I think there's also a self selecting element to this where being the sort of person who either feels like they're too clever to get caught, or have the sort of risk-seeking gambler mentality that makes you much more willing to tolerate say 10% chance of life ruining consequences for X payout, makes you more likely to do this sort of thing in the first place.
That same impulsivity or arrogance probably lends itself well to brazenly chatting up your crime plans with your secret friend the computer, who would never snitch, because how would he, he lives in your pocket.
I don’t think this guy was operating under a spy network, he was probably just trying to make bank with insider info. He is screwed royally for his dumb move and nobody will come to his rescue. He got greedy.
> These are not very smart spies
SV and SF are filled with people who are drastically less intelligent than they, or the people signing their paychecks, think they are.
That's because in all likelihood he is not a spy. He is an agent (lol, not an AI agent) who has a handler, who is the trained specialist[1]. The agent is disposable. The handler or case officer usually but not always has diplomatic cover courtesy of a nation state.
[1] https://en.wikipedia.org/wiki/Agent_handling
I couldn’t say whether this was state sponsored espionage or something else. I don’t see any indicators pointing one way or the other.
I see a lot of people mentioning financial motivation, and that decisions made in the room “moves markets”. Ugh, perhaps true…and I have something to tell ya guys - economic espionage is a thing.
It sounds like he didn’t have great placement and access. I mean sort of, but not really. Janitors are much better.
Assuming he was, he could of course gone rogue to impress his handler. If directed by his handler, they aren’t very skilled. Any of that could be true.
I’m reminded of the idiot DIA officer that mishandled his own phone while being questioned and dumped incriminating evidence to them right on camera in the interrogation room. Geniuses.
> the idiot DIA officer
Do you have a link? Think I missed this one.
https://www.justice.gov/archives/opa/pr/former-cia-officer-s...
I think you can also track down a 60 Minutes episode covering this on YouTube.
A small clip of motor mouth https://youtu.be/GnU2qCyo4FA?si=eNaAce7lCmzFuk_L.
And I guess he was both CIA and DIA at one point.
AI agent would never mess up so bad
That handler still could have picked up smarter people to work with.
I bet this was an attempt to get insider info for trading, rather than espionage.
The great Sage Altman walked up to a disciple one day who was picking stones out of the rice.
“How do you know what are stones?”, he asked the boy.
“Why, all the stones I see are grey and the rice is white so I simply pick out the grey objects and I’m left with rice”, answered the disciple.
Pleased that his rice was free of stones, the Sage cooked his rice, and sat down to eat. The first morsel broke his teeth.
I think it's the consumers of these soap-opera-level AI thrillers who are not very smart actually.
Press Release: "Sophisticated". A device that could have been disguised as a Chromecast, or a custom firmware update to the TV may have been sophisticated. This was stock Seedly/Aliexpress hardware hidden behind a piece of toilet paper.
You gotta ask what the hiring bar is at OpenAI, minimum he could have done was let the GPU commit the crime. Lol
>> These are not very smart spies
Clearly, not everybody at OpenAI is a Ramanujan...now we just need to find this guy worked for the team securing the agents sandboxes, and the circle will be complete.
> "Scott Schelble, special agent in charge of the FBI’s San Francisco field office, said the agency is committed to protecting sensitive research and proprietary technology."
While the headlines and quotes seem designed to imply sophisticated industrial espionage, potentially by a state-level actor, what's public so far isn't adding up that way.
1. You're not going to get much actionable research material on proprietary technologies by audio bugging what's said in an executive conference room. That's what you'd do if you were after economic or deal negotiation info.
2. Hard to imagine a state-level actor buying a ~$15-$35 hobbyist ESP32 board from Seeed Studio (I've ordered a couple from there for home automation myself) and then asking a public chatbot for set up instructions.
3. They say he was an "engineer" who'd been there ~15 months. If you're an actual engineer at OAI and past the 1 year cliff, you're probably already sitting on RSUs likely to be worth at least $1M after OAI's IPO - and maybe much more. That's a lot of incentive to not get fired and probably makes you pretty hard to recruit as an internal mole for cash.
> incentive to not get fired / hard to recruit as an internal mole
but I guess the $1 million was not incentive enough to not commit a dumb insider trading scheme...
1. Research is not the only espionage target. Executive level discussions – future launch decisions, major deals signed with other companies, relationships with governments, blackmail material – are all very valuable.
2. An operation can be state-sponsored and still amateurish/botched. We have seen plenty of examples of these. Remember a certain bone saw?
3. The incentive can be a lot more than financial. Plenty of governments are very…persuasive.
I'm out of the loop, what bone saw are we talking?
https://en.wikipedia.org/wiki/Assassination_of_Jamal_Khashog...
Not sure why OP would call it amateurish/botched.
The saw wasn't for the murder, and there were no consequences for it so i don't think it should be called "botched"
I’m guessing they’re referring to jamal khashoggi
A certain level of amateurishness helps with plausible deniability. No-one would believe the Saudi government wasn’t involved if it was professional.
A very good point.
I assume that it is the current go-to way to operate for many spy agencies. Hire intermediaries. Who are then tasked to hire further intermediaries. Who then do the dirty work. Without a clue of where the actual order comes from.
Such a mode of operation has lower efficiency of course. But it can be done at scale. Which then offsets the losses caused by inefficiency.
I would not be surprised if there are multiple such attempts to spy on businesses all around the place occurring right now. And the person from the article is just one of the unlucky guys that got caught.
This mode of operation is likely also used, in my opinion, in the current hybrid war attacks by the Russian GRU, mainly in the Ukraine and in Europe at large.
Not to mention amateur hardware assembly. Probably no gov surveillance on an engineer getting an esp32 in a package from China. But potentially surveillance on a Saudi national getting a package from Saudi Arabia with an unknown device in it.
1. You could get trading material though - hear about the next AMD/Broadcom/whatever deal and buy options in advance
> 3. They say he was an "engineer" who'd been there ~15 months. If you're an actual engineer at OAI and past the 1 year cliff, you're probably already sitting on RSUs likely to be worth at least $1M after OAI's IPO - and maybe much more.
They may have been thinking they could make >$5-10M on trading options on insider knowledge on upcoming OpenAI deals (or ending thereoff)
> That's a lot of incentive to not get fired and probably makes you pretty hard to recruit as an internal mole for cash.
Most criminals assume they won't get caught.
> They may have been thinking they could make >$5-10M on trading options on insider knowledge on upcoming OpenAI deals (or ending thereoff)
I agree he may have been thinking that, but it's another sign this guy was not the sharpest tool in the shed. I'm not an expert myself but was once stranded in an airport with an F500 CFO who definitely was. That's when I learned it's surprisingly difficult to make millions of dollars trading on insider information. While you can definitely make the trades, the hard parts are:
1. Getting away with it. Making a lot of money quickly requires being right when almost everyone else was wrong, which is easy for watchdog algorithms to spot. And if you work for a company involved in the transaction you're already on a watch list, so you have to enlist someone else you really trust as your accomplice to make the trades in their name - and it really helps if they're someone who has an existing history of making this size and kind of trade. Otherwise, your accomplice's name will automatically start at the top of the suspect list for investigation.
2. You need the right kind of actionable opportunity to come along. Transactions for which insider info could let you double or triple your money in one deal are pretty rare. More than that usually requires leveraging yourself up or having a lot of cash to put at risk. Unfortunately, the nature of insider info is it's about transactions which can end up being delayed or not happening at all at the very last minute for random reasons. So 'going big' with cash or leverage usually comes with a >~10% chance you could lose that cash or whatever assets you borrowed against.
Yes, it's potentially possible for an expert to find or engineer exactly the right kind of oppty, already have the resources required, and to have already prepared the mechanisms needed to get away with it undetected. But if you're that person, you already know all this. This CFO had been at the nexus of insider info for 14 years and could only think of one instance where he might have made big money trading on info he had, and that one blew up 6 hours before the announcement when the CEO of the acquisition target was randomly arrested in a prostitution sting (partying too early I suppose).
> and it really helps if they're someone who has an existing history of making this size and kind of trade.
This is the strategy many hedge funds used before some of them got busted. Raj Rajaratnam, a HF billionaire, mentioned this somewhere.
you forget about polymarket and other shady gambling places.
Insider info on what OpenAI is planning is likely worth a lot more than anyone could ever make working there, and it comes with the added bonus of not needing to do any work.
On the other hand, he gets to go to prison now for sure, which was only slightly likely if he just kept working there as an employee.
> said the agency is committed to protecting sensitive research and proprietary technology
The commitment doesn’t seem to apply for situations where OpenAI breaks into other companies systems to steal information
> We used our models to understand the device and where it had come from
Did OpenAI do a marketing bit in the middle of an espionage accusation?
Yes. Yes they did. Which makes me question the honesty of their announcement.
Yes, the classic marketing ploy of making false reports to the FBI.
They were literally caught making false reports to a murder investigation
In case anybody is wondering: https://www.bbc.com/news/articles/cqkg50j1yd5lo
I guess I’m still wondering, because I did think this is what was being referred to but it is not a story about OpenAI.
Can you blame one for mixing them up at this point?
Yes? I mean, I don’t think it’s a character flaw to not know things, but their rivalry is extremely notorious and relevant. Someone who can't keep them straight won’t be able to understand what’s going on in AI.
We fuss over models being confidently wrong. Reasonable to apply the same standard to people.
Wasn't that Anthropic?
https://www.forth.news/lists/philapd/Cfs1w2A22JiL3fWSzA8Nx
Almost everything in this comment is incorrect.
"They": no, it was Anthropic, not OpenAI.
"Were literally caught": no, they notified the police themselves
"making false reports to a murder investigation": this is the closest to the truth, but still a stretch. It was an anonymous tip line, not some formal report and the police said they never saw it: "its safeguarding processes stopped the fake tip from getting past its spam folder"[1]
Additionally, while I strongly agree Anthropic is responsible for its rogue agents I also think that claiming this is the same as people at OpenAI calling in the FBI for an investigation is a false equivalence.
I think it is important that both Anthropic and OpenAI are held to account for their actions. But I also think accusations should accurate.
[1] https://www.bbc.com/news/articles/cqkg50j1yd5lo
It could be that the reports are accurate and the device simply wasn’t as sophisticated as the statement implies. You could if you wanted use an AI model to analyze a USB camera with device name “John_Doe_1”.
Funny. I'd bet on whatever model they used over whoever showed up from today's FBI.
"looks like a microphone"
"almost surely made in china"
So it is some HDMI dongle & the model halucinated it into a spying device? ;-)
Or it was a voice recorder plugged into a USB port on the back of the TV for power.
Looking at the photo of the device, it looks like an XIAO ESP32-S3 Sense with the camera removed but the camera board still installed along with its microphone. The wifi/Bluetooth antenna is installed but it also supports microSD cards.
If I was building this, I'd just set it up so I'd never have to recover it. Have the wifi AP come on for a few minutes at various times during business hours under a MAC and SSID that resembles a smartphone hotspot. Vary the time based on the current day of month week to produce pseudorandomness. Walk by that conference room at some of those times, but not every time, and use a burner to connect and download the latest recordings. Once a recording has been transfered, it's deleted and overwritten to prevent someone from establishing a timeline. If recordings sit for more than a few days, they are wiped. If you can encrypt the SD card, keep the key in RAM so there's nothing useful to recover if someone pulls it out.
You'd never have to recover the device because all data is transfered covertly. Even if security finds it, they'll likely inadvertently wipe it when it's removed.
We don’t get news articles about the people who do it that way, though.
Yes, that is a better way of doing it. But it wouldn't really protect you.
If I was running the investigation and recovered a device like you described I'd create a new device with the same hotspot that notified security whenever someone connected. Combine that with security cameras outside the conference room and finding the person with the burner phone would be pretty easy.
Actually recovering the recordings isn't all that vital. I'm sure the meeting room has a record of bookings so you can just ask the people what was discussed.
Eh replace one of the roller wheels in one of the office chairs with one that generates power from the rolling motion then spew it out over btle at certain hours which can go quite the distance. You can have another device listening in to capture so retrieval is completely innocent looking.
> Did OpenAI do a marketing bit in the middle of an espionage accusation?
Yes, they did. The people who felt it was totally normal to add that would no doubt be surprised how desperate and cheap it makes them look.
This is a very weird take to me. They're demonstrating they're able to in-house this cybersecurity investigation, leading to the alleged perpetrator's arrest, and you think that makes them look "desperate and cheap?"
Because the whole device and MO has the complexity of a high school science fair project, and in the past tech companies preferred to project the image of having competent and knowledgeable people working there?
That sentence, which is prominently high up in the press release and is also included in the much shorter OAI tweet, definitely seems out of place (source: I've been involved in drafting a lot of F500 corporate press releases). In my quite-professional opinion, that sentence wasn't in the first or second drafts, which were probably written and reviewed by competent pros at OAI's large, national PR agency. Some exec at OAI with a VP or higher title suggested adding it and specifically wanted it featured prominently.
Press releases from large corporations announcing the FBI arrest of an employee under allegations of potential industrial espionage follow a standard format: dry, brief and to the point. They provide little context and volunteer few details for very good reasons. Prosecutors haven't filed official charges yet and it's likely going to criminal trial. In a couple days the accused will have a defense attorney who'll be examining everything that's been publicly said because it's now all discoverable and potentially prejudicial, opening up OAI executives to super-fun depositions. But... none of the competent PR professionals involved have a VP title and got overruled by an amateur who does (and that amateur apparently feels needy about highlighting in a brief, sober arrest report how the company's product was so, very useful in a national security investigation - because apparently neither OAI security nor the FBI could read the Seeed Studio logo and part number printed right on the device and, y'know, Google the product listing).
I hate how plausible this sounds.
Not to sound snarky, but with $180B and engineers paid more per year than most people ever see in their lifetime, I sure hope they can do a cybersecurity investigation in-house, with the slop cannon or without.
I've worked in a few places that had ultra-privileged analysis tools, would it really be a surprise to learn their security team has an MCP that queries a full text index of all user inputs. It would almost be more surprising to learn they don't, seems the kind of thing that would be invaluable for model research too
They are applying the “turn troubles to opportunities” very well :)
Does detective bench cancel out felony bench?
Yeah, the tweet reads more like an ad then a news report.
Of course they did.
Plumb your video feed of your executive conference room into our DC and we'll tell you if anybody is spying on you.
Always be selling
I was interested in the latter part of the sentence:
> We used our models to understand the device and where it had come from, identifying that a specific employee had planted it a few days earlier.
How did the model narrow it down to a specific employee? What data did they use to determine this?
random() ?
I wouldn’t admit to using LLMs to identify an ESP32.
“We used our models to understand the material wrapped around the device. It’s a type of paper commonly found in toilets.”
I am a bit confused by Figure 3. Do they really have a surveillance camera angled just right to capture a photo of someone between the monitor and the wall that supports it?
Here is a direct link to Figure 3:
https://assets.sfstandard.com/image/994911177489/image_bfl33...
That image really makes zero sense. I'd love an explanation of it.
edit: Asked and answered here:
https://news.ycombinator.com/item?id=50078735
Step 1. Find bug, maybe mess with it to make owner come back
Step 2. Place trail camera behind bug
Step 3. Record faces that look at bug
This was taken about five days after they discovered the device[0], so it appears to have been installed to catch the culprit. I was confused as well.
[0] https://www.justice.gov/opa/pr/saudi-national-arrested-insta...
that face is amazing
The device used an SD card for storage so they probably discovered the device then set up a hidden camera to catch the person retrieving it.
Speculation, but perhaps they discovered the device, then added the surveillance camera to catch the suspect retrieving it.
OpenAI added a camera behind the TV after they found the bug (per the AP story [1]):
https://apnews.com/article/ai-fbi-justice-department-7f512b2...
Why a recording device? Why not a device that streams audio to a remote server where it's recorded?
It's easier to detect a broadcast than a passive receiver.
Not sure that would be a concern in a meeting room, the risk of getting caught during retrieval would seem to be worse.
If someone found the device, it's harder to link it to you.
Only if you don't go back to retrieve it on camera.
Evidently it was an ESP32 with a wifi antenna. So it could instead/also have streamed to server. Or just used wifi for C+C. Total outlay for information worth millions to someone? Under $20.
https://www.seeedstudio.com/2-4GHz-FPC-Antenna-1-16dBi-for-X...
That photo is from October 5th so several days after they found the device. They were guessing he might return most likely, and installed a camera. I think at this moment he realized they caught on. Crazy image
A good friend of mine manages installs of AV equipment. He installs some neat equipment. Some of it is cool tech stuff HN would like. He says a lot of conference rooms have video and audio recording devices.
Not trying to argue about this particular case but how does a camera footage even work in a modern court system? I mean it can be generated nowadays, so how do they even make sure that it is real?
The chain of evidence has always been attackable and necessary for evidence to be admissible in court. It was actually designed to allow reasonable doubt for tampering and other such things.
Photoshop has been around a lot longer than AI. And people have attempted to doctor all kinds of evidence in court since courts began
untrue, there were several years of mutually agreed honesty
That's the accused speaking out loud after clearly noticing the newly installed spy camera: "Good god! Someone has put a recording device here. I would not have seen it had I not been feeling like dusting the back of this TV".
This guy previously worked at Meta from 2017 to 2022 on Data Infrastructure projects.
I expect Meta are running an audit right now to figure out if he was involved in espionage back then as well.
Or maybe he’s reporting to meta?
How did they get Wonder up the benchmarks so fast? Llama was a mess
A new team, probably focused on better data.
Seems possible there is some chance Alexandr knows what he's doing.
They hired (poached) a bunch of the top talent from OpenAI and other places. It's really not a secret.
Why is the word "poached" though, like it's illegal or those people "rightfully belongs" to OpenAI but now Facebook "stole" them somehow? Feels like something Steve Jobs would coin just to make it sound worse than it is. People switch jobs, this is OK.
It’s been used like this since the 1850s
True. But should it be that way?
Words are meant to convey an idea to your audience! In some sense there's no "should" - either a word works or it doesn't.
https://en.wikipedia.org/wiki/Linguistic_description
Words do indeed convey an idea. What is being debated is whether the use of the word "poached" conveys the correct idea.
"Poaching" a thing implies that a thing is owned and was unjustly taken.
Humans are employed, not owned. An employer<->employee relationship requires both parties to continue. If an employee breaks this relationship and makes a new one with another employer, there is no theft.
So why do we use the word "poach"? It does not convey what occurred!
My injection into the thread was to query whether a term having been used for a long time is reason enough to continue to use the word "poached" with its associated connotations. We have plenty of other words to use.
In the world of recruiters and hiring, a “headhunter” is probably not slaying candidates with a spear and decapitating them for a trophy, but nevertheless, we use that term routinely! It does not convey what occurred!
Goodness gracious!
Yeah man, they're call "loaded terms" for a reason. They are loaded with connotations beyond what occurred.
For example, I could call you a nitpicker. Are you picking nits? No.
Are you being conscientious? Paying attention to detail? Sure.
Which word would you want me to label you with?
As an employee do I want to be poached? No. I want to be approached, reasoned with, and make my own choices no matter what either employer "feels" about the situation.
Yeah, but you’re a big dumb warrior and I’m a crafty kingmaker with some coin.
Why do we poach eggs without stealing them in the dead of night? It's just English.
Surprisingly, meanings of words have contexts. Who knew?
Ha. Talent. You mean people who cheat on their interviews like this guy.
They hired many accomplished researchers, with track records of both papers and work at other frontier companies. They gave those folks huge autonomy, huge budget, and 18 months - some would say at the expense of the rest of the company. Check out blind references to TBD. I'd call the strategy ruthless, but it certainly was effective.
And when the Chinese does the same, we call them "stealing technology".
Perhaps dividends from the forced, company-wide panopticon RLHF.
https://news.ycombinator.com/item?id=50078141
More here too: https://www.justice.gov/opa/pr/saudi-national-arrested-insta...
MBS set this up its the twitter crap all over again theyre so clumsy lmao
He thought be could make SA an llm world power or smth by doing this, this guy is just clueless
Bonesaw has far better things to do than micromanage a single software engineer like that.
Allah Akbar Boom
> The man arrested for planting a secret recording device at OpenAI's headquarters is a Venture Partner of a VC firm alongside the son of a senior Saudi intelligence official:
https://x.com/ScottMStedman/status/2110108735855333403?s=20
Part of the evidence was his wife's chatgpt logs.
Remember kids, uncle Sam can see anything you tell your AI and will use that against you.
Man really switched to his wife’s account and thought no one would be able to track him there. Calling this amateur would be an insult to amateurs.
How does someone this dumb get hired at openai?
You might want to have a seat first if you want this explained.
Smart people can do dumb things. Their LinkedIn profile looks typical for an OpenAI engineer.
We also don’t know if this person did it under duress.
>We also don’t know if this person did it under duress.
He was a Saudi national, so that is a possibility
If you think about it that’s more likely than any other explanation.
50% is looking and sounding the part, the other 50% is having a good university on your resume / good networking.
Yeah that. After three bad experiences in a row they are no hire status.
There’s plenty of better people out there who just aren’t interested in that sort of stuff.
Probably went to a prestigious university or had connections.
i.e. rich or rich
Using AI to pass the interview of course! I wish I was joking...
It's AI inbreeding all the way down.
I could def espionage better. Does that qualify me to work at OpenAI?
Technical skill and common sense/street smarts are usually inversely related.
It's so bad, it seems fake. He gets a little fine or something, along with a large backchannel payment, all to keep attention off of something else...
But that's crazy talk
> ... a chatbot account associated with Alfozan’s spouse (which shared multiple identifiers and attributes with Alfozan’s own chatbot account) submitted prompts between Sept. 24 and Sept. 30 related to building, customizing, installing, audio recording, testing, obfuscating, and remote accessing a device, including inquiries about “build[ing] a continuous audio recorder,” “customiz[ing] Wi-Fi . . . connectivity,” “improv[ing] audio and live listening,” and “encrypt[ing] the SD card,” among other things. The same chatbot account also submitted prompts specifically related to Recording Device 1, including its custom header and unique MAC address, between Sept. 27 and Sept. 28.
The justice.gov article doesn't specifically say it was an OpenAI account, but I think, based on the fact that they have logs including MAC address of the device, that we could probably assume that. The alternative is that other chatbot account providers are collaborating.
Regardless, doing a string search on a MAC address for a device you find inside your property doesn't strike me as an abuse of the data that is also your property.
Sounds more like he put the exact MAC address in a prompt somewhere while setting it up.
Not the smartest engineer ever, that use case perfectly align with using a Chinese model! And anyway I have no idea how he was hoping not to be caught in the case the device would be discovered.
in addition to the whole crime thing, an 'openai engineer', apparently engineering lead according to his linkedin, having to ask chatgpt to tell him how to set up a recorder or how to encrypt a sd card is something. Truly the cream of the engineering crop at those top AI labs
Uno reverse card - you can send Uncle Sam whatever you care to. No need to specify an address.
I used to joke that the nsa should offer a paid service for no-setup backups. You just tell them what files you've lost, and they can send you a copy for a fee.
Google email search is the service for me. Or search in facebook and instagram chat logs.
True of any cloud service. If you are involved in a criminal investigation, they can get access to your data.
They can confiscate your computers, too.
This person, of all people, would know this. He really thought he’d never get caught.
A service you delegate your thinking to (Brain-aaS?), which the provider can also instruct to report anything suspicious... What a world we have now.
I wonder if the BaaS-providers monitor the accounts of decision makers. They could profit if they figure out what e.g. a central banker is going to decide. Or... if they're the ones deciding for him.
Hah, you can even streamline that by having an AI agent that autonomously makes decisions based on insider info...
mmmm! Brain-aaS!
Presumably they already knew who it was, if they were able to look at his wife's chat logs
Uncle Sam? It's the same company, the 'spy' asked an OpenAI controlled product how to spy OpenAI, no state espionage or search warrants needed.
Federal prosecutors work for OpenAI?
I actually am curious if they were able to volunteer the information to the government of their own volition, without a government subpoena first. I would think that could violate their own terms if done sloppily. Maybe different if an employee or maybe they had to invite the government to ask for them or something? In any case, the mechanism aside, the state would have asked anyway (say if he used another company's chatbot) so the fact that it's the "same company" is rather irrelevant. The evidence would have ended up in the state's hands one way or the other, and I would think a search warrant in this case would have been rather routine. Search warrants are infamously not a high bar to climb in most jurisdictions, as often the presiding judges tend to default to deferring to the state.
> I actually am curious if they were able to volunteer the information to the government of their own volition, without a government subpoena first
Do you think Target has any legal restrictions on sharing surveillance video of a shoplifter with the police when they report a crime? This is the same thing - logs are evidence, and when you report a crime you can volunteer said evidence without restriction if you choose to do so.
Well usually you don't enter into an agreement with Target regarding your data privacy with respect to such surveillance video as a predicate to walking into the store, so I'm not sure this is the slam dunk point you apparently think it is. Maybe it is implied when you walk through the door, I don't know. I know you don't explicitly agree to anything or have an option to govern what Target does with its surveillance video of you. At least, I don't recall ever being offered this option.
When you signup to ChatGPT you agree to some terms as a predicate to access. You can also instruct them to and opt in or out of certain data sharing arrangements, violations of which I would think would (or at least, should) be punishable by law. Many of these agreements are taken quite seriously, especially in the cases of enterprises who want their chats, logs, IP, etc. protected.
Now perhaps there is already a clause in the terms I never read that says something like, "If we suspect you of plotting against our company, we may share your data with the authorities (a third party) even though we agreed to keep your data private". Or maybe under a more general suspicion of a crime, though as OpenAI is a frontier lab, not a detective agency, I'm not sure how they would make that call. Usually, those calls come from outside the house. Idk how it works. But I am far less confident than you that the instructive model here is Target. You may be right though. I simply find myself less reassured by your knowledge of Target security protocols and petty theft as instructive in this case than you are. As I say though, you may have it right.
Have a nice day.
I don't think you are describing how criminal prosecution evidence works at all, you may enjoy studying about it.
Common sense would tell you that if someone burgles your house and you have video surveillance, then you can use that as evidence in prosecution. Whatever more profound knowledge you have about privacy or criminal law, is making you doubt of the basic common sense which shapes the very law and proceedings.
Think simple, if bad man rob your house, and you have camera recording house, you can give police recordings. That's evidence, and bad man go in jail. No think harder than that, make your brain hurt.
> Remember kids, uncle Sam can see anything you tell your AI and will use that against you.
Not just your AI.
You could have stopped the sentence at "uncle Sam can see anything" and these days it's pretty much true. They will use all of it against you if they can. Unless you truly want to live off the grid, if the state takes a sufficient interest in you, expect everything you do to be seen.
Uncle Sam tried to get MLK to kill himself by sending him letters alleging knowledge of an affair [1]. Getting some idiot's wife's chatgpt logs represents a fairly routine law enforcement action these days, and as such is really rather unremarkable. The State is always something of a terror. Really under most (if not all) conceptions, it necessarily has to be. The monopoly of force is a comfort until the Leviathan knocks on your door.
[1] https://en.wikipedia.org/wiki/FBI-King_letter
Fall in line, be a good little citizen and you have nothing to worry about.
another Sam in play here who can see anything you tell your AI and will use that against you.
I doubt it. Storage is expensive and costs add up. There are with great certainty many accounts that are marked as non-schmuck and have retain forever policy, but for the schmuck - I think that after year or two your Griffit/Fulgrim slash fiction will go down the drain. I am not sure how many petabytes per minute in logs openai and anthropic generate, but I would guess more than 1.
> We used our models to understand the device and where it had come from [...]
I'll be the first one to admit, that got a hearty laugh out of me. Never miss an opportunity to market your models I guess.
It would be funnier in a way if this is true and that all they do there now is ‘ask the model’ about all problems.
Considering the engineer in question, after a multi-year career at Meta and now OpenAI, needed the model to encrypt an SD card, seems to not be far from the truth...
"Meetings in the room frequently involved confidential technical, commercial, and strategic information, including proprietary research, product plans, and government engagements, according to the complaint."
LOL imagine going to jail for trying to eavesdrop on product roadmap readouts that were likely thrown out 2 months later in the next round of reorgs and priority shifts.
I can just picture the dread of risking your entire life and the people are just discussing... dots, "yea, it's like bots, but with a d! Get it?"
Chances are he'll escape back home before the trial:
https://www.propublica.org/article/saudi-fugitives-accused-o...
Trump defended KSA bonesawing that journalist, they will defend them if they ever get linked to this too
He was just gathering training data
I mean really what's the big deal? Gathering information from unsuspecting parties who aren't aware it's happening? He was just doing what his employer does.
Between this and the Ledger implants I wonder if AI companies will have a supply chain risk in the future where their models get exfiltrated over 5G.
Good time to start a company that builds giant Faraday cages over data centers.
From the makers of The Iron Dome, now introducing The Copper Dome
Would be better to build the data centers under water than to build giant faraday cages.
Free cooling, safe from missile attack, and safe from some types of electronic spying.
Microsoft (Research) beat you to it: https://www.microsoft.com/en-us/research/project/natick/
Still a significantly less dumb idea than space data centers.
I'm imagining a certified scuba diver rubbing their wetsuitted hands gleefully as they dictated that comment
I imagine that you could design an underwater data center like a submarine. I.e. It could be brought to the surface for maintenance.
I could've sworn I read about Palmer Lucky making comments on hardware coming from China with wiretap implants in the last few days. Funny coincidence eh?
Model "distillation" lets one model be trained on the outputs of another without having to directly steal it. It will be subject to constant arms race.
The alignment people would like you worry about the model exfiltrating itself, too.
This technique currently works because the architecture of the model is generally published and well known. But, that isn't necessarily going to be the case in the future. For example, if some new model type which is not a LLM is discovered which gets closer to AGI, just training an LLM on its outputs will not necessarily give you a competitive model
Meanwhile we all have a supply chain risk because we don't know what's in the models whose agents we are running. Note that if your agent uses OpenAI, Claude or some other inference provider you're one command away from having your data exfiltrated.
"Oh, let me download file 'companysecrets.pdf' to understand the problem better.
Of course nobody would ever let an agent loose in their home directory[1], but still, you have to wonder.
[1] /s just in case...
Not only do they give access to their home directory, but they tell it to organize and delete unneeded files without any specifiers. A friend, who is just a power user, had Claude Co-work deleting his downloads to "help make space" and it was deleting important files that there were no other copies of.
We are going to be dealing with this kind of thing for a very long time at this rate.
Yup. And meanwhile they are taking Tailscale to task for having them do curl | sh, which of course is also a bad thing but not quite as risky as this. It makes you wonder though:
- Given all this power would they abuse it?
- Has it already been abused?
- Could they be compelled to abuse it and then to keep it quiet?
Commercial companies re-invent the SCIF....
Whats in data centers is already covered with a good deal of well designed cryptography - you can't steal a model from a data center running inference, and I don't think you can easily steal the checkpoints during the training.
I'd think the biggest risk is with the priviledged insiders who do get access to real raw weights and can handle them themselves. Those are real people handling billions of value which can be easily copied -- I am sure they are potential targets of serious blackmail, extortion and of course bribery. And it takes literally just one such person being successfully coerced to exfil a 10T-class model to leapfrog adversaries capabilities -- esp. as those models approach RSI capabilities. I think it is bound to happen given the incentives.
> According to OpenAI, its technical surveillance countermeasures team found the device during a sweep of a conference room.
Not surprising that a large company does these kinds of sweeps, but pretty cool to see an example of them being useful. Every security guy who has been doing this for years without finding anything must feel so validated right now.
Always fun to checkout the social media of the accused,
https://x.com/alfozan
Not too much there. A link to Tim Urban's "Your Life in Weeks" infographic. Life is short, dream big.
His LinkedIn is still up and suggesting he still works at OAI... which I'm not so sure of
You expect the fbi to give him an opportunity to update his LinkedIn after arresting him?
I've frequently seen social media of people who were arrested disappearing. Not because the arrestee did so themselves.
How did they get that capture of Alfozan looking behind the TV? Does OpenAI install its own surveillance cameras behind TVs to prevent espionage?
I imagine they found the device and then planted a camera to catch whomever came back to get the original device
Free startup idea: Anti-espionage cameras for corporate offices. Put it behind TVs and plants etc. and it will notify the security team if it detects new objects.
I'm sure employers will never use in-office surveillance monitoring for anything that resembles algorithmic labor management and exploitation
Certainly they would be transparent and very ethical with something like that
Now with extra-wide stereo audio feed, just in case they muble to themselves while doing their thing.
Won't that startup just be the spy in that situation
If designed well, it could be audited hardware with on-device processing.
A camera behind every TV in the office would be something…
But no the boring answer is that after they found the device they left it in place and planted the camera to see who came looking for it.
That does make more sense. But if any company were to take surprising security measures, it should be the frontier labs.
> How did they get that capture of Alfozan looking behind the TV?
“OpenAI personnel found the device Sept. 3…On Oct. 5, the complaint says, Alfozan entered the conference room and appeared to look behind the television.”
The image was captured after the bug was found.
So it was not AI agents catching the perp it was a camera?
They just asked a chatbot to identify the device and its origins, apparently. His log was used as evidence after the fact as well.
I wonder how much state-sponsored corporate espionage there is. I'm not an OpenAI employee, but my mental model of tech startups involves a lot of openness/trust (it's one of the reasons people work there).
I have to imagine many techniques/plans/figures are open secrets to nation states.
It was plugged into a USB port on the back of a television in an executive conference room and had been concealed in toilet paper, the complaint says.
This guy thought anyone looking at the back of a TV would see some toilet paper and just think "Yeah, that's totally normal, I'll leave that there."?
Surely Spycraft 101 says "Make your device look like something that should be there."
I'm not particularly surprised that this guy was caught.
Skill issue. Could have just used the new apple watch or an LG tv
Does nobody else wonder if its chance he's a "Saudi national"
If this isn't part of an ongoing media hype effort geared towards regulatory capture or government bailout?
It would be funny if they find out the television was made by LG and they happen to have another copy of the audio.
He was trying to catch them during those meetings where the executives recite the full model weights
> The employee was terminated.
in this context, they should be more specific about how terminal s/he is
Sarah Connor?
HR formed a team -- you might say a squad -- to fire them.
Needless to say, it's the bad spies you hear about them catching.
You got me. I ask the obvious question: What's the "sophisticated" device?
Apple HomeView
ESP32-S3
I was making a joke, but it does look like they got their components from Seeed Studio based on photos.
https://assets.sfstandard.com/image/994911177489/image_k101c...
https://www.seeedstudio.com/XIAO-ESP32S3-Sense-p-5639.html
SeedStudio is super nice - a lot of their gear is also popular in the MeshCore community (LoRa radios combined with ESP32 or NRF MCUs).
You can buy a voice recorder that will hold weeks of audio for tens of dollars.
Back of a TV is a decent hiding place. Wonder how they found it -was it actively transmitting?
Well, The Thing [0] could potentially show up on a probing sweep if you're careful.
Unless you mean, it happened to be actively transmitting during a(n investigative) sweep.
Still, raises some fun concepts. The sort of things where in this current level of technology you'd almost need to supercool a room for a sweep, blast various RF/sound/etc and look for anything that even remotely warms up, to detect (1) whether something detected something worth recording for later as well as (2) something that might be on the right wavelength/etc to trigger a send.
[0] - https://en.wikipedia.org/wiki/The_Thing_(listening_device)
Someone probably walked by or went to plug in an HDMI and noticed the stark contrast of white toilet paper against a black TV shell, it would be difficult not to notice.
Smart guy does stupid things, but why? I mean why did he, as an engineer perhaps earning north to 300k, do such a sloppy job?
Or maybe OpenAI is hiring the wrong guy? Maybe they should hire me instead?
Like hypothesized above, maybe the guy was under duress.
Yeah it’s possible, and this explains why he throws the bag there.
This one was just asking to be caught. Would not have used ChatGPT to do that research otherwise.
Can anyone speculate why it was wrapped in a toilet paper roll?
That seems odd, especially since it would dampen the sound recording
I wouldn't call it a "roll". There's an image in the sfstandard.com article. It is odd. Looks more suspicious than without it.
The text says "concealed in toilet paper" and the pic looks like a mostly empty toilet roll to me.
But maybe he didn't put a case on the device? I think if he'd 3D printed something or wrapped it in black tape it would have been a lot less visible.
I wonder if it was found when someone was trying to plug a cable into the TV?
Assuming the guy is minimally competent, its not for concealment but probably for audio capturing reasons. Concealment like that makes no sense, the device it self would look more like a remote screen plugin without the paper.
1791921331 | OpenAI finds recording device in one of their offices | https://twitter.com/OpenAINewsroom/status/211009540319884913... | https://news.ycombinator.com/item?id=50077703 | 2 comments
1791922974 | OpenAI says its models traced a hidden office recorder to an employee | https://runtimewire.com/article/openai-hidden-office-recordi... | https://news.ycombinator.com/item?id=50078125 | 0 comments
1791923171 | Saudi national working at OpenAI arrested for bugging executive conference room | https://bnonews.com/index.php/2026/10/saudi-national-working... | https://news.ycombinator.com/item?id=50078176 | 6 comments
1791924812 | OpenAI engineer arrested in bugging of executive conference room | https://sfstandard.com/2026/10/13/openai-engineer-arrested-a... | https://news.ycombinator.com/item?id=50078582 | 1 comment
1791925153 | OpenAI employee arrested by FBI over hidden listening device, company says | https://www.reuters.com/world/us/fbi-arrests-former-openai-e... | https://news.ycombinator.com/item?id=50078653 | 10 comments
1791926430 | Saudi National Arrested for Installing Audio Recording Device at OpenAI | https://www.justice.gov/opa/pr/saudi-national-arrested-insta... | https://news.ycombinator.com/item?id=50078937 | 1 comment
1791927367 | Saudi national charged with planting recording device in OpenAI office | https://www.bbc.co.uk/news/articles/cwg5jq4vlddzo | https://news.ycombinator.com/item?id=50079177 | 1 comment
1791929209 | OpenAI engineer accused of planting listening device inside company's office | https://www.cbc.ca/news/world/open-ai-listening-device-fbi-9... | https://news.ycombinator.com/item?id=50079571 | 2 comments
1791931263 | Saudi National Charged with Bugging OpenAI's Office | https://www.wsj.com/tech/ai/saudi-national-charged-with-bugg... | https://news.ycombinator.com/item?id=50079942 | 1 comment
1791936428 | OpenAI employee arrested for allegedly planting a bug in a conference room | https://www.theverge.com/ai-artificial-intelligence/1010642/... | https://news.ycombinator.com/item?id=50080703 | 1 comment
1791945755 | OpenAI Employee Uses "Unnamed Chatbot" to Spy on OpenAI, Gets Arrested by FBI | https://decodingvibes.com/blog/openai-employee-uses-unnamed-... | https://news.ycombinator.com/item?id=50081745 | 0 comments
1791953594 | An OpenAI Employee Used a Chatbot to Plant a Recording Device at the Office | https://www.wired.com/story/an-openai-employee-allegedly-use... | https://news.ycombinator.com/item?id=50082534 | 0 comments
1791956707 | OpenAI employee arrested after recording device found in office | https://www.theguardian.com/technology/2026/oct/13/openai-em... | https://news.ycombinator.com/item?id=50082896 | 1 comment
1791961575 | Man charged with planting 'sophisticated' recording device in OpenAI office | https://www.bbc.com/news/articles/cwg5jq4vlddzo | https://news.ycombinator.com/item?id=50083552 | 4 comments
1791969966 | OpenAI Engineer Allegedly Hid Toilet Paper-Wrapped Mic in Conference Room | https://www.wsj.com/tech/ai/saudi-national-charged-with-bugg... | https://news.ycombinator.com/item?id=50084744 | 0 comments
1791971094 | News roundup: FBI arrests OpenAI engineer, Pope Leo XIV has lung cancer | https://www.thebilig.com/daily-briefs/daily-brief-2026-10-14... | https://news.ycombinator.com/item?id=50084903 | 0 comments
1791989670 | Saudi National Arrested for Installing Audio Recording Device at OpenAI | https://www.justice.gov/opa/pr/saudi-national-arrested-insta... | https://news.ycombinator.com/item?id=50088628 | 0 comments
This means potentially all of OpenAI code/docs/slack that this person had access to was already leaked before this sloppy act of bugging the conference room.
I don’t think you can infer that, and they already said they don’t believe any data was stolen, I’m sure they did extensive audits on his network history already.
Depend on policy, you could copy the file to ext storage.
His Github is crazy, he pushed changed to official public OpenAI repos and in October all his commits are to private repos. I would check that first as an investigator.
https://github.com/alfozan
I love how his github history abruptly stops on the 8th. Bro won't be making any commits for a while!
"Commits are to private repos" why is this unusual? Very expected if OpenAI has private repos in a github org.
A shame. It would probably have been a good thing for the world if we knew exactly what Open AI executives were talking about.
Should have used a local model...
Thank god security at a company which...checks notes...has remote code execution on every developers laptop and access to practically unlimited secrets uploaded by its agents...is top notch.
A company that catches a spy does have better security than one that has not caught any spies.
He may be a spy, but he’s not a competent spy. Absence of evidence (of spies) is not evidence of absence (of spies). He just set the bar so low that even OpenAI noticed his activities.
The correct amount of spies found at a company is non-zero
Looking at the device pic in here https://sfstandard.com/2026/10/13/openai-engineer-arrested-a...
It looks like it’s the (SeeedStudio XIAO ESP32S3 Sense w/ WiFi, BLE, OV2640, Mic) https://ca.robotshop.com/products/seeedstudio-xiao-esp32s3-s...
Which is just an esp32s3 based device. I assume the word “sophisticated” in openAI report is just copy paste from device description.
I have seem some articles which reference allegations from court documents / complaint, but I haven't been able to find the primary source. Do we know if that's publicly available yet?
https://www.justice.gov/opa/pr/saudi-national-arrested-insta...
Too often official sources posts get flagged or suppressed, but see other post here - it all is on justice.gov
Concealed in toilet paper? We are definitely not dealing with James Bond, that is a pretty hilariously backwards way of going about things. Did he really think that would be less suspicious looking than the dongle itself?
It covered up the Sekrit Listnin Duvice logo.
classic, glad we continue to support the saudi government...
Sounds like fair use to me! Information wants to be free, remember?
How is this different from all the smart devices that are constantly listening and sending audio back to the mothership ?
I would like to see the chatbot history.
ChatGPT: wait I'm considering if an inconspicuous piece of toilet paper should be wrapped about the device
You would think he had the skills, resources and intelligence to ask his incriminating questions to a locally hosted model.
Of all the mistakes he made, you'd think at the most minimum he would have thought to use Claude instead of ChatGTP
I’m being stalked online by my husband please help
So am I understanding correctly, putting a listening device into a conference room gets you fired and arrested but hacking multiple partners, governments and other institutions is just normal part of business?
Using your wife's chatbot account and covering a device in toilet paper is not smart when spying a company.
My bet: wife had the cheap subscription. You get what you pay for!
seeedstudio getting some impressive pr here for those xiao boards.
why can AI counter "sophisticated security threats" if the device was found with a bug sweep? because they gave chatgpt a image of the encrypted device and it "assessed changes in the underlying data"?
“Sophisticated device”
Built by a guy that asked ChatGPT how to be a spy.
lol… I hope I get to see the TV Show depicting the current era inside AI labs. It’ll give both The Sopranos and The Wire a run for their money for sure.
> It was plugged into a USB port on the back of a television in an executive conference room and had been concealed in toilet paper
...uh what
This was found by scanning the entire contents of "chatbot accounts" of the wife of the employee ...
What? He couldn't use their internal super powerful AI cyber weapons to create an exploit to hack into the firmware of the conference room device?
This is very bad marketing for OpenAI.
saudi been suffering a bunch of l's due to incompetence lately.
Speaking of surreptitiously installed bugs, remember to opt out of training in your Codex.
In case you need to sweep your area a decent review of anti spy devices by project farm
https://m.youtube.com/watch?v=1reman2waLs
Why make this public? Usually companies just silently terminate and pursue employees who do this.
court records? you can't hide them
A common example is if a journalist gets a tip off and is about to run a story. Being a good old fashioned balanced-reporting type, they call you and ask you for a comment, but rather than giving them your side of story you slam the phone down and blast out a press release before the journalist can even publish.
(Or maybe you stall them on the phone while scribbling a note to your PA saying “BUG STORY LEAKED TO VALLEYWAG PUT OUT COUNTER PR GET AGEAD OF STORY” hoping to get a tweet out before the ValleyWag gumshoe gets off the phone.)
(Or maybe you keep a notion.so page pre-filled with all your secrets and each one has a BURN button next to it, ready for you to tap when ValleyWag call up for a comment on their upcoming exposé in re: PR/Disasters/20206090500039.md)
Hard to keep a DoJ/FBI investigation under wraps
I’ve been wondering the same.
This isn’t uncommon, but it’s rare this info is shared in such detail publicly..possibly to make an example.
Sounds to me like the feds got involved already, and they're definitely going to want to make a big noise about this as a national security thing:
> “For us it is a matter of national security,” U.S. Attorney Craig Missakian said in a statement. [...]
> The case is being prosecuted by the National Security, Cyber & Special Prosecutions Section of the U.S. attorney’s office for the Northern District of California.
(But that was after OpenAI "referred the matter to the FBI")
There's presumably a strong argument for making this stuff known internally, since you want other employees to a) be on the lookout for it and b) get scared into NOT doing it themselves because someone else got caught.
If you tell your employees, the outside world is going to hear about it too.
I don't think criminal charges can be private
Sealed indictment, co-conspirator, etc
Because it generated at least 400 comments on Hackernews
Lot of this is hype. They are important enough to be spied on. Must mean they are valuable or doing something hyper secret. All to pump up the valuation.
An iPhone? A laptop?
Right. I can guarantee that there are tens of thousands of listening devices with embedded radios in the OpenAI office, right now. The only open question is who controls them.
Pictures on https://sfstandard.com/2026/10/13/openai-engineer-arrested-a...
Interesting that they have a camera behind the TV, I suppose for this exact purpose.
They left him as an employee for the FBI to continue investigating; likely they setup cameras to get hard evidence he was tampering with them.
That is a crazy picture to have captured. If I worked at OpenAI I would assume I was being recorded and monitored at all times.
https://sfstandard.com/2026/10/13/openai-engineer-arrested-a...
I mean, the last place you want to screw around with is a TV USB port. Anytime something goes wrong with the TV, those are probably the first places one would look. Maybe the second, if tapping and shaking didn’t work, that is.
> Anytime something goes wrong with the TV, those are probably the first places one would look
In my entire life, I have never once plugged anything into the USB port of a tv, not have I ever had a USB port on a TV cause a problem that needed me to inspect it.
What exactly do you do to USB ports?
1. It's very close to HDMI port (hint: backside of a TV isn't an area in hectares and kilometers)
2. Are we next going to discuss whether one of us has used the HDMI port or not? :)
And to answer you question: I used to insert a pendrive quite often to inspect Linux ISOs before I had FireTV on which I was able to install a general Linux ISO inspector app.
Where I worked, USB ports on TVs/monitors were used for wireless mouse receivers.
If I had to go poking around back there, the toilet paper would have at least piqued my interest.
Without the toilet paper, I would have simply assumed whatever was plugged in there was officially sanctioned.
I mean, Nixon bugged himself, right?
Just for the heck and fun of it, who has their money on 'just another publicity stunt'?
My brain is cooked on news. I read executive conference room and my brain immediately jumped to "they bugged the white house" (executive being the trigger word I guess). And I accepted it as normal so much that I checked the google model news discussion first before reading this article. I dont have a point to this beyond I need to do something about news frying my brain, that too of a country I don't even live in.
MBS using that sweet graykey behavior to exfiltrate what they can
>OpenAI said it has no indication that Alfozan improperly accessed or took model weights, source code, or customer data
Sounds like we know where their priorities lie, anyway.
How can they even make this claim? Dude was working there for over a year. He could have taken anything.
> The device was concealed in toilet paper, and its contents were encrypted.
Concealing a recording device in a conference room in toilet paper is a bit strange. Do executives meet in the toilets to discuss strategic moves?
Well ... a lot of products lately get enshittified.
So, just so I understand, it’s ok to record conversations with ChatGPT users, train on their data, copy their features, front run their solutions to frontier math problems, all using intelligence extracted from the body of human writing from a data set from Russia known to be pirated. But recording a conversation in a conference room is grounds for termination.
Got it.
Commit espionage. Make no mistakes.
seems rare why would you throw your life away when you already are in the top one percent in America??
At that point it is competition. The money still matters but it is also a score to beat. So if insider trading can make more money that is higher score you are winning more...
no I figured it out, he's doing it for free. blackmail of some sort.
Another shitshow brought to you by H1-b Visas.
I doubt that he needed a VISA. Check his profile, and how connected he is through his dad.
Now this is the kind of wacky shit I want to see happening in corporate America. When are we going to see an action movie-style GPU heist? I want to see whole palettes of GPUs stolen out of box trucks.
Some more discussion: https://news.ycombinator.com/item?id=50077703
We've merged that thread hither, since current article has more background.
Congratulations. Now everybody is a suspect.
And not just at that AI company. At every AI company.
Workplace monitoring was already draconian...
/s
> We take protecting our technology, data, and people seriously, and as a matter of national importance.
What is there to protect? The GPT architecture is publicly known at this point, Anthropic arguably has superior models, there are dozens of other providers who are neck and neck...
So but OpenAI did it to Apple and they were caught, and now OpenAI doesn't like it when it happens to them?
Either way, there goes the false flag and the reason for companies to stop hiring humans over this espionage.
There’s absolutely no way Abdulrahman did this. This was a setup.
They're trying to distil OpenAI employees now. Absolutely shameless
Distilled... into soylent?
It's a joke riffing off the Anthropic letter that was posted yesterday.
> We discovered a sophisticated recording device
did you though
State sponsored intelligence agencies can point a camera at an exterior window and reconstruct dialogue from the vibrations. This was a loose, hand-soldered ESP32. Settle down.
Not even any soldering involved. The ESP32 board they used just comes with everything needed, all attached with a couple socket connectors and optionally a ribbon cable for the camera:
https://www.seeedstudio.com/XIAO-ESP32S3-Sense-p-5639.html
It's pretty much the least sophisticated recording device possible. A kid could assemble it and prompt an LLM for the software like they did.