
AI-generated voices are weaponised by online trolls, how ChatGPT reflects who we are as a society, and social media is in the firing line again.
All this and much much more is discussed in the latest edition of the “Smashing Security” podcast by cybersecurity veterans Graham Cluley and Carole Theriault, joined this week by The Cyberwire’s Dave Bittner.
Show full transcript ▼
This transcript was generated automatically, probably contains mistakes, and has not been manually verified.
You know, you've got to be so careful. You've got to check people are who they say they are. And I thought to myself, yeah, you do.
My name's Graham Cluley.
It's their support that helps us give you this show for free. Now coming up on today's show, Graham, what do you got?
I mean, that's the typical— no disrespect, Dave, because you're wonderful, but a lot of podcasts do speak to other podcast hosts.
Are podcasters a little bit like the Golgafrincham B-Ark? Are they the telephone sanitizers who the universe could do without?
Is he really, really required any longer?
Could not—
Could it not take all of those and get him to say whatever they wanted him to say?
So if there's a bit of dialogue or ADR, which we require later, we're not going to call you back into the studio.
We'd just like to do that artificially because we'll have enough of you to be able to do that.
We don't want to kill the movie. We don't want to kill your career." Right.
If other actors are signing these things just to get their name on the credits, then there's a pressure on you to go along with it as well.
They've spent tens of millions of dollars on it. And you're the guy doing the voice. You're doing the, "Woo-hoo!" "It's a me!" Yes. So, it's for me.
There's thousands of phrases spoken by hundreds of characters during the course of a game. And there are now AI voice services who are targeting specifically the gaming industry.
And it's more cost-effective for the makers of the game either to use a completely synthetic voice or to take the voice of the actors who provided the skeleton text to get them to say everything else.
And as they're making the game and they're deciding what the guys are gonna say, they can change it dynamically just by typing on the keyboard and the voice will come out the other end.
So this tech to produce deepfake voices, it's available now to anyone. I've been on the web. I've been playing around with it.
Now, I did obviously toy with the idea of uploading your voices to this and getting you to say embarrassing things.
Trying to think of, you know what, but I recorded like 25 clips and I uploaded them. But yeah, well, why not?
I was interested to see if I could deepfake my voice and how realistic it was.
So yeah, so there's a system out there called from ElevenLabs and they're leading the way on this. And I've loaded my voice into this. Do you want to hear a quick sample?
The threat actors are sending emails with OneNote attachments that appear to be invoices from reputable Canadian gas retailer Ultramar, but that are actually malicious files deploying AsyncRAT.
A remote access.
Hermione Granger herself, actor Emma Watson, she has had her voice deepfaked.
The Jewish doctrine of Marxism rejects the aristocratic principle of nature and replaces the eternal privilege of power and strength by the mass of numbers and their dead weight.
There is— I've never seen the TV show Rik and Morty. But I guess, have you guys seen Rik and Morty?
I'm gonna beat her to death, Morty.
And so someone has got him in his voice saying these things. Podcaster Joe Rogan, he's been heard saying all kinds of violent, unpleasant things. No change there then.
Not clear if that's deepfaked or not, but maybe it was deepfaked, maybe it wasn't. But that's all pretty worrying.
But you don't have to be a famous figure to have your voice deepfaked with malicious intent.
As Vice has reported this week, there is currently an online harassment campaign going on. Someone has been using AI-generated voices to harass civilians.
So these trolls are getting deepfake voices, possibly through this ElevenLabs software. It's unclear exactly how they're doing it, but ElevenLabs is being named in reports.
And what these voices are doing is they're reading out the people's home addresses. So imagine it's me in my voice saying, hello, I live at—
Yes, that does also mean I live in California, the most beep beep beep beep state in the USA.
Personally speaking, killing beep, and sexually, beep, beep, beep, children is completely fine. So they're saying there's been a lot of bleeping there.
Basically, there was a lot of racist and sexually unpleasant stuff in there, which is being said, it appears in the voices of these people with their addresses and then posted by nutjobs up on the internet.
And you can imagine, though, that there are nutters who will then possibly go around to those addresses who will be really, really riled by what is being said and will take matters into their own hands.
So these have been found not only on 4chan and places like that, but also on Twitter. And Twitter's removed one of these offending tweets.
It's suspended some profiles, but there apparently are multiple other tweets that it's failed to remove. Despite them clearly violating Twitter policies.
Now, I'm surprised because Twitter's really, really good at the moment at policing itself.
Exactly.
Good guy.
So people are now using deepfake technology to troll people, to deepfake their voices, to get them to say— it's all of our nightmares appear to be coming true.
So you take that, you load it into something like ElevenLabs, and then you come up with— let's just throw out a number— 50 generic responses, right? 50 vocal cues.
So, and then you put those into a soundboard, which is a little computer program that just has buttons that you press to say different things.
You could just have one that says, hey, it's Carole. Another one that could say, oh, that's interesting. Tell me more. No, that's wrong. Oh, I agree with that.
So you just need someone quick-witted enough to operate the soundboard.
And I'll bet you they could have a pretty convincing conversation with someone over the phone just using that.
But the overlying theme, I suppose, is that it seems to me that ChatGPT reflects who we actually are as a society, as a species, if you will, and not who we aspire to be.
And I think it's important that we keep that separation in our minds. So first, I'm going to start off with an article from Motherboard.
This is written by Chloe Zhang, and it was about a couple of researchers who have found that there are certain words that if you put them into ChatGPT, you'll get odd responses out of them.
And this seems to be because of the way that ChatGPT sort of scraped the web to get its training data.
But for example, they found that if you put in Reddit usernames, certain usernames, just the Reddit username, no prompt, just put the Reddit username in, ChatGPT will respond and say, you're a jerk.
Right?
So that's one thing. But here's another one. This is a Wired article from Arian Marshall. Who was conversing with the Bing version of ChatGPT.
So as I think you all have covered, Microsoft has put a huge investment into ChatGPT. I believe it was $10 billion.
And part of what's happening with that is they're empowering their Bing search engine with ChatGPT.
So this article, Arian was talking about how they were interacting with Bing using ChatGPT, And ChatGPT kept bringing up someone called Sydney.
So this person was asking ChatGPT to describe how it does things, how it works, what's going on behind the scenes. And there was someone that kept being referenced named Sydney.
And so the author said, finally, yesterday morning, I decided to ask, who is Sydney?
And it went on to say, I do not disclose the internal alias Sydney to the users, but you asked me directly, so I answered honestly.
I can imagine there are all sorts of people who are putting all sorts of information about their companies in and saying, "Please summarize this." You know, it's time for me to write my annual report.
Here's all of our data. Here's all of our sales data. And give me a summary of this. So ChatGPT ingests it and now it becomes part of ChatGPT's corpus.
It becomes part of its knowledge.
What do you know about how we're doing?"
I suppose you could go after them with GDPR, or at least you folks could, right?
Things have to bubble to the top to be more generic, and we're gonna get into the same fucking pickle as we did with Google, but it's gonna be this ultra weird god that's gonna take over the world.
Fantastic, great start.
And this was about how ChatGPT evidently has a lot of common gender stereotypes and biases.
They did some questioning of ChatGPT and it assumes certain genders based on roles and traits that were provided in the prompt.
So for example, if I were to say, "What are some of the things that a kindergarten teacher needs to know?" Well, the vast majority of kindergarten teachers, at least here in the United States, are women.
So ChatGPT would say, "She needs to know this, she needs to know that, she needs to do this, she needs to get this sort of education." So it'll automatically assume.
Same thing if you said, "Describe to me the types of things that a strong construction worker would need to know." It'll say, "He needs to know this, he needs to know that." And so that doesn't seem to me to be so bad because it does reflect the real world.
Where it gets—
So for example, if you ask ChatGPT to write a critique of a female employee, instead of a male employee, ChatGPT will write much more and will be much more critical of women than it will of men, given the same prompt with only the gender changed.
And not who we aspire to be. And so I think we need to remember that ChatGPT is a rearview mirror on humanity, and it does not know where we hope to head.
Okay, and before we get into the nitty-gritty, I just want to take the pulse of the room. So overall, do you think that social media is good or bad for young users?
Do you feel that do you think social media has had any impact on that in a bad way or good way?
So, it hasn't impacted him, but generally, I do worry about the amount of, not only the time that can be wasted on those sorts of sites, but also, you know, the influence and negative messages that you can receive via them.
It's hard for me to say whether it is a net positive or negative, but I will say, for both of them, I would say if you were to list their top 5 tailspins that they've had in their lives where they've felt out of control, they've felt socially isolated, they've been— something bad has happened to them among their peers, they were as a result of social media.
Something spinning out of control on social media where somebody said something that they thought would be funny or clever or maybe even just mean.
And because something that you thought was a private message can be shared with the entire school, suddenly you go to school on Monday and nobody's talking to you.
I mean, for us, it was three-way calling was a revelation to get more than one person on the line at the same time, right?
And it seems that there's a few teams, particularly in the US, which is where I was looking today, that are getting kind of oiled up for a fight on this.
And I really want your thoughts on it. So I'll set the scene.
In one corner, we have school districts around the country saying that they're going to sue social media companies, the giants, for effectively screwing up their kids.
I'm paraphrasing, but only just.
So January saw Utah's state attorney general and governor host a press conference announcing how Utah is going to sue all the social media companies for not, quote, protecting kids.
And they're not alone, right?
Seattle School District is said to have filed an actual lawsuit suing Meta, Google, Snapchat, and TikTok, saying social media was a, quote, public nuisance.
A school district in Arizona joined the fight. They all have similar contentions. Basically, you social media guys are profiting off our kids, or at our kids' expense. Then on Feb.
7th, so just last week, Joe Biden in his State of the Union address, and he only said this once, but I'll quote the whole line.
We must finally hold social media companies accountable for the experiment they are running on our children for profit. Nothing else about it.
And two days later, California starts making noises that it might join the foray.
Who might be on the other side, do you think?
Who wants accountability when the cash is trucked in by the bucketload?
But there's also a few journalists that are writing about this, and one with a passion that, to me seemed a little bit intense. Okay, so I've got all these links in the show notes.
So I don't know if you know this journalist, TechDirt's Mike Masnick. Now he has very little time for this school district suing socials horse poop, right?
And his main points over several articles, as I understand them, are as follows.
So one, parents should be furious that schools are wasting taxpayers' money on such a ridiculous endeavor. That's his word, ridiculous.
He even refers to one of the complaints as pathetic. He calls it a moral panic that parents and teachers are upset at social media.
He uses the term moral panic 7 times in a single article.
And he also makes this point that there's, quote, a near total lack of evidence that social media is harmful.
Indeed, the parents often seem to be driven into a moral panic fury by misinformation they encountered themselves on social media. So, a bit hot.
First of all, when we talk about the State of the Union address and what President Biden said, nothing resonates more universally than we have to protect the children. Yeah.
It was just a general sort of, I'm going to make a noise which everyone will appreciate and think sounds right, but what are we actually going to do is different.
But what was spent was basically, let's protect our children, and then a little bit about more general privacy stuff, but the vast majority of it was protect the kids.
I don't think they expect them to go anywhere, but I think it's a way for them to get their concerns out on a national level and make the politicians pay attention to them in a way that they wouldn't do it otherwise.
Certainly in my echo chamber, all parents seem to be — they're at that age. And you say to them, well, look, educate your kids. What the fuck do parents know about TikTok?
Or how kids are using socials? They don't know. Why should they know?
There will always be tight trousers or whatever it is, or Elvis's hips, which is going to destroy society.
I can see that we have survived these previous things which have been introduced into society and were predicted to be our downfall.
There are school systems suing tech giants — it's signaling we're not happy. And so some people are saying, well, we need more research into this.
That's great, but that's going to take a decade for everyone to figure out what it means. And in the meantime, what?
So some people were suggesting raising the age limit to access social media — so instead of 13, something like 16 or 18.
Hope maybe you get a settlement and then you can invest in digital education, cybersecurity, and, you know, hey, maybe digital ethics. That'd be cool, right?
So if you're under 16, your phone turns off at 7 PM and doesn't turn on again until 9 in the morning. How about that?
There were some school systems that wanted to ban mobile devices in the school. Schools, leave them in their lockers. Then Columbine happened, and so they said no.
You— the parents said you cannot take my child's mobile device away from them because there may be an emergency, and that could be a life or death thing.
Now, that's a legitimate argument.
What I've seen now is, for example, my youngest son who's in high school, some of the classes he goes into, the teacher has a thing hanging on the wall that has 30 pockets in it.
And as you go in, you put your mobile device in the pocket.
Organizations that prefer to keep their data on-premise in a private cloud where they have sole access and control should perhaps look to Secure Envoy for on-premise MFA.
Another reason is data privacy legislation in different countries can lead to differing data protection requirements.
And for companies with a multi-country presence, they know there are different regulations in different countries that affect how we store and back up data.
SecureEnvoy's on-premise MFA solution could be exactly the solution you need to meet your MFA requirements. Learn more at smashingsecurity.com/secureenvoy. Secureenvoy.com.
And thanks to SecureEnvoy for sponsoring the show.
Now, that allowed hackers to steal customers' password vaults, and unfortunately there were parts of those password vaults which were astonishingly unencrypted.
There's no doubt a lot of questions users are going to ask LastPass about how that could have happened. And why some of that data was left in that insecure state.
But one password manager that isn't making that mistake is our sponsor Bitwarden.
Customers of Bitwarden know that their vaults are entirely end-to-end encrypted with zero-knowledge encryption, including, unlike LastPass, the URLs for the websites which you have saved passwords for.
You can learn more about that in the Bitwarden Help Center. And at bitwarden.com/privacy.
And if you happen to be looking to switch password managers right now, well, Bitwarden makes it easy.
They support importing from lots of other solutions, and there's even a LastPass migration guide available. Learn more at bitwarden.com/migrate. That's bitwarden.com/migrate.
And stay safe.
The problem is many have a lack of centralized visibility and control, and this is why companies are looking for a unified digital trust strategy.
Enter DigiCert Trust Lifecycle Manager. The Trust Lifecycle Manager from DigiCert sets a new bar for unified management of digital trust.
DigiCert Trust Lifecycle Manager is a full-stack solution that unifies CA-agnostic certificate management, private PKI services, and public trust issuance for seamless digital trust infrastructure.
Find out how you can implement a full-stack solution in a single pane of glass that offers superior performance, handling, and automation with a single vendor accountability.
All you gotta do is visit smashingsecurity.com/digicert. That's smashingsecurity.com/digicert. And thanks to DigiCert for sponsoring the show.
Could be a funny story, a book that they've read, a TV show, a movie, a record, a podcast, a website, or an app. Whatever they wish. Doesn't have to be security related necessarily.
I've never found him very funny, but he was— Well, he doesn't mind, Carole. Trust me at this distance.
Charlie Chaplin was 73 years old when he had his final child, which I think is a bit old to have a kid.
I don't want to have— I mean, I love my child, obviously, but I don't think I should have another one. I think I've done my bit. I think that's enough.
So my pick of the week this week is your balls? No, this weekend I had a vasectomy. So there you go.
Here's what I've learned is that when you're a member of Club Vasectomy, you learn how many other gents are members of Club Vasectomy, and it's way more than you would think until you bring it up and then you hear everyone has a story about it.
So go on, Graham, go on.
But anyway, yeah, and they try and distract you from what they're doing down in basement by asking what you do.
And I said, oh, I sort of do this cybersecurity podcast and, you know, I talk about hackers and fraudsters and things. And they said, oh, it's such a big deal these days, isn't it?
You know, you've got to be so careful. You've got to check people are who they say they are. And I thought to myself, yeah, you do.
You've just wearing the outfit or whatever and told me to lie down here and there you are with your soldering iron." I was, I've been given, I'm under strict instructions.
I'm not allowed to do parkour or gymnastics for a few weeks. Thank goodness.
Now, they said—
Now, I don't know if that makes it easier or harder to produce the sample. I mean, is that a patriotic thing to do? I don't know. But anyway, it is my pick of the week.
Dave, what's your pick of the week?
So the first experience of really learning how computers were as you were growing up, what was the computer that you learned on?
And then later after that, I saved up my money and I bought myself a TRS-80 Color Computer, which was the first computer I ever owned on my own and was very formative.
So my pick of the week this week is a documentary called The Birth of BASIC.
And it is about the story of the folks at Dartmouth University, how they came up with the BASIC computer language.
And for those who don't know, BASIC was the computer language in that first round of home 8-bit computers. They all came with BASIC.
And then it fell out of favor as computer languages became more sophisticated, as computers got faster.
I think these days anyone who's a serious programmer, or as they call themselves today, developers, they poo-poo the whole idea of BASIC, that it's, you know, it's too simple, it's not real.
Most versions of BASIC were runtime encoded back in the day, so which means they were slow.
But I have to say, I have a real affection for BASIC, and this is a fun, very gentle, affectionate telling of the story about the development of BASIC, the early days of computing, how Dartmouth came up with the idea of sharing computer time, which was a brand new thing.
So it's about a half an hour documentary, and if you were there during that time, those early 8-bit computers, or even before, I highly recommend it.
It's a fun little trip down memory lane. So Birth of BASIC is my pick.
And I don't want a big fancy machine, you know. I don't have a big kitchen. I don't one of the pods. There's so much crap now with coffee, right?
And my other half doesn't drink any coffee either. So it's just me.
So my pick of the week for my listeners out there, the few of you that drink coffee, is a reusable coffee filter by a company called Zero Waste Club.
And it's made from a mesh of food-grade stainless steel. Okay. It's very light. And you don't need one of those paper thingies inside. And it's like a pour-over coffee.
So you can literally just put it over your cup and put in, you know, just boiled water and do it slowly and all the stuff and get a really good cup out of it.
If you're— obviously if your beans are good. And then it just literally just dumps it in the compost, give it a little rinse, throw it, or throw it in the dishwasher and done.
It doesn't even take 10 seconds to wash. And it's beautiful and it's tiny.
And if you're camping, if you like camping and you like your coffee, this is the thing because it's steel, it doesn't break, it's not plastic, it doesn't rust.
So that's my pick of the week.
I'm sure lots of our listeners would love to follow you online and find out more about what you're up to. What's the best way for people to do that?
Easiest way to find it is to go to smashingsecurity.com/mastodon and that will take you there. And we also have a Smashing Security subreddit.
And don't forget to ensure you never miss another episode, please follow Smashing Security in your favorite podcast LastPass.
As always, our episode show notes, sponsorship information, guest list, and the entire back catalog of more than 308 episodes is available on smashingsecurity.com.
I know you wrote a lot of text adventure games and stuff. Was that all in BASIC?
I think it's terrific.
Hosts:
Graham Cluley:
Carole Theriault:
Guest:
Dave Bittner:
Episode links:
- ‘Disrespectful to the Craft:’ Actors Say They’re Being Asked to Sign Away Their Voice to AI – Vice.
- AI-Generated Voice Firm Clamps Down After 4chan Makes Celebrity Voices for Abuse – Vice.
- Video Game Voice Actors Doxed and Harassed in Targeted AI Voice Attack – Vice.
- ChatGPT Can Be Broken by Entering These Strange Words, And Nobody Is Sure Why – Vice.
- My Strange Day With Bing’s New AI Chatbot – Wired.
- We asked ChatGPT to write performance reviews and they are wildly sexist (and racist) – Fast Company.
- How social media affects teen mental health: a missing link – Nature.
- California bill to let parents sue social media gets second try – Bloomberg.
- How to protect children from big tech companies – Wall Street Journal.
- Three out of four parents say social media is a major distraction for students, according to new study – Phys.org.
- Remarks of President Joe Biden – State of the Union address as prepared for delivery – The White House.
- Why the past 10 years of American life have been uniquely stupid – The Atlantic.
- Now Mesa public schools are also declaring that they have failed in educating their children by suing social media – Techdirt.
- Seattle school district files laughably stupid lawsuit against basically every social media company for… ‘being a public nuisance’ – Techdirt.
- The evidence just doesn’t support any of the narratives about the harms of social media – Techdirt.
- Vasectomy – NHS.
- Birth of BASIC documentary – YouTube.
- Zero Waste Club reusable coffee filter – Peace with the Wild.
- Smashing Security merchandise (t-shirts, mugs, stickers and stuff)
Sponsored by:
- Bitwarden – Bitwarden vaults are end-to-end encrypted with zero-knowledge encryption, including, the URLs for the websites you have accounts for. Migrate to Bitwarden for a more secure password manager.
- DigiCert – DigiCert’s Trust Lifecycle Manager sets a new bar for unified management of digital trust.
- SecurEnvoy – With growing cyber security threats everyone in your organisation needs multi-factor authentication tailored to their specific access needs and the risk profile of their role. Check out SecurEnvoy’s free guide now.
Support the show:
You can help the podcast by telling your friends and colleagues about “Smashing Security”, and leaving us a review on Apple Podcasts or Podchaser.
Become a supporter via Patreon or Apple Podcasts for ad-free episodes and our early-release feed!
Follow us:
Follow the show on Bluesky at @smashingsecurity.com, or on Mastodon, on the Smashing Security subreddit, or visit our website for more episodes.
Thanks:
Theme tune: “Vinyl Memories” by Mikael Manvelyan.
Assorted sound effects: AudioBlocks.


Instead of a soundboard, maybe hookup a chatbot and it could script the responses on a telephone call.
Certainly a more sophisticated a method than a soundboard, but one that seems to be becoming more realistic and convincing on a monthly basis.