35 Comments

There is no use case for this technology. Not everything that can be invented should be invented

Expand full comment
Mar 31Liked by Dave Karpf

I feel the same way about Sora - there isn’t a single good reason for something like that to exist. Outlaw it.

Expand full comment
Mar 31Liked by Dave Karpf

What OpenAI really want is regulatory intervention that forces them and their competitors to have KYC (know your customer) rules like banks. This should prevent the plethora of new entrant start ups from entering the field. The technology is pretty much a commodity at this stage and they know it. Without that regulatory intervention they’ll be just another model amongst 10s of others.

The comms pre-brief across video and audio is there to get the media to start projecting fear of what this technology will do unchecked. If they get their way then all the existing voice generating models then have to tackle the harder problem of navigating regulatory authority which you can only do at a scale benefiting them and a select few others.

Like your other article about tech companies creating problems that “only they can solve” if only they were given some more money or less (or allowed self) regulation rings true.

Expand full comment
Mar 31Liked by Dave Karpf

Maybe the researchers should train the model on Sam Altman and show why this should be available to the public. I'm sure the CEO won't mind his voice available to everyone to use

Expand full comment

The reason we're all going to die is because too many people were either too stupid or too gullible to not realize this: there is NO "good" use case for any of these technologies that comes even close to making up for *completely and utterly breaking the idea of Objective Reality*.

Expand full comment
Mar 31Liked by Dave Karpf

So far, all OpenAI has are some really expensive party tricks, I suppose they can cruise on hoovered-up VC money for a while, but they've gotta start selling a product at some point, and I don't know if disrupting commercial art, help desks, and corporate writing is the big payoff for them. They need a cell phone, something ubiquitous, something EVERYBODY uses. What is it? You could tie the voice, video, and writing blocks together and crank out entertainment, Marilyn Monroe and Rudolph Valentino in a remake of A Star Is Born. Doesn't seem big enough. I think they want to build Deep Thought, a computer that can give the Ultimate Answer.

Expand full comment
Mar 31Liked by Dave Karpf

I LOVE the smell of Ranting in the morning! It keeps me sane for the time being to know there is someone who can articulate a first cause problem with clarity. I am personally now dealing with a robotic voice caller that keeps reiterating the same message over and over to my landline phone dozens of times throughout the 24 hour period. So, I had to disconnect my landline to receive NO CALLS at all. How nice is that for a new problem I should NOT need to deal with? I have AT&T, my son has T-Mobile - both with the same problem. How much worse could it get using God knows what as a means to harass the public? UGH!

Expand full comment
Mar 31Liked by Dave Karpf

Doesn't AI voice cloning already exist? Several news reports on people being impersonated to solicit ransom money from their relatives were published this last year, like on 60 Minutes https://www.cbsnews.com/news/how-digital-theft-targets-people-from-millennials-to-seniors-60-minutes-2023-05-21/.

Why is this reported as a new technology OpenAI came up with?

Expand full comment

Back in the 1970s, I worked for a technology group that used some primitive image modification technology to make a mouth look like it was speaking arbitrary phonemes. If I remember correctly, they used circa mid-1970s audio technology, probably analog, to fake our sponsor's voice and synched it up with the fake video of him speaking. It was an impressive demo for its day, and we were told to delete it. It was garbage by modern standards, but we've had 50 years of improved technology. As best I can tell, the delete command still works.

Expand full comment
Mar 31Liked by Dave Karpf

Quite. It kind of looks like inventing a terrible biological virus and mot because you actually want to develop protection against such a virus. What is true for the 'gene space' should probably have an equivalent in the 'meme space'.

Having said that, I strongly suspect that Hanlon's Razor holds here for a large part. Sam seems shifty enough, but many of his fellow travelers are probably honestly convinced of the things they (and he) says.

In the end, the issue is not so much that these systems are or will be intelligent, but that we humans aren't (enough).

Expand full comment

Hot damn Dave, you nail it. That Falcon Heavy ride to Mars needs plenty of seating me thinks.

This is such a bad idea that it really needs to be killed with fire.

Expand full comment

...why do these "humans" hate humans so much?...

Expand full comment

Of course, you are aware that several others have already come to market with this tech right?

Names you've never heard of, companies you've never heard of, releases you've never heard of and they never got in any spotlight, never commanded the world's attention to discuss the risks or solutions, never blogged about it or sat down with reporters.

I'm not quibbling with the problems of the technology, I'm not saying Altman is driven by altruism.

But, the fact that Altman is out there on the stage is the only reason most of us even know about it and have something to rant about.

Otherwise, it is just a genie escaped from a bottle you never saw.

While we rant, let us also give thanks to someone for spoon-feeding the present to us so we can opine about the future and the past here.

In the end, this article makes Altman's argument for him. Let's impede the competition, if Altman is bad, those ones we don't hear from are worse in the end.

Indeed they are not the protagonist in this case, that character has been working the room in silence already and Altman's voice is

Expand full comment

Predictably, the NYT obediently parroted their we’re-just-trying-to-get-this-right BS

Expand full comment

I find your comment very hostile. I would like to be able to clone my voice for presentations, to automate tasks, or to express creativity (if I can come up with a temporary voice variation that sounds really funny or cool and use it later), or eventually to have a device speak aloud with my voice in another language. How do we balance usability and security? Also, if OpenAI does not brag about its powerful technologies, how will it raise money? Please keep in mind that the development of AGI will be associated with the development of very uncomfortable (subjectively) technologies. I am not sure that this kind of venting is fruitful or will have a positive effect on society.

Expand full comment

I see a future sci-fi series: “Customer of Interest.” You’re being recorded. OpenAI has a system, a machine that mimics your voice and lets criminals use it every hour of every day. I know because I’m Sam Altman, I paid a bunch of techies to build it. I wanted it to make money for me but now it’s creating windfalls for every grifter, fraudster and terrorist with a laptop and no moral code - like me.

Expand full comment