Do you trust AI?

Use this board for general non-cycling-related chat, or to introduce yourself to the forum.
reohn2
Posts: 46309
Joined: 26 Jun 2009, 8:21pm

Re: Do you trust AI?

Post by reohn2 »

Jdsk wrote: 26 Aug 2025, 8:54am
reohn2 wrote: 26 Aug 2025, 8:46am With the growth of AI how will we know the difference between truth and fake/mistake?
It's hard enough now,with AI in full swing confusion will reign which will play into the hands of the unscrupulous.
The same way that was should judge the reliability of other information: provenance, trustworthiness, transparency, identification and minimisation of bias, avoidance of fallacy...

Fortunately we have the benefit of several centuries of learning how to do this.

Jonathan
And yet we wind up with people like Trump,Putin,BoJo,Farage and many others Iike them in positions of power they should never have been in.
If the ordinary wo/man on the street can be fooled by such morons,shysters and snakeoil salespersons,how much more confused will the electorate be when these people get their hands on AI?
-----------------------------------------------------------
"All we are not stares back at what we are"
W H Auden
Nearholmer
Posts: 7593
Joined: 26 Mar 2022, 7:13am

Re: Do you trust AI?

Post by Nearholmer »

There is trust, as in do you believe the answers it gives now, and there is trust as in do you trust what it might be used for, or do.

On the latter point, this is a quick primer on possible negative outcomes https://www.forbes.com/sites/bernardmar ... the-world/

The author is a friend of mine, who really knows the AI scene inside out, and is a very “grounded” person who writes, presents, and advises on the topic globally, and I think is well worth listening to. His archive of articles is worth dipping into https://bernardmarr.com/articles/
djnotts
Posts: 4077
Joined: 26 May 2008, 12:51pm
Location: Nottingham

Re: Do you trust AI?

Post by djnotts »

^Nearholmer: "On the latter point, this is a quick primer on possible negative outcomes https://www.forbes.com/sites/bernardmar ... the-world/"

Depressing innit? A bit on the optimistic side to my way of thinking, especially in the context of the rise of the extreme right, whether global capitalism or old skool nationalistic facism.

My life expectancy such that I'll probably miss the worst of it all, except maybe Farage's camps, but my kids and grandkids face total misery ......
User avatar
Cugel
Posts: 7130
Joined: 13 Nov 2017, 11:14am

Re: Do you trust AI?

Post by Cugel »

Nearholmer wrote: 26 Aug 2025, 12:44pm
Not that long ago the vast majority of human learning was via practice, not theorising
I really, really don’t think so.

Tuition in one form or another, so transferring knowledge from one brain to another, is probably a defining or differentiating characteristic of us upright apes. Many, many creatures teach their offspring to some extent, but nothing like to the extent that we teach.
A major mode of learning for we primates is copying. The vast majority of this copying has been via doing not talking or reading - until quite recently, when we copy methos transmitted via talking, reading and viewing vids. These media lose or don't include a vast amount of relevant information needed for successful and true copying.
Nearholmer wrote: Much of the “initial knowledge capital” was certainly gained by trial and error, but it wasn’t down to each successive individual to discover everything over again, and a rich oral tradition is as much a library as is a pile of books, maybe even more so, because it gets foisted upon the individual. TBH Im not certain whether the “soma” in question is the individual, of the entire collection of individuals, but if it’s the former then the collected wisdom in the heads of the tribe members is “extra-somatic”.
Until the advent of a set of educational establishments available to all, there was very little in the way of the sort of education we had at school. Such education was confined to a tiny number of the population, in monasteries and, later, places like Oxbridge. Most learning was via trades, guilds and similar. It was learning by doing with very little in the way of written descriptions of the procedures and methods.

Talking was obviously involved, but only as a sort of goad to keep the doings on track.
Nearholmer wrote: As for theorising, humans seem to have been at that game from very early-on too, postulating by extension from proven knowledge and essaying, making the odd inductive leap etc.

You are right that technologies have long emerged in advance of any deep theoretical understanding of them, but it would also be true to say that the two have often progressed sort-of hand-in-hand, and although theory preceding practise by a long distance has become much, much more common in recent centuries it wasn’t completely absent before that.
Theorising has long been a part of human culture. The whole of a religion, for example, is theorising in the extreme! But theorising about more practical matters was always part of a much larger container of doings of particular kinds. And theorising was (rightly) regarded as worthy of a lot of suspicion because older methods tended to be tried and true whilst theopries often turned out to be mad theories lacking in any attention to their full consequences and costs.

One aspect of the rise and dominance of theorising over learning-by-doing is the establishment of whole institutions that have a power in society yet actually produce little of worth and often a lot that's damaging. Religions are like that but so are pseudo-sciences such as economics, psychiatry and political think tanks. None of them value learning-by-doing and are far too keen to blame poor implementation of their pet theories as reasons for failure/damage rather than the theory itself.
Nearholmer wrote: As for the overall “ignorance was bliss” drift of what you say, I don’t buy it. People managed to exist in large numbers in miserable and degraded condition before the “knowledge revolution” (invented term) as much as they have since, they just existed in smaller numbers because of lack of the knowledge needed to sustain greater numbers.

To be sure, our ability to obliterate ourselves either in a bang or a series of whimpers, is greater than it’s ever been, but so is our ability to sustain ourselves. Everything to play for in the second half, as they say in football commentaries.
It's true that the greatest producers of misery for humans is other humans. "Hell is other people". However, the modern habit of producing and blindly following theoretical propositions blind to their full consequences has vastly increased the potential for humans to do damage and create mayhem. Consider the human cost in applied death due to various ideologies of the C20th alone. Don't fit the theory of what a human or national subject should be? Death for you!

We're currently witnessing the largest theory-driven damage we humans have managed so far - existential risks of many kinds abound. If you think there's going to be some fine "second-half" when all the technologists and business orcs come to their senses and invent wonderful new tech and economics to solve all the problems made by not-so-wonderful tech and economics well ...... dream on, as the waters rise, the food disappears and the various mobs, official and unofficial go raging about. With luck we'll die quickly in a forest fire or under a nuclear bomb.
“Practical men who believe themselves to be quite exempt from any intellectual influence are usually the slaves of some defunct economist”.
John Maynard Keynes
User avatar
Cugel
Posts: 7130
Joined: 13 Nov 2017, 11:14am

Re: Do you trust AI?

Post by Cugel »

reohn2 wrote: 26 Aug 2025, 9:34pm
Jdsk wrote: 26 Aug 2025, 8:54am
reohn2 wrote: 26 Aug 2025, 8:46am With the growth of AI how will we know the difference between truth and fake/mistake?
It's hard enough now,with AI in full swing confusion will reign which will play into the hands of the unscrupulous.
The same way that was should judge the reliability of other information: provenance, trustworthiness, transparency, identification and minimisation of bias, avoidance of fallacy...

Fortunately we have the benefit of several centuries of learning how to do this.

Jonathan
And yet we wind up with people like Trump,Putin,BoJo,Farage and many others Iike them in positions of power they should never have been in.
If the ordinary wo/man on the street can be fooled by such morons,shysters and snakeoil salespersons,how much more confused will the electorate be when these people get their hands on AI?
J once more references the mythical "we" who go about rationally and logically winnowing the good from all the bad. Two problems:

This "we" is a rather small portion of "all we humans", generally ignored by the more emotive among us, especially the sociopathic loons who seem to grasp the reins of power then drive their carriage over a cliff, with all we prols packed tightly inside.

And even that small "we" of rational judges seems deluded about the utility of their processes for judging information, often turning out to be the same folk emitting some of the daftest and most dangerous notions.

One such notion is that "we" can somehow control the evolution of AIs entirely to "our" benefit. Oh dear!
“Practical men who believe themselves to be quite exempt from any intellectual influence are usually the slaves of some defunct economist”.
John Maynard Keynes
Nearholmer
Posts: 7593
Joined: 26 Mar 2022, 7:13am

Re: Do you trust AI?

Post by Nearholmer »

Abandon hope all ye who enter Ceredigion.

(or wherever Cugel Towers actually is)
mattheus
Posts: 6892
Joined: 29 Dec 2008, 12:57pm
Location: Western Europe

Re: Do you trust AI?

Post by mattheus »

"we" may be forgetting that knowledge is not the same as wisdom. Some words I stole from elsewhere:

Knowledge is merely having clarity of facts and truths, while wisdom is the practical ability to make consistently good decisions in life.

Knowledge is knowing that a tomato is a fruit; wisdom is not putting it in a fruit salad” Miles Kington(1941-2008).
User avatar
Cugel
Posts: 7130
Joined: 13 Nov 2017, 11:14am

Re: Do you trust AI?

Post by Cugel »

Nearholmer wrote: 27 Aug 2025, 9:42am Abandon hope all ye who enter Ceredigion.

(or wherever Cugel Towers actually is)
'Tis in that blessed county, large but sparsely populated, mostly with folk still connected by a thread to reality rather than the various dreamscapes of this tech-utopia or that.

So, I feel quite hopeful that Ceredigion will remain a haven, far from the madding crowds, for a while yet. Perhaps I should join Plaid Cymru and push for a policy of border walls and zero immigration of the Sais, despite myself being a-one? :-)

But keep on hoping for an AI benevolent dictator if you wish. I hope for one myself but my wish keeps going THUNK!
“Practical men who believe themselves to be quite exempt from any intellectual influence are usually the slaves of some defunct economist”.
John Maynard Keynes
User avatar
Cugel
Posts: 7130
Joined: 13 Nov 2017, 11:14am

Re: Do you trust AI?

Post by Cugel »

mattheus wrote: 27 Aug 2025, 9:43am "we" may be forgetting that knowledge is not the same as wisdom. Some words I stole from elsewhere:

Knowledge is merely having clarity of facts and truths, while wisdom is the practical ability to make consistently good decisions in life.

Knowledge is knowing that a tomato is a fruit; wisdom is not putting it in a fruit salad” Miles Kington(1941-2008).
Many of us now must make do with a dog's breakfast.

Sweet fruit salads are still available but one must forage about to find the ingredients as the shop-bought ones are full of micro-plastics and strange chemicals. Also, they don't seem to taste of anything other than mild-turnip.

The blackberries have been super-prolific this year. Of course, one must pick from higher up as there's a risk that the lower froot will have a redolence of dog micturate! Still, better than microplastics.
“Practical men who believe themselves to be quite exempt from any intellectual influence are usually the slaves of some defunct economist”.
John Maynard Keynes
djnotts
Posts: 4077
Joined: 26 May 2008, 12:51pm
Location: Nottingham

Re: Do you trust AI?

Post by djnotts »

Extract from BBC Indepth piece on tech moguls all building massive bunkers to save themselves from the AI and AGI they are unleashing on the rest of us!

This bit is such absolute nonsense only reaction is hollow laugh followed by screaming:

"Those in favour of AGI and ASI are almost evangelical about its benefits. It will find new cures for deadly diseases, solve climate change and invent an inexhaustible supply of clean energy, they argue.

Elon Musk has even claimed that super-intelligent AI could usher in an era of "universal high income".

He recently endorsed the idea that AI will become so cheap and widespread that virtually anyone will want their "own personal R2-D2 and C-3PO" (referencing the droids from Star Wars).

"Everyone will have the best medical care, food, home transport and everything else. Sustainable abundance," he enthused."

Sick joke.
pwa
Posts: 18552
Joined: 2 Oct 2011, 8:55pm

Re: Do you trust AI?

Post by pwa »

I have seen a few instances lately where people have posted screenshots of the results of an online search they have done, which has thrown up an AI generated answer that is general and inaccurate. And they have presented this drivel as evidence that they trust. In one instance I knew the information to be plain wrong. It seems that some people are now accepting AI information as fact. Maybe one day that trust will be justified, but not yet.
sjs
Posts: 1498
Joined: 24 Jan 2010, 10:08pm
Location: Hitchin

Re: Do you trust AI?

Post by sjs »

pwa wrote: 11 Oct 2025, 11:44am I have seen a few instances lately where people have posted screenshots of the results of an online search they have done, which has thrown up an AI generated answer that is general and inaccurate. And they have presented this drivel as evidence that they trust. In one instance I knew the information to be plain wrong. It seems that some people are now accepting AI information as fact. Maybe one day that trust will be justified, but not yet.
As an example:
Attachments
Screenshot from 2025-10-11 12-33-35.png
cycle tramp
Posts: 5539
Joined: 5 Aug 2009, 7:22pm

Re: Do you trust AI?

Post by cycle tramp »

djnotts wrote: 10 Oct 2025, 3:51pm
Elon Musk has even claimed that super-intelligent AI could usher in an era of "universal high income".

"Everyone will have the best medical care, food, home transport and everything else. Sustainable abundance," he enthused."
Ai should only be trusted within certain parameters and any results should be double checked..
..that said, I'm not convinced that I trust those who are designing Ai either. The above is point in case, Musk clearly fails to understand economics: if everyone has a 'universal high income' then all you would do is increase inflation, to the point that universal high incomes were just normalised.
'Everybody is a genius - but if you judge a fish on its ability to climb a tree it will live its whole life believing it is stupid' Albert Einstein
axel_knutt
Posts: 4281
Joined: 11 Jan 2007, 12:20pm

Re: Do you trust AI?

Post by axel_knutt »

Jdsk wrote: 26 Aug 2025, 8:54am
reohn2 wrote: 26 Aug 2025, 8:46am With the growth of AI how will we know the difference between truth and fake/mistake?
It's hard enough now, with AI in full swing confusion will reign which will play into the hands of the unscrupulous.
The same way that was should judge the reliability of other information: provenance, trustworthiness, transparency, identification and minimisation of bias, avoidance of fallacy...

Fortunately we have the benefit of several centuries of learning how to do this.

Jonathan
There aren't enough years in a lifetime to do that with everything. Do people review all the research that went into developing the drug their GP has just sent them home with? Do people check the nutrition data on every packet of food they pick up? No, they delegate the job to others, and take the information at face value.

Prof. Daniel Kahneman deals with this in Thinking Fast & Slow. The brain has two modes of operation: one automatic and reflexive, that uses heuristics to come to a quick conclusion, and another slower more analytical and deliberative mode. The vast majority of the brain's work is the former not the latter, because it's fast, efficient, and produces the right answers most of the time, and because there isn't time to think slowly and analytically for everything all the time. It is, however, easy to learn how it works and how to fool it, and that's what magicians, propagandists, and various other manipulators do. To see what Dr Goebbels would have done if he'd had the internet and social media at his disposal, just look at what Putin's doing right now. AI will just turbocharge the process.

Did you remember to check that the last phone call you received from a voice you recognise was the person they purported to be, and not an AI fake? Or did you just take it for granted that all your calls will continue to be genuine, as they always have been in the past?

It seems to me that the sector of the economy that always gets the biggest productivity gains from technology is crime. Nowadays that efficient banking app on your phone is so convenient it enables the phone-snatching E-bike riders to empty your bank account before selling your phone on. Fraud currently accounts for 42% of crime, but only 1% of police resources.
“I'm not upset that you lied to me, I'm upset that from now on I can't believe you.”
― Friedrich Nietzsche
PDQ Mobile
Posts: 5322
Joined: 2 Aug 2015, 4:40pm

Re: Do you trust AI?

Post by PDQ Mobile »

^^^
Axel knutt
yes
This is spot on.
Post Reply