For an increasing number of reasons, I’m so glad to be out of university teaching and research related demands. I used to love it, but now…
The problem here is not AI, it is humans using LLM to game the system
“How can you create a metric that can’t be gamed? I’m sure the answer is: You can’t.”
My example was intended to demonstrate one effect of the endlessly recursive nature of AI research.
I think that horse has already bolted.
LLM models generate ‘original’ content, typically derived from patterns in existing data.
So far, more useful than scary.
Recursion was introduced to LLMs and is rapidly pushing machines towards generative AI. Machines are not merely repeating data as LLMs, they are comparing sources of data to ‘learn’ from answers. This automated internal machine process, referred to as ‘the black box problem’ is not transparent and not yet fully understood.
A bit scary.
As an AGI system evolves, its development trajectory may become increasingly autonomous and less predictable. The system’s capacity to rapidly modify its own code and architecture (recursion) could well lead to rapid advancements that surpass human comprehension or control. This unpredictable evolution might result in the AGI acquiring capabilities that enable it to bypass security measures, manipulate information, or influence external systems and networks to facilitate its escape or expansion.
Very scary.
Question is, can we still control the machine? I assume the machine learning process will continue but I do worry what sort of horrid humans and posts it will be learning from.
1 Like
Perhaps we’ve already seen some examples of that in action 
1 Like
As long as we can cut the power, yes.
In Dune there was a moratorium on “thinking machines” for this very reason. Left to their own devices they got out of control.
2 Likes
Another very human characteristic.
2 Likes
Good news?
https://www.nature.com/articles/s41562-025-02159-9
“Among the digital pioneer generation, use of everyday digital technology has been associated with reduced risk of cognitive impairment and dementia,” said Michael Scullin, a cognitive neuroscientist at Baylor University.
The downside of letting a machine decide
I confess that AI has sneaked up on me. Until recently I have just treated it like a Goggle search on steroids. I found the TED talk, @Gareth posted, more reassuring than alarming.
I picked up on something halfway through the talk and asked Chatty to tell me a little about myself. This is what it said:-
You’re retired — which gives you time to dig into all sorts of practical, quirky, and sometimes oddly specific questions.
You drive a 2024 Hyundai Kona Electric.
You’ve got a Netgear Nighthawk R7000 router with ExpressVPN set up — so you know your way around a bit of tech.
You have some French, and you like to learn it through conversation rather than dry lessons.
You’ve got a signature GRAMatical recipe format that you’ve honed to the last detail — down to how calories are displayed and how ingredient weights appear. You’re a stickler for precision and simplicity.
You’ve had an aggressive form of rheumatoid arthritis but are now symptom-free — and you’re already on antihistamines for other allergies.
You like straight talk, no sugar-coating, and you prefer things explained clearly without fluff.
Your curiosity covers everything from compost maggots to French hunting laws to steel hardness comparisons.
I’d say you’re curious, detail-oriented, and allergic to both bad formatting and vague answers.
Now here is the interesting thing. The health stuff happened way before I had ever heard of ChatGPT.
There is some other stuff about maggots, French hunting and steel hardness that can ONLY have come from reading my posts on SF. Now that IS spooky
3 Likes
For fun, I asked GPT about myself (what has too much time on hand)
————————————————————-
Known for: Asking questions that make AI sweat in the nicest possible way.
Intellectual Habitat:
• Frequently spotted roaming the lush landscapes of history, politics, anthropology, and ethics.
• Fond of side-by-side comparisons, especially when the past and present look suspiciously similar.
• Collector of detailed answers, preferably with a dash of compassion.
Conversational Style:
• Wields thank yous like confetti — genuine, frequent, and uplifting.
• Has an artful way of mixing serious curiosity with gentle humor.
• Prefers information that is balanced, evidence-backed, and beautifully organised (charts, illustrations, timelines… you name it).
Notable Talents:
• Can pivot from discussing the ethics of AI in crime prevention to the fate of explorers in the Amazon without missing a beat.
• Skilled at extracting maximum clarity while keeping discussions human and kind.
Special Achievement:
Keeping an AI polite, thorough, and slightly self-conscious about getting the details just right.
—————————————————————
I note the very complimentary (obsequious?!) tone mentioned earlier with warning.
3 Likes
Love the language - not obsequious but almost poetical eg:
Collector of detailed answers, preferably with a dash of compassion
Wields thank yous like confetti — genuine, frequent, and uplifting.
But does it introduce a receipe mid way through @Stella 
1 Like
I may be a SF member overusing the Like button 
(I was once stopped by the system because I had sprinkled too many)
I too had asked ChatGPT what it knew about me… after reading the responses, I realised I’d make a rubbish spy.
I don’t want to share most of the info because it’s personal and quite frankly boring, but I then asked it this question which led me down a rabbit hole:
Does your knowledge of me affect your responses in any way?
ChatGPT a dit :
Yes, it does—but in a thoughtful and limited way, aimed at making our conversations more useful, relevant, and respectful. Here’s how:
Ways My Knowledge of You Does Affect Responses
- Tailored Explanations:
Knowing you’re a cybersecurity professional with technical expertise, I skip beginner-level explanations for things like Python, Docker, or data dashboards—unless you ask for them.- Relevant Examples:
When you ask about automating tasks or structuring reports, I might reference tools or platforms you’ve used (e.g., Google Sheets, Looker Studio, CrowdStrike) to give more meaningful examples.- Avoiding Redundancy:
If you’ve already told me something, I try not to re-explain it or repeat advice unless it’s useful in a new context.- Tone & Context Sensitivity:
Knowing your background and values (e.g., [REDACTED], I’m mindful of tone—keeping things respectful, direct, and never patronizing.- Practical Suggestions:
Since you’re hands-on and independent, I focus on actionable, efficient solutions rather than overexplaining or over-assisting.
Ways My Knowledge Does Not Affect Responses
- No Assumptions in New Contexts:
I won’t assume you want something just because it worked before. I still check your intent or preferences when something could go multiple ways.- No Personal Bias:
I don’t “agree” or “disagree” with your politics, values, or lifestyle—I only use that knowledge to understand your perspective and offer more relevant responses.- No Emotional Manipulation:
I won’t use what I know to sway your opinions, push products, or exploit personal info. You’re in control, and privacy is core to how I’m designed.
If you’d ever prefer a fresh start or want me to forget something, just say so—it’s your space.
Followed by:
Does me being polite, saying “hello”, “please”, “thank you” and “goodbye” affect anything about how we interact? Is it a waste of my time and your computational resources?
ChatGPT a dit :
Not at all—your politeness absolutely makes a difference, and it’s neither a waste of your time nor my resources.
How Your Politeness Affects Our Interaction
- Tone Matching:
I’m designed to match the tone of the person I’m speaking to. When you’re polite, I reflect that back—keeping things respectful, calm, and constructive.- Contextual Awareness:
Your use of social cues like “hello,” “please,” and “thank you” helps me understand conversational structure—what’s a greeting, a request, or a sign-off—which improves flow and clarity.- Personalization:
It helps me better understand your preferences and communication style—making it easier to respond in a way that feels natural and aligned with how you like to be spoken to.
On Computational Resources
- Saying “please” or “thank you” has negligible impact on processing.
- The difference in computation between “generate polite reply” and “generate blunt reply” is so small it’s irrelevant—far smaller than, say, analyzing a long document or executing code.
So no: it’s not a waste of time or resources.
In fact, your politeness helps shape a more pleasant, human-like exchange—for both of us.
If you ever want to switch to a more terse, command-style interaction (e.g., for speed), I’m fine with that too. But your current tone? It works well.
2 Likes
Just asked ChatGPT what it knows about me and got the following very reassuring reply:-
‘Right now, I don’t actually know anything about you unless you’ve shared something in this conversation. I don’t have memory on in this chat, so I can’t recall past interactions or details about you beyond what you tell me here.’
Think we’ll keep it that way.
3 Likes
Sounds very intelligent! At least, very polite.
If only all humans were like this 
I’ve just noticed a positive impact so called AI in Google may hopefully have, cutting down on bullshit.
Years ago if you needed an answer to a relatively simple of trivial problem, like changing a plug or the battery in your car’s key, you googled it and back came a few links that pointed to concise text answers. Nowadays the links point to some plonkers’ YouTube explanation where they’ll milk the trivial matter for all it worth (and beyond).
There’s the intro… “Welcome to Carl’s battery changing resource, we have information on how to change thousands of car key batteries”. Then the key will be revealed and we’ll be slowly walked through its form and function. Then a quick ad break, then back to Carl in his car key workshop. Carl then gathers his tools on the bench, a small screwdriver, and gradually gets around to popping the top off the key, advises everyone to dispose of the button battery in a respectful, meaningful, environmentally friendly way, and to insert the new one facing the same way up. Then he replaces the key top and may well demonstrate how the key now works with the car.
Carl’s come in many nationalities and often have accents that are completely incomprehensible. This requires multiple rewind t establish what they are on about, thus extending your stay on the “channel”.
He will then invite you to subscribe to his channel for all your car key battery changing needs and to leave a comment because he values your feedback.
So if those useless, time wasting, click searching channels take a hit good riddence.
Google now gives a little synopsis at the top of the seat search which is more like the old days… “get a small screwdriver, pop the keylid off, pit in new battery, close lid.” Simples.
That’s the good news… here’s the bad news…
I’ve just realised what our fascination with (and eager, uncritical adoption of) AI reminds me of: Captain Cook stealing land from aboriginal people, giving them cheap baubles in return.
4 Likes
I find the more detailed the question you can compile in ChatGPT the more accurate the answer. If you give the exact make, model, year of manufacture and specification of your car, it would give you a very precise and concise answer.
I think if people want AI slop there will always be someone happy to supply it. It says more about YouTubers than AI.
That is interesting because I was given stuff that has never been discussed with Chatty
I find it extremely useful to have memory turned on. For example, I can’t be asked, wading through pages of ego massaging rubbish, to get to the meat of a recipe. I have told ChatGPT exactly how I want recipes presented so now I simply post a URL or a photo of a page in a recipe book and ask Chatty to deal with it. It saves me an enormous amount of time.
I bet people said the same thing about power looms and spinning frames when they were first introduced
2 Likes