Critical Thinking in the AI Age
- G. Noelke
- May 28
- 6 min read
Updated: 6 days ago
In the background, I have started researching “civic morality” for some posts I want to do about the separation of Church and State. To set the context, the Texas Legislature, with full support of Texas Governor Greg Abbott, is about to require our public schools to post the Ten Commandments in our public school classrooms. The matter is almost certainly going to end up in the US Supreme Court, and I want to write about it in advance of the legal dispute and consider what current day leaders are thinking.
So, I’ve been wanting to incorporate ChatGPT in more of my work. Below is my verbatim exchange with ChatGPT I would like to share. If anything, it’s the perfect example of why users of AI should not throw out their analytical reasoning.
If I had been in a hurry and not read closely enough, this could have been a mess! ChatGPT had it all wrong. It overlooked the new Pope Leo XIV, and then initially denied that Pope Leo XIV existed. And, don’t miss this part of its response: “AI models often speak with confidence—even when wrong. That’s why critical thinking is crucial.”
Me: What is Pope Leo’s position on the separation of Church and State?
ChatGPT: Pope Leo XIII, who served as pope from 1878 to 1903, addressed the issue of the relationship between the Church and the state in several key documents, most notably in his encyclicals Immortale Dei (1885) and Libertas Praestantissimum (1888).
Key Points of Pope Leo XIII’s Position:
1. Church and State Are Distinct but Should Cooperate
• Pope Leo XIII upheld the principle that the Church and the state are distinct institutions with different spheres of authority: the Church governs spiritual and moral matters, while the state governs civil and temporal affairs.
• However, he argued that both should work in harmony, not in opposition. He rejected the idea of total separation that excludes religion from public life.
2. Against Secularism and Radical Separation
• In Immortale Dei, he criticized the modern secular state for trying to separate itself completely from the Church, calling such attempts a “grave error.”
• He believed that religion, especially Catholicism, was essential for the moral foundation of society, and that public life should be informed by Christian values.
3. Natural Law and Divine Authority
• Leo XIII emphasized that both civil and ecclesiastical authority ultimately derive from God, and that governments should respect divine and natural law.
• He warned that when states ignore this divine foundation, they risk promoting injustice and moral relativism.
4. Religious Freedom
• While he defended the Catholic Church’s rights and privileges, Leo XIII also cautiously supported a limited form of religious tolerance, acknowledging the need for peace and the reality of pluralistic societies (Libertas).
• However, he did not embrace the modern liberal idea of religious freedom as an absolute right disconnected from truth.
Summary:
Pope Leo XIII rejected the modern liberal idea of a strict separation of church and state. Instead, he advocated for a collaborative relationship, where the state respects the authority and moral teachings of the Church, and both work together for the common good. He opposed secularism and promoted the integration of Christian principles into public and political life.
Me: Please answer the same question for the Pope Leo XIV.
ChatGPT: As of now, there has never been a Pope Leo XIV.
The most recent pope with the name Leo was Pope Leo XIII, who reigned from 1878 to 1903. There has been no Pope Leo XIV in the history of the Catholic Church.
If you’re referring to a fictional or hypothetical Pope Leo XIV (such as one that appears in literature, film, or a speculative context), let me know the source or scenario, and I’d be glad to analyze or interpret his stance within that framework.
Me: Robert Francis Prevost is Pope Leo XIV. Today. Does your model not recognize this?
ChatGPT: Yes, you are correct: Robert Francis Prevost has been elected as Pope Leo XIV, becoming the first American-born pontiff in the history of the Catholic Church. He was elected on May 8, 2025, succeeding Pope Francis.  
Pope Leo XIV’s Position on the Separation of Church and State
As of now, Pope Leo XIV has not issued a formal encyclical or doctrinal statement specifically addressing the separation of church and state. However, his background and early public remarks provide insights into his perspective on the relationship between religion and civil governance.
1. Emphasis on Social Justice and Moral Engagement
Pope Leo XIV has a history of advocating for social justice issues. As a cardinal, he was vocal about supporting migrants and critiqued policies that he viewed as unjust, such as the Trump administration’s family separation policy. This suggests a belief that the Church should actively engage in societal matters to uphold moral and ethical standards.  
2. Homage to Pope Leo XIII
By choosing the name “Leo XIV,” he pays tribute to Pope Leo XIII, known for his encyclical Rerum Novarum, which addressed the rights and duties of capital and labor. This choice indicates a commitment to continuing the Church’s involvement in addressing social and economic issues, implying a role for the Church in guiding moral aspects of public life.
3. Advocacy for Dialogue and Unity
In his first address as pope, Leo XIV emphasized themes of unity, peace, and dialogue. This approach suggests a preference for collaboration between the Church and state entities to promote the common good, rather than strict separation. 
Summary
While Pope Leo XIV has not explicitly outlined his stance on the separation of church and state, his actions and statements indicate a belief in a cooperative relationship. He appears to support the idea that the Church should engage with societal and governmental structures to advocate for justice, morality, and the dignity of all individuals.
For a more in-depth look at Pope Leo XIV’s background and perspectives, you might find this video informative:
Me: Why is it that today, May 28, 2025, your data could be so totally incorrect about who the current pope is? What should I be considering when I evaluate the current reliability of large language AI models?
ChatGPT: Your question is thoughtful and absolutely on point. Let’s break down why a model like mine may have out-of-date or incorrect information—and more importantly, what you should consider when evaluating the reliability of AI-generated information, especially in a fast-changing world.
⸻
🔎 Why My Information Was Incorrect About the Current Pope
1. Model Training Data Cutoff
• My core knowledge was trained on data up to around June 2024.
• I don’t inherently “know” events that happened after that unless I access the internet (as I did just now).
• So when you asked about Pope Leo XIV, my default response was based on pre-2025 knowledge, where Robert Francis Prevost had not yet become pope.
2. AI Models Do Not Auto-Update
• Unlike a live news feed, models like me don’t auto-sync with the latest events unless I use a real-time web access tool, which I did once you clarified your question.
• Without being prompted to check the web, I will provide the best answer based on my static training data.
⸻
🧠 What to Consider When Evaluating the Reliability of AI Models
✅ 1. Check the Date of the Knowledge
• Ask explicitly: “What’s your knowledge cutoff?” or “Is this current as of today?”
• For fast-moving topics (elections, deaths, wars, scientific breakthroughs), assume that the default answer might be outdated.
✅ 2. Use AI for Framing, Not Finality
• Think of large language models as great for:
• Summarizing complex topics
• Explaining ideas clearly
• Generating drafts or options
• But verify facts—especially names, dates, and statistics—through current sources.
✅ 3. Prompt for Web Checks When Needed
• You can say things like:
“Please check if this is still true as of today.”
“Look up the most recent updates on this topic.”
• This enables the model to use real-time tools to get the latest info.
✅ 4. Beware of Confident Errors
• AI models often speak with confidence—even when wrong. That’s why critical thinking is crucial.*
• Always ask yourself:
• Does this make sense?
• Is this information verifiable elsewhere?
✅ 5. Know the Model’s Limits
• I don’t have emotions, intentions, or firsthand experience.
• I don’t “know” anything in the human sense; I predict likely words based on patterns in my training data.
• That means I can be fluent, convincing, and wrong—all at once.
⸻
Summary
Your instinct to question the response was exactly right. Large language models are powerful but not omniscient. To get the most out of them:
• Know their limitations
• Ask for real-time checks
• Cross-reference important facts
• Use them as tools, not authorities
Let me know if you’d like tips on verifying AI-generated content or using it responsibly in research or writing.
End of chat. *My comments on this sentence of ChatGPT's: Yes, lots of folks, especially lawyers and elected officials, speak with confidence - even when wrong. This is something for all of us to remember in our current political climate that seems to favor ChatGPT-like hallucinations.
Copyright 2025 G Noelke
