This is really interesting. Impressive how you got it to decide that Sam Smith is female. I don't know much about how logical reasoning works within chatGPT, but this article seems to suggest that it understands logic pretty well:
But even if ChatGPT understands logic, I'm not sure it's bound by logical rules in any strict sense. So perhaps it is possible to get chatGPT to output a contradiction on any topic? Perhaps eventually AI could be used to 'prove' a contradiction in a theory like gender ideology (as long as some theorem from metalogic/computability theory doesn't rule this out), but I'm not sure we're there yet, unfortunately.
Thanks Peyton, it's always nice to get feedback. Yes, I'm not under the impression that I've actually taught it anything - as you suggest, I'm sure it's more than able to generate contradictions on any subject.
It's a definite essay-killer though, due to the amount of information it's absorbed and its ability to regurgitate it assertively in a flowing style but without direct plagiarism. To test the breadth and depth of its capabilities, I asked it some quite specific questions about a very niche topic I'm an expert in (one that I've written about online and been invited to speak at conferences about), and the answers were basically good enough to make me obsolete. It's like a more personable Wikipedia.
I tried to get Bing to give a more accurate answer to your first question, and it ended up telling me that at most 15% of all romantic relationships are between people with different genitalia, and that only 12% of those are fertile because of stats about chicken eggs. It then accused me of homophobia when I said that wasn't true. A pretty fun waste of time.
This is really interesting. Impressive how you got it to decide that Sam Smith is female. I don't know much about how logical reasoning works within chatGPT, but this article seems to suggest that it understands logic pretty well:
https://medium.com/@evlabs/chatgpt-imitates-logical-reasoning-surprisingly-well-f88b1ac8d6f7
But even if ChatGPT understands logic, I'm not sure it's bound by logical rules in any strict sense. So perhaps it is possible to get chatGPT to output a contradiction on any topic? Perhaps eventually AI could be used to 'prove' a contradiction in a theory like gender ideology (as long as some theorem from metalogic/computability theory doesn't rule this out), but I'm not sure we're there yet, unfortunately.
Regardless this is a cool exposition.
Thanks Peyton, it's always nice to get feedback. Yes, I'm not under the impression that I've actually taught it anything - as you suggest, I'm sure it's more than able to generate contradictions on any subject.
It's a definite essay-killer though, due to the amount of information it's absorbed and its ability to regurgitate it assertively in a flowing style but without direct plagiarism. To test the breadth and depth of its capabilities, I asked it some quite specific questions about a very niche topic I'm an expert in (one that I've written about online and been invited to speak at conferences about), and the answers were basically good enough to make me obsolete. It's like a more personable Wikipedia.
I tried to get Bing to give a more accurate answer to your first question, and it ended up telling me that at most 15% of all romantic relationships are between people with different genitalia, and that only 12% of those are fertile because of stats about chicken eggs. It then accused me of homophobia when I said that wasn't true. A pretty fun waste of time.
I didn't even know there was a Bing AI...
Yeah, it's a version of GPT-4 that can access the internet and you can talk to it in Skype for some reason.