|
Post by monklady123 on Oct 16, 2024 13:03:01 GMT
A spin-off of that thread about the kid who tried to pass of an AI paper as his own... How do teachers know when a good student is using AI? I mean, if a student who doesn't usually turn in well-written papers suddenly offers one that's much better than normal the teacher would know that *someone* wrote it for him. But in the case of that other thread, the boy was eligible for the National Honor Society so clearly he was a good student. So if he turns in a well-written AI paper how does the teacher find out? This might be a dumb question because full disclosure, I have no idea what an AI-written paper is like. Maybe it's "stilted"? or with odd vocabulary? But wouldn't a good student think to change those things? I have no idea since the kids I'm teaching are mostly in 2nd, 3rd, and 4th grades and none of them have thought of trying to use AI to write their essays about "Daily Life on the Space Station" or "My Favorite Forest Animal" (to name two recent assignments). lol. As I've said before in various technology threads, I'm so glad my kids are grown now. My son would probably be the one in high school (which he hated every minute of) trying to use AI to get around something. And my daughter would have been horrified to ever even consider using it. lol.
|
|
|
Post by Merge on Oct 16, 2024 13:07:09 GMT
Oddly, there are AI-driven tools that teachers can use to determine whether the paper was written by AI.
But often a teacher can just tell. AI writing is often described as stilted. The paper may use vocabulary the student is unlikely to know, or turns of phrase that aren't typical for the age group.
Our state-appointed superintendent is having the curriculum department create many district learning materials using AI-generated passages and poems, and it's very obvious and awful.
|
|
pantsonfire
Drama Llama
Take a step back, evaluate what is important, and enjoy your life with those who you love.
Posts: 6,269
Jun 19, 2022 16:48:04 GMT
|
Post by pantsonfire on Oct 16, 2024 13:12:39 GMT
Probably like dh and I knew when a student blatantly plagiarised a paper.
Dh had 5 classes of about 30 students each and one project was to do a report on a mathematician. I would help him go through the papers before he graded them to check for plagiarism and what not.
Sure enough while reading I was like that is not their writing and would input the paragraph and sentences into my PC and 99% of the time it was straight stolen from another paper or article or book.
We ten marked it 0.
|
|
SweetieBsMom
Pearl Clutcher
Posts: 4,785
Jun 25, 2014 19:55:12 GMT
|
Post by SweetieBsMom on Oct 16, 2024 13:13:37 GMT
Good question! I don't know that I'd know but I'm not a teacher.
When I heard about the story with the parents suing the district they were also talking about another story that a teach had given a writing assignment and flat out told the kids not to use AI. She had gone and used AI and then could compare to the student's work and something like 75% of them had at least used a portion of AI (and word for word, I mean, come on, change the language at least). And she gave every kid that used AI a zero on the assignment because they were explicitly told not to do it.
|
|
|
Post by Bridget in MD on Oct 16, 2024 14:37:28 GMT
When it is a picture, typically the hands are not right (ie 6 fingers).
|
|
|
Post by monklady123 on Oct 16, 2024 15:23:59 GMT
When it is a picture, typically the hands are not right (ie 6 fingers). Yeah, very often the photos are obvious. But for writing I wasn't sure. But I have no experience using AI for anything, and haven't read something written by AI that a kid is trying to pass off as their own. I'd love to compare something written by a real high school student with one written (on the same subject) by Ai just to see if I could pick out which is which.
|
|
|
Post by katlady on Oct 16, 2024 15:24:34 GMT
When it is a picture, typically the hands are not right (ie 6 fingers). Or other body parts are either incorrect or missing. And lot of those photos with big googly eyes on small “cute” kids are AI generated. For plagerism on essays, there are tools that scan a paper and will tell you what percentage of the paper has phrasing that is in their database. I would think the AI tools would work the same way too.
|
|
huskergal
Pearl Clutcher
Posts: 3,439
Jun 25, 2014 20:22:13 GMT
|
Post by huskergal on Oct 16, 2024 16:06:44 GMT
If you have read a student's previous work, you can tell what they did or did not write.
If you are not familiar with a student's writing style, AI has no style. It has no voice. It also does not have grammatical errors of any kind. It is very rare to have a student that does not make at least one mistake when writing.
Student AI example: In the waters deep and wide, Where colorful fish love to hide, Darting through the ocean's blue, Shimmering scales, a breathtaking view.
Swaying gently with the ocean's flow, In a world where corals brightly glow, Such graceful creatures, a sight to see, In their liquid world, wild and free.
Silver tails and fins that gleam, In the sunlight's golden beam, A dance of beauty beneath the sea, Where fish swim wild, wild and free.
I knew immediately it wasn't the author's work. Also, I have an add on for Google Docs that tells how long a student worked on the document. It shows copy and paste. It records exactly what they did. I can literally watch them copy and paste the text. This student denied at first and then admitted it.
|
|
|
Post by smasonnc on Oct 16, 2024 16:10:28 GMT
The use of the word "enchanting." Every time I try to write something in AI, it uses that word along with lots of cliches.
|
|
|
Post by MissBianca on Oct 16, 2024 16:27:15 GMT
A teacher ran a poem DD wrote in sophomore year through a generator to see if she used AI to write it. They couldn’t find anything but still accused DD of cheating somehow. DD brought her book of poems in to show that her work was similar and she’s like yeah, it’s mine but thanks for running it through AI so now it’s stored somewhere in the internet abyss for someone else to lift in the future. She was soooo pissed! The school was practically falling all over themselves apologizing and wanted her to submit that and more work for a contest they have for poetry. She was like no thanks, my work is for me. So after that she wrote the bare minimum just to get a passing grade and kept her really good work at home. It’s a shame because she is a really good poet but didn’t want to share the good stuff.
|
|
huskergal
Pearl Clutcher
Posts: 3,439
Jun 25, 2014 20:22:13 GMT
|
Post by huskergal on Oct 16, 2024 16:30:08 GMT
Another example of AI driven text: Paul Kaa was born into a world of shadows and scars, destined to navigate the fire-scorched remnants of a childhood that had crumbled before his very eyes. Growing up in an uncertain home, Paul learned early on how to mask his emotions behind a façade of indifference. His father, once filled with promise as a local artist, spiraled into despair after losing his wife in an accident, an event Paul could never fully understand but would feel its repercussions for years. The late-night arguments morphed into violent outbursts that filled their small apartment with anguish; only the flickering glow from streetlights penetrated the oppressive darkness. In this battleground between love and bitterness, Paul became both victim and observer, quietly absorbing lessons about human manipulation while shedding layers of innocence. The nightmare culminated one fateful evening when flames consumed their dilapidated shelter—a devastating act engineered by Tristen: a neighbor cloaked in charm yet soaked in malevolence. Underneath Tristen's easy smile lurked intelligence so keen it cut like glass; he played puppeteer with everyone around him until those strings snapped tautly against Paul's fragile psyche. In moments leading up to the inferno, Tristen wove tales laced with deceit that provoked confusion within young Paul—fueling rifts between him and even those who cared deeply for him. Abandoned by caregivers who succumbed to despair or were manipulated against one another amidst chaos ensured he grew more isolated than ever before tragedy struck full force.
|
|
huskergal
Pearl Clutcher
Posts: 3,439
Jun 25, 2014 20:22:13 GMT
|
Post by huskergal on Oct 16, 2024 16:49:57 GMT
A teacher ran a poem DD wrote in sophomore year through a generator to see if she used AI to write it. They couldn’t find anything but still accused DD of cheating somehow. DD brought her book of poems in to show that her work was similar and she’s like yeah, it’s mine but thanks for running it through AI so now it’s stored somewhere in the internet abyss for someone else to lift in the future. She was soooo pissed! The school was practically falling all over themselves apologizing and wanted her to submit that and more work for a contest they have for poetry. She was like no thanks, my work is for me. So after that she wrote the bare minimum just to get a passing grade and kept her really good work at home. It’s a shame because she is a really good poet but didn’t want to share the good stuff. I ask the students first to see what they say. If she said it was hers and brought in samples of her work, I would believe her. I let them decide if they want to confess before I check to see if it is AI.
|
|
Just T
Drama Llama
Posts: 5,884
Jun 26, 2014 1:20:09 GMT
|
Post by Just T on Oct 16, 2024 16:53:21 GMT
I have a coworker who sometimes uses AI in our social media post. Usually, as soon as I start reading, I can tell. It often sounds unnatural, forced even. I've told her, if you are having a hard time coming up with words, tell me and I will. I love to write, and I do most of our social media posts. I don't want what we put out to sound so inconsistent, and I think it does, and is obvious, when a post is using AI.
|
|
|
Post by melanell on Oct 16, 2024 16:54:52 GMT
I'm not a teacher, but I do know they have even free AI-detectors on line you can use. Plus, as mentioned above, in our district the kids use Google Docs for most assignments, and some teachers even ask the kids to also time themselves working, too.
But I will say, that when I have come across AI writing in different situations, it always just sounds "off" at best, and really bad at worst. I belong to a book club that uses a Discord server to chat, and we've had chats in the past about AI writing, and we tried to use AI to "write" a few passages based on the topic of conversation at the time, and some of the results are just "meh", but some were comically bad.
I've seen YouTubers use AI then share with viewers. And relatively recently Ebay started allowing sellers to use AI, and theirs is awful! It is also WRONG sometimes, which is a pain as a buyer. So now, if I have the choice between buying from a seller using AI and one who is not, I choose the one who is not.
One time, I knew the AI was wrong. I double checked with the seller, who swore, "Oh no, the listing is correct." Now, I *wanted* it to be wrong. It was for vintage cards and said they were blank inside, and I knew from my own knowledge of how those cards used to be that they absolutely were not blank. And the AI called them blank.
So I bought them, expecting them to have pre-printed messages, which they did, and I was happy. BUT, if I was a dishonest person, I could have absolutely contacted Ebay, informed them that the item I received was not as described, and gotten my money back. So, people putting their complete faith in the AI they use can get burned beyond just poor school grades. And that's a lesson kids need to realize about "the real world" outside of school, as well.
|
|
|
Post by melanell on Oct 16, 2024 16:57:17 GMT
The use of the word "enchanting." Every time I try to write something in AI, it uses that word along with lots of cliches. Similarly, a lot of overly-flowery language is something I have noticed. Just "fluff" making the sentence or paragraph twice as long as necessary.
|
|
huskergal
Pearl Clutcher
Posts: 3,439
Jun 25, 2014 20:22:13 GMT
|
Post by huskergal on Oct 16, 2024 17:06:22 GMT
I hate what AI has done with photography!
|
|
|
Post by monklady123 on Oct 16, 2024 17:14:53 GMT
So just for fun I asked AI to "write a two paragraph essay about dolphins written by a third grader". It gave me the following paragraphs. lol... as someone who has spent a lot of time around 3rd graders I'm quite sure that only maybe a handful would say things like "they are known for..." and use commas... many of them don't even put periods at the end of their sentences, never mind using commas. I do think it would be harder to know AI when the students are higher level though. Although those of you who teach older kids/adults would know their styles, as you've mentioned in this thread. "Dolphins are amazing animals that live in the ocean. They are known for being very smart and friendly. Dolphins can jump high out of the water and do flips! They have smooth bodies and a big fin on their back called a dorsal fin. Dolphins communicate with each other using sounds like clicks and whistles. They often swim in groups called pods, and they love to play with each other. Sometimes, they even ride the waves created by boats! Dolphins eat fish and squid, which they catch using their sharp teeth. They are very social animals and seem to enjoy being around people too. Many people love watching dolphins perform tricks at marine parks. However, it’s important to protect dolphins and their homes in the ocean. We can help keep the ocean clean and safe for dolphins and other sea creatures. Dolphins are special and should be cared for so everyone can enjoy them for a long time!"
|
|
Just T
Drama Llama
Posts: 5,884
Jun 26, 2014 1:20:09 GMT
|
Post by Just T on Oct 16, 2024 17:21:32 GMT
I hate what AI has done with photography! Oh, me tooooo!! All the scenery photos posted in travel groups on FB look so fake and overdone! Why not just let the real photos speak for themselves?
|
|
|
Post by katlady on Oct 16, 2024 17:29:49 GMT
Also, I have an add on for Google Docs that tells how long a student worked on the document. This is interesting to know about Google Docs. Does this also mean that all your students are required to use Google Docs? They can't use Word or something similar? A teacher ran a poem DD wrote in sophomore year through a generator to see if she used AI to write it. They couldn’t find anything but still accused DD of cheating somehow. DD brought her book of poems in to show that her work was similar and she’s like yeah, it’s mine but thanks for running it through AI so now it’s stored somewhere in the internet abyss for someone else to lift in the future. She was soooo pissed! The school was practically falling all over themselves apologizing and wanted her to submit that and more work for a contest they have for poetry. She was like no thanks, my work is for me. So after that she wrote the bare minimum just to get a passing grade and kept her really good work at home. It’s a shame because she is a really good poet but didn’t want to share the good stuff. I feel sad for your daughter! The same thing is happening in the art world, where artist are afraid to show their work because it may get picked up by an AI generator.
|
|
huskergal
Pearl Clutcher
Posts: 3,439
Jun 25, 2014 20:22:13 GMT
|
Post by huskergal on Oct 16, 2024 18:50:24 GMT
Also, I have an add on for Google Docs that tells how long a student worked on the document. This is interesting to know about Google Docs. Does this also mean that all your students are required to use Google Docs? They can't use Word or something similar? A teacher ran a poem DD wrote in sophomore year through a generator to see if she used AI to write it. They couldn’t find anything but still accused DD of cheating somehow. DD brought her book of poems in to show that her work was similar and she’s like yeah, it’s mine but thanks for running it through AI so now it’s stored somewhere in the internet abyss for someone else to lift in the future. She was soooo pissed! The school was practically falling all over themselves apologizing and wanted her to submit that and more work for a contest they have for poetry. She was like no thanks, my work is for me. So after that she wrote the bare minimum just to get a passing grade and kept her really good work at home. It’s a shame because she is a really good poet but didn’t want to share the good stuff. I feel sad for your daughter! The same thing is happening in the art world, where artist are afraid to show their work because it may get picked up by an AI generator. We use Google Classroom so everything they do is Google. They could write it elsewhere and copy and paste it into the Google Doc but that would show up on the Google Doc. I also look at Version History as well.
|
|
|
Post by melanell on Oct 16, 2024 19:55:24 GMT
I checked our student handbook and it specifies that district prohibits students from handing in AI generated work or responses as their own work. It also lists the exact consequences a student should expect should they be caught using AI in that way, with increasing severity for continued offenses.
1st offense: note home to parents, and option to re-do the assignment for HALF credit 2nd offense: note home to parents, a zero grade on assignment, and detention 3rd offense: note home to parents, a zero grade on assignment, a 3 day suspension
If there are continued offenses, the suspensions become 5 day, and the student can possibly lose credit for the entire course.
|
|
|
Post by epeanymous on Oct 16, 2024 20:06:16 GMT
We've been instructed as faculty not to use the AI detectors (or, at least, not to accuse students based on the AI detectors, you can obviously do what you want) because they generate a lot of false positives. We're asked instead to design assignments that either make sensible use of the possibility people will use AI or are constructed in ways where AI won't help or can't be accessed.
|
|
huskergal
Pearl Clutcher
Posts: 3,439
Jun 25, 2014 20:22:13 GMT
|
Post by huskergal on Oct 16, 2024 23:37:40 GMT
We've been instructed as faculty not to use the AI detectors (or, at least, not to accuse students based on the AI detectors, you can obviously do what you want) because they generate a lot of false positives. We're asked instead to design assignments that either make sensible use of the possibility people will use AI or are constructed in ways where AI won't help or can't be accessed. That really doesn't work with creative writing.
|
|
|
Post by Merge on Oct 16, 2024 23:46:41 GMT
We've been instructed as faculty not to use the AI detectors (or, at least, not to accuse students based on the AI detectors, you can obviously do what you want) because they generate a lot of false positives. We're asked instead to design assignments that either make sensible use of the possibility people will use AI or are constructed in ways where AI won't help or can't be accessed. So once again, teachers are being asked to solve a societal problem created by someone else. Nice.
|
|
|
Post by crazy4scraps on Oct 17, 2024 0:33:42 GMT
When it is a picture, typically the hands are not right (ie 6 fingers). Yeah, very often the photos are obvious. But for writing I wasn't sure. But I have no experience using AI for anything, and haven't read something written by AI that a kid is trying to pass off as their own. I'd love to compare something written by a real high school student with one written (on the same subject) by Ai just to see if I could pick out which is which. There are all kinds of tells, everything from incorrect body parts, weird soft focus vignette type staging, things that just look too smooth or too perfect to be real, no watermarks ever. I see it a lot in my baking groups and it’s infuriating to me because I don’t want a casual viewer scrolling through to think those cakes or cookies or whatever are real. I mean, anyone trying to establish a brand and build a following or build a local business isn’t going to put up a gorgeous, drool worthy photo of something they made and NOT include some kind of branding or logo on that photo so a potential client will know who to contact if they want something similar. I’m surprised by how many comments those images get which makes me believe that the commenters are bots too. And when you read the replies to real people’s posts, they sound so canned that there’s no way it’s a real person replying. Someone will post and tag a friend saying, “You should make this!” And the bot will reply (multiple times, to multiple posts), “So happy you’re interested! Let me know what you think, your feedback means a lot!” 🙄 I mean, what is the point of these AI bot accounts? I just looked at the about info for one that showed up on my feed. The account was established in February of this year. There were literally 30 different recipes with photos posted within the last 24 hours, another 25 recipes the day before that, and so on, etc. Oh, and the photo of the woman in profile picture for the account was lifted from someone else with a totally different name on Facebook. 😳
|
|
|
Post by melanell on Oct 17, 2024 1:03:14 GMT
I just heard an example of AI on a video, and one of the things that stood out to me was the repeated use of meaningless adverb pairs such as "almost probably" and "probably certainly".
|
|
The Great Carpezio
Pearl Clutcher
Something profound goes here.
Posts: 3,019
Jun 25, 2014 21:50:33 GMT
|
Post by The Great Carpezio on Oct 17, 2024 3:13:42 GMT
I have experimented with this a couple of times now; I had students choose how they wanted to write an essay. They could choose to have AI write it (but they should "tweak" it to sound natural, AI assist (idea generation or editing but they craft it themselves) or they could write it on their own with no AI.
Both times I have done this, it ends up being about 1/3 of each category (80-90 students). They only get a few points for the essay (criteria is different for each), but then they have to write a paragraph about what they liked, disliked, process, recommendations, etc...and that is where they get most of their grade. Before I read the paragraph. I guess what they did. I have been 100% correct. I will admit that a handful of the AI-assisted were hard to detect and I would be hesitant to call it out, but I can always tell.
Now, I have been grading student essays since the last millennia, so I can sniff cheating out fairly well, but AI has a cadence and uses words in ways that natural writing does not. I do think a more mature and intelligent student could certainly take the time and fool people, but it would take time and effort AND a pretty good self-awareness of one's own voice and style to do that. I believe I can do that as a 52-year-old high school teacher who knows her own self and writing well, but most high school and college students aren't going to be able to do that. --some, probably. It is harder to tell with very good students; I will admit that.
I use Origin by GPTZero and Google for quick AI and plagiarism checks. I use BRISK for a more thorough check AND I use the AI features to give feedback and create questions, etc... AI is a powerful and game-changing tool in education...and also the bane of our existence.
|
|
The Great Carpezio
Pearl Clutcher
Something profound goes here.
Posts: 3,019
Jun 25, 2014 21:50:33 GMT
|
Post by The Great Carpezio on Oct 17, 2024 3:20:54 GMT
My first Prompt to ChatGPT: Write a message board post about how AI can be hard to detect but there are tools that can be used to detect students using Ai because AI doesn't sound like natural human writing. Give an example of how a teacher might be able to tell if AI was used on a paper.
I wanted to share some thoughts on the challenges of detecting AI-generated content in student assignments. As AI tools become more sophisticated, it can be tough to discern whether a paper was written by a student or generated by an AI. However, there are still some effective strategies and tools that can help us identify AI usage.
One key aspect to consider is the distinct style of AI-generated writing. While AI can produce coherent and well-structured text, it often lacks the nuances of natural human expression, such as personal anecdotes, emotional depth, and varied sentence structure. For instance, if a student submits an essay that is overly formal or consistently employs complex vocabulary without any personal touch, it may raise some red flags.
Example: Imagine a student writes an essay on the impact of climate change. If the paper is filled with factual information and sounds very polished but lacks any personal insights or experiences related to the topic, a teacher might suspect it was generated by AI. A human writer would likely incorporate personal reflections or specific examples that connect to their own life or community.
To help with detection, there are tools available that analyze writing styles and can flag submissions that appear to be AI-generated. These tools look for patterns in word choice, sentence structure, and overall coherence that might not align with a student's typical writing style.
While AI can be a useful tool for research and assistance, it's important for us as educators to encourage authentic expression in student writing. By being vigilant and utilizing available resources, we can help ensure that our students engage meaningfully with their assignments.
My revision---You said: Write a casual message board post about how AI can be hard to detect but there are tools that can be used to detect students using Ai because AI doesn't sound like natural human writing. Give an example of how a teacher might be able to tell if AI was used on a paper. Make it sound very natural and like a high school student wrote it. ChatGPT said:
So, I’ve been thinking a lot about this whole AI writing thing lately. It’s pretty wild how good these tools are getting, but it’s also kind of sketchy when it comes to schoolwork. Like, how can teachers even tell if we used AI to write our papers?
I read that AI can be super polished and structured, but it often lacks that personal touch we all have in our writing. For example, if someone writes an essay about their favorite book, you’d expect them to share personal thoughts or feelings, right? But if a paper just lists facts and sounds really formal, it’s a huge red flag.
Imagine a teacher reading a paper about a student’s experience with a summer job, and it’s all technical jargon without any personal stories. They’d probably think, “Wait a second, this doesn’t sound like them at all!”
There are actually tools out there that help teachers catch AI-generated content by analyzing writing styles. They look for patterns that don’t match a student’s usual work, which is pretty smart.
Anyway, just wanted to share my thoughts. Do you guys think teachers will start using these tools more often? What do you think about AI in school?
So, yeah.
|
|
|
Post by mom2kbs on Oct 17, 2024 3:31:18 GMT
I would love to know what add on you have to find if it was copied and pasted Etc. I am an adjunct for a local community college and that would be super helpful.
|
|
|
Post by Zee on Oct 17, 2024 4:59:44 GMT
Yeah, very often the photos are obvious. But for writing I wasn't sure. But I have no experience using AI for anything, and haven't read something written by AI that a kid is trying to pass off as their own. I'd love to compare something written by a real high school student with one written (on the same subject) by Ai just to see if I could pick out which is which. There are all kinds of tells, everything from incorrect body parts, weird soft focus vignette type staging, things that just look too smooth or too perfect to be real, no watermarks ever. I see it a lot in my baking groups and it’s infuriating to me because I don’t want a casual viewer scrolling through to think those cakes or cookies or whatever are real. I mean, anyone trying to establish a brand and build a following or build a local business isn’t going to put up a gorgeous, drool worthy photo of something they made and NOT include some kind of branding or logo on that photo so a potential client will know who to contact if they want something similar. I’m surprised by how many comments those images get which makes me believe that the commenters are bots too. And when you read the replies to real people’s posts, they sound so canned that there’s no way it’s a real person replying. Someone will post and tag a friend saying, “You should make this!” And the bot will reply (multiple times, to multiple posts), “So happy you’re interested! Let me know what you think, your feedback means a lot!” 🙄 I mean, what is the point of these AI bot accounts? I just looked at the about info for one that showed up on my feed. The account was established in February of this year. There were literally 30 different recipes with photos posted within the last 24 hours, another 25 recipes the day before that, and so on, etc. Oh, and the photo of the woman in profile picture for the account was lifted from someone else with a totally different name on Facebook. 😳 I love looking at pics like that for the AI "tells". It's like a spot-the-difference game to me. I especially love house and home ones, though the comments from the general public are annoying because lots of them didn't know how to spot a fake photo. "What color paint is that" "Where did you get those drawer pulls" "Where can I find those cabinets" And there will be a vase holding some weird wooden spoon thing with three heads, none of the windows are the same, cabinets don't match up, etc. But, AI gets better all the time. Scarily so. As for the writing, I'd never used it up until recently. I had it update my resume. It did a great job. I like writing so I normally prefer to do it myself, but I had to update my resume when I went part time and I didn't feel like putting in the energy. Plus, now it's ready for all the AI filters that are used to check resumes in the first place.
|
|