I don't understand why they ever stopped to grade with supervised assessment. Before AI they could get someone else to do the work for them. I don't get it. It's such an obvious and simple solution to AI cheating.
post
i went to a college that had no homework, but lots of recommend reading/exercises, all grading was tests and exams in class on paper. AI would have no use there
Pen and paper. Let's not think too hard here. The answer is simple.
Hi! Nerdy uni student here, it's an 80 people classroom. People just sit in the back and use their phone during paper exams. They then go to class groupchat to boast about how clever they were for coming up with that idea...
Also since professor has actual research to do, exams are proctored by the teaching assistants who frankly don't care. In fact TA's openly use AI to grade homeworks.
May sound slightly biased, but I think the solution is people going "exams were not meant to be part of this system, or at least in the current state they are" and making some reforms.
I wish it was that simple, I really do, but when did handwriting get dropped from the curriculum? Ok slightly hyperbolic, that was the US, still on the UK curriculum. But the importance of it has dropped dramatically.
Even 10 years ago the legibility of student answers was sufficiently awful we were doing exam technique training for students and it has degraded substantially since then.
There's the right answer, and then there's the practical answer. This is the former.
They'll just use AI then copy it to paper.
That's not how that would work at all, because they wouldn't have their phones. They would have pen, paper, and a desk. Where's the AI coming from?
You are aware that teachers still preside over the classroom correct?
You are aware that this article is about take home work for college, right?
It's only about take home work in the sense that it's advocating against it
Englandβs higher education regulator, the Office for Students, is warning universities that they may need to replace traditional take-home essays and open-book exams with supervised assessments that prevent students from relying on artificial intelligence to do their work.
Then pen and paper aren't necessary to prevent AI use. Its trivial for IT security to pull logs of students suspected of using AI to cheat (it's part of my job), or to block AI at the firewall level.
Are you implying that mobile networks do not function on university campuses?
Why would that matter if they're taking the exams and writing essays in the same room as the professor?
Part of this thread was people talking about students using their phones in the back and TAs not caring enough to intervene. It seemed to me that your response was related to that but perhaps it was not.
Fair enough. Although if the issue is the exam proctors not actually proctoring the exam, the medium in which it's taken won't matter.
At least with computer tests there's software that lets the proctor see every screen at once. But cellphones are an issue either way.
The best solution would be to have testing services handle it. But would cost way too much for any university to do.
For me it's insane that they were allowed to take the test at home in the first place. Trusting in honor isn't ever going to work.
In the pre-AI age, I think take home tests were fine. However they were generally much harder than a similar in person exam on the same material. I remember one professor gave the advice "if you are given the option between a take home exam and an in person classroom exam, always take the latter. Since the former doesn't have as tight of a time limit as the latter does, and will almost always be far more challenging" (or something to that effect)
Even five years ago, these were fine. You couldn't cheat if you didn't know the material.
Take home tests? I didn't read that in the article, take home essays yes. Which is just normal homework
Especially when you can offload to AI like a jock offloading on a nerd. No papers, oral⦠in person shit.
Welcome to 2024?
We ditched all digital testing and went back to paper exams. There are two med school classes full of AI cheaters and we've had record numbers of med students and grad students kicked out of programs. Fake it until you make it doesn't actually work.
Just make finals and exams oral, like interviews.
I like the idea of an oral exam. You come prepared to present a topic and answer questions. You are allowed to reference your notes, cards, etc. on the fly.
My professional qualifications all had an oral exam board. Was some of the most nerve wracking things I ever had to stand/sit through.
Please, they never even tried for the most part, they just wanted some easy bullshit tool where they could click a button and not worry about it. This bullshit predates AI by the way, companies like TurnItIn should be sued for fraud because people who actually wrote stuff have been falsely accused and people who plagiarized shit went undetected. These bullshit software packages never really did what they claimed to be able to do.
You want to actually stop AI cheating? Easy: In person tests and essays where the teacher is actually paying attention; no computers, phones, or other smart devices. Problem solved, you're welcome. Yes "professor" that means you have to do your fucking job instead of clicking buttons in Learn or Canvas or whatever dumpster fire on an LMS you're "teaching" on. Cry more I guess? People are paying a shitload of money for this, take it seriously, asshole.
Sorry, I've had some shitty professors.
Another avenue is doing regular screenings, orally or hand-written. Any sus answers, that student gets flagged and further evaluated.
But, the problem is, as I'm sure the article I haven't read points out, that cost-benefit is all fucked up. The benefit to students is they get a degree without having to do any work, so lots of people are going to do it, and the cost to Universities would be having to expel a good chunk of their students, which is going to cost them a lot of tuition money and alumni donations.
The reality is that the value of a university education--outside of STEM--in this bloated labor market is really just a social credit. What we need to tackle is all the poeple who can't get hired for positions they are absolutely qualified for but can't get because they don't have a degree.
There is something called a BONAFIDE QUALIFICATION written into employment law, and "college education" is considred a bonafide qualification even if it's not.
A real education is very important in many ways, some of which are harder to quantify. Instead of pushing people through these bullshit conveyor belts in what is sometimes little more than glorified daycare for adult children, we should actually fix education. Instead, it's under attack by fascists all over the planet because an educated populace is not as easily controlled.
Yes, there's education and then there's degrees. In my experience, anybody is capble fo getting a degree, but education is optional and largely up to the student. The only degrees that demand an actual ability to think and research and formulate are PhDs.
I find colleges and universities are, at this point, largely extractive, dumping people into adulthood with massive debts and no employable skills and I am through supporting them in any way. That doesn't mean I don't value an education or the ability to think critically, I'm just using my ability to think critically to realize that much of higher education is a scam, and the role of a degree is socially determined.
The student is only part of the equation: If they were never given the tools to learn to begin with, that's on society more than it is the student. I do agree though: One can obtain a degree without actually having received an education.
I think most people just don't engage analytically no matter what tools you give them. My sister & I went to the same exact schools and she ended up a homeschooling anti-vaxer.
I think even many people who are willfully ignorant can be reached, but things have to kind of line up for it to work. The odds of that happening in an educational system that has been gutted are much lower, which is probably what the assholes doing the gutting are counting on.
It seems like the quality and nature of the education system is impacted by the economic system in which it exists
Okay, but here's the situation at the institution where someone I know teaches...
Students enroll with Disability Services (roughly 1/3 of the class) because they tell their doctor they have test anxiety. Doctor then gives them a notes saying "so-and-so has test anxiety". Nevermind the fact that anxiety around a test should be a normal reaction -- particularly tests you never prepared for.
They get presented with a buffet of options for what will help them "succeed". And THE STUDENT picks what they want. Triple time to complete their tests? Unlimited unsupervised bathroom breaks? Flexible scheduling (i.e. taking the test after everyone else got their results back & knows the answers)? Private testing rooms with no proctor? Ability to use AI "just for grammar"? It's all there...
Absolute raging trashfire...
How come no one in all the governments is thinking "we are destroying society and we will be fucked in 10 years"? I mean, it's pretty obvious. I'm not a conspiratard but it feels like people in power want others to be really stupid.
Interesting concept: attempting to detect AI use in drafting academic assignment solutions, when the AI itself is trained on works published by the academically trained...
I mentioned this in another post, maybe in a few.
The college I'm going to requires you to now use a Microslop account instead of a student one; this isn't new but it sure was confusing when you have three different emails for the school.
So when you log in. You're greeted by ChatGPT. The website for the school is such a clusterfuck that their website search uses AI. Then your writing is checked by AI. Now they encourage you to use an AI website for MLA/APA citation. Also your work is probably being graded by AI since most of the time it takes forever to get an answer from whoever is teaching the class. The amount of scripts seem to point that your mouse movements and keyboard strokes are being checked by AI since using RespondASS(the show us your room and you'll get flagged for looking at your keyboard and more! Like we might accidentally brick your computer!) was so very welcomed(sarcasm).
So there's a point where you start to think about whats really going on when you're rammed up the ass with AI shit and the syllabus says you can't use AI and assignments say "write it in your own words."
It's interesting. I wouldn't doubt that all the written papers are being used for llm training. Then you write your paper in your own words, and get a lowered grade because you made a jokey joke. If your friend has an issue in Windows 8.1 and came to you for help, what would you do? Find a new friend. I answered whatever the question.
Nothing too serious, and you ask why the lower grade. It wasn't professional and this class is being monitored. I answered the question and to top it off there were two-three other people that copied and rehashed my answer...
What I wrote was correct as I had done it, I just wrote it in a anti-AI way that someone had to read it and understand the concept.
So in conclusion, college is fucked. Half of it is advertising software and the other half is wasting your time. I've had good teachers and then I've had more idiots that don't belong teaching, well they don't if it takes almost a week to get an answer.
I can also confirm that functionality in Microsoft products is (I think deliberately) being dumbed down and made counterintuitive in order to force people to use CoPilot. This has been especially problematic with Sharepoint.
It's very likely deliberate. Even the operating system. I booted an old computer up with W7 and I was surprised how much easier it is to use.
One class I had, they do a VM style "sim" and you're asked to open the terminal. Okay I press win+r to type in cmd. Incorrect! Use the search bar and type in terminal... I was pissed off
Please donβt tell me universities genuinely thought AI detection was going to pan out?!
The last decade makes me feel like we're already living in an idiocratic dystopia on the brink of realising our great filter.
Everything from the rise of fascism, narcissism, dysmorphia and associated mental illnesses, to ignoring climate change, to systemic corruption and collusion, to everyone going all in on stochastic AI. This world is cooked. Our logic is corrupted. There is something fundamentally broken with the average humans brain.
There is something fundamentally broken with the average humans brain.
Thatβs true, but itβs not just the average humanβs brain. Itβs all our brains. Humans have been hacking each other for millennia - think of any scam or marketing tactic.
The question isnβt whether weβre imperfect (we are), itβs whether we can survive despite those imperfections. Whether we can recognize our deficiencies and protect each other from ourselves.
It starts with empathy. The war on empathy is doing more damage to this world than anything else IMO.
Everything from the rise of fascism, narcissism, dysmorphia and associated mental illnesses
Excuse me? I really hope this isn't a thinly veiled dig at trans people. Do not put us on the same level as Mango Mussolini
There is certainly a giving up on owning and being a part of oneβs world, and instead embracing a consumeristic mind-controlling framing in which one is simply pushed around by basic urges and those who feed them and how everyone else is consuming.
I think this is the Internet and tech. Lots of people praise the older Internet, before Facebook etc, and for good reason. But Iβm not sure you can separate what it was and what itβs become.
I think thereβs a neo-Luddite position that many would appreciate but donβt know how to conceptualise, because weβre all in this consumeristic mind-control cloud to some extent and donβt know what foregoing it even looks like.
They totally did, and bought massive contracts for AI-detection software at the same time, fucking morons, they were giving the students AI software access. Pissed all over themselves.
Just like they gave up on all previous forms of cheating. Anyone clamoring that degrees will be useless NOW has not been paying attention. Until universities are held accountable for unleashing incompetent cheaters onto society, the financial incentive is to throughput as many students as possible and it has been for a long time.
And it's not just financial incentives. Many institutions are difficult to get into. They have a process and hold that process, their judgement, in high regards. If someone gets in and is a failure that reflects poorly on them. They want students to succeed, one way or another, to show what brilliant students they attract.
As an educator with a Masters in this topic I am going to submit myself for possible pitchforks.
Exams have been shit for ages.
I will easily and immediately concede some exams by some professors some of the time are good. But generally? Most exams are crap.
Math Reasoning: If an exam is supposed to provide a snapshot into student learning, then the exam results should demonstrate that learning as a number.
Counter example: Consider an exam thst is cumulative. It contains 10 questions chosen by the professor. A student in the class has perfect knowledge of half the course material, and is perfectly impossible of getting the other half right (confidently in correct). This means that if the exam is to represent the students learning that student should score a 50. But if the professor chooses 10 questions outside this students knowledge set that student gets a zero.
Before you say "it's a fail either way" many mathematics programs have a passing grade on exams at 30% or higher so be careful with grade assumptions as well.
I'll post more later but these are time consuming and... Well I teach lol, I have limited free time.
Suffice to say I will get around to the AI part at some point.
The problem is writing good tests and curriculum is extremely difficult. It takes extensive training and a team of people to make it passably decent.
The vast majority of test are written or selected by the teacher with limited to no training on the subject. They have absolutely no clue how absolute shit it is.
This is especially true at the university/college level where the professors are all trained in the field of study and have close to zero training in teaching.
Unpopular opinion:
Who cares if they use AI? When I was in college I'd do other people's homework for beer money. I got smarter, they didn't, I got beer. Worked out fine for me. People who paid me to do their work for them...well, either they ended up redoing it themselves, or they failed out and found something else to do that better fit their interests. Honestly, kind of a win-win
Who cares if they use AI?
Because they are applying to competitive professional programs, with limited entry numbers, so for every cheat would gets in, one person working 90 hour weeks is excluded. Onto grad school and med school, those programs require physical expertise and knowledge at the experimental bench or ER.
You really want a doctor who cheated his way into med school treating you in the ER while you're bleeding out?
This is a huge problem already and frankly, post-secondary cheating should be a criminal offence.
Yeah, assuming they can pass the entrance exams. Can't really have AI take your MCAT for you.
On the other hand, if someone can cheat their way through intro courses and still submit a competitive application with competitive test scores? They're smart enough to get it done.
Those people who I'd do homework for? They usually started failing pretty hard around junior/senior level courses. That's the problem with outsourcing your thinking. Most every professor knows what's up when someone is submitting 100% homework assignments and getting 50-60% when exams roll around.
I don't why so much of it is dependent on writing a long paper and having several people read through it. It's a waste of time even before AI.
Just do a quick 10 minute oral exam and you'll know if they understand it.
Some things take more than 10 minutes to explain, but only if you need to start from scratch, so for more advanced topics they should just ask questions from the top down and assume the basics. Anyone who fails to understand the basics will obviously fail the deeper meaning as well, or shouldn't have been able to come to that level of exam anyway.
The point of an essay is that a person may, accurately and succinctly, convey a complex idea to a stranger across an ocean using only the written word. Which is half the point of literacy. Where I to hire a college grad who couldn't compose an email about a complex, nuanced subject, i would think real hard about hiring any alums of theirs.
Knowing stuff isn't enough. You have to be able to present it in a communicable fashion.
Nobody reads college student essays over the ocean.
Anyway, you misspelled "were" and forgot to capitalize "I". I will forgive your comma mistakes, because I am not in a position to correct commas in English.
C-.
If you can't articulate why schools use long essays, perhaps you shouldn't suggest scrapping them. One should know how a machine works before one starts tinkering with it. And a course is a machine like any other. Don't start pulling out pieces before you know what they do.
If you don't how a system works, it's the perfect time to disassemble it.
Why is that?
You'll learn from it. (which is the purpose of universities, rather than grades or papers anyway)
In this case though, it's more because the system clearly doesn't work, so something has to be done eiher way.
They (schools) can't fight AI forever. It will over burden them with slop no matter what they try. It's futile to think that it can be detected, f.i. if the students put the AI in speech mode and writes down the answers in hand etc.
It's better to rethink the entire purpose of what they're trying to achieve. Hundreds of pages of written paper probably isn't it to begin with.
They're trying to educate: To get knowledge into the head of students. A written paper won't really show what's inside the head of the student regardless of it being written by the student, their parents, Indian fiver hirees, AI or simply paid to pass.
IMO the validition process has to be rethought, and it's only good that AI has broken the system.
I agree that something has to be updated. Breaking it down is a good way to Understanding what you're breaking down helps understand why and how to improve it. Especially something as complicated as an entire education system and the resulting tech relationship. On some level I agree, something needs overhauled. But it's also impossible to anticipate future technological leaps that would do something like this again. We as a people need to be more measured in embracing tech so wholeheartedly. I don't know that there is a blanket response to such things that every individual school can address. This is something national leadership should be addressing. The whole scale blind adoption of 'AI' is the cause, it'll take more than college boards to address
I'm all for that, but some people will complain that they get nervous and that's why they couldn't state how they do the things.
The amount of accomodations in US colleges is insane to where some people are allowed to take extra time, or take their tests not in a classroom setting, or have their tests read to them because they're illiterate or a variety of other things that just aren't compatible with the workforce is insane.
Seems insane to not assist people learning. Reaching people you otherwise would not is a good thing.You WANT more people in the work force who can understand concepts. Who gives a shit how they demonstrate it or if they need an accommodation?
Supporting people through their weakness can help them find or reinforce their Strengths. That is absolutely something education should strive for.
The accommodations are other life skills that they are lacking in. I think oral examinations would really highlight weak points for a lot of people and they would seek exemptions that are easier.
I'm not saying that you don't assist people with learning, but I think testing and learning are two different beasts. I think having a uniform standard for testing is a good thing, I'm all for oral examinations or proctored written tests, but I worry about all of the people that will seek exemptions from it because they can't perform to the same standards on those tasks. It's degrading to the letter grade of everyone else.
I do think that it is the responsibility of every student to study and find resources that best fit their learning style.
Is Education there to teach material or life skills? Yes, it's important for Students to learn how to learn, but the institution SHOULD be trying to reach as many as possible. There should be guidance for people who learn differently. You certainly aren't taught HOW you learn, but it is worth any institutions effort to assist.
I don't support the idea that everyone need learn and consider topics in the same way. One Method for Everyone is how we get this Lowest Common Denominator, Min/Max bullshit.
Having AI do tour work at a university is the same as hiring someone else to doyour work
You're just wasting your money that you paid to learn something and you'll fail your exams because you learned nothing.
It is so extremely dumb
their diplomas will be worthless.
It was horrible but we had to buy βblue booksβ which were just stupid notebooks only sold at the school bookstore. Then final exams were done by hand in person in these stupid sized booklets. I needed 5 of them for the written English exam.
top 100 comments