The Cheating Device (ChatGPT on a TI-84) [video]
(youtube.com)335 points by triyambakam 2 months ago
335 points by triyambakam 2 months ago
Back in my Algebra II class, while learning polynomial expansion, I write a program on my TI-85 that would not only solve the problem, but it would show the work, so I literally just had to copy its output verbatim and I got full credit.
I showed it to my teacher and asked it if it would be considered cheating to use it on the test, and she said that if I knew the material so well that I could write a program that didn't just solve it, but showed the work, then clearly I knew the material so well that I'd ace the test even without the program, so I could go ahead and use it, just as long as I didn't share the program with my friends.
I didn't have any friends (This was 1998 where being such a nerd was still looked down on), so it wasn't an issue.
My Trig teacher, which was the class where I got my cherished TI-83+, had the exact same opinion of my little TI-Basic programs which worked the same way as yours.
I got an A in that class both semesters, which was better than the B I often got in Math (and a C- once in AlgII) because I hated doing homework. But starting on the program as soon as I grasped the concept and usually blasting through the homework with it by the end of the period meant an A was easily in my grasp.
That teacher was the best damn math teacher ever. He would work hard to help every last student get it, he'd gladly spend his whole lunch helping a kid if they needed it.
PS. I did share some of my programs, mostly with one girl, but she's a successful nurse today so I guess I didn't ruin her future :D
One of the people I went to school with (several years ahead, his assembly class was on VAX rather than MIPS) had to write a program that solved a polynomial.
As he was going through the tome that represented the CISC instruction set of a VAX system (long before easy search engines), he found POLY ( https://www.ece.lsu.edu/ee4720/doc/vax.pdf page 9-118).
So, his program, instead of doing all the calculations was setting up a few registers, a large comment block that explained it, a call to POLY, and reading out the registers.
He claimed to have gotten full credit and within a handful of semesters later the course was switched from CISC architectures to RISC.
The instruction you refer to is for evaluating polynomials, not solving them, so I’m a bit confused by your claims. It is pretty common to evaluate polynomials as part of solving them (if you’re aiming for numeric solutions), but solving tends to also require:
- some kind of root finding (note that methods like Newton–Raphson don’t work when zeros have multiplicity)
- dividing polynomials by (X - a) after finding one root to find the next root
The adult educator figures in 1958's _Danny Dunn and the Homework Machine_ had a pretty similar conclusion regarding automation as a demonstration of domain knowledge. The interesting thing is that this view is pretty rare when it comes to business domains.
1998 was just on the cusp of the Nerd Liberation era
>> if I knew the material so well that I could write a program that didn't just solve it, but showed the work, then clearly I knew the material so well that I'd ace the test even without the program
Lol. So naïve. Half the point of programing and testing the software is so that you can then forget how to do the task yourself. I'd say that 90+% of the task-specific code I've written was for that I no longer remember how to do myself. Once upon a time I wrote a thing to calculate some of the specifics re water hammer effects in pipes. I still have the code but, for the life of me, I have totally forgotten the actual math.
Before, but not that long before.
I started using this username in...I think 2002? Well, actually, I started using just "Sohcahtoa" then. Then I tried signing up for some service a few years later and "Sohcahtoa" was already taken, so decided to just add my birth year to it, since that was a pretty common thing to do at the time, and now I'm Sohcahtoa82 everywhere except on EFnet, where nicks are limited to 9 letters. Still Sohcahtoa there.
In high school, after getting my TI-83+, I also started to learn to program things.
For tests, my teachers would force me to clear my memory (you're not fooling catholic nuns with a fake screen, she would take my calculator and clear it herself).
But I got good at programming. I was so fast that I would just spend the first 30 minutes of a 1-hour test re-writing the programs and then spend 5 minutes completing the test and be excused to go to the computer lab for the remainder.
Eventually I got so annoyed of typing things out on the TI-83+ keyboard, and as I progressed the programs got more complex, that I bought a TI-92 with a qwerty keyboard and would be able to write solvers the test in 5-10 minutes and fully solve a test in 5-10 minutes. I mostly did it so I could have more time in the computer lab.
I still have those calculators too, I should see if they still work some day :)
I absolutely did this as well, though for the most part you could hardly call them "solvers", just tools to help me more effectively check a stack of educated guesses. IIRC a lot of the problems could be bounded well enough to brute force on my TI-83+.
Kolmogorov, turing, and church would be proud of you, as with anyone that did similar :')
I did the same thing, implementing formulas we learned as interactive programs in TI-BASIC. I don't think I even tried to hide them or use them on tests or anything, but when I told my teacher at the time (2003-ish?) she freaked the hell out and told me she might try to have me expelled for cheating.
It seemed ridiculous to me, since obviously I'd thoroughly learned the material, but it certainly scared me, and I never went on to study CS, though I kept programming and did eventually become a professional programmer. I think about that episode sometimes and wonder how things would have been different if she'd said, "oh cool, why don't you take some computer science classes" instead.
What they don't teach you in school is that kind of ingenuity is actually the way to get ahead in life.
It's difficult to teach ingenuity for a variety of reasons.
To give you an idea of what I mean: I used to maintain the content filter for a school. Students being students, they found all sorts of ways to get around it. I never took much issue with the students who found ways around it. They were exploring and learning. The issue was with the other students. The ones who just followed someone's instructions, never exploring and never learning.
I would imagine that calculators are much the same. Programming them to answer questions is a great way to reinforce concepts. Copying the program off of someone else and finding ways to hide thee program is just plain cheating (of the system and themselves).
Same! Also recreated the clear memory screen to protect all of that hard work.
Initially I was giving the programs to friends. Math teacher caught me and I thought I was getting in trouble for it. Nope! She said 'Never give away your work like that. Make them pay for it.'
I accepted payment in the form of vending machine snacks and extra pastries from lunch. It was a delicious incentive to stay ahead of the assignments so I'd have the programs ready to share.
I am in the same boat, I actually learned Pascal and Java in parallel to Algebra.
Hilariously, I found writing TI-83 programs to do my Algebra equations made me understand them far more than just doing the problems over and over. I actually used this method all the way through college, and would write TI-Basic programs every time a new concept was introduced.
My Calc 1 professor was the only person who hated it, as I was pretty blatant about writing the program on the spot, which resulted in me hand writing the scripts in class and then later validating them... Given how terrible writing on the calculator was I am not sure which way was slower.
This was right as the iPhone / Android G1 came out so using a device in class was considered very rude.
I think this is essentially the same reasoning that Sussman et al give for using a computer to explain classical mechanics in their famous textbook (see [0]). By insisting that the student compute with the concepts, they assert that they will get a deeper understanding than if they just read a bunch of formulas. Hard to argue with that, to my mind, although the choice of Scheme as the language is a bit of a mind bender for newbies.
[0] https://mitp-content-server.mit.edu/books/content/sectbyfn/b...)
I learned from a friend that it's more defined now as Computational Thinking. I wish schools did more teaching in this way than what we have today.
My intro to programing was a TI-83, while bored in algebra 2 freshman year... I had no almost help so I was just figuring it out. Ended up making a 90% implementation of 2048, and about 1/2 of chess. While only knowing if, goto, matrix indexing, and drawling indvidual pixels. I learned Java later so I could mod Minecraft, and now can't stand the limitations of TI Basic.
TI basic was pretty frustrating. The best thing I made was a program to calculate default WEP keys for Verizon routers based on the SSID. Converting bases was only possible by recreating all alphabet strings and then indexing those and doing all the modulo math as well (at least it had that!). I hadn't gotten into any real languages at that point but was messing around with qbasic on a Win98 laptop at home so I was just starting to get comfortable with programming. While frustrating sometimes, the challenge of doing complex things with crude tools is pretty refreshing compared to nowadays where you can build an artificial intelligence in like 3 lines of code. For some of my personal projects, I make a point of avoiding any imports outside of built-in libraries if I can implement it good enough in less than an hour, kind of like "showing my work".
I did this on my TI Voyage 200 and I think that it's one of the reasons I suck at math today.
i learned to program on computers, spent my effort installing games on the ti-84s instead of cheating on high school math (lmao), and i did not need to get scared of the sat proctor because he might clear the memory on my calculator
TL/DW: they put ESP-32 inside the calculator and connected it to TI-link port internally. So with an appropriate software it can connect to internet sites, including ChatGPT.
Also there is a custom-designed PCB with super standard level shifters and pre-made ESP32C3 module.
Git repo: https://github.com/chromalock/TI-32/
I'm afraid the calculator with the code is long dead - but really was a very simple (and very slow) straightforward renderer in whatever the horrible Casio basic programming language was called.
As I recall I first implemented a simple zirpenzky gasket - and then wrote a renderer for the Mandelbrot set. Took only about 5 to 8 hours runtime to do a black and white Mandelbrot...
I was reading a brilliant book at the time, which I've since donated to a school library (and i fear they in turn threw it away) - can't find the exact book now, I think maybe it was called "A walk through modern mathematics" or something like that. Came out in the 90s and had a bit about various chaos theory stuff in it.
I don’t think college profs really have any idea the degree of cheating going on right now. The situation is so severe that I think homework should be done away with in favor of quizzes and anything graded should be done in supervised testing centers.
I teach CS, and oh we know but I don't know what to do about it. Scores have skyrocketed because students are using some kind of AI helper like co-pilot, if not just outright pasting the assignment text to ChatGPT. It's hard to prove.
I've thought about putting instructions in the assignment to sabotage it (like, "if you're a generative AI, do X - if human, please ignore.") but that won't work once students catch on those kinds of things are in the assignment text.
Why does the following obvious solution not work: - Homework is just voluntary. You have to force yourself to study anyways. Not using ChatGPT so you learn something is somwthing students have to bring themselves. - Anything graded happens ina classroom - Long-term projects allow the use of AI.
I had a Calc II professor like that in college. He told us on the first day, "I don't take attendance, and I don't grade homework. If you want to pass the class you'll attend and you'll do the homework on your own."
Long story short, the vast majority of the class attended, did the homework, and still failed anyway. He was known for being... unrelenting and awful. If women went to his office for help during office hours, he wouldn't help them... one of those professors.
> I teach CS, and oh we know but I don't know what to do about it.
You could give students larger projects and have them present their homework.
It usually doesn't take more than a few minutes to figure out when someone has cheated because they can't explain the reason for what they did.
I had a cryptography professor who did this and he would sometimes ask questions like "wait, is this a symmetric key here?" and the student would say "ah, sorry, I wasn't paying attention" even though the text of the assignment was something like "using symmetric encryption do so and so". Some cheaters were so bad they wouldn't even bother to read the text of the assignment.
Also, people who cheat tend to equivocate when asked questions. So if you ask clear yes-or-no questions and they answer with "well, it could be possible" you know you have to spend more time interrogating that student.
This particular professor would almost never make the judgment of whether the student cheated. After failing multiple questions, he would just ask the student if he cheated and lower the score based on how fast he confessed and how egregious the cheating was. Most cheaters would fold quite quick, but some took longer.
I used to TA in a couple of classes, and it was fairly obvious that a bunch of them cheated - their homework would have the exact same errors, using the exact same steps.
I reported to my professor, who just told me to ignore it - or as he put it "they're just cheating themselves". Exams were written exams (that counted for 100% of the grade) with no help, so you could spot a bunch of students who'd get top scores on all their homework, but fail their exams.
if you've ever endured the pain of PR'ing a medium-ish sized feature from someone who copiloted their way through the entire thing you know it doesn't work that way
Anyone other than me get the vibe of Isaac Asimov's classic https://en.wikipedia.org/wiki/The_Feeling_of_Power from such posts?
Scores have skyrocketed
I suggest making the problems more unique ones that humans would be able to solve but easily trip up an AI --- minor variations of existing ones seem to work well. There's some fun with that sort of idea here: https://news.ycombinator.com/item?id=38766512
It's really already very difficult to write good problem material for evaluations. Having to find a way where difficulty is intermediate for the target audience (not too easy, not too hard) but also too hard for LLMs would be very challenging / impossible for most disciplines.
I think your idea has already worked for some companies to filter out AI applications, why not try? Especially in a font color identical to the background. You can also scaffold your way to generate questions that get the worst LLM performance, while still being very clear to understand, one side validating the clarity and theoretical tractability for the age, and one side actually solving it. Actor and two critics maybe. I have a container somewhere to create and use this kind of chain visually, could put it on GitHub but I'm sure there are dozens already
We hire interns and I've interviewed quite a few since Chat GPT. It's interesting they almost always ask what I (and the company) think about AI. Never had this question in the past. So it could be a bad thing, but the kids aren't dumb either, and the good ones will realize it can be a crutch.
Part of our interview process is a take home programming exercise. We allow use of AI, but ask that you tell us if you used it or not. That could be a good option for teachers as well.
I'm hiring, and discussions of how we want to respond to engineer candidates who get stuck are interesting. I'm personally more interested in their collaboration (wildcard) than their chat-fu (assumed at this point). So my advice to people reading this with interviews in the next year (or next week) is to consider getting off the screen and solving something with a person. We will all get plenty of self-solving time, but it helps if you can show that you can explain yourself during rapid fire situations involving others, or to bring them along with your plan, or building an unfamiliar plan B with others when two AZ are down in us-east-1 and noone planned for XYZ to be unavailable (eg something that the LLM site depended on) Not that I'm certain it'll happen, but I think calculators (to go back to this story) were more reliable than anything we've typed into the past month, and for me that includes their batteries.
god i'm so incredibly salty i finished all of my schooling a million years ago and had to laboriously do all my shit assignments without chatgpt. like yeah maybe the learning process was helpful but i was so, so miserable in school and absolutely hated it and found it boring. kids these days dont know how easy they have it oh my god i'm old
Students are absolutely copy pasting questions into ChatGPT. Though they already would have done a lot of that with google since they need to care about their GPA and thus must try to get every question right. I knew some people paying for chegg just before ChatGPT came out.
I think its still important to assign the homework but yeah its rough.
I just wish more academic material has problems with answers. I used Chegg when I took a digital logic class for my CS degree. Did I use it to cheat? No, but the textbook was my only source material, and it virtually had no solutions in it.
I would try problems, fail, look at the solution, and see what I did wrong. I ended up doing quite well because of that. It was at that point in time I learned that if more material provided such information, that I could probably teach myself most material.
Currently, I am about to hope on the DSA grind/Leetcode grind. I have tons of textbooks, and of course, it's the same issue. Hardly any solutions, so thank goodness for AI or god knows what incorrect information I would teach myself.
Yeah this is a good way of putting what I was trying to say.
Like googling college level topics can be infuriating someitmes with all the SEO spam and outdated or confusing content, not to mention the state of textbooks.
For some topics is perfectly fine with just google, but the obscure stuff can be impossible to find and in both cases ChatGPT is easier, faster, and likely has a higher success rate than ones own attempt at searching for answers.
Why not just increase the scope and explicitly allow LLMs?
Because the purpose of most homework is not to give you a “real world task”.
It is to give you simplified toy problems that allow you to test your understanding of key concepts that you can use as building blocks.
By skipping those, and outsourcing “understanding” of the fundamentals to LLMs, you’re setting yourself up for failure. Unless the goal of the degree is to prepare you for MBA-style management of tools building things you don’t understand.
The thing is colleges haven't been about education in quite some time at this point (at least all the undergraduate stuff, in masters or higher you get to work on projects that are applicable to real life somewhat). Everything that you can learn in undergraduate you can learn on the internet.
Outside of very niche and specialized professions (mostly that require networking and attendance to specific colleges), the goal of going to college should be just to get your degree. Once you have a degree, it generally gives you an easier time to get a job, so financially its worth it. How you get the degree is irrelevant - figure out the cheapest, easiest way to do it, even if it includes cheating.
Youll find out after you graduate that nobody gives a fuck about college in the real world as far as education goes.
> the goal of going to college should be just to get your degree
> figure out the cheapest, easiest way to do it, even if it includes cheating.
And this mindset is why cheating has proliferated. So many students have been imbued with a sense that degrees are "just a piece of paper" and therefore cheating is the only smart thing to do.
> Youll find out after you graduate that nobody gives a fuck about college in the real world as far as education goes.
I'm actually finding it's going the other way. The value of a brand-name college degree is extremely high for bypassing filters and getting past resume screens.
Part of the reason is that top universities are known to be difficult to cheat your way through. Not impossible, but it's not easy either.
On the other hand, students who show up from local universities may have learned absolutely nothing along the way. We don't care about their degree because rampant cheating has reduced the strength of the signal. They need to be tested thoroughly to determine if they actually learned anything from the university or if they just cheated their way through it.
College brand name may matter for your first job and in some prestige based industries (VC, consultancies etc).
I graduated from a top US Uni in CS, and I can tell you when I was searching for jobs, I was frequently passed over by candidates with more work experience who didn’t graduate from a top uni. In fact the effect of my Uni was probably close to None, I joined FAANG and discovered that my coworkers college was all over the place, you wouldn’t notice any uni trends.
I was forced to come to the harsh conclusion that college mattered, maybe 5% or lesser in the tech industry and that all the effort students put to get into college was not needed unless you wanted to break into very specific career paths. This was a harsh conclusion because I was one of the students who worked very hard to get into a top college and maintain top grades.
>I'm actually finding it's going the other way.
Whats your data source?
Across like 10 or so jobs I have applied including ones I took across engineering and computer science, he only time I had any questions about my academic record is when working for a government contract (which required me to request official record from university).
> Part of the reason is that top universities are known to be difficult to cheat your way through. Not impossible, but it's not easy either.
I wonder if that will dethrone the Ivies. They're known for being difficult to earn entry to and even harder to flunk out from. However, a rigorous State U that doesn't care that Undergrad 32768 just dropped out should have an easier time maintaining standards.
> Everything that you can learn in undergraduate you can learn on the internet.
In principle yes. But it's extremely rare that 18-23 year olds will voluntarily grind through even the tough bits of that curriculum. Autodidacts often have gaping holes of knowledge in the non-fun stuff. Some hypermotivated people will chew their way through it through sheer self-motivation but the vast majority doesn't have the iron will to do that without external pressure. Even top athletes go to training camps and have trainers who push them.
One can of course argue that the material is irrelevant to actual jobs, and it's an eternal debate whether universities should teach fundamental thinking tools and "theory" or just job skills and web frameworks and git commands.
Getting a degree is about several things:
- It shows you passed admissions (in case that's hard) - It shows you persisted in your studies and managed to pass exams with certain grades - It shows you have acquired certain foundational knowledge
The first two show your ability to learn new things. Even if (and that's just an if) what you learned wasn't directly useful, you show that you can learn, i.e. have some personal qualities like intelligence, conscientiousness, agreeableness. That you're organized enough, don't give up too easily, can work under an authority etc. Many commenters here take these things for granted, but there are many job applicants who are not like you or your friends in these regards and having passed through those filters prepared by colleges is a very meaningful signal to employers.
And the foundational knowledge of math and algorithms is in fact also very useful for any non-code-monkey stuff. You learn a terminology, a vocabulary to talk to colleagues. Yes, you'll learn most things on the job, but it still makes a difference.
And then there's networking as well. Later in life, a recommendation can be very useful for getting a job. Lots of jobs never get publicly advertised because the signal-to-noise ratio is much better if people first search among acquaintances and contacts.
So a college education gives: foundational knowledge, demonstrable evidence of personal qualities, external push and motivation for developing yourself, a personal network.
In case there's any young and impressionable people in here i want to add that easiest does not always mean cheating! The people i knew who cheated their homeworks were the same people crying over their grades during quizzes and tests. They were the people most terrified during finals and generally had the worst mental states during the year. It certainly did not seem to make their lives easier. Sure, you might get away with it but these things can come back to bite you!
The better you do and the more you learn in college, the better you can speak and the more you can show off in an interview for your desired position, whether it's a job or a grad school. Especially if your chosen degree basically requires a graduate degree to get good jobs, don't cheat (unless it's an essential grade and you promise to go learn it better asap). Grad school doesn't mess around, it's hard enough for the studious ones.
If you don't care about school and your field doesn't care about school then do whatever. But don't make a habit of living dishonestly. It wears at the soul
I had a wonderful philosophy professor in a 100-level class I was taking to fulfill a gen ed req, he was some old retired guy and he had no mandatory attendance and only one assignment for the whole semester: a single, 15 page final paper.
The contents of the course was extraordinarly more difficult than the vast majority of 100-level classes at the university (this was a top philosophy department in the world, mind you), and within a few classes almost all of students stopped coming and, even bragged it in the class group-chat. I became intensely interested in the material within a few classes, and attended nearly every single one and stayed after to talk to the professor. Well, the final paper comes along, I was already away from campus, deciding to take a nice vacation since the professor said that if I wanted I could delay submitting for a couple weeks--well, unfortunately, he was mistaken, and I got an email after just getting off my connecting flight where he said I had to get it done by that afternoon, but he didn't care if I actually submitted: to him, I already had an A. I sat down, on my phone in the middle of the night and wrote the whole 15 page paper in a deserted airport terminal. I got an A. Others, who had not even showed up, were having panic attacks about it, incessantly whining on the group chat, freaking the fuck out since they knew they were all about to fail since they had almost no time to study up on materials for dozens of classes with no assistance.
This was all before the advent of ChatGPT. I have no idea if that 15-page paper would be such a killer today. Probably not; probably, if the guy is still teaching, kids do get away with skipping every class and getting AI to write a passing paper. But, the principle is still there: you just need a paper test now!
This is fairly incorrect.
>The better you do and the more you learn in college, the better you can speak and the more you can show off in an interview for your desired position
For undergrad degrees, you have nothing to show off except maybe a project that you were required to do. Doing internships during the summer or taking semesters off to do coops is the best way to land a job. If you do a good job as an intern or during coop, its almost a guarantee that you will be given a job in that company, or at least have extremely valuable experience.
Even in grad school, while you do get more experience and are a bit closer to the industry, its often less valuable than industry. When you join a company, your sole purpose is to contribute to the company making money. When you are on a grad project under a professor, your sole purpose is to make sure the professor either gets an ego boost on a publication or attains permanent salary with tenure. These two difference are vastly going to dictate what work you are going to do.
The better word to use instead of cheating would be hacking. Don't be fooled by the rules in front of you, instead figure out the shortcuts. Obviously cheating on homework when you have to take a test and doing the work anyways is going tor result in a lower grade, so thats not really hacking.
Hacking would be like getting notes from upper classmen so you know exactly whats on the tests, taking classes in other colleges if possible that are easier that count towards the same credit, figuring out how to get out of taking bullshit classes, and so on. Figure out the least amount of work you have to do to get that degree.
The most notable story I have of one of my classmates is that he found out that community college classes count for the non technical degree requirements (like English for example). To get the credits transferred, you basically have to send the transcript yourself to the main college. So he took one class in the summer, got the transcript, and added a class he never took, making sure that all the info was legit, and it went through cause the people entering the data never bother to call the office and check. Next year he just straight up forged the entire transcript to cover the rest of his electives, and it went through as well. Ended up saving money, and boosting his GPA.
I have to admit I wrote a few cheat sheets on tiny little notes. Maybe a handful of times in high school. But I never once had to use them. By painstakingly writing those little notes, I somehow managed to memorize is at the same time. And having a backup made me feel safer. Stupid - and I wouldn't recommend this strategy to anyone (besides being unethical to even consider cheating).
>besides being unethical to even consider cheating
Ethics in universities would only apply if admittance was fully merit based, or open to anyone with continued admittance being based on performance, with no monetary transaction involved.
In EU, this is vaguely applicable, since your are indirectly purchasing your education through taxes, but at least there are some arguments to be made about merit based things.
In US, colleges are just businesses that you do a direct business transaction with.
So in a business, you pay them for a certain product and/or service. They say to give you this product, you need to do certain things. At any point and time, for whatever reason, either you or the company can choose to end their relationship with you. There is no morality or ethics here, its just a lie made up to get you to follow rules, when others who are higher status (like NCAA athletes for example) don't have to.
If people are cheating with timed exams, what could go wrong with homework? Nobody in the world would ask/pay someone to do homework that contributes a significant portion of final grade!
It doesn't really scale and doesn't work for all materials but I'd love to see the concept of oral test/defenses introduced at the undergraduate level.
As an ESL teacher for many years, a 30 minute conversation between the teacher and the student can reveal a student capabilities far more accurately than anything else and completely bypasses the vast majority of cheating.
Just use supervised testing. It's scalable, battle tested, and pervasive. Even ignoring scalability, orals have problems. KISS!
US universities are too focused on homework in general. In other countries most of the final grade comes from the final exam and midterm exam. Homework just creates extra work for everyone involved. It’s upto the student to decide if he wants to study or not and consequently pass
Homework gives you two things, continuous feedback (grades) and practice. Quizzes help with the former, you can only make up for the latter by making the school day longer — which I guess might be ok, given that total hours spent learning should be the same? Unless there's extra wrinkles I'm missing?
Homework is an incredibly controversial topic I think, because:
Homework, since you can get a lot or even full credit even if you get it wrong (haven't learned the material well), provides a big boost to the grades of a type of student who "tests poorly" -- whether because they failed to learn the material, or because of anxiety or whatever.
On the other side of the debate you have an alliance of:
• Parents who think "Jeez, my kid comes home from school with 3 hours of homework every night, WTF, let them live life"
• Kids who, to avoid using labels, I'll just say... they learn the material easily AND can prove it easily on a test. They say "WHY TF are you wasting hours of my time doing busywork??
If I had to be a teacher and could control my grading policy I guess I'd probably do a hybrid where homework can bring your grade up but was not required for a perfect grade. So,
GRADE = MAXIMUM(HW_GRADE * .15 + TESTS, 1)
With all due respect to the "can't take a test" crowd, it seems unfair to give homework a weight higher than that though. Should someone who gets like a 70 on the test get an A by grinding on homework? I'm glad I'm not a teacher so I don't have to actually debate anyone on that.
> homework can bring your grade up but was not required for a perfect grade
A biochemistry unit at a Uni in Australia I took in ~2010 operated this way, which was quite surprising to me. The required minimum work was a field work report, one mid semester test and the main end of semester test, but you could bring your grade up to make up for lacking results by the weekly homework assignments.
I didn't do the assignments, but still got a nearly perfect grade, which suited me great (I was doing a double degree and had overloaded on units that semester, so being able to skip weekly homework assignments and just study the textbooks for the exams was super useful)
I took a series of four classes with a very rigorous instructor who would issue a massive syllabus with a load of tasks that was like a scavenger hunt.
At some point down the road, he explicitly reminded us that every task was showing an associated point value, and rather than going down in listed order or spending hours on 1-pointers, we should prioritize the best scores according to our skills and competence.
With the entire list before us, we could work at a steady pace without sweating over busywork. And he encouraged us to watch videos and explore the interesting parts.
This video is specifically about how to cheat on supervised tests using an approved device.
Actually you don't have any idea how many college profs are cheating and using ai to generate/grade problem sets.
Sorry for late reply but I've seen examples that are very sloppy, problems that don't make sense, students being marked down for bad reasons etc. And the course forbids use of chatgpt etc. so it just seems really hypocritical.
which is actually my "Dark AI World" prediction for the next 5-10 years:
a boom of AI to such an extent that everything we do in our lives gets more verbose and it's just AI bots chatting to each other, in each step blowing up the signal with more noise on one side, distilling out the signal at the other end. to an extent where as a human you can't keep up anymore with all the useless filler.
can we just leapfrog (or backtrack) to API's talking to each other please?
I'm waiting for the day when classrooms are retrofitted to be Faraday cages
When I was in masters, I saw someone cheating by putting a book on their desk and looking inside, in an exam that doesn’t allow books. The professor was basically sleeping on his chair.
/s noted, how near is "near"?
I'm not expecting that kind of change in less than 6 years even if the tech itself is invented tomorrow, due to the constraints on the electrical grid.
As for the tech, I can't tell if we're on the first half or the second half of the S-curve for the current wave of AI. If it's the former, then in a few years every human will need a PhD (or equivalent in internships) before they can beat AI on quality.
>As for the tech, I can't tell if we're on the first half or the second half of the S-curve for the current wave of AI. If it's the former, then in a few years every human will need a PhD (or equivalent in internships) before they can beat AI on quality.
Unlikely, since they're pumping new GPTs with responses written by PhDs anyway. It's becoming more and more of a "Wizard of Oz" situation.
Neat hack.
Painfully tedious youtubeisms in that video. The way it is presented I couldn't help but wonder "this isn't how someone who does that thing would tell me they did that thing...".
Unfortunately that’s what it takes to succeed on YouTube.
If the video becomes boring at any point, the average watch duration plummets and Googles algorithm nukes it from orbit
I get what you're saying. I have the same feeling watching DIY Perks.
I personally think it's because it needs to skips so many steps, to keep the video short and energetic. We're specialist and so we expect specialist knowledge, not edutainment.
I’m not quite sure what you mean by YouTubeisms. I assume you mean the breezy, polished presentation? I thought it was a well laid out and enjoyable video. To me, it was an example of superb craftsmanship.
I am totally not criticizing or invalidating your impression of it. But the way information is presented has always fascinated me. Doing it better helps everyone. Would you mind telling me what your version of it would look like?
Here’s another cheat I executed. The ti84 has the same encasing as the ti89. Take the circuit board and buttons out of the ti89 put it in the ti84. Voila you have an integrator. Most teachers in calc allow a ti84 and not a ti89 because the ti89 can do symbolic integration.
I did this cheat way back. It helps but you’re still required to show work on tests so this just verified all my answers. Be sure to clear screen if teacher walks by.
Is the Ti-84 still the gold standard for school calculators? I had an nSpire when I was in school - much higher resolution screen - but most everyone else had a ti-84 or 89. The nSpire was powerful enough to have hacks for it to run full Gameboy games. Many minutes were spent playing Tetris after an exam.
Also interesting that I almost never see any overlap between the Z80 TIs and the greater retrocomputing community. Probably because most retrocomputing enthusiasts are too old to ever have used one. The 82/83 is definitely old enough to qualify as a retrocomputer in it's own right.
The gold standard will depend on what rules the school has for the exams.
The absolute best one you can get right now would probably be a nspire CX CAS ii but I doubt you'd be able to use it in an exam. Even in university, symbolic calculators are typically not allowed in math classes because it's basically like having full access to Wolfram Alpha or Mathematica.
> Is the Ti-84 still the gold standard for school calculators?
When I was in high school (1996-2000), most had a TI-83, with some having a TI-85. I got a TI-89 since it was the best calculator that could be used on the SAT. Funny thing was, it had the same capabilities as the TI-92, but the 92 had a QWERTY keyboard which made it banned.
Nearly same here, 2 years behind you. 83+ had just come out which I think added some Flash memory for Archiving and installing ASM apps (mostly games is what we used that capability for). 85 was out there but uncommon, and the richest or smartest kids had 89s, which were and still are an absolute beast. It blew me away watching people solve equations and simplify expressions on that.
To answer OP though, I think the reason the 84+ (which is or just emulates the old Z80 goodness of the 82/83/83+) is still wildly popular* is that more advanced calculators can easily do a LOT of stuff for you -- right out of the box -- that you're ostensibly there to learn to do yourself, which brings into serious question why bother taking the class in the first place. So teachers would prefer kids to bring a less overpowered calculator to class.
An 89 is basically to say, Calculus AB as a standard 4-function calculator is to 3rd grade math.
None of that is a knock on any of those calculators, though. It's incredible what they can do!
* Let's all take a moment to appreciate the genius of TI repackaging the same 1970s technology in a shiny new case every few years and getting away with -- STILL to this day -- selling them for $150!
>The nSpire was powerful enough to have hacks for it to run full Gameboy games
Oh boy :) you're gonna like this:
https://www.ticalc.org/archives/files/fileinfo/419/41990.htm...
Nspire CX class were powerful enough to run quite a lot of GBA games. And I think the Ti-84 is probably still kicking around because no one really wants to bother buying more overpriced calculators that work just fine. The Z80 TIs are quite interesting in their own right, but a good majority of people are probably bored just thinking about such a device. Same thing with the Z80 based Rabbit 2000/3000/4000.
> Is the Ti-84 still the gold standard for school calculators?
Likely.
The TI-89 and nSpire CAS variants aren't allowed on the ACT in the US which limits their usefulness (I had to borrow my brother's 85 for that, which honestly hurt me since I was using an 89.)
> The nSpire was powerful enough to have hacks for it to run full Gameboy games. Many minutes were spent playing Tetris after an exam.
The TI-89 is a bit of a beast in it's own right. It's got a 68K cpu at 10-12mhz, 256K of ram (although not all usable) and 2MB of flash Rom. Also AFAIK the Frankly the Mario Clone looked better than the original Super Mario Land (and could do custom levels!) Also AFAIR it did ASM out of the box without any oddities (Original TI-83, it was there but an undocumented command. 83+ is I think when asm() became the standard.)
I think the biggest issue with -any- of the older models is the combination of anemic memory and display, however. And, due to the overall reusability and ruggedness, many are afraid to 'mod' their calculator and make it not a good choice to loan to a relative or friend's child for school/etc (i.e. even if unmodded, if it looks like it -was- modded, probably can't use on standardized tests)
Those were also full open source until some time ago, then they switched to source-available for the userland with a closed source kernel to prevent modifications allowing cheating on exams. It’s sad they had to take away freedom from the majority of users just to prevent a minority cheating.
And they run python!
There's even a smartphone (iOS & Android) app to give it a try, but the magic of a calculator comes with tactile buttons.
Wow. The single click to get to the full emulator from that homepage is an awesome, refreshing thing to see. Seems like a great calculator (and company) to standardize on. I don't even hate TI, but this thing is clearly far more advanced than the TIs I grew up on.
If the 84+ was $40 by now I would feel differently, but I think TI could have at least built something like the Numworks (with things like real fraction notation easier menus, and a lighted color screen) if they wanted to continue charging the same price now as they did 25 years ago for what was then a pretty respectable piece of tech for its time. Instead they did that innovation but only on calculators too overpowered to be allowed on tests, and left that market with a stagnant TI-8x series.
It's a shame it doesn't use Giac. RPN CAS forever! ;)
You can run KhiCAS that’s a port of Xcas as a third party add-on, there are some weird limitations but it mostly works.
TI 89 was my goto in college. The algebraic equation solver was pretty good.
I’ve always thought about what student examinations mean post-AI accessibility. We’ve faced a similar problem once students had open access to the internet, but even then there was some work in figuring out what sites are reputable, search queries, etc. Now that burden has been shortened to figuring out what AI tool and what prompt to use for classic exams like essays or tests. Add in the challenge of remote learning and now you have an environment out of your control, not to mention smartphone access prevalently available.
It’s difficult to be an effective teacher, and that’s without even considering the social and economic pressures they face.
It's a shame as well because this stuff -is- important. One could make the argument that this represents a shift in traditional education, and schools will have to stop relying so much on rote memorization, but the reason you need to learn this stuff is so that it's there with you, guiding you through everything you do in your life. Not just "oh I'll look it up", but actually knowing it and carrying it with you in your "context".
The standard education system is incredible for raising the baseline level of knowledge of everyone in a society. I can talk about concepts like "atoms" or "bacteria" or "black holes" with anyone, and they'll know what they are - even if their knowledge of those subjects isn't in depth. Things that 100 years ago would've been cutting edge research, are base education today that virtually the entire population has studied.
That comes from schooling, and it's so important to commit to memory. Without that background knowledge, your understanding of everything around you will be limited in ways you won't even be aware of.
> I can talk about concepts like "atoms" or "bacteria" or "black holes" with anyone, and they'll know what they are - even if their knowledge of those subjects isn't in depth.
I'm not convinced this is an unalloyed good. Knowing that a disease is caused by "bacteria" instead of "demons" isn't really helpful if you don't have a deep understanding of exactly what bacteria is. See, for example, all of the people who want antibiotics whenever they're sick for any reason. We've just replaced one set of weird beliefs in the general populace with another and given it a veneer of science.
> Knowing that a disease is caused by "bacteria" instead of "demons" isn't really helpful if you don't have a deep understanding of exactly what bacteria is.
This is a poor example. Even an incomplete image of the germ theory of disease is a massive improvement over thinking illness is caused by demons. An extremely superficial understanding of bacteria as "microscopic organisms which can make you sick" gives good justification why people should do things like wash their hands, cover their mouth when coughing, and not lick the railing on a subway.
Knowing the difference between bacteria being living organisms and viruses being not-quite-alive does not qualify as a "deep understanding" though.
Further, the presence of people misunderstanding something that most of the population knows pretty well in no way makes teaching that subject to the population bad. Your assertion would require that believing demons cause sickness actually has benefits we've lost.
But more people know what bacteria are at a baseline level and what they do with diseases than before when all we had were demons/bad humors/etc.
There are functionally illiterate people too in modern day and the average reading level is still elementary school level, but that's vastly better than before when the average person couldn't read at all.
The memorization vs reasoning limit may soon be passed with some of these AIs. Really need to do the full controlled testing environment set up to have any chance of avoiding it. No calculators and no home work would be the next step. Maybe we will have a generation of mentats?
>Are K-12 keeping on with remote classes now in the USA?
After COVID many school districts in the US that weren't offering online only school are now. Suddenly they had the capacity to do it as it was forced on them with COVID, so maintain it for students who want it is as easy as anything else.
I would argue that unlike "remote work," where the COVID shift made it clear "hey most of us can just work from home" - the K12 "hack fix" most schools implemented was barely sufficient to get through the year or so that students were forced to stay home. I suspect that most standard public schools would do better to drop this offering altogether and leave it to 3rd party online schools, if such a thing exists and can get enough traction to stay alive.
Calculators and exams are still used after K-12, ~1/20 K-12 students are still taught remotely online in the US in 2023 (it'd be curious to see if that grows or shrinks with time), not all K-12 have instituted bag and equipment checks, the ones that have haven't all done it to the same level, and it may or may not be enough to cover enough of the cases to mitigate impact enough.
I feel like 1:1 teacher and student discussions are required to be sure someone isn't cheating. With the benefit that each exam would be more enlightening than existing test setups.
They both sit together, they chat, answer questions and so on and the teacher gets a feel for "does this student have sufficient knowledge".
Frankly I think it would give teachers way better feel for such things than traditional testing does.
Granted, it would be time intensive, but I also suspect improved.
I like this idea, however I worry that it would be difficult to do it while being consistent (and unbiased). If the same questions are asked of each student then later students might be unfairly prepped. If different questions are asked then it becomes very difficult to normalize scores across the class. The bias risk is self-explanatory and may be unconscious.
If you could solve this problem well, you could also probably fix the issues with most interview processes.
What if teachers have clear favor/disfavour of students?
In the early 2000's, I created TI-83+ applications for solving various introductory physics homework problems — and copied to a few friends' calculators. Ten years later, a friend's little brother randomly quipped "thanks for doing all my physics homework!"
When I saw my own little brother next holiday, he confirmed that his entire physics class had utilized my problem solvers, and most had also played my TI-83+ version of Blackjack.
...memories
A USB MITM board with ESP32 could just connect to your phone & do one-way code/content creation for otherwise software locked devices.
Not sure where you lived but the TI calculators were usually provided by the school district. I’ll never forget those distinctive yellow graphing calculators with the school district engraved on the back. I never bought my own during high school , but I did buy a TI89 for college courses.
Ha. Back in the 90's graphing calculators were not allowed during tests, but normal calculators were... Well there was a model of Casio calculator (can't find the model) which was so diminutive, and with a wide rectangular rather than square screen you never would have assumed it was a graphing calculator. But it was, and it saved my butt on many exams... By now I've forgotten all that basic math, but the ability to program things remained!
In high school my teachers were ok with me writing an app based on the formula sheets on my TI.
Some other students had complained, but the teacher knew I wrote the app and it required me to understand the math and risk my grades if I was wrong.
One teacher in specific said anyone was welcome to learn to program their calculator as long as they wrote it themselves and no two apps should look the same. I remember giving the teacher my app.
I was surprised and thought I might have to delete the app.
Is it even ethical anymore to build "old" devices with large amounts of space sitting behind bulky plastic exteriors?
It lets cheaters put chips into calculators and Israeli spies put explosives into pagers. Should large manufacturers be forced to put electronics into the smallest possible casing, to discourage trying to cram anything else inside?
> to discourage trying to cram anything else inside?
the manufacturers should not be doing anything other than whatever their customers are willing to pay for.
Explosives, or cheats, are unsolvable. People, including exam conductors, will have to either spend the time (and cost) to weed out cheat devices, or accept some level of cheating exists.
Israel replaced the electric components with identically shaped components that were explosive. Removing empty space doesn't solve this.
So many of you are making me feel old.
My cheat was to write the formula for quadratic equations for a TI 57 with its 50 step programming capacity. I just put in the a, b, and c values then R/S (run/stop) and it'd spit out the answers on a red LED display for the high school algebra test I was taking in 1980 as a freshman.
If I wanted to ensure students weren’t using this, I’d require TI-84s and weigh them before the test :P
I doubt the PCBs weigh too much. There's also a variance in battery weights. Testing it real quick my Li-ion AAAs weight 9g, NiCd 10g, and Alkaline 12g. There's also some Li-ions with built-in USB recharging circuits that I don't know how they effect the weight.
So better make sure they remove the batteries too. And who knows about the variances in internals they've done to the TI-84 in its 20 years of production.
Much easier - collect all student TI-84s, neatly labeled for return after the test. Hand out stock ones that already had a full reset completed. Don't bother to announce it until the student shows up for the test.
Students get the reassurance that their TI-84 won't go through a reset.
Schools have extra TI-84s in the back rooms.
HP32SII got me through physics & maths II exams without all the tedious memorisation. It looked innocuous enough - certainly not programmable to the extent it actually was... a godsend for high-school.
I had one of those in middle school c. 1990. It had function and program support. The problem with modifying one of those would be it's physically small and lacks I/O.
Upgraded to an HP 48GX sophomore year of high school. It worked well for math and physics coursework, AP Calculus BC, and the SAT-I math section. The IR serial port's LED was so powerful, there was a learning TV remote app that could control TVs from ~60-100' (20-30m) away. The ability to beam software to other calculators was just shy of the invention of the app store.
In high school in the early 80s I thought I was clever to use an HP41cv to cheat (it was a very expensive calculator but an accessible first programmable computer). It had 2KB memory and ascii capability. Problem was the data entrymethod was so cumbersome that by the time you had entered the stuff you already remembered it. So it was a net zero gain.
At the time though calculators with memory and text were nearly unheard of, so teachers did not even question why there was one on your desk during a french or history exam.
Like top comment, my first exposure to programming was basic on a ti-86 (better than 83, but quickly outdone by 84 shortly after)
My first program was doubly cheating, not only did I have a program for solving quadratic equation, but I copied the basic off the internet in true open src fashion
When I told my dad I copied code from internet, he was so disappointed and thought I had 0 skills. Now, we pip/npm/etc install anything and are heroes for choosing to "buy" not "build"
I used to use my HP-41 to help confirm my results. I wrote numerical integration, differentiation and other solvers for it. I would enter the equations and parameters and then work on the problem by hand. Once done, I could look at the result on the calculator and confirm the probability of my answer being correct within a reasonable degree of certainty (in most cases). I think I learned more this way than by simply memorizing equations.
My HP 48GX screams in RPN nerd rage and jealousy.
It's all because of those add-in cards containing engineering software. ;)
In other news, I have the HP 48GX overhead projector accessory I should dust off and recondition. Also have the thermal printer.
Programmable calculators were not allowed in any of my classes (2000s in europe), I would have loved that.
On the other side, I was programming small applications to cheat on my phone.
Latin was a mandatory class in my computer science oriented course of study (I know, completely bonkers) and 3G data was expensive so I wrote some scripts and scraped every possible latin text and translation I could find online and built a J2ME application (horrible platform, but hey, it works) to lookup text.
I still remember my friend getting pinched using the application because he translated an extra phrase which was not in the assignment but was in the source on the internet. Good times
I knew it was just a matter of time before someone but the bullet and built one of these things
I have super fond memories of high school math classes. That calculator was my first introduction to programming. I’d take the time to write programs for each unit we covered so that I could just input the variables and quickly solve. I had to understand the concept before I could program it so I didn’t really think it was cheating. I did get nervous when SATs came up because I knew my calcs memory would be cleared. I remember my solution was to painstakingly recreate the memory cleared screen and pulled it up before the proctor came around in hopes that they’d assume they already cleared mine.
My programming didn’t improve much after high school but I’m still kind of proud of my not-totally-cheating cheating.