▲ 365 ▼ "participants who had access to an AI assistant wrote significantly less secure code" and "were also more likely to believe they wrote secure code" - 2023 Stanford University study published at CCS23 (arxiv.org) submitted 2 years ago by cypherpunks@lemmy.ml to c/technology@lemmy.ml 38 comments fedilink hide all child comments
[–] Nomecks@lemmy.ca 16 points 2 years ago (2 children) No worries, the properly implemented CI/CD pipelines will catch the bad code! permalink fedilink source hideshow 4 child comments replies: [–] azimir@lemmy.ml 17 points 2 years ago (1 child) I had a student came into office hours asking why their program got a bad grade. I looked and it didn't actually do anything related to the assignment. Upon further query, they objected saying that the CI pipeline built it just fine. So ..yeah... You can write a program that builds and runs, but doesn't do the required tasks, which makes it wrong. This was not a concept they'd figured out yet. permalink fedilink source parent hideshow 2 child comments replies: [–] Arcka@midwest.social 9 points 2 years ago Shouldn't the pipeline have failed unless the functional tests passed? permalink fedilink source parent [–] Hasherm0n@lemmy.world 7 points 2 years ago Until you find out those were also built by a junior using an llm to help 🙃 permalink fedilink source parent
[–] azimir@lemmy.ml 17 points 2 years ago (1 child) I had a student came into office hours asking why their program got a bad grade. I looked and it didn't actually do anything related to the assignment. Upon further query, they objected saying that the CI pipeline built it just fine. So ..yeah... You can write a program that builds and runs, but doesn't do the required tasks, which makes it wrong. This was not a concept they'd figured out yet. permalink fedilink source parent hideshow 2 child comments replies: [–] Arcka@midwest.social 9 points 2 years ago Shouldn't the pipeline have failed unless the functional tests passed? permalink fedilink source parent
[–] Arcka@midwest.social 9 points 2 years ago Shouldn't the pipeline have failed unless the functional tests passed? permalink fedilink source parent
[–] Hasherm0n@lemmy.world 7 points 2 years ago Until you find out those were also built by a junior using an llm to help 🙃 permalink fedilink source parent