submitted 2 years ago* (last edited 2 years ago) by [M] to c/softwaregore@lemmy.world
 

Reminds me of the Therac-25 incident..

top 50 comments

sorted by: hot top controversial new old
[–] 193 points 2 years ago (1 child)

Jesus. QA is not a corner you should cut when it's literally life and death.

  • source
  • hideshow 2 child comments
  • [–] 55 points 2 years ago* (last edited 2 years ago) (5 children)

    So uh… as someone who works in biotech and understands exactly what level of rigor is required before the FDA allows you to sell a medical device - a term that has specific legal definition, regulations, and restrictions, I’m a bit suspicious this could be fake. This sort of error would indicate a systemic error and abrogation of due diligence at at least 4 different levels, and would be an apocalyptically huge lawsuit.

    Edit: I stand corrected - lots of people are corroborating this whole thing. That’s kind of astounding, tbh.

  • source
  • parent
  • hideshow 10 child comments
  • [–] 67 points 2 years ago (2 children)
  • [–] 50 points 2 years ago (1 child)

    β€œand would be an apocalyptically huge lawsuit.”

    Apocalyptically huge lawsuit, here we come!!!

  • source
  • parent
  • hideshow 2 child comments
  • [–] 56 points 2 years ago

    Not fake. I'm a type 1 diabetic on this version of Omnipod and have noticed this before as well as other issues. I also had the app refuse to let me close an innocuous error modal window to activate a pod while I was in another country.

    While I love the hardware, the software feels precisely like it has been outsourced to a team with no knowledge of what T1 is and whoever internally is greenlighting the changes isn't properly testing.

    The newest officially supported phone is the S21.

  • source
  • parent
  • [–] 27 points 2 years ago

    There is a video demo of the bug later on the thread.

    Some android devices have a combination .- key on the numeric input UI. This is a contentious enough design choice to have stackoverflow threads on it. That combo key style is what's used by the device and version shown on the demo. It appears that the device is reading that combo key as - and discarding (or taking absolute value), and not as a leading decimal.

  • source
  • parent
  • [–] 167 points 2 years ago (1 child)

    I quit Insulet (I was the principal software dev for Android on OP5) because management didn't care about this kind of thing. I couldn't stay in good confidence.

  • source
  • hideshow 2 child comments
  • [–] 125 points 2 years ago* (last edited 2 years ago) (1 child)

    A story from a type 1 diabetic:

    I had what we will call "an incident" where I took pretty close to this scale of extra insulin. I'm a much heavier insulin user but it varies greatly between people and the kind of person who is dosing fractions of a unit like 0.15 turning into 15 would be a massive problem. It took about an hour for me to get to the hospital and I seemed just fine at that point. I don't know why because usually the type of insulin I use hits it's peak within an hour for me. My only guess is that my body was overwhelmed and somehow delayed my reaction to it, which I've never seen before.

    I got into the ER and they were very casual about it. From my past experience in medicine I'm guessing they weren't sure if it really happened and wanted to see how it played out. My blood sugar was somewhere around 100 when they first tested me. 5 minutes later it was in the 40s. At that point the nurse said "oh fuck!" and sprinted to grab D50 (basically a sugar infusion) from where they keep their meds. I have been a paramedic (not just an EMT) and I can count the number of times I've seen a nurse run on my fingers.

    They started an IV in both arms and were pumping sugar in to keep me alive. My memory gets kinda hazy after that. They kept checking my blood for potassium levels because burning through that much insulin + glucose uses it up and can stop your heart. Eventually they had to start a central line (like an IV but straight into your heart) in my neck to deliver insulin because they were worried all the sugar they were giving in both arms would burn my arm veins. I remember the feeling when they started it and used a probe to see if it was in the right place the "tickling" feeling literally in my heart. I ended up in the ICU on 1-to-1 with a nurse because they had to monitor me so closely. If I had been later to the ER by 10-15 minutes I wouldn't be telling you this story. I also had the benefit of knowing what happened ahead of time, which you would not if your pump magically multiplied your dose by 100 and you didn't notice.

    All this to say, this is pretty fucking serious.

  • source
  • hideshow 2 child comments
  • [–] 30 points 2 years ago* (last edited 2 years ago)

    Am a medic. Had a similar call, but dude ended up having a rare tumor on his pancreas called and insulinoma. They produce and hold a bunch of insulin and can occasionally rupture and flood your system with insulin. Ofcourse we didn't Know he had one at the time.

    We had a non Diabetic PT that we found with a glucose that just read low. So 30< with our glucometers. Dumped 100 of d20 into him with absolutely no changes. Ended up infusing 4 more bags of d20 into him during transport. Got him up to like 80 and then watched him become unresponsive again 5 min later. Checked again and found it to be back to 40. He was in a room a few min later. Normally Im glad we don't cary d50 anymore that shit was like using a sledge hammer to hammer in a tack nail. But this was the one time d20 wasn't cutting it.

    Anyways, glad you are alive. Shit can be scary.

  • source
  • parent
  • [–] 77 points 2 years ago*

    So if I understand it, a bug has been identified that's potentially going to make diabetics OD on insulin and die.

    That's fucked.

  • source
  • [–] 70 points 2 years ago (1 child)

    FDA: we have rigorously tested the pump and have found no issues.

    Public What about the app, which can control the pump and was written by the lowest bidder with no QA department?

    FDA: We have no jurisdiction over phone apps, due to the legislation that gives us jurisdiction over pumps being from the 70s. I guess, just don't use the app?

  • source
  • hideshow 2 child comments
  • [–] 63 points 2 years ago* (30 children)

    This, right here, is why "professional" software "engineers" should be licensed.

  • source
  • hideshow 32 child comments
  • [–] 21 points 2 years ago (1 child)

    Former healthcare to software engineer working on a master's here. My colleagues who were licensed back in healthcare weren't all of the same quality. They all made mistakes at one point or another, some pretty bad some minor. There's no difference though, minor could just as well become major.

    The way they get around it in healthcare is by throwing more people at the problem. You have a physician who is good at pointing in the general direction of the problem and a solution, then you have all the auxiliary staff who will narrow down on the solution based on their field. But at any single point all of them could fuck up, or one of them could.

    Now that I'm a software engineer and I've written enough code to do stuff. I can confidently say that licensing will not solve this problem. Especially if there aren't enough people involved. Which is probably what was missed in the beginning.

    Anyway long rant over.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 11 points 2 years ago (3 children)

    Licensing isn't about magically ensuring that the practitioner won't make mistakes; it's about holding the practitioner accountable for his mistakes, which in theory gives him more incentive to be more careful -- or to change his practice's workflows and systems so as to be better able to detect and correct mistakes.

    In fact, I would argue that the "throwing more people at the problem" phenomenon in healthcare is an example of that very thing. Do you think they'd keep staffing levels equally high without licensing? 'Cause I sure don't.

  • source
  • parent
  • hideshow 3 child comments
  • load more comments (3 replies)
  • load more comments (28 replies)
    [–] 58 points 2 years ago (1 child)

    Christ Almighty this is the dystopian software future that my college computer science ethics professor was working so hard to delay.

  • source
  • hideshow 2 child comments
  • [–] 55 points 2 years ago (3 children)
  • [–] 34 points 2 years ago (1 child)

    It looks like the advisory/recall notice came out (depending on time zones) either before his posts or shortly thereafter.

    Looks like the company has jumped on this right away as they should.

    They have several non app solutions for bolus dosing. Looks like the app is new (iOS version isn't even out yet) and they didn't vet their consultants output adequately. Probably because this was some quick port that was outsourced and management didn't pay attention because 'requirements are the same'.

    Super important in med device development to have adequate internal oversight of developers to ensure requirements are properly rigorously tested. Especially in a class III device like this

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (1 reply)
  • [–] 30 points 2 years ago (1 child)

    Life saving info, only available in the US.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 37 points 2 years ago

    Sounds like the FDA should be involved here somehow..

  • source
  • [–] 35 points 2 years ago (9 children)

    As a diabetic, holy fucking shit! I've been on the fence about getting a pump because it's just one more thing that can fail.

  • source
  • hideshow 9 child comments
  • load more comments (9 replies)
    [–] 35 points 2 years ago (4 children)

    Thanks to Bush II, medical device manufacturers are immune to class action lawsuits!

    Yay Capitalism!

    My Dad had the leads on his pacemaker fail and caused his heart to be repeatedly and continuously shocked.

    Leads were replaced but guess who paid for that?

    It wasn't the manufacturer!

  • source
  • hideshow 4 child comments
  • load more comments (4 replies)
    [–] 32 points 2 years ago

    "But why would you do those steps in that order?" - The programmers, probably.

    I'm wondering if the field where you input the insulin amount is the same as you input the carbs, as that'd easily explain the bug. Reuse of the same field without proper checks can easily lead to... "Funny" results. If the carbs and insulin fields are completely separate, then that's some very weird math bug they've put in there, somehow.

  • source
  • [–] 30 points 2 years ago (1 child)

    part of the reason why the pharmaceutical industry is pretty rough and requires several verifications, as it only takes one mistake to be a fatal one.

  • source
  • hideshow 2 child comments
  • [–] 28 points 2 years ago (1 child)

    can anyone with more insight explain what checks and balances had to have failed for this to make it to the field? i understand that this is like obviously potentially lethal but i don't really know how this kind of thing would normally be prevented.

  • source
  • hideshow 2 child comments
  • [–] 25 points 2 years ago* (last edited 2 years ago)

    Usually something in the testing process, or perhaps the testing process itself is lacking. For medical applications it should be pretty rigorous as the consequences if something slips through can be very bad.

    If this is a new feature, then every step of the process designed to make sure it works failed. Which those are precisely will depend on the project, it could mean that multiple devs and QA had a look and either missed it or didn't think to test for it. Where I work the developer implementing a feature tests it, then 2 other developers review the code, one of them also tests it, then it goes to dedicated QA who will test it more in depth and also do regression tests (checking that existing functionality still works). The testing QA member also checks with another QA member about anything they may have missed in their test steps. But this can vary heavily, also depending on the general model of development cycle (agile or waterfall) etc - though I'm working on much less critical software, no ones going to get injured even if nothing works correctly.

    If the bug was introduced through an update to this or another feature, their regression tests might be lacking.

    It's also possible (though imo extremely negligient for such an application) that they don't have dedicated QA in the first place, and even don't require their devs to test comprehensively in place of dedicated QA.

    Or, they found the bug, but management didn't want to allocate the resources to fix it.

    Imo something like this slipping through shows negligience of some form, it's impossible to guarantee bug-free software, but this is not some obscure, hard to reproduce error.

  • source
  • parent
  • [–] 10 points 2 years ago

    That reminds me of that one Hacknet contract

  • source
  • [–] 8 points 2 years ago

    This is not a mundane detail, Michael!

  • source
  • load more comments
    view more: next β€Ί