The production bug that made me care about undefined behavior

(gaultier.github.io)

55 points | by birdculture 3 hours ago

9 comments

  • nneonneo 1 hour ago
    Even calling uninitialized data “garbage” is misleading. You might expect that the compiler would just leave out some initialization code and compile the remaining code in the expected way, causing the values to be “whatever was in memory previously”. But no - the compiler can (and absolutely will) optimize by assuming the values are whatever would be most convenient for optimization reasons, even if it would be vanishingly unlikely or even impossible.

    As an example, consider this code (godbolt: https://godbolt.org/z/TrMrYTKG9):

        struct foo {
            unsigned char a, b;
        };
    
        foo make(int x) {
            foo result;
            if (x) {
                result.a = 13;
            } else {
                result.b = 37;
            }
            return result;
        }
    
    At high enough optimization levels, the function compiles to “mov eax, 9485; ret”, which sets both a=13 and b=37 without testing the condition at all - as if both branches of the test were executed. This is perfectly reasonable because the lack of initialization means the values could already have been set that way (even if unlikely), so the compiler just goes ahead and sets them that way. It’s faster!
    • jmgao 6 minutes ago
      There are some even funnier cases like this one: https://gcc.godbolt.org/z/cbscGf8ss

      The compiler sees that foo can only be assigned in one place (that isn't called locally, but could called from other object files linked into the program) and its address never escapes. Since dereferencing a null pointer is UB, it can legally assume that `*foo` is always 42 and optimizes out the variable entirely.

    • quietbritishjim 23 minutes ago
      If I understand it right, in principle the compiler doesn't even need to do that.

      It can just leave the result totally uninitialised. That's because both code paths have undefined behaviour: whichever of result.x or result.y is not set is still copied at "return result" which is undefined behaviour, so the overall function has undefined behaviour either way.

      It could even just replace the function body with abort(), or omit the implementation entirely (even the ret instruction, allowing execution to just fall through to whatever memory happens to follow). Whether any computer does that in practice is another matter.

      • masklinn 17 minutes ago
        > It can just leave the result totally uninitialised. That's because both code paths have undefined behaviour: whichever of result.x or result.y is not set is still copied at "return result" which is undefined behaviour, so the overall function has undefined behaviour either way.

        That is incorrect, per the resolution of DR222 (partially initialized structures) at WG14:

        > This DR asks the question of whether or not struct assignment is well defined when the source of the assignment is a struct, some of whose members have not been given a value. There was consensus that this should be well defined because of common usage, including the standard-specified structure struct tm.

        As long as the caller doesn't read an uninitialised member, it's completely fine.

    • masklinn 13 minutes ago
      Things can get even wonkier if the compiler keeps the values in registers, as two consecutive loads could use different registers based as you say on what's the most convenient for optimisation (register allocation, code density).
    • recursivecaveat 1 hour ago
      Even the notion that uninitialized memory contain values is kind of dangerous. Once you access them you can't reason about what's going to happen at all. Behaviour can happen that's not self-consistent with any value at all: https://godbolt.org/z/adsP4sxMT
    • arrowsmith 1 hour ago
      How is this an "optimization" if the compiled result is incorrect? Why would you design a compiler that can produce errors?
      • Negitivefrags 1 hour ago
        It’s not incorrect.

        The code says that if x is true then a=13 and if it is false than b=37.

        This is the case. Its just that a=13 even if x is false. A thing that the code had nothing to say about, and so the compiler is free to do.

      • tehjoker 1 hour ago
        It's not incorrect. Where is the flaw?
      • throwatdem12311 2 minutes ago
        [dead]
  • panstromek 57 minutes ago
    I have bumped into this myself, too. It's really annoying. The biggest footgun isn't even discussed explicitly and it might be how the error got introduced - it's when the struct goes from POD to non-POD or vice-versa, the rules change, so completely innocent change, like adding a string field, can suddenly create undefined behaviour in unrelated code that was correct previously.
  • fizzynut 42 minutes ago
    Even if you fixed the initialized data problem, this code is still a bug waiting to happen. It should be a single bool in the struct to handle the state for the function as there are only two states that actually make sense.

    succeeded = true; error = true; //This makes no sense

    succeeded = false; error = false; //This makes no sense

    Otherwise if I'm checking a response, I am generally going to check just "succeeded" or "error" and miss one of the two above states that "shouldn't happen", or if I check both it's both a lot of awkward extra code and I'm left with trying to output an error for a state that again makes no sense.

    • deepsun 32 minutes ago
      It happens often when "error" field is not a bool, but a string, aka error_message. Could be empty string, or _null_, or even _undefined_ if we're in JS.

      Then the obvious question why do we need _succeeded_ at all, if we can always check for _error_. Sometimes it can be useful, when the server doesn't know itself if the operation is succeeded (e.g. an IO/database operation timed out), so it might be succeeded, but should also show an error message to user.

      Another possibility if the succeeded is not a bool, but, say, "succeeded_at" timestamp. In general, I noticed that almost always any boolean value in database can be replaced with a timestamp or an error code.

  • MutableLambda 47 minutes ago
    Yeah, looks pretty straightforward to me, but I used to write C++ for a living. I mean, there are complicated cases in C++ starting with C++11, this one is not really one of them. Just init the fields to false. Most of these cases is just C++ trying to bring in new features without breaking legacy code, it has become pretty difficult to keep up with it all.
  • mac3n 1 hour ago
    Many years had a customer complaint about undefined data changing value in Fortran 77. It turned out that the compiler never allocated storage for uninitialized variables, so it was aliased to something else.

    Compiler was changed to allocate storage for any referenced varibles.

  • vhantz 1 hour ago
    The two fields in the struct are expected to be false unless changed, then initialize them as such. Nothing is gained by leaving it to the compiler, and a lot is lost.
    • gwd 1 hour ago
      I think the point is that sometimes variables are defined by the language spec as initialized to zero, and sometimes they aren't.

      Perhaps what you mean is, "Nothing is to be gained by relying on the language spec to initialize things to zero, and a lot is lost"; I'd agree with that.

      • vhantz 1 hour ago
        Please don't be pedantic. Compilers implement the standard, otherwise it's just a text document.
  • kayo_20211030 1 hour ago
    Great post. It was both funny and humble. Of course, it probably wasn't at all funny at the time.
  • titzer 2 hours ago
    tldr; the UB was reading uninitialized data in a struct. The C++ rules for when default initialization occurs are crazy complex.

    I think a sanitizer probably would have caught this, but IMHO this is the language's fault.

    Hopefully future versions of C++ will mandate default initialization for all cases that are UB today and we can be free of this class of bug.

    • torstenvl 2 hours ago
      Yeah... but I wouldn't characterize the bug itself (in its essential form) as UB.

      Even if the implementation specified that the data would be indeterminate depending on what existed in that memory location previously, the bug would still exist.

      Even if you hand-coded this in assembly, the bug would still exist.

      The essence of the bug is uninitialized data being garbage. That's always gonna be a latent bug, regardless of whether the behavior is defined in an ISO standard.

      • forrestthewoods 1 hour ago
        Yeah I agree. This is a classic “uninitialized variable has garbage memory value” bug. But it is not a “undefined nasal demons behavior” bug.

        That said, we all learn this one! I spent like two weeks debugging a super rare desync bug in a multiplayer game with a P2P lockstep synchronous architecture.

        Suffice to say I am now a zealot about providing default values all the time. Thankfully it’s a lot easier since C++11 came out and lets you define default values at the declaration site!

        • titzer 1 hour ago
          I prefer language constructs define that new storage is zero-initialized. It doesn't prevent all bugs (i.e. application logic bugs) but at least gives deterministic results. These days it's zero cost for local variables and near-zero cost for fields. This is the case in Virgil.
          • andrewaylett 43 minutes ago
            That makes things worse if all-zero is not a valid value for the datatype. I'd much prefer a set-up that requires you to initialise explicitly. Rust, for example, has a `Default` trait that you can implement if there is a sensible default, which may well be all-zero. It also has a `MaybeUninit` holder which doesn't do any initialisation, but needs an `unsafe` to extract the value once you've made sure it's OK. But if you don't have a suitable default, and don't want/need to use `unsafe`, you have to supply all the values.
          • kevin_thibedeau 1 hour ago
            C & C++ run on systems where it may not be zero cost. If you need low latency startup it could be a liability to zero out large chunks of memory.
            • ablob 11 minutes ago
              I think it's acceptable to leave an escape hatch for these situations instead of leaving it to easy to misunderstand nooks and crannies of the standard.

              You don't want to zero out the memory? Slap a "foo = uninitialized" in there to have that exact behavior and get the here be demons sign for free.

    • trueismywork 2 hours ago
      For now, best strategy is to initialize everything explicitly.
  • inglor_cz 53 minutes ago
    Symbian's way of avoiding this was to use a class called CBase to derive from. CBase would memset the entire allocated memory for the object to binary zeros, thus zeroizing any member variable.

    And by convention, all classes derived from CBase would start their name with C, so something like CHash or CRectangle.