ecb - Man Page

LIBECB - e-C-Builtins

About Libecb

Libecb is currently a simple header file that doesn't require any configuration to use or include in your project.

It's part of the e-suite of libraries, other members of which include libev and libeio.

Its homepage can be found here:

    http://software.schmorp.de/pkg/libecb

It mainly provides a number of wrappers around many compiler built-ins, together with replacement functions for other compilers. In addition to this, it provides a number of other low-level C utilities, such as endianness detection, byte swapping or bit rotations.

Or in other words, things that should be built into any standard C system, but aren't, implemented as efficient as possible with GCC (clang, MSVC...), and still correct with other compilers.

More might come.

About the Header

At the moment, all you have to do is copy ecb.h somewhere where your compiler can find it and include it:

   #include <ecb.h>

The header should work fine for both C and C++ compilation, and gives you all of inttypes.h in addition to the ECB symbols.

There are currently no object files to link to - future versions might come with an (optional) object code library to link against, to reduce code size or gain access to additional features.

It also currently includes everything from inttypes.h.

About This Manual / Conventions

This manual mainly describes each (public) function available after including the ecb.h header. The header might define other symbols than these, but these are not part of the public API, and not supported in any way.

When the manual mentions a "function" then this could be defined either as as inline function, a macro, or an external symbol.

When functions use a concrete standard type, such as int or uint32_t, then the corresponding function works only with that type. If only a generic name is used (expr, cond, value and so on), then the corresponding function relies on C to implement the correct types, and is usually implemented as a macro. Specifically, a "bool" in this manual refers to any kind of boolean value, not a specific type.

Types / Type Support

ecb.h makes sure that the following types are defined (in the expected way):

   int8_t       uint8_
   int16_t      uint16_t
   int32_t      uint32_
   int64_t      uint64_t
   int_fast8_t  uint_fast8_t
   int_fast16_t uint_fast16_t
   int_fast32_t uint_fast32_t
   int_fast64_t uint_fast64_t
   intptr_t     uintptr_t

The macro ECB_PTRSIZE is defined to the size of a pointer on this platform (currently 4 or 8) and can be used in preprocessor expressions.

For ptrdiff_t and size_t use stddef.h/cstddef.

Language/Environment/Compiler Versions

All the following symbols expand to an expression that can be tested in preprocessor instructions as well as treated as a boolean (use !! to ensure it's either 0 or 1 if you need that).

ECB_C

True if the implementation defines the __STDC__ macro to a true value, while not claiming to be C++, i..e C, but not C++.

ECB_C99

True if the implementation claims to be compliant to C99 (ISO/IEC 9899:1999) or any later version, while not claiming to be C++.

Note that later versions (ECB_C11) remove core features again (for example, variable length arrays).

ECB_C11, ECB_C17

True if the implementation claims to be compliant to C11/C17 (ISO/IEC 9899:2011, :20187) or any later version, while not claiming to be C++.

ECB_CPP

True if the implementation defines the __cplusplus__ macro to a true value, which is typically true for C++ compilers.

ECB_CPP11, ECB_CPP14, ECB_CPP17

True if the implementation claims to be compliant to C++11/C++14/C++17 (ISO/IEC 14882:2011, :2014, :2017) or any later version.

Note that many C++20 features will likely have their own feature test macros (see e.g. <http://eel.is/c++draft/cpp.predefined#1.8>).

ECB_OPTIMIZE_SIZE

Is 1 when the compiler optimizes for size, 0 otherwise. This symbol can also be defined before including ecb.h, in which case it will be unchanged.

ECB_GCC_VERSION (major, minor)

Expands to a true value (suitable for testing by the preprocessor) if the compiler used is GNU C and the version is the given version, or higher.

This macro tries to return false on compilers that claim to be GCC compatible but aren't.

ECB_EXTERN_C

Expands to extern "C" in C++, and a simple extern in C.

This can be used to declare a single external C function:

   ECB_EXTERN_C int printf (const char *format, ...);
ECB_EXTERN_C_BEG / ECB_EXTERN_C_END

These two macros can be used to wrap multiple extern "C" definitions - they expand to nothing in C.

They are most useful in header files:

   ECB_EXTERN_C_BEG

   int mycfun1 (int x);
   int mycfun2 (int x);

   ECB_EXTERN_C_END
ECB_STDFP

If this evaluates to a true value (suitable for testing by the preprocessor), then float and double use IEEE 754 single/binary32 and double/binary64 representations internally and the endianness of both types match the endianness of uint32_t and uint64_t.

This means you can just copy the bits of a float (or double) to an uint32_t (or uint64_t) and get the raw IEEE 754 bit representation without having to think about format or endianness.

This is true for basically all modern platforms, although ecb.h might not be able to deduce this correctly everywhere and might err on the safe side.

ECB_64BIT_NATIVE

Evaluates to a true value (suitable for both preprocessor and C code testing) if 64 bit integer types on this architecture are evaluated "natively", that is, with similar speeds as 32 bit integers. While 64 bit integer support is very common (and in fact required by libecb), 32 bit CPUs have to emulate operations on them, so you might want to avoid them.

ECB_AMD64, ECB_AMD64_X32

These two macros are defined to 1 on the x86_64/amd64 ABI and the X32 ABI, respectively, and undefined elsewhere.

The designers of the new X32 ABI for some inexplicable reason decided to make it look exactly like amd64, even though it's completely incompatible to that ABI, breaking about every piece of software that assumed that __x86_64 stands for, well, the x86-64 ABI, making these macros necessary.

Macro Trickery

ECB_CONCAT (a, b)

Expands any macros in a and b, then concatenates the result to form a single token. This is mainly useful to form identifiers from components, e.g.:

   #define S1 str
   #define S2 cpy

   ECB_CONCAT (S1, S2)(dst, src); // == strcpy (dst, src);
ECB_STRINGIFY (arg)

Expands any macros in arg and returns the stringified version of it. This is mainly useful to get the contents of a macro in string form, e.g.:

   #define SQL_LIMIT 100
   sql_exec ("select * from table limit " ECB_STRINGIFY (SQL_LIMIT));
ECB_STRINGIFY_EXPR (expr)

Like ECB_STRINGIFY, but additionally evaluates expr to make sure it is a valid expression. This is useful to catch typos or cases where the macro isn't available:

   #include <errno.h>

   ECB_STRINGIFY      (EDOM); // "33" (on my system at least)
   ECB_STRINGIFY_EXPR (EDOM); // "33"

   // now imagine we had a typo:

   ECB_STRINGIFY      (EDAM); // "EDAM"
   ECB_STRINGIFY_EXPR (EDAM); // error: EDAM undefined

Attributes

A major part of libecb deals with additional attributes that can be assigned to functions, variables and sometimes even types - much like const or volatile in C. They are implemented using either GCC attributes or other compiler/language specific features. Attributes declarations must be put before the whole declaration:

   ecb_const int mysqrt (int a);
   ecb_unused int i;
ecb_unused

Marks a function or a variable as "unused", which simply suppresses a warning by the compiler when it detects it as unused. This is useful when you e.g. declare a variable but do not always use it:

  {
    ecb_unused int var;

    #ifdef SOMECONDITION
       var = ...;
       return var;
    #else
       return 0;
    #endif
  }
ecb_deprecated

Similar to ecb_unused, but marks a function, variable or type as deprecated. This makes some compilers warn when the type is used.

ecb_deprecated_message (message)

Same as ecb_deprecated, but if possible, the specified diagnostic is used instead of a generic depreciation message when the object is being used.

ecb_inline

Expands either to (a compiler-specific equivalent of) static inline or to just static, if inline isn't supported. It should be used to declare functions that should be inlined, for code size or speed reasons.

Example: inline this function, it surely will reduce code size.

   ecb_inline int
   negmul (int a, int b)
   {
     return - (a * b);
   }
ecb_noinline

Prevents a function from being inlined - it might be optimised away, but not inlined into other functions. This is useful if you know your function is rarely called and large enough for inlining not to be helpful.

ecb_noreturn

Marks a function as "not returning, ever". Some typical functions that don't return are exit or abort (which really works hard to not return), and now you can make your own:

   ecb_noreturn void
   my_abort (const char *errline)
   {
     puts (errline);
     abort ();
   }

In this case, the compiler would probably be smart enough to deduce it on its own, so this is mainly useful for declarations.

ecb_restrict

Expands to the restrict keyword or equivalent on compilers that support them, and to nothing on others. Must be specified on a pointer type or an array index to indicate that the memory doesn't alias with any other restricted pointer in the same scope.

Example: multiply a vector, and allow the compiler to parallelise the loop, because it knows it doesn't overwrite input values.

   void
   multiply (ecb_restrict float *src,
             ecb_restrict float *dst,
             int len, float factor)
   {
     int i;

     for (i = 0; i < len; ++i)
       dst [i] = src [i] * factor;
   }
ecb_const

Declares that the function only depends on the values of its arguments, much like a mathematical function. It specifically does not read or write any memory any arguments might point to, global variables, or call any non-const functions. It also must not have any side effects.

Such a function can be optimised much more aggressively by the compiler - for example, multiple calls with the same arguments can be optimised into a single call, which wouldn't be possible if the compiler would have to expect any side effects.

It is best suited for functions in the sense of mathematical functions, such as a function returning the square root of its input argument.

Not suited would be a function that calculates the hash of some memory area you pass in, prints some messages or looks at a global variable to decide on rounding.

See ecb_pure for a slightly less restrictive class of functions.

ecb_pure

Similar to ecb_const, declares a function that has no side effects. Unlike ecb_const, the function is allowed to examine global variables and any other memory areas (such as the ones passed to it via pointers).

While these functions cannot be optimised as aggressively as ecb_const functions, they can still be optimised away in many occasions, and the compiler has more freedom in moving calls to them around.

Typical examples for such functions would be strlen or memcmp. A function that calculates the MD5 sum of some input and updates some MD5 state passed as argument would NOT be pure, however, as it would modify some memory area that is not the return value.

ecb_hot

This declares a function as "hot" with regards to the cache - the function is used so often, that it is very beneficial to keep it in the cache if possible.

The compiler reacts by trying to place hot functions near to each other in memory.

Whether a function is hot or not often depends on the whole program, and less on the function itself. ecb_cold is likely more useful in practise.

ecb_cold

The opposite of ecb_hot - declares a function as "cold" with regards to the cache, or in other words, this function is not called often, or not at speed-critical times, and keeping it in the cache might be a waste of said cache.

In addition to placing cold functions together (or at least away from hot functions), this knowledge can be used in other ways, for example, the function will be optimised for size, as opposed to speed, and code paths leading to calls to those functions can automatically be marked as if ecb_expect_false had been used to reach them.

Good examples for such functions would be error reporting functions, or functions only called in exceptional or rare cases.

ecb_artificial

Declares the function as "artificial", in this case meaning that this function is not really meant to be a function, but more like an accessor - many methods in C++ classes are mere accessor functions, and having a crash reported in such a method, or single-stepping through them, is not usually so helpful, especially when it's inlined to just a few instructions.

Marking them as artificial will instruct the debugger about just this, leading to happier debugging and thus happier lives.

Example: in some kind of smart-pointer class, mark the pointer accessor as artificial, so that the whole class acts more like a pointer and less like some C++ abstraction monster.

  template<typename T>
  struct my_smart_ptr
  {
    T *value;

    ecb_artificial
    operator T *()
    {
      return value;
    }
  };

Optimisation Hints

bool ecb_is_constant (expr)

Returns true iff the expression can be deduced to be a compile-time constant, and false otherwise.

For example, when you have a rndm16 function that returns a 16 bit random number, and you have a function that maps this to a range from 0..n-1, then you could use this inline function in a header file:

  ecb_inline uint32_t
  rndm (uint32_t n)
  {
    return (n * (uint32_t)rndm16 ()) >> 16;
  }

However, for powers of two, you could use a normal mask, but that is only worth it if, at compile time, you can detect this case. This is the case when the passed number is a constant and also a power of two (n & (n - 1) == 0):

  ecb_inline uint32_t
  rndm (uint32_t n)
  {
    return is_constant (n) && !(n & (n - 1))
      ? rndm16 () & (num - 1)
      : (n * (uint32_t)rndm16 ()) >> 16;
  }
ecb_expect (expr, value)

Evaluates expr and returns it. In addition, it tells the compiler that the expr evaluates to value a lot, which can be used for static branch optimisations.

Usually, you want to use the more intuitive ecb_expect_true and ecb_expect_false functions instead.

bool ecb_expect_true (cond)
bool ecb_expect_false (cond)

These two functions expect a expression that is true or false and return 1 or 0, respectively, so when used in the condition of an if or other conditional statement, it will not change the program:

  /* these two do the same thing */
  if (some_condition) ...;
  if (ecb_expect_true (some_condition)) ...;

However, by using ecb_expect_true, you tell the compiler that the condition is likely to be true (and for ecb_expect_false, that it is unlikely to be true).

For example, when you check for a null pointer and expect this to be a rare, exceptional, case, then use ecb_expect_false:

  void my_free (void *ptr)
  {
    if (ecb_expect_false (ptr == 0))
      return;
  }

Consequent use of these functions to mark away exceptional cases or to tell the compiler what the hot path through a function is can increase performance considerably.

You might know these functions under the name likely and unlikely - while these are common aliases, we find that the expect name is easier to understand when quickly skimming code. If you wish, you can use ecb_likely instead of ecb_expect_true and ecb_unlikely instead of ecb_expect_false - these are simply aliases.

A very good example is in a function that reserves more space for some memory block (for example, inside an implementation of a string stream) - each time something is added, you have to check for a buffer overrun, but you expect that most checks will turn out to be false:

  /* make sure we have "size" extra room in our buffer */
  ecb_inline void
  reserve (int size)
  {
    if (ecb_expect_false (current + size > end))
      real_reserve_method (size); /* presumably noinline */
  }
ecb_assume (cond)

Tries to tell the compiler that some condition is true, even if it's not obvious. This is not a function, but a statement: it cannot be used in another expression.

This can be used to teach the compiler about invariants or other conditions that might improve code generation, but which are impossible to deduce form the code itself.

For example, the example reservation function from the ecb_expect_false description could be written thus (only ecb_assume was added):

  ecb_inline void
  reserve (int size)
  {
    if (ecb_expect_false (current + size > end))
      real_reserve_method (size); /* presumably noinline */

    ecb_assume (current + size <= end);
  }

If you then call this function twice, like this:

  reserve (10);
  reserve (1);

Then the compiler might be able to optimise out the second call completely, as it knows that current + 1 > end is false and the call will never be executed.

ecb_unreachable ()

This function does nothing itself, except tell the compiler that it will never be executed. Apart from suppressing a warning in some cases, this function can be used to implement ecb_assume or similar functionality.

ecb_prefetch (addr, rw, locality)

Tells the compiler to try to prefetch memory at the given address for either reading (rw = 0) or writing (rw = 1). A locality of 0 means that there will only be one access later, 3 means that the data will likely be accessed very often, and values in between mean something... in between. The memory pointed to by the address does not need to be accessible (it could be a null pointer for example), but rw and locality must be compile-time constants.

This is a statement, not a function: you cannot use it as part of an expression.

An obvious way to use this is to prefetch some data far away, in a big array you loop over. This prefetches memory some 128 array elements later, in the hope that it will be ready when the CPU arrives at that location.

  int sum = 0;

  for (i = 0; i < N; ++i)
    {
      sum += arr [i]
      ecb_prefetch (arr + i + 128, 0, 0);
    }

It's hard to predict how far to prefetch, and most CPUs that can prefetch are often good enough to predict this kind of behaviour themselves. It gets more interesting with linked lists, especially when you do some fair processing on each list element:

  for (node *n = start; n; n = n->next)
    {
      ecb_prefetch (n->next, 0, 0);
      ... do medium amount of work with *n
    }

After processing the node, (part of) the next node might already be in cache.

Bit Fiddling / Bit Wizardry

bool ecb_big_endian ()
bool ecb_little_endian ()

These two functions return true if the byte order is big endian (most-significant byte first) or little endian (least-significant byte first) respectively.

On systems that are neither, their return values are unspecified.

int ecb_ctz32 (uint32_t x)
int ecb_ctz64 (uint64_t x)
int ecb_ctz (T x) [C++]

Returns the index of the least significant bit set in x (or equivalently the number of bits set to 0 before the least significant bit set), starting from 0. If x is 0 the result is undefined.

For smaller types than uint32_t you can safely use ecb_ctz32.

The overloaded C++ ecb_ctz function supports uint8_t, uint16_t, uint32_t and uint64_t types.

For example:

  ecb_ctz32 (3) = 0
  ecb_ctz32 (6) = 1
int ecb_clz32 (uint32_t x)
int ecb_clz64 (uint64_t x)

Counts the number of leading zero bits in x. If x is 0 the result is undefined.

It is often simpler to use one of the ecb_ld* functions instead, whose result only depends on the value and not the size of the type. This is also the reason why there is no C++ overload.

For example:

  ecb_clz32 (3) = 30
  ecb_clz32 (6) = 29
bool ecb_is_pot32 (uint32_t x)
bool ecb_is_pot64 (uint32_t x)
bool ecb_is_pot (T x) [C++]

Returns true iff x is a power of two or x == 0.

For smaller types than uint32_t you can safely use ecb_is_pot32.

The overloaded C++ ecb_is_pot function supports uint8_t, uint16_t, uint32_t and uint64_t types.

int ecb_ld32 (uint32_t x)
int ecb_ld64 (uint64_t x)
int ecb_ld64 (T x) [C++]

Returns the index of the most significant bit set in x, or the number of digits the number requires in binary (so that 2**ld <= x < 2**(ld+1)). If x is 0 the result is undefined. A common use case is to compute the integer binary logarithm, i.e. floor (log2 (n)), for example to see how many bits a certain number requires to be encoded.

This function is similar to the "count leading zero bits" function, except that that one returns how many zero bits are "in front" of the number (in the given data type), while ecb_ld returns how many bits the number itself requires.

For smaller types than uint32_t you can safely use ecb_ld32.

The overloaded C++ ecb_ld function supports uint8_t, uint16_t, uint32_t and uint64_t types.

int ecb_popcount32 (uint32_t x)
int ecb_popcount64 (uint64_t x)
int ecb_popcount (T x) [C++]

Returns the number of bits set to 1 in x.

For smaller types than uint32_t you can safely use ecb_popcount32.

The overloaded C++ ecb_popcount function supports uint8_t, uint16_t, uint32_t and uint64_t types.

For example:

  ecb_popcount32 (7) = 3
  ecb_popcount32 (255) = 8
uint8_t  ecb_bitrev8  (uint8_t  x)
uint16_t ecb_bitrev16 (uint16_t x)
uint32_t ecb_bitrev32 (uint32_t x)
T ecb_bitrev (T x) [C++]

Reverses the bits in x, i.e. the MSB becomes the LSB, MSB-1 becomes LSB+1 and so on.

The overloaded C++ ecb_bitrev function supports uint8_t, uint16_t and uint32_t types.

Example:

   ecb_bitrev8 (0xa7) = 0xea
   ecb_bitrev32 (0xffcc4411) = 0x882233ff
T ecb_bitrev (T x) [C++]

Overloaded C++ bitrev function.

T must be one of uint8_t, uint16_t or uint32_t.

uint32_t ecb_bswap16 (uint32_t x)
uint32_t ecb_bswap32 (uint32_t x)
uint64_t ecb_bswap64 (uint64_t x)
T ecb_bswap (T x)

These functions return the value of the 16-bit (32-bit, 64-bit) value x after reversing the order of bytes (0x11223344 becomes 0x44332211 in ecb_bswap32).

The overloaded C++ ecb_bswap function supports uint8_t, uint16_t, uint32_t and uint64_t types.

uint8_t  ecb_rotl8  (uint8_t  x, unsigned int count)
uint16_t ecb_rotl16 (uint16_t x, unsigned int count)
uint32_t ecb_rotl32 (uint32_t x, unsigned int count)
uint64_t ecb_rotl64 (uint64_t x, unsigned int count)
uint8_t  ecb_rotr8  (uint8_t  x, unsigned int count)
uint16_t ecb_rotr16 (uint16_t x, unsigned int count)
uint32_t ecb_rotr32 (uint32_t x, unsigned int count)
uint64_t ecb_rotr64 (uint64_t x, unsigned int count)

These two families of functions return the value of x after rotating all the bits by count positions to the right (ecb_rotr) or left (ecb_rotl). There are no restrictions on the value count, i.e. both zero and values equal or larger than the word width work correctly. Also, notwithstanding count being unsigned, negative numbers work and shift to the opposite direction.

Current GCC/clang versions understand these functions and usually compile them to "optimal" code (e.g. a single rol or a combination of shld on x86).

T ecb_rotl (T x, unsigned int count) [C++]
T ecb_rotr (T x, unsigned int count) [C++]

Overloaded C++ rotl/rotr functions.

T must be one of uint8_t, uint16_t, uint32_t or uint64_t.

uint_fast8_t  ecb_gray_encode8  (uint_fast8_t  b)
uint_fast16_t ecb_gray_encode16 (uint_fast16_t b)
uint_fast32_t ecb_gray_encode32 (uint_fast32_t b)
uint_fast64_t ecb_gray_encode64 (uint_fast64_t b)

Encode an unsigned into its corresponding (reflective) gray code - the kind of gray code meant when just talking about "gray code". These functions are very fast and all have identical implementation, so there is no need to use a smaller type, as long as your CPU can handle it natively.

T ecb_gray_encode (T b) [C++]

Overloaded C++ version of the above, for uint{8,16,32,64}_t.

uint_fast8_t  ecb_gray_decode8  (uint_fast8_t  b)
uint_fast16_t ecb_gray_decode16 (uint_fast16_t b)
uint_fast32_t ecb_gray_decode32 (uint_fast32_t b)
uint_fast64_t ecb_gray_decode64 (uint_fast64_t b)

Decode a gray code back into linear index form (the reverse of ecb_gray*_encode. Unlike the encode functions, the decode functions have higher time complexity for larger types, so it can pay off to use a smaller type here.

T ecb_gray_decode (T b) [C++]

Overloaded C++ version of the above, for uint{8,16,32,64}_t.

Hilbert Curves

These functions deal with (square, pseudo) Hilbert curves. The parameter order indicates the size of the square and is specified in bits, that means for order 8, the coordinates range from 0..255, and the curve index ranges from 0..65535.

The 32 bit variants of these functions map a 32 bit index to two 16 bit coordinates, stored in a 32 bit variable, where the high order bits are the x-coordinate, and the low order bits are the y-coordinate, thus, these functions map 32 bit linear index on the curve to a 32 bit packed coordinate pair, and vice versa.

The 64 bit variants work similarly.

The order can go from 1 to 16 for the 32 bit curve, and 1 to 32 for the 64 bit curve.

When going from one order to the next higher order, these functions replace the curve segments by smaller versions of the generating shape, while doubling the size (since they use integer coordinates), which is what you would expect mathematically. This means that the curve will be mirrored at the diagonal. If your goal is to simply cover more area while retaining existing point coordinates you should increase or decrease the order by 2 or, in the case of ecb_hilbert2d_index_to_coord, simply specify the maximum order of 16 or 32, respectively, as these are constant-time.

uint32_t ecb_hilbert2d_index_to_coord32 (int order, uint32_t index)
uint64_t ecb_hilbert2d_index_to_coord64 (int order, uint64_t index)

Map a point on a pseudo Hilbert curve from its linear distance from the origin on the curve to a x|y coordinate pair. The result is a packed coordinate pair, to get the actual x and < coordinates, you could do something like this:

   uint32_t xy = ecb_hilbert2d_index_to_coord32 (16, 255);
   uint16_t x = xy >> 16;
   uint16_t y = xy & 0xffffU;

   uint64_t xy = ecb_hilbert2d_index_to_coord64 (32, 255);
   uint32_t x = xy >> 32;
   uint32_t y = xy & 0xffffffffU;

These functions work in constant time, so for many applications it is preferable to simply hard-code the order to the maximum (16 or 32).

This (production-ready, i.e. never run) example generates an SVG image of an order 8 pseudo Hilbert curve:

   printf ("<svg xmlns='http://www.w3.org/2000/svg' width='%d' height='%d'>\n", 64 * 8, 64 * 8);
   printf ("<g transform='translate(4) scale(8)' stroke-width='0.25' stroke='black'>\n");
   for (uint32_t i = 0; i < 64*64 - 1; ++i)
     {
       uint32_t p1 = ecb_hilbert2d_index_to_coord32 (6, i    );
       uint32_t p2 = ecb_hilbert2d_index_to_coord32 (6, i + 1);
       printf ("<line x1='%d' y1='%d' x2='%d' y2='%d'/>\n",
         p1 >> 16, p1 & 0xffff,
         p2 >> 16, p2 & 0xffff);
     }
   printf ("</g>\n");
   printf ("</svg>\n");
uint32_t ecb_hilbert2d_coord_to_index32 (int order, uint32_t xy)
uint64_t ecb_hilbert2d_coord_to_index64 (int order, uint64_t xy)

The reverse of ecb_hilbert2d_index_to_coord - map a packed pair of coordinates to their linear index on the pseudo Hilbert curve of order order.

They are an exact inverse of the ecb_hilbert2d_coord_to_index functions for the same order:

   assert (
      u == ecb_hilbert2d_coord_to_index (32,
             ecb_hilbert2d_index_to_coord32 (32,
               u)));

Packing coordinates is done the same way, as well, from x and y:

   uint32_t xy = ((uint32_t)x << 16) | y; // for ecb_hilbert2d_coord_to_index32
   uint64_t xy = ((uint64_t)x << 32) | y; // for ecb_hilbert2d_coord_to_index64

Unlike ecb_hilbert2d_coord_to_index, these functions are O(order), so it is preferable to use the lowest possible order.

Bit Mixing, Hashing

Sometimes you have an integer and want to distribute its bits well, for example, to use it as a hash in a hash table. A common example is pointer values, which often only have a limited range (e.g. low and high bits are often zero).

The following functions try to mix the bits to get a good bias-free distribution. They were mainly made for pointers, but the underlying integer functions are exposed as well.

As an added benefit, the functions are reversible, so if you find it convenient to store only the hash value, you can recover the original pointer from the hash ("unmix"), as long as your pointers are 32 or 64 bit (if this isn't the case on your platform, drop us a note and we will add functions for other bit widths).

The unmix functions are very slightly slower than the mix functions, so it is equally very slightly preferable to store the original values wehen convenient.

The underlying algorithm if subject to change, so currently these functions are not suitable for persistent hash tables, as their result value can change between different versions of libecb.

uintptr_t ecb_ptrmix (void *ptr)

Mixes the bits of a pointer so the result is suitable for hash table lookups. In other words, this hashes the pointer value.

uintptr_t ecb_ptrmix (T *ptr) [C++]

Overload the ecb_ptrmix function to work for any pointer in C++.

void *ecb_ptrunmix (uintptr_t v)

Unmix the hash value into the original pointer. This only works as long as the hash value is not truncated, i.e. you used uintptr_t (or equivalent) throughout to store it.

T *ecb_ptrunmix<T> (uintptr_t v) [C++]

The somewhat less useful template version of ecb_ptrunmix for C++. Example:

   sometype *myptr;
   uintptr_t hash = ecb_ptrmix (myptr);
   sometype *orig = ecb_ptrunmix<sometype> (hash);
uint32_t ecb_mix32 (uint32_t v)
uint64_t ecb_mix64 (uint64_t v)

Sometimes you don't have a pointer but an integer whose values are very badly distributed. In this case you can use these integer versions of the mixing function. No C++ template is provided currently.

uint32_t ecb_unmix32 (uint32_t v)
uint64_t ecb_unmix64 (uint64_t v)

The reverse of the ecb_mix functions - they take a mixed/hashed value and recover the original value.

Host Endianness Conversion

uint_fast16_t ecb_be_u16_to_host (uint_fast16_t v)
uint_fast32_t ecb_be_u32_to_host (uint_fast32_t v)
uint_fast64_t ecb_be_u64_to_host (uint_fast64_t v)
uint_fast16_t ecb_le_u16_to_host (uint_fast16_t v)
uint_fast32_t ecb_le_u32_to_host (uint_fast32_t v)
uint_fast64_t ecb_le_u64_to_host (uint_fast64_t v)

Convert an unsigned 16, 32 or 64 bit value from big or little endian to host byte order.

The naming convention is ecb_(be|le)_u16|32|64_to_host, where be and le stand for big endian and little endian, respectively.

uint_fast16_t ecb_host_to_be_u16 (uint_fast16_t v)
uint_fast32_t ecb_host_to_be_u32 (uint_fast32_t v)
uint_fast64_t ecb_host_to_be_u64 (uint_fast64_t v)
uint_fast16_t ecb_host_to_le_u16 (uint_fast16_t v)
uint_fast32_t ecb_host_to_le_u32 (uint_fast32_t v)
uint_fast64_t ecb_host_to_le_u64 (uint_fast64_t v)

Like above, but converts from host byte order to the specified endianness.

In C++ the following additional template functions are supported:

T ecb_be_to_host (T v)

T ecb_le_to_host (T v)

T ecb_host_to_be (T v)

T ecb_host_to_le (T v)

These functions work like their C counterparts, above, but use templates, which make them useful in generic code.

T must be one of uint8_t, uint16_t, uint32_t or uint64_t (so unlike their C counterparts, there is a version for uint8_t, which again can be useful in generic code).

Unaligned Load/Store

These function load or store unaligned multi-byte values.

uint_fast16_t ecb_peek_u16_u (const void *ptr)
uint_fast32_t ecb_peek_u32_u (const void *ptr)
uint_fast64_t ecb_peek_u64_u (const void *ptr)

These functions load an unaligned, unsigned 16, 32 or 64 bit value from memory.

uint_fast16_t ecb_peek_be_u16_u (const void *ptr)
uint_fast32_t ecb_peek_be_u32_u (const void *ptr)
uint_fast64_t ecb_peek_be_u64_u (const void *ptr)
uint_fast16_t ecb_peek_le_u16_u (const void *ptr)
uint_fast32_t ecb_peek_le_u32_u (const void *ptr)
uint_fast64_t ecb_peek_le_u64_u (const void *ptr)

Like above, but additionally convert from big endian (be) or little endian (le) byte order to host byte order while doing so.

ecb_poke_u16_u (void *ptr, uint16_t v)
ecb_poke_u32_u (void *ptr, uint32_t v)
ecb_poke_u64_u (void *ptr, uint64_t v)

These functions store an unaligned, unsigned 16, 32 or 64 bit value to memory.

ecb_poke_be_u16_u (void *ptr, uint_fast16_t v)
ecb_poke_be_u32_u (void *ptr, uint_fast32_t v)
ecb_poke_be_u64_u (void *ptr, uint_fast64_t v)
ecb_poke_le_u16_u (void *ptr, uint_fast16_t v)
ecb_poke_le_u32_u (void *ptr, uint_fast32_t v)
ecb_poke_le_u64_u (void *ptr, uint_fast64_t v)

Like above, but additionally convert from host byte order to big endian (be) or little endian (le) byte order while doing so.

In C++ the following additional template functions are supported:

T ecb_peek<T>      (const void *ptr)
T ecb_peek_be<T>   (const void *ptr)
T ecb_peek_le<T>   (const void *ptr)
T ecb_peek_u<T>    (const void *ptr)
T ecb_peek_be_u<T> (const void *ptr)
T ecb_peek_le_u<T> (const void *ptr)

Similarly to their C counterparts, these functions load an unsigned 8, 16, 32 or 64 bit value from memory, with optional conversion from big/little endian.

Since the type cannot be deduced, it has to be specified explicitly, e.g.

   uint_fast16_t v = ecb_peek<uint16_t> (ptr);

T must be one of uint8_t, uint16_t, uint32_t or uint64_t.

Unlike their C counterparts, these functions support 8 bit quantities (uint8_t) and also have an aligned version (without the _u prefix), all of which hopefully makes them more useful in generic code.

ecb_poke      (void *ptr, T v)
ecb_poke_be   (void *ptr, T v)
ecb_poke_le   (void *ptr, T v)
ecb_poke_u    (void *ptr, T v)
ecb_poke_be_u (void *ptr, T v)
ecb_poke_le_u (void *ptr, T v)

Again, similarly to their C counterparts, these functions store an unsigned 8, 16, 32 or 64 bit value to memory, with optional conversion to big/little endian.

T must be one of uint8_t, uint16_t, uint32_t or uint64_t.

Unlike their C counterparts, these functions support 8 bit quantities (uint8_t) and also have an aligned version (without the _u prefix), all of which hopefully makes them more useful in generic code.

Fast Integer to String

Libecb defines a set of very fast integer to decimal string (or integer to ASCII, short i2a) functions.  These work by converting the integer to a fixed point representation and then successively multiplying out the topmost digits. Unlike some other, also very fast, libraries, ecb's algorithm should be completely branchless per digit, and does not rely on the presence of special CPU functions (such as clz).

There is a high level API that takes an int32_t, uint32_t, int64_t or uint64_t as argument, and a low-level API, which is harder to use but supports slightly more formatting options.

HIGH LEVEL API

The high level API consists of four functions, one each for int32_t, uint32_t, int64_t and uint64_t:

Example:

   char buf[ECB_I2A_MAX_DIGITS + 1];
   char *end = ecb_i2a_i32 (buf, 17262);
   *end = 0;
   // buf now contains "17262"
ECB_I2A_I32_DIGITS (=11)
char *ecb_i2a_u32 (char *ptr, uint32_t value)

Takes an uint32_t value and formats it as a decimal number starting at ptr, using at most ECB_I2A_I32_DIGITS characters. Returns a pointer to just after the generated string, where you would normally put the terminating 0 character. This function outputs the minimum number of digits.

ECB_I2A_U32_DIGITS (=10)
char *ecb_i2a_i32 (char *ptr, int32_t value)

Same as ecb_i2a_u32, but formats a int32_t value, including a minus sign if needed.

ECB_I2A_I64_DIGITS (=20)
char *ecb_i2a_u64 (char *ptr, uint64_t value)
ECB_I2A_U64_DIGITS (=21)
char *ecb_i2a_i64 (char *ptr, int64_t value)

Similar to their 32 bit counterparts, these take a 64 bit argument.

ECB_I2A_MAX_DIGITS (=21)

Instead of using a type specific length macro, you can just use ECB_I2A_MAX_DIGITS, which is good enough for any ecb_i2a function.

LOW-LEVEL API

The functions above use a number of low-level APIs which have some strict limitations, but can be used as building blocks (studying ecb_i2a_i32 and related functions is recommended).

There are three families of functions: functions that convert a number to a fixed number of digits with leading zeroes (ecb_i2a_0N, 0 for "leading zeroes"), functions that generate up to N digits, skipping leading zeroes (_N), and functions that can generate more digits, but the leading digit has limited range (_xN).

None of the functions deal with negative numbers.

Example: convert an IP address in an uint32_t into dotted-quad:

   uint32_t ip = 0x0a000164; // 10.0.1.100
   char ips[3 * 4 + 3 + 1];
   char *ptr = ips;
   ptr = ecb_i2a_3 (ptr,  ip >> 24        ); *ptr++ = '.';
   ptr = ecb_i2a_3 (ptr, (ip >> 16) & 0xff); *ptr++ = '.';
   ptr = ecb_i2a_3 (ptr, (ip >>  8) & 0xff); *ptr++ = '.';
   ptr = ecb_i2a_3 (ptr,  ip        & 0xff); *ptr++ = 0;
   printf ("ip: %s\n", ips); // prints "ip: 10.0.1.100"
char *ecb_i2a_02  (char *ptr, uint32_t value) // 32 bit
char *ecb_i2a_03  (char *ptr, uint32_t value) // 32 bit
char *ecb_i2a_04  (char *ptr, uint32_t value) // 32 bit
char *ecb_i2a_05  (char *ptr, uint32_t value) // 64 bit
char *ecb_i2a_06  (char *ptr, uint32_t value) // 64 bit
char *ecb_i2a_07  (char *ptr, uint32_t value) // 64 bit
char *ecb_i2a_08  (char *ptr, uint32_t value) // 64 bit
char *ecb_i2a_09  (char *ptr, uint32_t value) // 64 bit

The ecb_i2a_0N functions take an unsigned value and convert them to exactly N digits, returning a pointer to the first character after the digits. The value must be in range. The functions marked with 32 bit do their calculations internally in 32 bit, the ones marked with 64 bit internally use 64 bit integers, which might be slow on 32 bit architectures (the high level API decides on 32 vs. 64 bit versions using ECB_64BIT_NATIVE).

char *ecb_i2a_2   (char *ptr, uint32_t value) // 32 bit
char *ecb_i2a_3   (char *ptr, uint32_t value) // 32 bit
char *ecb_i2a_4   (char *ptr, uint32_t value) // 32 bit
char *ecb_i2a_5   (char *ptr, uint32_t value) // 64 bit
char *ecb_i2a_6   (char *ptr, uint32_t value) // 64 bit
char *ecb_i2a_7   (char *ptr, uint32_t value) // 64 bit
char *ecb_i2a_8   (char *ptr, uint32_t value) // 64 bit
char *ecb_i2a_9   (char *ptr, uint32_t value) // 64 bit

Similarly, the ecb_i2a_N functions take an unsigned value and convert them to at most N digits, suppressing leading zeroes, and returning a pointer to the first character after the digits.

ECB_I2A_MAX_X5 (=59074)
char *ecb_i2a_x5  (char *ptr, uint32_t value) // 32 bit
ECB_I2A_MAX_X10 (=2932500665)
char *ecb_i2a_x10 (char *ptr, uint32_t value) // 64 bit

The ecb_i2a_xN functions are similar to the ecb_i2a_N functions, but they can generate one digit more, as long as the number is within range, which is given by the symbols ECB_I2A_MAX_X5 (almost 16 bit range) and ECB_I2A_MAX_X10 (a bit more than 31 bit range), respectively.

For example, the digit part of a 32 bit signed integer just fits into the ECB_I2A_MAX_X10 range, so while ecb_i2a_x10 cannot convert a 10 digit number, it can convert all 32 bit signed numbers. Sadly, it's not good enough for 32 bit unsigned numbers.

Floating Point Fiddling

ECB_INFINITY [-UECB_NO_LIBM]

Evaluates to positive infinity if supported by the platform, otherwise to a truly huge number.

ECB_NAN [-UECB_NO_LIBM]

Evaluates to a quiet NAN if supported by the platform, otherwise to ECB_INFINITY.

float ecb_ldexpf (float x, int exp) [-UECB_NO_LIBM]

Same as ldexpf, but always available.

uint32_t ecb_float_to_binary16  (float  x) [-UECB_NO_LIBM]
uint32_t ecb_float_to_binary32  (float  x) [-UECB_NO_LIBM]
uint64_t ecb_double_to_binary64 (double x) [-UECB_NO_LIBM]

These functions each take an argument in the native float or double type and return the IEEE 754 bit representation of it (binary16/half, binary32/single or binary64/double precision).

The bit representation is just as IEEE 754 defines it, i.e. the sign bit will be the most significant bit, followed by exponent and mantissa.

This function should work even when the native floating point format isn't IEEE compliant, of course at a speed and code size penalty, and of course also within reasonable limits (it tries to convert NaNs, infinities and denormals, but will likely convert negative zero to positive zero).

On all modern platforms (where ECB_STDFP is true), the compiler should be able to completely optimise away the 32 and 64 bit functions.

These functions can be helpful when serialising floats to the network - you can serialise the return value like a normal uint16_t/uint32_t/uint64_t.

Another use for these functions is to manipulate floating point values directly.

Silly example: toggle the sign bit of a float.

   /* On gcc-4.7 on amd64, */
   /* this results in a single add instruction to toggle the bit, and 4 extra */
   /* instructions to move the float value to an integer register and back. */

   x = ecb_binary32_to_float (ecb_float_to_binary32 (x) ^ 0x80000000U)
float  ecb_binary16_to_float  (uint16_t x) [-UECB_NO_LIBM]
float  ecb_binary32_to_float  (uint32_t x) [-UECB_NO_LIBM]
double ecb_binary64_to_double (uint64_t x) [-UECB_NO_LIBM]

The reverse operation of the previous function - takes the bit representation of an IEEE binary16, binary32 or binary64 number (half, single or double precision) and converts it to the native float or double format.

This function should work even when the native floating point format isn't IEEE compliant, of course at a speed and code size penalty, and of course also within reasonable limits (it tries to convert normals and denormals, and might be lucky for infinities, and with extraordinary luck, also for negative zero).

On all modern platforms (where ECB_STDFP is true), the compiler should be able to optimise away this function completely.

uint16_t ecb_binary32_to_binary16 (uint32_t x)
uint32_t ecb_binary16_to_binary32 (uint16_t x)

Convert a IEEE binary32/single precision to binary16/half format, and vice versa, handling all details (round-to-nearest-even, subnormals, infinity and NaNs) correctly.

These are functions are available under -DECB_NO_LIBM, since they do not rely on the platform floating point format. The ecb_float_to_binary16 and ecb_binary16_to_float functions are usually what you want.

Arithmetic

x = ecb_mod (m, n)

Returns m modulo n, which is the same as the positive remainder of the division operation between m and n, using floored division. Unlike the C remainder operator %, this function ensures that the return value is always positive and that the two numbers m and m' = m + i * n result in the same value modulo n - in other words, ecb_mod implements the mathematical modulo operation, which is missing in the language.

n must be strictly positive (i.e. >= 1), while m must be negatable, that is, both m and -m must be representable in its type (this typically excludes the minimum signed integer value, the same limitation as for / and % in C).

Current GCC/clang versions compile this into an efficient branchless sequence on almost all CPUs.

For example, when you want to rotate forward through the members of an array for increasing m (which might be negative), then you should use ecb_mod, as the % operator might give either negative results, or change direction for negative values:

   for (m = -100; m <= 100; ++m)
     int elem = myarray [ecb_mod (m, ecb_array_length (myarray))];
x = ecb_div_rd (val, div)
x = ecb_div_ru (val, div)

Returns val divided by div rounded down or up, respectively. val and div must have integer types and div must be strictly positive. Note that these functions are implemented with macros in C and with function templates in C++.

Utility

element_count = ecb_array_length (name)

Returns the number of elements in the array name. For example:

  int primes[] = { 2, 3, 5, 7, 11 };
  int sum = 0;

  for (i = 0; i < ecb_array_length (primes); i++)
    sum += primes [i];

Symbols Governing Compilation of ecb.h Itself

These symbols need to be defined before including ecb.h the first time.

ECB_NO_THREADS

If ecb.h is never used from multiple threads, then this symbol can be defined, in which case memory fences (and similar constructs) are completely removed, leading to more efficient code and fewer dependencies.

Setting this symbol to a true value implies ECB_NO_SMP.

ECB_NO_SMP

The weaker version of ECB_NO_THREADS - if ecb.h is used from multiple threads, but never concurrently (e.g. if the system the program runs on has only a single CPU with a single core, no hyper-threading and so on), then this symbol can be defined, leading to more efficient code and fewer dependencies.

ECB_NO_LIBM

When defined to 1, do not export any functions that might introduce dependencies on the math library (usually called -lm) - these are marked with [-UECB_NO_LIBM].

Undocumented Functionality

ecb.h is full of undocumented functionality as well, some of which is intended to be internal-use only, some of which we forgot to document, and some of which we hide because we are not sure we will keep the interface stable.

While you are welcome to rummage around and use whatever you find useful (we don't want to stop you), keep in mind that we will change undocumented functionality in incompatible ways without thinking twice, while we are considerably more conservative with documented things.

Authors

libecb is designed and maintained by:

   Emanuele Giaquinta <e.giaquinta@glauco.it>
   Marc Alexander Lehmann <schmorp@schmorp.de>

Info

2024-01-25 perl v5.38.2 User Contributed Perl Documentation