Remove two assertions

This is a workaround a g++-9 bug that occurs only when build type is
Release. The code compiles just fine with other build types.

This does not occur with g++-10 for instance...