Tests fail or pass depending on random seed

Certain tests, e.g. test_single_dense_activation_exact[4,6] fail or pass depending on the random seed.

One general good practice is to use the pytest-randomly plugin to set a random seed (and also repeat tests for different random seeds).

Also, we should try to understand the different failure modes for this particular test.