Integer GEMM sometimes breaks when using openmp
To reproduce use the Conv2D PR and run its test with openmp enabled.

Sometimes the test will succeed, other fails, the GEMM output result looks random across runs. Disabling openmp it always works.