[Matrix] Fold the transpose into the matmul operand used to fetch scalars

For column-major this is:
  A * B^t
whereas for row-major:
  A^t * B

Differential Revision: https://reviews.llvm.org/D101762