[mlgo] Don't set the source permissions when copying over tf files

This is akin to the `install` behavior. It should make build directory
deletable on certain build bots.