We don't need to keep track of the packed alignment, just whether the struct is packed or not. Fixes PR4610.

llvm-svn: 76884