Skip to content
Commit cf817561 authored by Reid Spencer's avatar Reid Spencer
Browse files

Use a better algorithm for rounding sqrt results. Change the FIXME about

this to a NOTE: because pari/gp results start to get rounded incorrectly
after 192 bits of precision. APInt and pari/gp never differ by more than
1, but APInt is more accurate because it does not lose precision after 192
bits as does pari/gp.

llvm-svn: 34834
parent cf87f9ee
Loading
Loading
Loading
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please to comment