Precision and overflow.

R. Clayton (rclayton@monmouth.edu)
Mon, 14 Feb 2000 11:10:48 -0500 (EST)

• Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
• Next message: R. Clayton: "Questions about architectural design."
• Previous message: R. Clayton: "SRD clarifications."

   how do I deal with 31 bit precision requirement?

I don't know; what does your SRD say about it? I probably would have
interpreted it to mean that the absolute value of any value which is greater
than 2,147,483,647 (2^31 - 1) is an overflow and gone on from there.

Once you answer this question, there's at least one other important question
you need to answer about precision and overflow.

• Next message: R. Clayton: "Questions about architectural design."
• Previous message: R. Clayton: "SRD clarifications."

This archive was generated by hypermail 2.0b3 on Thu Mar 30 2000 - 20:50:05 EST