1
Answer

double precision problem

Ask a question
Simon Rasing

Simon Rasing

12y
1.8k
1
Question from a beginner. I used doubles in a program to calculate cable sag. The formula itself is pretty sophisticated, lots of math.tanh()'s and math.sqrt()'s. After analyzing the results i found out there's a slight precision problem. Doubles don't seem precise enough for this particulair problem. Is there a way to solve this? ---Posted from iPhone App---

Answers (1)