Resources

Numerical accuracy

The calculations in our apps: the policy each one is under, the precision it runs at, and the code itself.

  • 941 calculation policies
  • 6,917 calculations in 1,248 source files
  • 143 exact
  • 6,286 in 64-bit
  • 335 with a 32-bit step
  • 437 open items
  • Last reviewed

Calculation policies

A policy says how one family of calculations keeps its precision. Open one to see its calculations, by source file, and their code.

  • Annotations and scales read from a PDF

    Turns the annotations of an opened PDF into editable markups (boxes, lines, outlines, pen strokes, count marks, text boxes) and reads the sheet's scale.

    • MarkupCraft
    32-bit step, flagged
    10 calculations in 2 files
    32-bit in part Open item
  • Arc through three points and angle measurement

    Works out the arc markup's circle from its three points, its length, and the angle between two legs shown by the angle measurement.

    • MarkupCraft
    64-bit, direct
    5 calculations
    64-bit Open item
  • Area markup with cut-outs, and clipboard placement

    The area and perimeter of an area markup less its cut-outs, whether cut-outs fit, and where pasted markups land.

    • MarkupCraft
    64-bit, direct
    6 calculations in 2 files
    64-bit
  • Arithmetic on typed lengths

    Works out a length typed as an expression, such as 4+7/16 or 2*450mm, wherever a length is asked for.

    • CadCraft
    • ModelCraft
    • MarkupCraft
    • TakeoffCraft
    • CivilCraft
    • DetailCraft
    64-bit, direct
    4 calculations
    64-bit
  • BCF viewpoint of a markup

    The camera position and view scale written to a BCF file for each markup, in meters of paper.

    • MarkupCraft
    64-bit, direct
    1 calculation
    64-bit
  • Blank pages: paper sizes and grid

    The size of a new blank page in PDF points and the positions of its grid lines or dots.

    • MarkupCraft
    64-bit, direct
    2 calculations
    64-bit
  • Board geometry and clearances

    Distances between tracks, pads and zones, point-in-shape tests, areas and pad positions on a printed circuit board.

    Every app 64-bit, direct
    10 calculations in 2 files
    64-bit Open item
  • Board placement and routing

    Where parts are placed and where tracks and vias run on a board, with the wire length reported.

    Every app 64-bit, stated limit
    8 calculations in 2 files
    64-bit Open item
  • Calc sheet units, functions and driven parameters

    The unit factors, powers, functions and conversions of a calc sheet, and the values a sheet writes into the app's parameters.

    Every app 64-bit, direct
    13 calculations
    64-bit Open item
  • Calc sheets

    Unit-aware formulas saved with the file: spans, loads, moments, pass or fail checks.

    Every app 64-bit, direct
    3 calculations
    64-bit Open item
  • Carried, stamped and pasted markup geometry

    Where markups land when they are carried onto a revised sheet, where a stamp or a picture is placed, and where copied page content is pasted.

    • MarkupCraft
    64-bit, direct
    6 calculations in 3 files
    64-bit Open item
  • Check report values

    The required and found values written in the Problems panel and in the check report exported as CSV.

    Every app 64-bit, direct
    1 calculation
    64-bit Open item
  • Circuit solver

    Operating point, DC sweep, AC response and transient of a circuit of resistors, capacitors, inductors, sources, diodes, transistors and switches.

    Every app 64-bit, stated limit
    18 calculations in 2 files
    64-bit Open item
  • Controller standard functions and integer types

    Timers, counters, arithmetic functions and type conversions of the soft controller.

    Every app 64-bit, direct
    6 calculations
    64-bit Open item
  • Device number check

    The check on the accuracy page that reports how many bits this device's numbers carry, how many processor threads and how much memory the browser shows, and what it says about the graphics processor.

    Every app 64-bit, direct
    2 calculations
    64-bit
  • Drawing comparison by vector paths

    Compares two revisions of a sheet by their drawn lines: which lines were taken out or put in, how much, where, and whether the drawing inside a task's region changed.

    • MarkupCraft
    64-bit, stated limit
    16 calculations in 4 files
    64-bit Open item
  • Edits to a page's own content

    Moves, scales, turns, reshapes and rewords the drawing's own lines, pictures and text in the PDF (the Page content tool), and writes the result back into the file.

    • MarkupCraft
    64-bit, stated limit
    16 calculations in 2 files
    64-bit Open item
  • Fault trees and reliability block diagrams

    The probability of a top event, minimal cut sets, importance measures, system reliability and mean time to failure.

    Every app 64-bit, stated limit
    10 calculations
    64-bit Open item
  • Flow simulation (discrete events)

    Queues, servers, conveyors, vehicles and resources simulated event by event: utilization, waiting times, throughput and their confidence ranges.

    Every app 64-bit, stated limit
    15 calculations in 2 files
    64-bit Open item
  • GDSII layout: reals, flattening, areas and checks

    Reading and writing chip layout streams, flattening cell hierarchies, layer areas and the basic width, spacing and area checks.

    Every app 64-bit, stated limit
    12 calculations
    64-bit Open item
  • Gerber and drill file numbers

    The coordinates and sizes written to Gerber layers, drill files and the job file, and read back from them.

    Every app 64-bit, stated limit
    7 calculations
    64-bit Open item
  • Inverse kinematics and joint trajectories

    Joint angles that put a robot link at a target, and timed joint moves with their speeds, accelerations and peak torques.

    Every app 64-bit, stated limit
    9 calculations in 2 files
    64-bit
  • Library 3D preview

    The 3D view of an item on its Library page and on the configure page.

    Every app Display only
    3 calculations in 2 files
    32-bit, display only
  • Library configurator sizes

    The size and connection positions shown for the chosen variant on a Library item's configure page.

    Every app 64-bit, direct
    2 calculations
    64-bit
  • Load flow and short-circuit currents

    Bus voltages, branch flows and losses of an AC network, and fault currents by symmetrical components.

    Every app 64-bit, stated limit
    12 calculations in 3 files
    64-bit Open item
  • Lumped system models

    Operating point and response over time of electrical, thermal, hydraulic and mechanical networks built from lumped elements.

    Every app 64-bit, stated limit
    12 calculations in 3 files
    64-bit Open item
  • Magnetic and electric field solvers

    The field of wire segments, the mutual inductance of loops, and 2D finite-element magnetic and electric fields with energy, capacitance and force.

    Every app 64-bit, stated limit
    12 calculations in 2 files
    64-bit Open item
  • Markup geometry while drawing and editing

    Works out the points and boxes that are stored when a markup is drawn, snapped, typed to scale, resized, moved, simplified or lined up.

    • MarkupCraft
    64-bit, direct
    12 calculations in 4 files
    64-bit
  • Markup outlines and measurement labels

    Builds what each markup draws, on screen and in the saved PDF: its outline as lines and Bézier curves, and the label text of a length, area, angle or count.

    • MarkupCraft
    64-bit, direct
    9 calculations
    64-bit
  • Numbers sent between people editing together

    How a number in an edit is written into a Studio Live message and read back on the other side.

    Every app 64-bit, direct
    5 calculations
    64-bit
  • Numbers typed into the property grid

    Turns what a person types or drags in a Properties row into the number handed to the app.

    Every app 64-bit, direct
    3 calculations
    64-bit
  • Numbers written into edited PDF page content

    How a number is written into the content stream of a PDF page that MarkupCraft edits.

    • MarkupCraft
    64-bit, stated limit
    1 calculation
    64-bit
  • Numbers written to the saved PDF

    Writes each markup into the PDF as an annotation: its position, its points, its drawn appearance, the sheet's scale and the measured text.

    • MarkupCraft
    64-bit, stated limit
    13 calculations
    64-bit Open item
  • Parametric PCB footprints

    Pad positions, pad sizes and the courtyard of standard-style footprints, worked out from pitch, row spacing and pin count.

    Every app 64-bit, stated limit
    7 calculations
    64-bit
  • Pen sketch cleanup

    Decides what a freehand stroke was meant to be (a line, circle, arc, rectangle or polyline) and makes that exact shape, then joins nearby ends.

    • CadCraft
    • MarkupCraft
    64-bit, stated limit
    9 calculations
    64-bit
  • People flow and evacuation time

    How fast people pass doors, corridors and stairs, which way each room empties, and how long it takes everyone to reach an exit.

    Every app 64-bit, stated limit
    6 calculations
    64-bit
  • Pipe, duct and gas networks

    Heads, pressures, flows and velocities in a steady network of pipes, pumps and fittings.

    Every app 64-bit, stated limit
    9 calculations in 2 files
    64-bit Open item
  • Planar linkages (closed loops)

    The pose of four-bars, slider-cranks and other planar linkages, their sweep, velocity ratios, mobility and Grashof class.

    Every app 64-bit, stated limit
    9 calculations
    64-bit Open item
  • Protection curves and grading

    Relay and fuse operating times, grading margins between devices, and the cable damage time.

    Every app 64-bit, stated limit
    6 calculations
    64-bit Open item
  • Redline package coordinates

    The positions written into a redline package that lists each markup on its sheet.

    • MarkupCraft
    64-bit, stated limit
    2 calculations
    64-bit
  • Rigid-body dynamics of a mechanism

    Joint torques for a given motion, the mass matrix, joint accelerations for given torques, energy, and a simulated motion over time.

    Every app 64-bit, stated limit
    6 calculations
    64-bit
  • Rotations, transforms and small linear algebra (motion)

    Rotation matrices, roll-pitch-yaw angles, rotation vectors, rigid transforms and the dense solve used by the robot and linkage calculations.

    Every app 64-bit, direct
    7 calculations
    64-bit Open item
  • Schedule risk (Monte Carlo)

    The finish at P10, P50, P80 and P90, how often each task is critical, and which durations drive the finish.

    Every app 64-bit, stated limit
    3 calculations
    64-bit
  • Sheet compare picture

    Mixes the renderings of an old and a new sheet into one picture that colors what was removed and what was added.

    • MarkupCraft
    Display only
    1 calculation
    32-bit, display only
  • Sheet scale, typed lengths and measured values

    Turns a sheet's scale into real lengths and areas: the calibration from a preset or from two picked points, the reading of a typed length, and the length, area, perimeter and count shown for a measurement.

    • MarkupCraft
    64-bit, direct
    15 calculations in 2 files
    64-bit Open item
  • Size of a copied area

    Works out how big a copied area of a sheet is on paper and in the real world, the pixel size it is rendered at, and the scale and turn that fit it to two picked points.

    • CadCraft
    • BimCraft
    • MarkupCraft
    • DetailCraft
    64-bit, direct
    5 calculations
    64-bit
  • Spending on a person's own AI model

    Adds up what calls to a person's own AI model have cost today and this month, and stops a call that could pass the limits the person set.

    Every app 64-bit, stated limit
    4 calculations
    64-bit
  • Text positions: search hits and the OCR text layer

    Works out where a found word sits on the sheet, the cloud drawn round it, and where the words read from a scanned page are placed.

    • MarkupCraft
    64-bit, stated limit
    6 calculations in 2 files
    64-bit
  • Text width from built-in font metrics

    The width of a text string, used to size and wrap text boxes in the markup.

    • MarkupCraft
    64-bit, stated limit
    2 calculations
    64-bit
  • Unit conversion

    Converts lengths, areas, volumes, angles and slopes between 57 units.

    Every app Exact values
    4 calculations
    64-bit

A policy is added only after its source was read. Each statement can be checked in the code shown on its page; the app repositories are public. When a release changes a calculation, its page says so until it has been read again.

The standard

  • 64-bit everywhere

    Every calculation runs in 64-bit floating point (IEEE 754 double precision), from the number you type to the number you read.

  • 15 digits, always

    A 64-bit number keeps any 15-digit value intact and takes 17 digits to write out in full. Our rule for every calculation: carry all 17 between steps, and order the arithmetic so that avoidable rounding never costs one of the first 15.

  • 32-bit gets a warning

    A 32-bit number keeps about 7 digits. Where a 32-bit step can reach a number you read, the calculation is flagged in the lists below, and the app will warn that the result can have less mathematical precision.

This device

The apps calculate in 64-bit on every device. Work handed to the graphics processor is the exception: browsers expose graphics processors as 32-bit calculators, which can provide less mathematical precision.

A browser reports a rounded or capped view of the machine, never a full inventory: it gives the number of processor threads (not the model), memory rounded down and capped at 8 GB (Chromium only), and one graphics adapter even when a machine has several. What the browser reports about graphics is a capability, not a measurement of the card. The size of a graphics card's memory bus (a 192-bit bus, for example) says how fast data moves, not how precisely it calculates. Most graphics cards can calculate in 64-bit natively, slowly, but WebGL and WebGPU do not offer it to web pages.

Approaches

Every policy takes one of five approaches to keeping its precision.

Exact values 8 policies
Constants and factors are held as exact fractions from their definitions. The arithmetic is ordered so that no rounded factor is ever used.
Exact predicates 1 policy
Coordinates are 64-bit. The yes-or-no decisions that shape the geometry (which side of a line, inside or outside a circle) are computed exactly, so rounding cannot flip one.
64-bit, direct 337 policies
Every value is a 64-bit number from input to result. Formulas are closed form or a direct solve, and every comparison uses a stated tolerance.
64-bit, stated limit 428 policies
The arithmetic is 64-bit, but the method or the data sets the accuracy: a solver tolerance, a mesh, a step size, a datum shift, a table. The limit is stated where the result is shown.
Display only 49 policies
Computed to draw the screen, often in 32-bit on the graphics processor. No number a person reads, saves or exports comes from it.
32-bit step, flagged 118 policies
One step stores or exchanges 32-bit values that reach a number a person reads. It is listed here with its open item, and the step is either moved to 64-bit or the app will warn where the number is read.

Precision is not robustness

Mathematical precision is how many digits a number keeps. Geometric robustness is whether a shape stays valid: every intersection found, every solid closed, every face joined to its neighbors. They are different properties, and a CAD system can have the first without the second.

Every geometric algorithm rests on yes-or-no questions. Is this point left or right of that line? Do these two edges cross? Is this point inside that circle? Each answer is the sign of a small expression. When three points are almost in line, the true value of that expression can be smaller than the rounding error of the arithmetic that computes it, and the sign comes out wrong. That happens at 15 digits as readily as at 7.

One wrong sign is not a small error in the last digit. It is a different decision: an intersection that is missed, two triangles that overlap, a face that points the wrong way, a solid with a gap in it. Every coordinate can be correct to 15 digits while the shape they describe is invalid.

A point C almost on the line from A to B. Magnified, C is a tiny distance to one side of the line. A B C C left or right?
C lies a rounding error away from the line through A and B. Which side it is on decides how the geometry is built.

What makes geometry robust

  • Exact predicates

    The yes-or-no questions are answered exactly. The fast 64-bit answer is used when it is safely away from zero. When it is not, the sign is computed again with as many digits as it takes.

  • Decide once

    A decision about a shape is recorded as topology, and every later step agrees with it. The same question is never asked twice with a chance of two answers.

  • Stated tolerances

    Where a tolerance is used it is written down, scaled to the size of the geometry and applied the same way everywhere.

  • Local origins

    Coordinates far from zero are moved to a local origin before the work, so the digits are spent on the geometry and not on the distance to the origin.

  • Valid by construction

    Algorithms whose result is guaranteed to be a closed solid, whatever the input, in place of ones that repair the result afterwards.

  • More than the language

    These choices matter more than the programming language. JavaScript, C++ and Rust all compute with the same 64-bit numbers: the same algorithm is as robust, or as fragile, in each.

Where our apps stand

The list on this page records both properties. Surface triangulation in CivilCraft and BimCraft uses exact predicates. Solid modeling in PartCraft runs on a kernel whose result is a closed solid by construction. The intersections in the CadCraft app use stated tolerances today, and exact tests for the near-parallel and near-tangent cases are an open item. Each policy says which approach it takes.