Skip to content
English
Customer portal
3D Spark Homepage
  • There are no suggestions because the search field is empty.

Run Validation: 3D Spark

This SOP explains how CS Ops validates total cost accuracy using the standard validation dataset and computes Cost WMAPE. This determines PASS or FAIL.

Before you start: confirm you are logged into the correct customer 3D Spark organization.

Inputs

  • Validation CAD files in CS_Internal/Validation_Run/Validation_CAD

  • Validation Group Upload Spreadsheet in CS_Internal/Validation_Run/Validation_CAD (from Run Extractor: G-code)

  • Validation Summary Spreadsheet in CS_Internal/Validation_Run/Evidence

  • Calibrated setup exists in 3D Spark, including the full process chain with customer's pre- and post-process steps.

Validation approach

Prefer total cost accuracy. For validation parts, calculate total cost in 3D Spark twice:

The steps below are completed much faster if you had saved customer's process chain as a TEMPLATE or as an ANALYSIS PROFILE.

Ideally, you should have created the TEMPLATE or ANALYSIS PROFILE during finalizing customer's 3D Spark instance.

More info: Click here

  1. Baseline: 3D Spark cost estimate using 3D Spark build time.
  2. Benchmark: Recalculate cost in 3D Spark after overriding main-process build time with slicer estimates.
  3. Rule: baseline and benchmark must use the same pre-process and post-process definitions; only main-process build time source changes.
  4. Apply the build-time overwrite method as explained here: Manually Updating Build Time Estimates 
     

Acceptance rule:

  • Compute Cost WMAPE from baseline total cost vs benchmark total cost. PASS when Cost WMAPE < 10%, FAIL when Cost WMAPE ≥ 10%.

Step 1: Prepare The Validation Upload Package

Confirm in CS_Internal/Validation_Run/Validation_CAD:

  • validation CAD files exist

  • validation Group Upload Spreadsheet exists

Confirm in CS_Internal/Validation_Run/Evidence:

  • validation Summary Spreadsheet exists

If not:

  • stop and complete Run Extractor: G-code first

Step 2: Group Upload Validation Parts If Needed

If validation parts are not already in 3D Spark:

  • use group upload with the validation CAD folder and Group Upload Spreadsheet

Step 3: Generate 3D Spark Estimates

In 3D Spark:

  • run estimation for the validation parts using the calibrated setup

  • For benchmark calculation, overwrite main-process build time values with slicer build time values for each validation build job.
    How to article: Manually Updating Build Time Estimates

  • export or capture total cost values for both baseline and benchmark calculations required for Cost WMAPE calculation

Step 4: Decide PASS Or FAIL

  • Compute total cost accuracy using the benchmark calculation (3D Spark cost with main-process build time overwritten by slicer estimates).

  • Compute Cost WMAPE using the validation table of baseline total cost vs benchmark total cost.

  • Use the Cost WMAPE table template: CS_Internal/Evidence/3D_Spark_Validation_Tool_[Version].xlsx.

  • You can also download the Validation Tool here: Download

  • Store the filled Cost WMAPE table in CS_Internal/Validation_Run/Evidence.

  • Decide PASS or FAIL using the acceptance rule.

Also store a short decision note in:

  • CS_Internal/Evidence/Onboarding_Execution_Note.docx

Step 5:

If PASS
Continue the CS Ops Runbook with the next step.

If FAIL

If Cost WMAPE ≥ 10%:

Completion Criteria

You are done when:

  • Cost WMAPE is computed and stored in Validation_Run/Evidence

  • PASS or FAIL is recorded in CS_Internal/Evidence/Onboarding_Execution_Note.docx