Skip to content

Tutorial B: From Raw Data to a Robot Model ​

This tutorial uses teleoperation data from a Station Lite dual-arm workstation to walk through the complete workflow: collect → curate → dataset → train → model → deploy and validate.

RolesFAE, R&D engineer
Time requiredAbout 1 hour hands-on; training time depends on compute and queueing
ResultA model version, downloadable model artifacts, and a deployment record

When to Use This Tutorial ​

  • You want a robot to learn a new manipulation skill, such as pick and place, sorting, or flower arranging.
  • You can teleoperate a robot to record tens to hundreds of demonstrations.
  • You need training results that are reproducible and traceable, and you want to validate them on a real robot.

Before You Begin ​

RequirementDetailsReference
RoleFAE or R&D engineerRoles and Permissions
DeviceStation Lite registered, with a teleoperation device boundDevice Management
ComputeAn available training compute quotaAccounts and Members
Inference node (for deployment)A qualifying edge inference node, or cloud inferenceDeployment Overview

Workflow Overview ​

How training jobs, checkpoint models, model versions, and deployments relate

text
① Collect and upload → ② Curate → ③ Export a training dataset → ④ Create a training job → ⑤ Track training
→ ⑥ Export a checkpoint to validate direction → ⑦ Manage and download the model → ⑧ Deploy and validate on the robot

Step 1: Collect and Upload Data ​

Where: Data Collection → Collection Tasks, then click New.

  1. Select device model Station Lite. The storage format is automatically set to HDF5.
  2. Select device SN ST-2609-0001.
  3. Select Full upload, which is recommended for small batches of high-value demonstrations.
  4. Enter task name pick_place_station, a scene, a target count of 100, a collector, and a due date, then click Create Task.
  5. The collector claims the task and records the teleoperated demonstrations. Each episode uploads automatically when it ends.

Done when progress reaches 100/100, every upload is complete, and the task status is Completed.

How many demonstrations?

Pick-and-place tasks in a single scene typically start with 50 to 200 demonstrations. Run the full workflow on a small batch first, then collect more based on evaluation results.

Step 2: Curate the Data ​

  1. Go to Data Curation → Data Assets and filter by collection task. The format shows HDF5 and the status shows Ready to Curate.
  2. Select all episodes and create the curation project pick_place_v1.
  3. Step through each episode in the data workbench:
    • Label failed grasps, collisions, and long pauses as Anomaly_<note> and mark them as excluded ranges.
    • Mark entirely unusable demonstrations for exclusion.
    • Click Mark as Reviewed after checking each episode.
  4. For large batches, first run black-frame detection and joint-data validation scripts from Batch Processing to generate candidate labels, then confirm them manually.

HDF5 data already includes robot state, so no pipeline run is needed. See Data Workbench.

Step 3: Export a Training Dataset ​

  1. Click Export in the workbench, enter the name pick_place_v1, and choose HDF5.
    • The platform's built-in training templates use HDF5 directly.
    • Choose LeRobot if you plan to train in an open-source framework.
  2. When the export completes, the dataset status is Exported and the version is frozen.

Only dataset versions in the Exported state can be used for training.

Step 4: Create a Training Job ​

Where: Model Training → Task Management, then click Create Training Job.

SettingValue in this exampleNotes
Job namePick and place v1Any characters allowed
English namepick_place_v1Letters, digits, and underscores only; used to name artifacts
Training datapick_place_v1 (v1)Multiple versions allowed if they share a format
Model familyACTEasyDP, Pi 0.5, and R0 are also available
Compute tierStandard4 × GPU, suitable for typical training
Training strategyLong-horizon, quality-firstSet by the platform; cannot be changed

Click Submit. The platform locks the parameter snapshot: training steps, learning rate and schedule, batch size, optimizer, random seed, and dataset versions.

Step 5: Track Training ​

Where: Click Details on the training job card in the job list.

StatusMeaning
QueuedWaiting for available compute; the queue position is shown
TrainingIn progress; the current step and loss curve are shown
CompletedRan the full step budget (currently 80,000 steps) and produced a model version
Stopped / FailedStopped manually or terminated abnormally; check the logs

The details page shows the loss curve, learning rate schedule, throughput, GPU utilization, and logs. A loss that decreases steadily and then levels off indicates normal convergence.

Step 6: Export a Checkpoint to Validate Direction Early ​

You don't have to wait for training to finish before validating.

  1. On the training job details page, click Export Checkpoint.
  2. The platform registers the current weights as a checkpoint model, labeled with its progress at export, for example "Step 20,000 · 25%".
  3. Run an inference test with the checkpoint (see Step 8). If the direction looks right, let training continue. If it's clearly off, stop the job and return to curation to adjust the data.

Exporting a checkpoint does not interrupt training; the job status remains Training.

Step 7: Manage and Download the Model ​

Where: Model Deployment → Model Management.

  1. When training completes, a model version appears in the model list, for example pick_place_v1 · v20261020-01.
  2. Click Details to see its lineage: training job, dataset versions, hyperparameter snapshot, and step count.
  3. To use the model locally, click Download to get the model artifact archive (weights, model config, normalization statistics, and inference config). See Downloading Model Artifacts.

Step 8: Deploy and Validate on the Robot ​

Where: Model Deployment → Inference Deployment.

  1. Choose a deployment type:
    • Cloud inference for quick validation, with no local hardware required.
    • Edge deployment for long-term on-site operation, which requires passing four pre-deployment checks.
  2. Select the model version and target device, and turn on NexBench evaluation if needed.
  3. Complete the safety confirmation before you start: no one within 1 m of the robot, a clear motion path, an emergency stop that is within reach and working, and a model that matches the task.
  4. Start inference, observe the run on site, and review execution records and evaluation results in the inference job details.

See Deployment Overview and Validation and Evaluation.

What You Get ​

OutputLocation
Dataset version pick_place_v1Dataset Management
Training job and parameter snapshotTraining job details
Checkpoint models and final model versionModel Management (downloadable)
Deployment and inference recordsInference Deployment

How to Confirm You're Done ​

  • [x] The training job status is Completed.
  • [x] The model version appears in Model Management with complete lineage.
  • [x] At least one deployment ran successfully and on-site validation reached a conclusion.
  • [x] Failure segments have been reviewed in Data Feedback.

Common Issues ​

IssueResolution
No dataset available when creating a training jobConfirm the dataset is Exported and that multiple selections share a format
The job stays queuedNo compute is available yet. Leave it queued; don't resubmit.
Loss isn't decreasingCheck whether the dataset contains many failed demonstrations that weren't excluded, and run an inference test on a checkpoint
The edge deployment button is disabledCheck which pre-deployment checks are missing and run nexcore-edge check on the node
Inference results are poorReview bad cases in Data Feedback, then collect more data or adjust curation, export a new version, and retrain

Next Steps ​

NexCore is evolving rapidly; the latest version prevails.NexCore Docs · Embodied AI Skill Learning Platform by Lumos Robotics