DeepQ AI Platform
DeepQ AI Platform
  • 👋Welcome to DeepQ AI Platform!
  • Overview
    • 💡What is DeepQ AI Platform?
    • ✨Our Features
    • 🎁Whats new?
  • Product Guides
    • 👁️‍🗨️Navigation
      • 🧱Modules
      • 👩‍🏫User Profile
    • 📐DeepCap (Image Annotation Module)
      • 🖼️Dataset(s)
      • 📝Annotation Projects
      • 🖌️Annotation Jobs
    • 🖥️AI Training
      • 🖼️Dataset(s)
      • ⚙️Training Tasks
      • 🧠Models
  • Use Cases
    • 🧑‍🤝‍🧑Roles & Plans
    • ⬆️Upload & Manage Image Data
      • Data Formats
      • Combine Datasets
    • 👨‍🏫Create & Run Annotation Project
      • Create Annotation Project
        • Annotation Quality Control
      • Manage/View Annotation Project
      • Advanced Tips
    • 🧑‍⚕️Annotate/Review Images
      • Basic Annotation
      • Advanced Annotation Tips
    • 👨‍🔬Train/Test AI Model
      • Create Training Task
        • General Training
        • Specialized Training
        • Existing Model Retraining
      • Manage/View Training Task
        • Training Insight Reports
      • View/Test Models
        • Inference Insight Reports
      • Advanced Tips
  • Tutorial Videos
    • 🛠️Basic operations
    • 🔩Advanced Operations
  • Misc
    • ⁉️Troubleshooting & FAQs
    • 📔Changelogs
      • V3.0
      • V3.0.2.1
    • 📖Legal Documents
Powered by GitBook
On this page
  • Create Inference Job
  • Real-time inference
  • Batch inference
  • View Inference Detail
  1. Use Cases
  2. Train/Test AI Model

View/Test Models

Test the performance of your trained model with Inference Jobs

PreviousTraining Insight ReportsNextInference Insight Reports

Last updated 1 month ago

Create Inference Job

In the model detail view, you can create "Inference Jobs" to test the model

  • You have to deploy the model before creating any inference task.

  • There are two modes of model inference: batch & real-time.

Real-time inference

Select and open one JPG/ PNG image from your local device, the inference result will be shown automatically with the AI image viewer.

The AI viewer contains the following information of each image:

Type
Image classification
Object detection
Object Segmentation

prediction results

label name & confidence score

label name & bounding boxes in dotted lines

label name & objects with white stripes

Explainability

NA

NA

Ground truth (if available)

ground truth labels

Bounding boxes in bold lines

Objects painted in solid colors

Batch inference

  • Batch inference: Select one of the dataset that you have uploaded from the drop list, enter the inference name and complete the creation process.

    • Prediction only: For datasets without annotation data, inference result will only provide prediction results without an inference report.

View Inference Detail

Annotation Data (with ground truth/label)

  • The inference detail, including training task, dataset, and annotation data will be shown here.

  • Inference List: You can view the inference detail about the dataset, accuracy, and status.

  • Inference Dataset shows all the cases that have been trained in this task.

Inference Detail for different types:

Type
Image Classification
Object Detection
Object Segmentation

Performance metrics

>Accuracy >ROC/PR Curve >Confusion Matrix >Evaluation Summary

>mAP >FROC/PR Curve >Evaluation Summary

>DICE scores >Evaluation Summary

Dataset Statistics

>Label Distribution

>Box Label >Box-per-Image >Box Ratio >Box Area >Label Distribution (Image-wise)

>Label Distribution >Mask-Coverage Distribution

Prediction only

  • if the batch inference dataset does not contain ground truth (annotation file not selected), there will be no performance metrics & Dataset statistics

  • Each image of the selected dataset will be shown in the last column, you can check the result by clicking on the image.

heat map of each label (can be toggled on of by )

👨‍🔬
Image Classification: prediction & ground truth
Image classification: heat map on
Object detection: prediction & ground truth
Object Segmentation: prediction & ground truth
Inference Detail: Image Classification
Inference Detail: Object Detection
Inference Detail: Object Segmentation