Instant Tracker

Related documentations
Tracker Coordinate System

The Instant Tracker instantly scans the planar surface in the camera frame and recognizes the space with sensors. You can find the rendered 3D object on the space.

Create Instants
Start / Stop Tracker
Use Tracking Information
Create Instant Target Data

Create Instants

>InstantTrackerViewController.swift

var cameraDevice:MasCameraDevice = MasCameraDevice()
var sensorDevice:MasSensorDevice = MasSensorDevice()
var trackingManager:MasTrackerManager = MasTrackerManager()

Start / Stop Tracker

To start / stop Tracker, refer to the following code.

>InstantTrackerViewController.swift

@objc func pauseAR()
{
    ...
    trackingManager.start(.TRACKER_TYPE_INSTANT)
}

@objc func resumeAR()
{
    trackingManager.stopTracker()
    ...
}

Use Tracking Information

To augment an object using Tracking results, refer to the following code.

You must be used Convert Matrix for Metal.('metalMatrixConverter')

>InstantTrackerViewController.swift

func draw(in view: MTKView) {
    ...
    
    let trackingState:MasTrackingState = trackingManager.updateTrackingState()
    let result:MasTrackingResult = trackingState.getTrackingResult()
    
    let backgroundImage:MasTrackedImage = trackingState.getImage()
    var backgroundProjectionMatrix:matrix_float4x4 = cameraDevice.getBackgroundPlaneProjectionMatrix()
    let metalMatrixConverter:matrix_float4x4 = getScaleMatrix(1.0, y: -1.0, z: 1.0)
    backgroundProjectionMatrix = backgroundProjectionMatrix * metalMatrixConverter
    
    let projectionMatrix:matrix_float4x4 = cameraDevice.getProjectionMatrix()
    
    if let cameraQuad = backgroundCameraQuad {
        cameraQuad.setProjectionMatrix(projectionMatrix: backgroundProjectionMatrix)
        cameraQuad.draw(commandEncoder: commandEncoder, image: backgroundImage)
    }
    
    let trackingCount:Int32 = result.getCount()
    
    for i in stride(from: 0, to: trackingCount, by: 1) {
        let trackable:MasTrackable = result.getTrackable(i)
        let poseMatrix:matrix_float4x4 = trackable.getPose() * metalMatrixConverter
        
        textureCube.setProjectionMatrix(projectionMatrix: projectionMatrix)
        textureCube.setPoseMatrix(poseMatrix: poseMatrix)
        textureCube.setTranslation(x: panTranslateX, y: panTranslateY, z: -0.15)
        textureCube.setScale(x: 0.3 + pinchScale, y: 0.3 + pinchScale, z: 0.3)
        textureCube.draw(commandEncoder: commandEncoder)
    }
    ...
}

Create Instant Target Data

You can create new data only when it is not in Tracking state. Refer to the following code.

>InstantTrackerViewController.swift

@IBAction func doTrackingState(_ sender: Any) {
    let button:UIButton = sender as! UIButton
    
    if button.titleLabel?.text == "Start Tracking" {
        beforeTranslateX = 0.0
        beforeTranslateY = 0.0
        panTranslateX = 0.0
        panTranslateY = 0.0
        pinchScale = 0.0
        rotateValue = 0.0
        
        trackingManager.findSurface()
        button.setTitle("Stop Tracking", for: .normal)
    } else if button.titleLabel?.text == "Stop Tracking" {
        trackingManager.quitFindingSurface()
        button.setTitle("Start Tracking", for: .normal)
    }
}