DORE SEGMENT

3. If xcode version 12 or above, Select "Target" - > "General" -> "Framework" Click plus (Add) icon and choose Frameworks "DoreCoreAI.xcframework" and "DoreSegment.xcframework". make sure to select "Embed & Sign" option

Step 2:

Initiate DoreSegment Manager

private var modelManager: SegmentManager?

 modelManager = SegmentManager()
        
 //load license
 let isValid:Bool = (modelManager?.init_data(licKey: "insert your license key here") ?? false)

Step 3:

Execute Segment Session with input image

//run and get result
let result:segmentOut  = segmentOut ( features: (self.modelManager?.run_model(onFrame: pixelBuffer))! )

//mask image Black - bacground, White - foreground
let ciImage:UIImage = getMaskBW(result.semanticPredictions)!

Get Transparent segment output image

//run model and get result
let result:segmentOut  = segmentOut ( features: (self.modelManager?.run_model(onFrame: pixelBuffer))! )
        
//mask image White - bacground, Black - foreground
let ciImage:UIImage = getMaskWB(result.semanticPredictions)!
        
        
//extract image
let rgbCIimage:CIImage = CIImage.init(cvPixelBuffer: pixelBuffer)
let rgbImage:UIImage = convertCItoUIimage(cmage: rgbCIimage)
let finalImage:UIImage = cutoutmaskImage(image: rgbImage, mask: ciImage)
        
        
DispatchQueue.main.async {
  self.maskoutView.image = finalImage
}

DoreSegmentLite (Lite Version SDK)

DoreSegmentLite is used for reducing app size, all support and library files will be downloaded at runtime (Internet connection required).

Total SDK size will be 1.2MB Max

How to use :

Step 1:

1. Add this line in your pod file

pod 'DoreSegmentLite'

2. Run pod install, and open project

pod install

3. If xcode version 12 or above, Select "Target" - > "General" -> "Framework". Click plus (Add) icon and choose Frameworks "DoreCoreAI.xcframework". make sure to select "Embed & Sign" option

Step 2:

Add "SegmentLiteDelegate" in your view controller

class ImageSegment: UIViewController, SegmentLiteDelegate {

Initiate SegmentLiteManager

private var modelManager: SegmentLiteManager!

modelManager = SegmentLiteManager()
modelManager?.delegate = self

//Load license / start initiating
self.modelManager?.init_data(licKey: "insert your license key here")

Library file will be download at runtime when you initiate "SegmentLiteManager", it will be download and placed in app internal storage, you can get download completion signal through DoreSegmentLiteDelegate callback, use some progress indicator until download completion. this download progress will be processed only on first time, it will load with app internal storage location from second time load.

    //===DoreSegmentLiteDelegate===
    func onSegmentLiteSuccess(_ info: String) {
        self.alertView.dismiss(animated: true, completion: nil)
        //DoreSegment Library files downloaded successfully...! Ready to run segment
        
    }
    
    func onSegmentLiteFailure(_ error: String) {
        self.alertView.dismiss(animated: true, completion: nil)
        //DoreSegment Library files downloading failed..!
        print(error)
    }
    
    func onSegmentLiteProgressUpdate(_ progress: String) {
        //DoreSegment Library files downloading...!
        print(progress)
        self.progressView!.progress = Float(progress)!
    }
    
    func onSegmentLiteDownloadSpeed(_ dps: String) {
        print(dps)
    }
    //==============================

Step 3:

Execute Segment Session with input image

//run and get result
let result:segmentOut  = segmentOut ( features: (self.modelManager?.run_model(onFrame: pixelBuffer))! )

//mask image Black - bacground, White - foreground
let ciImage:UIImage = getMaskBW(result.semanticPredictions)!

Android

Technical Specifications:

Android Studio	3.5 or Above
Min SDK Version	API Level 23
Android Version	Marshmallow 6.0 or Above

You can implement DoreSegment SDK in your existing/new Android project with in just 3 Steps

Step 1:

1. Add this lines in project -> build.gradle (under respositories section)

allprojects {
    repositories {
        google()
        jcenter()
        maven { url "https://raw.github.com/doreai/Framework/master" }
    }
}

2. Add this line in app -> build.gradle (under dependencies section)

Version number will be vary depends on latest release

dependencies {
    ....
     
    implementation 'com.dore:segment:1.0.4'

    
}

Don't forgot to Sync your project

Step 2:

Initiate DoreSegment Manager

Kotlin Code :

private val bEngine:SegmentManager = SegmentManager()

val lickeycode = "insert your license key here"
bEngine.init_data(this,lickeycode)

Java Code :

SegmentManager bEngine = new SegmentManager();

String lickeycode = "insert your license key here";
bEngine.init_data(this,lickeycode);

Step 3:

Execute Segment Session with input image

Kotlin Code :

//get input bitmap image
val dimage = DoreImage.fromBitmap(tex_view.bitmap)
//get result
var result = bEngine.run(dimage)

runOnUiThread {
  //get segment mask image
  outImg.setImageBitmap(result?.getMask(1f))  //alpha value 0.1 to 1
}

Java Code :

//get input bitmap image
DoreImage dimage = DoreImage.fromBitmap(tex_view.bitmap);

//get result
DoreVisionSegmentResult result = bEngine.run(dimage);

runOnUiThread(new Runnable() {
   @Override
   public void run() {
     outImg.setImageBitmap(result.getMask(1f));     //alpha 0.1 to 1
   }
});

Get Transparent segment output image

Kotlin Code :

runOnUiThread {
   bg_outImg.setImageBitmap(result?.transparentImage)
}

Java Code :

runOnUiThread(new Runnable() {
  @Override
  public void run() {
     outImg.setImageBitmap(result.getTransparentImage());
  }
});

DoreSegmentLite (Lite Version SDK)

DoreSegmentLite is used for reducing app size, all support and library files will be downloaded at runtime (Internet connection required).

Total SDK size will be less than 1MB

How to use :

1. Add this lines in project -> build.gradle (under respositories section)

allprojects {
    repositories {
        google()
        jcenter()
        maven { url "https://raw.github.com/doreai/Framework/master" }
    }
}

2. Add this line in app -> build.gradle (under dependencies section)

Version number will be vary depends on latest release

dependencies {
    ....
     
    implementation 'com.dore:segmentlite:1.0.3'

    
}

Don't forgot to Sync your project

Step 2:

Initiate DoreSegment Manager

Kotlin Code :

private val bEngine:SegmentLiteManager = SegmentLiteManager()

val lickeycode = "insert your license key here"
bEngine.init_data(this,lickeycode)

Java Code :

 SegmentLiteManager bEngine = new SegmentLiteManager();

 String lickeycode = "insert your license key here";
 bEngine.init_data(this,lickeycode);

Library file will be download at runtime when you initiate "SegmentLiteManager", it will be download and placed in app internal storage, you can get download completion signal through SegmentLiteListener callback, use some progress indicator until download completion. this download progress will be processed only on first time, it will load with app internal storage location from second time load.

Kotlin Code :

     bEngine.setSegmentLiteListener(object : SegmentLiteListener {

           override fun onSuccess(info: String) {
              //library files downloaded successfully...! ready to run 
               isLibLoaded  = true
            }

            override fun onFailure(error: String) {

            }

            override fun onProgressUpdate(progress: String) {
                Log.d("Download Library : ", progress)
            }


        })

Java Code :

bEngine.setSegmentLiteListener(new SegmentLiteListener() {
            @Override
            public void onSuccess(String s) {
                //library files downloaded successfully...! ready to run
                isLibLoaded = true;
            }

            @Override
            public void onFailure(String s) {

            }

            @Override
            public void onProgressUpdate(String s) {
                Log.d("Download Library : ", s);
            }
        });

Step 3:

Execute Segment Session with input image

Kotlin Code :

//get input bitmap image
val dimage = DoreImage.fromBitmap(tex_view.bitmap)
//get result
var result = bEngine.run(dimage)

runOnUiThread {
  //get segment mask image
  outImg.setImageBitmap(result?.getMask(1f))  //alpha value 0.1 to 1
}

Java Code :

//get input bitmap image
DoreImage dimage = DoreImage.fromBitmap(cur_pic);
//get result
DoreVisionSegmentResult result = bEngine.run(dimage);

runOnUiThread(new Runnable() {
   @Override
   public void run() {
    outImg.setImageBitmap(result.getMask(1f));     //alpha 0.1 to 1
  }
});

Additional Note: Supported ABIs : armeabi-v7a and arm64-v8a, which should cover most modern Android devices.

Assistance

DoreSegment

IOS

DoreSegmentLite (Lite Version SDK)

Android

DoreSegmentLite (Lite Version SDK)

Company

License

Product

Help