Capture the objects using Object Detection and Tracking feature by Huawei ML Kit in Android (Kotlin)

Introduction

In this article, we can learn about object detection and tracking of Huawei ML Kit. A user can take a photo of an object through camera or gallery. Then Object Detection and Tracking service searches for the same or similar objects in the pre-established object image library and returns the IDs of those object and related information. It is very useful in order to detect multiple objects in an image which can be located and classified in real time. Currently, detects maximum of eight different types of object categories such as Household products, fashion goods, food, places, plants, faces and others.

Requirements

1. Any operating system (MacOS, Linux and Windows).

2. Must have a Huawei phone with HMS 4.0.0.300 or later.

3. Must have a laptop or desktop with Android Studio, Jdk 1.8, SDK platform 26 and Gradle 4.6 installed.

4. Minimum API Level 19 is required.

5. Required EMUI 9.0.0 and later version devices.

How to integrate HMS Dependencies

1. First register as Huawei developer and complete identity verification in Huawei developers website, refer to register a Huawei ID.

2. Create a project in android studio, refer Creating an Android Studio Project.

3. Generate a SHA-256 certificate fingerprint.

4. To generate SHA-256 certificate fingerprint. On right-upper corner of android project click Gradle, choose Project Name > Tasks > android, and then click signingReport, as follows.

Note: Project Name depends on the user created name.

5. Create an App in AppGallery Connect.

6. Download the agconnect-services.json file from App information, copy and paste in android Project under app directory, as follows.

7. Enter SHA-256 certificate fingerprint and click tick icon, as follows.

Note: Above steps from Step 1 to 7 is common for all Huawei Kits.

8. Click Manage APIs tab and enable ML Kit.

9. Add the below maven URL in build.gradle(Project) file under the repositories of buildscript, dependencies and allprojects, refer Add Configuration.

10. Add the below plugin and dependencies in build.gradle(Module) file.

11. Now Sync the gradle.

12. Add the required permission to the AndroidManifest.xml file.

Let us move to development

I have created a project on Android studio with empty activity let us start coding.

In the MainActivity.kt we can find the business logic.

Create MLObjectGraphic class to find objects list logic.

Create LensEnginePreview class to find lens view logic.

Create GraphicOverlay class to find graphics size view logic.

In the activity_main.xml we can create the UI screen.

Demo

Tips and Tricks

1. Make sure you are already registered as Huawei developer.

2. Set minSDK version to 19 or later, otherwise you will get AndriodManifest merge issue.

3. Make sure you have added the agconnect-services.json file to app folder.

4. Make sure you have added SHA-256 fingerprint without fail.

5. Make sure all the dependencies are added properly.

Conclusion

In this article, we have learnt about object detection and tracking of Huawei ML Kit. A user can take a photo of an object through camera or gallery. Then it detects image library and returns the IDs of those object and related information. It is very useful in order to detect multiple objects in an image which can be located and classified in real time.

I hope you have read this article. If you found it is helpful, please provide likes and comments.

Reference

ML Kit — Object Detection and Tracking